You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

How to create and use a national cross-domain ontology and data infrastructure on the Semantic Web

Abstract

This paper presents a model and lessons learned for creating a cross-domain national ontology and Linked (Open) Data (LOD) infrastructure. The idea is to extend the global, domain agnostic “layer cake model” underlying the Semantic Web with domain specific and local features needed in applications. To test and demonstrate the infrastructure, a series of LOD services and portals in use have been created in 2002–2023 that cover a wide range of application domains. They have attracted millions of users in total suggesting feasibility of the proposed model. This line of research and development is unique due to its systematic national level nature and long time span of over twenty years.

1.Extending the layer cake model

The Semantic Web (SW) sees the Web as an interlinked collection of data (Web of Data) instead of only a space of interlinked hypertext documents, Web of Pages. The idea was proposed in the 90’s by Tim Berners-Lee [4], and first recommendations for the SW,11 such as the Resource Description Framework22 (RDF), were developed before the millenium. The recommendations constitute the W3C “layer cake model” [9,13] on top of XML, the lingua franca of the WWW, and lay out a new basis of shared semantics for interoperability of data. Founded on using first order predicate logic, the semantics of the SW [19] are independent of application domains and natural languages. This makes the model suitable for dealing with the versatile multi-domain and multilingual data underlying the Web.

To develop applications, the layer cake model is not enough: domain and application specific infrastructures based on shared W3C standards and best practices are needed, too. These can focus on specific domains, such as medicine, biology, cultural heritage, or geography on an international level. However, in practice one also has to deal with national level issues and data available that are represented using national languages, data models, vocabularies, and are created using conventions of local legacy systems. It therefore makes sense to speak about a “national Semantic Web infrastructure” that is compatible with the global SW standards. For example, Cultural Heritage (CH) data in different countries is often nationally specific calling for adapted local solutions for representing and using the data.

Most of the international infrastructure work [5] is focused on collaborations on particular application domains. In contrast, this paper concerns the question: How to Create a National Cross-domain Ontology and Linked Data Infrastructure and Use It on the Semantic Web. This problem is addressed by presenting, discussing, and evaluating approaches and living laboratory experiments developed in Finland during 2002–2023. Presenting lessons learned in this particular endeavour is hopefully useful in a more general setting, as similar challenges are likely to be faced in other countries, too.

The paper is organized as follows: In Section 2, elements needed for a national SW infrastructure are first introduced. The idea and lessons learned in developing a national ontology and a LOD infrastructure are then presented in Sections 3 and 4, respectively. After this, applications of the infrastructures are discussed: as a proof-of-concept, a model is presented that has been used for creating a series of in-use data services and semantic portals that have had up to millions of users (Section 5). Finally, contributions of the work are summarized and related works discussed (Section 6). This paper presents the first consolidated account of this line of research and development, summarizing works reported before in over 500 papers and other publications available on the Web.33

Fig. 1.

Elements needed for a national Semantic Web infrastructure.

Elements needed for a national Semantic Web infrastructure.

2.Elements of a Semantic Web infrastructure

Figure 1 depicts components that are arguable needed in the developing a national SW infrastructure – according to the experiences to be reported in this paper. The system is based on the domain agnostic W3C Web Standards and Best Practices (on the left below in the figure) of publishing Linked Data44 [16]. Meta(data) Models for metadata [94] are needed for representing knowledge of different application domains, populated by resources taken from shared Domain Ontologies and Ontology Services for interoperability. In this paper, the term domain ontology refers to typically hierarchical, thesaurus-like knowledge organization systems whose concepts are used to populate property values of (meta)data models. The ontologies should be made openly available and easy to access for interoperability and re-use, based on shared ontology services/libraries; cf. [6,66] for a survey of such systems. In the same vein, data services for publishing LD datasets, preferably using, e.g., open Creative Commons licenses, are needed for making re-use of data possible and easy. Also Applications of Linked Data are part of the infrastructure connecting the system to its end users. For making all this possible, Software Tools are needed for aggregating the distributed heterogeneous data from legacy and other data silos involved, and for extracting and linking (disambiguating) entities and relations from data records and textual descriptions [64]. Also tools for data publishing and analysis are needed, as well as tooling for developing new applications for the end users. Here using the FAIR principles55 for creating Findable, Accessible, Interoperable, and Re-usable data are recommended. The FAIR principles are compatible with the linked data principles66 and best practices77 of the W3C.

For developing, maintaining, and using the infrastructure in a sustainable way a Human Infrastructure is needed (on the left in Fig. 1), too. This involves, e.g., educating people about the technology, introducing SW courses in university curricula, and production of documentations and learning materials for the community using national languages. In the Finnish case, for example, online materials have been created,88 a Finnish text book about the SW was produced [22], over 40 public seminars and other events have been organized in Finland and beyond,99 and hackathons1010 were organized on using the data and tools. The work reported in this paper has also been a core part of the activities of the Helsinki Centre for Digital Humanities HELDIG,1111 established in 2016 with a particular focus on Digital Humanities research [23,26].

3.Domain ontology infrastructure

In the early 2000’s, the focus in SW research was on ontologies [76], arguably the “silver bullet” of the SW [10]. Accordingly, a series of projects called “FinnONTO” in 2003–2012 were conducted1212 in Finland.

A National Effort The goal in the FinnONTO initiative [45] was to develop a national ontology and content infrastructure, based on W3C standards, that would be cross-domain,1313 multilingual (Finnish, Swedish, and English), and openly available. The consortium behind the initiative included finally some 50 companies and public organizations that represented a wide spectrum of functions of the society, including libraries, health organizations, cultural institutions, government, industry, media, and education. By integrating the interests of several functions of the society it was possible to acquire substantial and long-standing funding for the infrastructure and application development work.

The initiative produced 1) metadata models contributing to national standards,1414 2) domain ontologies [45,85] to be used for populating the metadata models, 3) a living laboratory called ONKI of public ontology services [85,91], and 4) tools for metadata creation and application development, such as Skosify [77] for SKOS vocabulary quality assessment and the SAHA editor [52,59] for editing RDF repositories. The infrastructure was tested by using it in case studies in different application domains, including e-culture [36,61], e-health [44,78], e-government [74], e-learning [48], and e-commerce [54].

A central goal of FinnONTO was to create an interlinked cloud of national ontologies [11] based on existing thesauri that were already used in different areas of the society. The rationale for this was that metadata available in national databases had already been catalogued using these thesauri, which would make it much easier to develop applications. According to the FinnONTO vision, the ontologies should be served not only through human readable browser interfaces,1515 but also as centrally managed national ontology services using REST APIs. In this way, common functionalities of the services, such as (semantic) autocompletion [35], URI fetching, and query expansion [86], could be shared on a national level, and everybody would get access to up-to-date versions of the ontologies. This kind of collaboration would be cost-efficient on a national level and gradually lead to better interoperability of the data catalogued in different organizations. Availability of the centralized services is needed especially for smaller organizations that do not have much expertise and resources for developing their own web services.

Table 1

Linked domain ontologies of the original KOKO ontology cloud. Contemporary versions of these RDFS ontologies are available transformed automatically into SKOS format at the national ontology service https://finto.fi

OntologyApplication domain# of concepts
YSOGeneral upper ontology27 200
AFOAgriculture and forestry7000
JUHOGovernment6300
KAUNOLiterature5000
KITOLiterary research850
KTOLinguistics900
KULOCultural research1500
LIITOEconomics3000
MAOMuseum artifacts6800
MEROSeafaring1300
MUSOMusic1000
PUHOMilitary2000
TAODesign3000
TEROHealth6500
TSRWorking and employment5100
VALOPhotography2000

From Thesauri to Ontologies The FinnONTO project transformed 16 key national thesauri used in Finland into light-weight ontologies listed in Table 1. The transformation process was more ambitious than just transforming the traditional standard thesaurus format [2] into an RDF-based model, such as SKOS.1616 The thesauri were developed semantically a bit forward, using the OntoClean methodology [14] and RDFS,1717 in the following ways [45]: 1) Multiple meanings of thesauri terms were disambiguated and relocated in rdfs:subClassOf hierarchies. For example, the concept of child, a unique concept in the underlying General Finnish Thesaurus YSA, can refer to the class of young people, to a family relation type, or a social class (superconcept of street child). These concepts should obviously be in located different places in an RDFS domain ontology, i.e., a hierarchical ontology constructed using the RDFS semantics. The concept was therefore split into several concepts in the corresponding General Finnish Ontology YSO [73]. 2) The thesauri that were transformed did not differentiate whether the standard Broader Term (BT) relation [2] means the part-of or hypernymy relation. This distinction was crafted manually in the ontologies. 3) The rdfs:subClassOf hierarchies were completed: all concepts were given at least one superclass except the root. 3) Inheritance of being an instance over subclass hierarchies was checked as specified by the RDFS semantics, so that the hierarchies could be used for reasoning, e.g., in query expansion and when using faceted search in applications, such as the Sampo portals [27].

Linked Ontology Cloud KOKO The domain ontologies in Table 1 contain similar and related concepts [11]. Especially, the largest ontology YSO (27200 concepts) – transformed from the most used thesaurus YSA of the National Library in Finland – shared lots of concepts with all other ontologies, in some cases more than 50%. This suggested that the ontologies should be linked together using YSO as the top ontology. This idea resulted in creating the Finnish linked ontology cloud called KOKO1818 where the top ontology concepts of YSO are refined by subconcepts of interlinked domain specific ontologies [11,45].

While transforming the top ontology YSO from a thesaurus into an ontology its concept labels were also translated into English and the existing partial Swedish translation was completed. This makes it possible to align the ontology with related international domain ontologies. In some other KOKO ontologies translations were already available.

Lessons Learned A key problem to be solved in FinnONTO was that large cross-domain thesauri, especially the General Finnish Thesaurus YSA, could not anymore be maintained easily by its management team. Even if the team included people from different fields, the terminology related to specific areas needed deeper domain specific expertise than was available. Developing the interlinked KOKO ontology cloud mitigates the problem by distributing work on specific concepts to collaborative, domain specific ontology developer teams. However, in this model new problems arise pertaining to maintaining the linked ontology cloud and to coordinating the collaboration network [11]. These new challenges are now being tackled by the Finto collaboration network1919 coordinated by the National Library. The FinnONTO initiative pointed out that lots of redundant work had been done in developing the thesauri in Finland as they shared lots similar concepts with each other. In the new, more coordinated KOKO model, redundant work can be better eliminated. To support the ontology alignment work, tools such as MUTU [69] were developed.

A challenge encountered in the ontologization process was that organizing the concepts into class hierarchies cannot in many cases represent correctly the meaning of the original terms that can be complex and fuzzy. The world cannot be represented fully using ontologies and there can be several ways in which this can be done. In spite of such challenges, the idea of adding more semantics needed for application development seems to be a better option than continuing using the original thesauri, whose semantics were too vague from a sofware development point of view in applications, such the semantic portals to be discussed in this paper. A strategic choice made in FinnONTO was to follow the wisdom articulated by Jim Hendler already in the late 90’s in the SHOE project:2020 A little semantics goes a long way. In our case, the traditional thesauri semantics [2] were refined only a little using RDFS (as explained above, using and completing, e.g., class hierarchies) for interoperability and to help development of web applications. However, already this was a handful of work, as thousands of terms in the thesauri had to be manually checked and refined [73].

A mundane challenge of developing large domain ontologies, at least in Finland, is how to convince the funding organizations, year after year, that this never-ending work should be supported on a regular basis, not only as separate short-time projects. This is possible if the benefits of using ontologies in practical applications can be demonstrated. In our case, it took some ten years of project-based work before the KOKO ontology infrastructure and the current Finto.fi services could be funded in a more sustainable way by two Finnish ministries. The strategy taken in FinnONTO was to move forward in baby steps, and after each step show a demonstrator on how the ontologies can be applied in practise for creating something useful.

The idea of creating a “living laboratory” of ONKI ontology services [85,91] on the Web turned out to be important for deploying the infrastructure. The participating FinnONTO organizations were supported by the project in connecting their legacy systems to the APIs of ONKI for testing and evaluating the services. Finally, the “point of no return” was reached where pulling off the plug of the services was not an option anymore as the number of ONKI API users were counted already in hundreds.

The FinnONTO project series 2003–2012 started with a smallish one-year project, but eventually grew into a national effort of substantial size on the Finnish scale with dozens of funding organizations involved. A reason for this was that in addition to public organizations, such as museums, libraries, and archives, also companies got interested in the technology, which convinced the main funding organization Tekes (called today Business Finland) that something useful and of monetary value is happening related to semantic web technologies. It is usually easier to get funding for technology development than for research in humanities.

The KOKO ontologies are based on keyword thesauri whose terms usually correspond to the classes. FinnONTO worked also on various “instance-based” ontologies, such as national geogazetteers, person and organization registries, biological taxonomies of species [87,88], and nomenclatures and terminologies of medicine [78], such as Medical Subject Headings MESH.2121 Creating a national ontology and data infrastructure is a never-ending job and research goes on today, e.g., in the Linked Open Data Infrastructure for Digital Humanities initiative2222 [24] that is part of the national FIN-CLARIAH research infrastructure for Digital Humanities.2323 Here the idea is to combine – on a national level as in the CLARIAH initiative in the Netherlands – the work related to the pan-European infrastructure CLARIN,2424 the research infrastructure for language as social and cultural data, and DARIAH,2525 the infrastructure for arts & humanities scholars.

When developing ontology-based applications in FinnONTO, much of the time of the developers was “waisted” in cleaning and aligning the data from different organizations for interoperability. Obviously, it would be more cost-efficient do this work already when cataloging the data using ontology services. This would also enhance the quality of the linked data, which is a critical problem [93] on the SW. The local cataloguers know best their own data and should have the best interest in quality of their data. The motto for the FinnONTO work was therefore taken from a wisdom of Albert Einstein: Intellectuals solve problems – geniuses prevent them; a key goal of FinnONTO was to prevent interoperability problems rather than to solve them afterwards when the damage has already been done in cataloguing [21].

A major outcome of FinnONTO was the ONKI ontology server with its ontologies [91] that were published first in 2008. As a next step, the ONKI Light service2626 [79] was developed and deployed in 2014 [80] by the National Library of Finland as the national Finto.fi service.2727 ONKI Light finally evolved into the open source Skosmos tool2828 [81] in use in several other organizations in Finland and internationally.2929 ONKI Light was based on a SPARQL endpoint. The idea was to separate the data service fully from the user interface, and use only SPARQL to access the data. This idea turned later useful when developing the Sampo model [27] and Sampo-UI tool [46,70] for semantic portals to be discussed later in this article.

The Finto.fi service has grown into a popular national open service. In 2019 it was used by 280000 different users and its APIs were called 32 million times. The users include, e.g., museums, whose cataloging system get their keywords with URI identifiers from Finto. These developments suggest that the fundamental ideas of FinnONTO are feasible; they have actually made a paradigm change in Finland in developing and using linked light-weight ontologies on a national level instead of thesauri.

4.From 5-star to 7-star Linked Data deployment scheme

The SW infrastructure model of Fig. 1 includes a platform for publishing datasets and (re-)using them via web services. A key component in LD publishing is the SPRAQL endpoint, but the platform should also support other functions [16]. The Linked Data Finland service LDF.fi3030 [43] was therefore developed in the “Linked Data Finland” follow-up projects3131 of FinnONTO.

LDF.fi has two user-groups: 1) For application developers, LDF.fi provides SPARQL endpoints and a suite of standard Linked Data (LD) services, including content negotiation, APIs for downloading datasets, LD browsing and editing, and additional tools for, e.g., data documentation and visualization. 2) For data publishers, the idea is to support and automate the data publishing process in the following way: The publisher creates a service description of the dataset and its schemas, using an extended version of the W3C Service Description recommendation.3232 Based on such metadata, LDF.fi then 1) automatically sets up the technical services, 2) generates a dataset “homepage” that explains the dataset, schemas, and 3) provides additional related services for querying, documenting, inspecting, and validating the data. LDF.fi is used primarily for reading RDF data by SPAQRQL queries, not for writing, although also this could be done using the SPARQL endpoint. The general Linked Data Platform recommendation3333 that was under development at the same time has not been used in LDF.fi.

Linked data publications on the SW are typically evaluated with the W3C “5-star” deployment scheme,3434 using a quality scale analogous to evaluating hotels. In LDF.fi, the 5-star model is extended to a 7-star model: there are nowadays also a few 7-star hotels around.3535 The 6th star is given to a data publication if it includes not only the 5-star data but also the schemas of the data with documentation. This makes re-use of data easier. The 7th star is given to a data publication, if the publication includes some kind of evaluation that the data actually conforms to the provided schemas using, e.g., SHACL3636 or ShEx3737 [53]. The idea here is to encourage publishers to publish high quality data as data quality of LD is a severe issue on the SW.

Schemas can be documented automatically in LDF.fi for the human reader using a schema documentation generator, in our case using SpecGen3838 and LODE.3939 Datasets in the LD world often use schemas (vocabularies) for which definitions or descriptions are not available, but are embedded in the data itself. In order to find out how schemas are actually used in a dataset, including both published and unpublished schemas, a service vocab.at4040 was created that analyzes a given dataset from this perspective and creates an HTML document that lists, e.g., statistics of vocabulary usage and raises up issues detected if an IRI is not dereferenceable. The input for vocab.at is either an RDF file, a SPARQL endpoint, or an HTML page with embedded RDFa markup.

LDF.fi is implemented by a combination of the Fuseki SPARQL server4141 for storing the primary data and a Varnish Cache web application accelerator4242 for routing URIs, content negotiation, and caching. For deployment of applications with a data service (cf., e.g., the MMM system [31]) a microservice architecture with Docker containers4343 is used. Each individual component (the application, Varnish, and Fuseki) is run in its own dedicated container, making the deployment of the services easy due to installation of software dependencies in isolated environments. This enhances the portability of the services. The server environment of LDF.fi is provided by the CSC – IT Center for Science, a company of the Ministry of Education and Culture of Finland providing computational infrastructures for the national universities in Finland.

Lessons learned The Linked Data Finland platform has turned out to be useful for data-analytic research purposes and in developing applications (cf. Section 5). LDf.fi has been used for publishing some 100 linked datasets. Many of them are in use in semantic portal applications and via SPARQL querying combined with query editing and scripting tools using the open CC BY 4.0 license. Some datasets are used only internally in related research projects, and for some datasets licensing policy of the data owners prohibits open use. LDF.fi hosts several instance-based ontologies, too, such as an RDF-based version of the ca. 800000 official Finnish geographical places based on data of the National Survey.

The LDF.fi service is still maintained by the Aalto University and University of Helsinki that developed it on an academic project basis, but with the hope that some day it will be deployed and be maintained in a more sustainable way – this is at least what happened to the related ONKI/Finto ontology services. A step towards this is that in 2020 the idea of providing Linked Open Data services on a national level using LDF.fi was accepted on the new research infrastructure roadmap of the Academy of Finland as part of the larger FIN-CLARIAH infrastructure.

5.Sampo model: Applying the Semantic Web infrastructure

Table 2

Sampo model principles P1–P6

P1Support collaborative data creation and publishing
P2Use a shared open ontology infrastructure
P3Make clear distinction between the LOD service and the user interface (UI)
P4Provide multiple perspectives to the same data
P5Standardize portal usage by a simple filter-analyze two-step cycle
P6Support data analysis and knowledge discovery in addition to data exploration

When developing the Finnish SW infrastructure, applications that test and demonstrate its usability were constantly developed. This work evolved gradually into a set of principles for developing LOD services and semantic portals on top of them, called the Sampo Model, and the Sampo Series of LOD services and semantic portals [27]. The novelty of the Sampo model4444 lays in its attempt to formulate a set of re-usable design principles or guidelines for creating LOD services and semantic portals, especially for Cultural Heritage applications and Digital Humanities research [12]. Based on six principles, the model is a kind of consolidated approach for creating LOD services and semantic portals, something that the field of the Semantic Web is arguably still largely missing [18].

The Sampo Model is an informal collection of principles for LOD publishing and designing semantic portals listed in Table 2. Principles P1–P3 can be seen as a foundation for developing data services; P4–P6 are related to creating semantic portals. The model is based on the idea of collaborative content creation (P1). The data is aggregated from local data silos into a global service, based on a shared ontology and publishing infrastructure (P2). The local data are harmonized and enriched with each other by linking and reasoning. In this model everybody can arguably win, including the data publishers by enriched data and shared publishing infra, and the end users by richer global content and services. The model argues for the idea of separating the underlying Linked Data service completely from the user interface via a SPARQL API (P3). This arguable simplifies the portal architecture and the data service can be opened for data analysis research. For example, YASGUI4545 [71] interface for SPARQL querying and visualizing the results can be used, or Python scripting in Google Colab4646 and Jupyter notebooks4747 [83].

The general idea of principles P4–P6 is to “standardize” the UI logic so that the portals are easier to use for the end users and for the programmers to develop, as demonstrated in the Sampo-UI framework tool [46,70]. Principle P4 articulates the idea of providing different thematic application perspectives by re-using the data service. The application perspectives can be provided on the landing page of the Sampo portal system or be completely separate applications by third parties. According to P5 the application perspectives can be used by a two-step cycle for research: First the focus of interest, the target group, is filtered out using faceted semantic search [39,84,90]. Second, the target group is visualized or analyzed by using ready-to-use data analytic tools of the application perspectives. Finally, the Sampo model aims not only at data publishing with search and data exploration [63] but also to data analysis and knowledge discovery with seamlessly integrated tooling for finding, analysing, and even solving research problems in interactive ways (P6) [25].

The Sampo model principles are compatible with the FAIR principles for creating Findable, Accessible, Interoperable, and Re-usable data,4848 but were developed in the context of publishing and using LOD. The principles P1–P6 can be used directly for creating semantic portals. However, its is also possible to apply them first to create an application domain specific framework and reuse it for developing different related application instances, which is arguably cost-efficient. This idea of re-using domain-specific “Sampo frameworks” has been demonstrated in the LetterSampo system for publishing epistolary data [34] and in FindSampo for archaeological data [38].

The Sampo model has evolved gradually in 2002–2023 via lessons learned in developing a series of semantic portals and LOD services, starting from MuseumFinland – Finnish Museums on the Semantic Web4949 (online since 2004) [37], CultureSampo – Finnish Culture on the Semantic Web 2.05050 (online since 2009) [36,61], and BookSampo5151 (online since 2011 with some 1.6 million annual users today) [58]. They demonstrated how CH content of dozens of different kinds, both tangible and intangible CH content, can enrich each other. WarSampo – Finnish World War II on the Semantic Web5252 (online since 2015 with several new perspectives published in 2016–2019) [30], an example of applying LOD to publishing and studying Military History [28], is a popular Finnish service that has had thus far some 1.2 million users. A key idea in WarSampo is to reassemble the life stories of the World War II soldiers based on data linking from different data sources. This biographical and prosopographical idea was a source of inspiration for several later biographical applications [29], including BiographySampo – Biographies on the Semantic Web5353 (online since 2018) [33], Norssit Alumni [32], U.S. Congress Prosopographer [65], and AcademySampo5454 (online since 2021) [56]. NameSampo [47] publishes data about over 2 million place names and places in Finland with old maps. The NameSampo project developed, based on the SPARQL Faceter tool [50] used in many earlier Sampos, the first version of the Sampo-UI framework [46] that has been used after this in all Sampos. It supports implementation of principles P4–P6 from an UI point of view. Sampo-UI has been re-used, e.g., in the portal Mapping Manuscript Migrations (MMM)5555 (online since 2020) [31,49] based on metadata about some 220000 pre-modern manuscripts from the University of Oxford (U.K.), Schoenberg Institute (U.S.), and IRHT (France), in FindSampo5656 [38] (online since 2021) for supporting archaeology from a citizen science and metal detectorists’ perspectives. LetterSampo5757 [89] is based on early modern epistolary metadata aggregated in the Early Modern Letters Online (EMLO) service5858 at the Oxford University, the CKCC corpus underlying ePistolarium5959 of the Huygens Institute in the Netherlands, and correspSearch6060 service of the Berlin-Brandenburg Academy of Sciences. During the spring of 2023 two new Sampos of particular societal impact were released: LawSampo6161 [42] publishes Finnish legislation and case law based on data from the Ministry of Justice in Finland. ParliamentSampo6262 [40,41] publishes LOD of the Parliament of Finland (1907–2023). Its LOD service includes knowledge graphs about nearly one million Parliamentary debate speeches [75] as well as data about the organizational structures and events of the Parliament, politicians, and their networks [57] in 1907–2023. In OperaSampo6363 (online since 2023) [1] data about thousands of historical music theater and opera performances in Finland (1830–1960) are published.

Developing these systems in use in a university research group6464 would not have been possible without re-using the elements of the national infrastructure (Fig. 1) and developing them further step-by-step in a systematic way. The Sampo-UI framework has turned out to be very effective tool in developing the portal user interfaces, and it has been used also by some external developers. In some cases, a first test demonstration of a new Sampo has been developed in a few weeks, but this depends on the case and quality of the data available. In cases like ParliamentSampo several years of development was needed for a finished in-use version on the Web. Natural language processing (NLP) techniques have been another important category of tools in later Sampos, such as LawSampo and ParliamentSampo, where lots of data have been available only in unstructured textual form. During our work, external NLP tools were re-used and new ones developed for named entity recognition (NER) and linking (NEL), for automatic annotation of keywords, and for topical classification of texts [55,82]. For LawSampo also a pseudonymization tool called Anoppi was created [67] as personal information in court decisions cannot be disclosed on the Web.

Data about all over 20 Sampo portals, including links, videos, publications, and further information are available on the Sampo portals homepage.6565

6.Discussion

This paper addressed challenges of extending the SW layer cake model for creating ontology and LOD infrastructures on national and domain specific levels. Lessons learned in developing Finnish ontology and LOD services 2002–2023 for practical applications were discussed. This work has utilized methods of design science [17,62,68] and action research [8], where the idea is to design artifacts, evaluate their value and utility, and to provide improvements in solutions. Rather than creating theoretical knowledge, design science applies knowledge. In this paper, infrastructure elements were designed, implemented, and applied to create the Sampo series of data services and portals as proof-of-concepts. They have had up to millions of end users, which suggests feasibility of the national infrastructures presented. The line of R&D presented is unique in its focus on different domains on a national level, longevity, and series of applications in use on the Semantic Web. Our general strategy has been to develop useful proof-of-concept prototypes and to publish them openly on the Web for everyone to use. The data owners and stake holders, such as memory organizations, saw this as an opportunity to develop their own systems, started to use the services and applications, and in many cases the point of no return has been reached.

In contrast to current related ontology library systems [7,66] that typically focus on particular application domains, ONKI and Finto aimed at being a cross-domain ontology service on a national level. For example, the BioPortal [72] of Stanford University is focused on publishing biomedical ontologies. There are lots of LOD services and SPARQL endpoints around.6666 The novelty of the LDF.fi service lays on its 7-star model and the idea of integrating the data service with various online tools as well as learning materials to support data re-use. Instead of being a focused data service for particular data, such as DBpedia for Wikipedias, the LDF.fi platform aims at being a cross-domain platform of datasets on a national level. The main application area of the presented infrastructure has been Cultural Heritage and Digital Humanities [12], although also systems for, e.g., e-health, e-government, and e-learning were developed.

Fig. 2.

Timeline illustrating the development of the Semantic Web and work reported in this paper.

Timeline illustrating the development of the Semantic Web and work reported in this paper.

Figure 2 illustrates the work reported in this paper on a timeline and in relation to some global developments of the Semantic Web. The development of the SW was boosted by the seminal article in Scientific American in May 2011 by Tim Berners-Lee, James Hendler, and Ora Lassila [3], and this inspired us to organize the conference Semantic Web Kick-off in Finland in the autumn of 2001 together with researchers of the W3C, the Finnish Artificial Intelligence Society, and some other organizations [20]. This event initiated SW research in Finland. During the past 20 years, the SW has evolved in phases [18] (cf. top of the figure) with a focus first on ontologies [76], then on Linked (Open) Data [16], and today on Knowledge Graphs (KG) [15]. In the same vein, our work on infrastructure first focused on ontologies and ontology services (ONKI.fi and Finto.fi) and then on Linked Data and data model services. The Sampo series of applications reflects this development by showing a shift of focus in three generations [25] from data publishing, based on shared ontologies and metadata vocabularies6767 (1. generation portals), to supporting the end-users of KGs with seamlessly integrated data-analytic tools and visualizations needed in areas such as Digital Humanities (2. generation systems). However, the series has also taken first steps forward towards 3. generation portals that can solve problems for the end users based on knowledge discovery, Artificial Intelligence, and computational creativity. There are lots of related works pertaining to the different Sampo systems; discussing them is beyond the scope of this paper, but pointers to such works can be found in the referenced research papers. The bottom line of Fig. 2 depicts introduction of some important standards and important events of the SW for a context.

The ontologies and linked open datasets discussed in this paper constitute together a kind of national Linked Open Data Cloud. The idea is that as new ontologies and applications with new datasets are developed, the open RDF data already available in the infrastructure, say ontologies of places and historical people, can be reused and refined gradually better and better. This applies also to the open source tools, such as the Sampo-UI framework, that has been re-used and extended in all Sampo systems after publishing NameSampo in 2008. A goal of the current national FIN-CLARIAH infrastructure initiative is to foster this development.

The experiences reported in this paper indicate that creating and using a national semantic web infrastructure is useful from the data producers’ and data users’ points of view. However, creating and using linked data has its own challenges, too. More collaboration and agreements on data models and ontologies are needed for interoperability between the data producers, which complicates the publication process. Integration of SW technologies with legacy systems may be challenging, and there is lack of IT personnel competent in using SW technologies and tools. Creating linked data manually is costly but automatic methods may not be available and automation lowers data quality. Using structured semantic data and making the knowledge structures explicit to the end user in the UI calls for new kind of digital data literacy and source criticism6868 from the end user [51,60]. What the underlying data actually means is not always clear and issues of Big Data quality, such as completeness, veracity, skewness, uncertainty, fuzziness, and errors of data arise. However, in spite of the challenges, enriching data carefully with semantics, with one way or another, is in my mind a way ahead towards creating a more and more intelligent Web in a cost-efficient way. In contrast using “black box” language model-based systems and deep machine learning, such as Chat GPT, the SW makes the data on the Web explicit, transparent, and well-defined, and the already structured curated data in databases can be utilized. This facilitates creation of explainable “white box” AI systems [25,92].

Notes

3 Online publications of the Semantic Computing Research Group (SeCo): http://seco.cs.aalto.fi/publications/.

4 Best Practices for Publishing Linked Data: https://www.w3.org/TR/ld-bp/.

7 Data on the Web Best Practices: https://www.w3.org/TR/dwbp/.

8 See, e.g., the open self-study video lecture course “Linked Data Technologies for Cultural Heritage and Digital Humanities: Introducing the Semantic Web in Video Lectures” at https://seco.cs.aalto.fi/teaching/sw-introduction/.

9 Homepages of the events organized by the Semantic Computing Research Group: https://seco.cs.aalto.fi/events/.

12 FinnONTO project homepages: https://seco.cs.aalto.fi/projects/finnonto/.

13 In this paper, cross-domain ontology refers to a knowledge organization system encompassing several interlinked application domains.

14 Such as the Public Recommendation for Geographic Metadata, Ministry of Internal Affairs, http://www.jhs-suositukset.fi/suomi/jhs158.

15 Two human interfaces were created, ONKI.fi (https://onki.fi) for RDFS and ONKI Light for SKOS domain ontologies (https://light.onki.fi).

18 The current version of KOKO is available at the Finto.fi service: https://finto.fi/koko/fi/.

27 Available at: https://finto.fi

29 For a list of international services, see https://www.kiwi.fi/display/Finto/Skosmos-ohjelmisto0.

33 Linked Data Platform 1.0: https://www.w3.org/TR/ldp/.

35 Such as the Burj Al Arab in United Arab Emirates.

44 The model is called “Sampo” according to the Finnish epic Kalevala, where Sampo is a mythical machine giving riches and fortune to its holder, a kind of ancient metaphor of technology according to the most common interpretation of the concept.

49 This application at https://museosuomi.fi got the Semantic Web Challenge Award at the ISWC 2004 conference.

64 Semantic Computing Research Group (SeCo): https://seco.cs.aalto.fi

65 Sampo portals’ homepage: https://seco.cs.aalto.fi/applications/sampo/.

Acknowledgements

Nearly 100 people6969 at the Semantic Computing Research Group (SeCo) have contributed to the work presented in this paper, funded by over 50 organizations in Finland and beyond. Thanks to Marcia Zeng for the keynote talk invitation to the DCMI 2021 conference; this paper is a written account of that talk. The work of writing this paper is partly related to the Semantic Parliament (ParliamentSampo) project of the Academy of Finland, the EU project InTaVia: In/Tangible European Heritage,7070 and the EU COST action Nexus Linguarum7171 on linguistic data science. Thanks to the Finnish Cultural Foundation for an Eminentia Grant for reflecting the work presented. CSC – IT Center for Science has provided computational resources for our projects.

References

[1] 

A. Ahola, E. Hyvönen, H. Rantala and A. Kauppala, Publishing and studying historical opera and music theatre performances on the Semantic Web: Case OperaSampo 1830–1960, in: Proceedings of SWODCH 2023. Semantic Web and Ontology Design for Cultural Heritage. Co-Located with the 22nd International Semantic Web Conference (ISWC 2023) in Athens, Greece, CEUR Workshop Proceedings, Vol. 3540: , (2023) , https://ceur-ws.org/Vol-3540/paper8.pdf.

[2] 

J. Aitchison, A. Gilchrist and D. Bawden, Thesaurus Construction and Use: A Practical Manual, Aslib IMI, (2000) .

[3] 

T. Berners-Lee, Design Issues: Linked data, (2006) , https://www.w3.org/DesignIssues/LinkedData.html.

[4] 

T. Berners-Lee, M. Fischetti and M.L. Dertouzos, Weaving the Web: The Original Design and Ultimate Destiny of the World Wide Web by Its Inventor, 1st edn, Harper, San Francisco, (1999) . ISBN 0062515861.

[5] 

P. Brunet, L. de Luca, E. Hyvönen, A. Joffres, P. Plassmayer, M. Pronk, R. Scopigno and G. Sonkoly, Report on a European collaborative cloud for culturals heritage, Ex-ante impact assessment, (2022) , p. 108. doi:10.2777/64014.

[6] 

M. d’Aquin and N.F. Noy, Where to publish and find ontologies? A survey of ontology libraries, Web Semantics: Science, Services and Agents on the World Wide Web 11: ((2012) ), 96–111. doi:10.1016/j.websem.2011.08.005.

[7] 

M. d’Aquin and N.F. Noy, Where to publish and find ontologies? A survey of ontology libraries, Journal of Web Semantics First Look 11: (0) ((2012) ). doi:10.2139/ssrn.3198941.

[8] 

R.M. Davison, M.G. Martinsons and N. Kock, Principles of canonical action research, Information Systems Journal 14: (1) ((2004) ), 65–86, ISSN 13501917. doi:10.1111/j.1365-2575.2004.00162.x.

[9] 

J. Domingue, D. Fensel and J.A. Hendler, Introduction to the Semantic Web technologies, in: Handbook of Semantic Web Technologies, J. Domingue, D. Fensel and J.A. Hendler, eds, Springer, (2011) , pp. 1–41. ISBN 978-3-540-92913-0. doi:10.1007/978-3-540-92913-0.

[10] 

D. Fensel, Ontologies: Silver Bullet for Knowledge Management and Electronic Commerce, 2nd edn, Springer, (2004) .

[11] 

M. Frosterus, J. Tuominen, S. Pessala and E. Hyvönen, Linked open ontology cloud: Managing a system of interlinked cross-domain light-weight ontologies, International Journal of Metadata, Semantics and Ontologies 10: (3) ((2015) ), 189–201. doi:10.1504/IJMSO.2015.073879.

[12] 

E. Gardiner and R.G. Musto, The Digital Humanities: A Primer for Students and Scholars, Cambridge University Press, New York, NY, USA, (2015) . doi:10.1017/CBO9781139003865.

[13] 

R. Goebel, S. Zilles, C. Ringlstetter, A.R. Dengel and G.A. Grimnes, What is the role of the semantic layer cake for guiding the use of knowledge representation and machine learning in the development of the Semantic Web?, in: AAAI Spring Symposium: Symbiotic Relationships Between Semantic Web and Knowledge Engineering, (2008) .

[14] 

N. Guarino and C. Welty, Evaluating ontological decisions with OntoClean, Communications of the ACM 45: (2) ((2002) ), 61–65. doi:10.1145/503124.503150.

[15] 

C. Gutierrez and J.F. Sequeda, Knowledge graphs, Communications of the ACM 64: (3) ((2021) ), 96–104. doi:10.1145/3418294.

[16] 

T. Heath and C. Bizer, Linked Data: Evolving the Web into a Global Data Space, 1st edn, Morgan & Claypool, Palo Alto, California, (2011) , http://linkeddatabook.com/editions/1.0/.

[17] 

A.R. Hevner, S.T. March, J. Park and S. Ram, Design science in information systems research, MIS Quarterly: Management Information Systems 28: (1) ((2004) ), 75–105, ISSN 02767783. doi:10.2307/25148625.

[18] 

P. Hitzler, A review of the Semantic Web field, Commun. ACM 64: (2) ((2021) ), 76–83, ISSN 0001-0782. doi:10.1145/3397512.

[19] 

P. Hitzler, M. Krötzsch and S. Rudolph, Foundations of Semantic Web Technologies, Springer, (2010) .

[20] 

E. Hyvönen (ed.), Semantic Web kick-off in Finland – vision, technologies, research, and applications, in: HIIT Publications 2002-01, Helsinki Institute for Information Technology, (2002) , https://seco.cs.aalto.fi/publications/2002/hyvonen-semantic-web-kick-off-2002.pdf.

[21] 

E. Hyvönen, Preventing interoperability problems instead of solving them, Semantic Web – Interoperability, Usability, Applicability 1: (1–2) ((2010) ), 33–37. doi:10.3233/SW-2010-0014.

[22] 

E. Hyvönen, Semanttinen web. Linkitetyn avoimen datan käsikirja, Gaudeamus, (2018) , pp. 271, https://kauppa.gaudeamus.fi/sivu/tuote/semanttinen-web/2493083.

[23] 

E. Hyvönen, Helsinki Centre for Digital Humanities (HELDIG): Developing the digital world together, in: EuropaNow, Council for European Studies (CES), Columbia University, New York, (2019) , https://www.europenowjournal.org/2019/09/09/the-helsinki-centre-for-digital-humanities-heldig-developing-the-digital-world-togethe/.

[24] 

E. Hyvönen, Linked open data infrastructure for Digital Humanities in Finland, in: DHN 2020 Digital Humanities in the Nordic Countries. Proceedings of the Digital Humanities in the Nordic Countries 5th Conference, CEUR Workshop Proceedings, Vol. 2612: , (2020) , pp. 254–259, http://ceur-ws.org/Vol-2612/short10.pdf.

[25] 

E. Hyvönen, Using the Semantic Web in Digital Humanities: Shift from data publishing to data-analysis and serendipitous knowledge discovery, Semantic Web – Interoperability, Usability, Applicability 11: (1) ((2020) ), 187–193. doi:10.3233/SW-190386.

[26] 

E. Hyvönen, Digitaalisten ihmistieteiden keskus HELDIG profiloi Helsingin yliopiston humanistisia aloja, Tieteessä tapahtuu 38: (1) ((2021) ), https://journal.fi/tt/article/view/102658/59857.

[27] 

E. Hyvönen, Digital Humanities on the Semantic Web: Sampo model and portal series, Semantic Web – Interoperability, Usability, Applicability 14: (4) ((2022) ), 729–744. doi:10.3233/SW-190386.

[28] 

E. Hyvönen, military history on the Semantic Web: Lessons learned from developing three in-use Linked Open Data services and semantic portals for Digital Humanities, in: Digital Humanities and Intelligent Computing of Cultural Heritage: Global Development and China Solutions, Routledge, (2024) , preprint, https://seco.cs.aalto.fi/publications/2023/hyvonen-military-history-2023.pdf.

[29] 

E. Hyvönen, Creating and using biographical dictionaries for Digital Humanities based on Linked Data: A survey of web services in use in Finland, in: Proceedings of the Biographical Data in a Digital World 2022 (BD 2022), Tokyo, ZRC SAZU, Ljubljana, Slovenia, (2024) . doi:10.3986/9789610508120.

[30] 

E. Hyvönen, E. Heino, P. Leskinen, E. Ikkala, M. Koho, M. Tamper, J. Tuominen and E. Mäkelä, WarSampo data service and semantic portal for publishing linked open data about the Second World War history, in: The Semantic Web – Latest Advances and New Domains (ESWC 2016), Springer, (2016) , pp. 758–773. doi:10.1007/978-3-319-34129-3_46.

[31] 

E. Hyvönen, E. Ikkala, M. Koho, J. Tuominen, T. Burrows, L. Ransom and H. Wijsman, Mapping manuscript migrations on the Semantic Web: A semantic portal and Linked Open Data service for premodern manuscript research, in: The Semantic Web – ISWC 2021, Springer, (2021) , pp. 615–630. ISBN 978-3-030-88360-7. doi:10.1007/978-3-030-88361-4_36.

[32] 

E. Hyvönen, P. Leskinen, E. Heino, J. Tuominen and L. Sirola, Reassembling and enriching the life stories in printed biographical registers: Norssi high school alumni on the Semantic Web, in: Proceedings, Language, Technology and Knowledge (LDK 2017), Springer, (2017) , pp. 113–119. doi:10.1007/978-3-319-59888-8_9.

[33] 

E. Hyvönen, P. Leskinen, M. Tamper, H. Rantala, E. Ikkala, J. Tuominen and K. Keravuori, BiographySampo – Publishing and enriching biographies on the Semantic Web for Digital Humanities research, in: The Semantic Web, ESWC 2019, Springer, (2019) , pp. 574–589. doi:10.1007/978-3-030-21348-0_37.

[34] 

E. Hyvönen, P. Leskinen and J. Tuominen, LetterSampo – historical letters on the Semantic Web: A framework and its application to publishing and using epistolary data of the republic of letters, Journal on Computing and Cultural Heritage 16: (1) ((2023) ), 1–23. doi:10.1145/3569372.

[35] 

E. Hyvönen and E. Mäkelä, Semantic autocompletion, in: The Semantic Web – ASWC 2006. First Asian Semantic Web Conference, Proceedings, Springer, (2006) , pp. 739–751. doi:10.1007/11836025_72.

[36] 

E. Hyvönen, E. Mäkelä, T. Kauppinen, O. Alm, J. Kurki, T. Ruotsalo, K. Seppälä, J. Takala, K. Puputti, H. Kuittinen, K. Viljanen, J. Tuominen, T. Palonen, M. Frosterus, R. Sinkkilä, P. Paakkarinen, J. Laitio and K. Nyberg, CultureSampo – Finnish culture on the Semantic Web 2.0. Thematic perspectives for the end-user, in: Museums and the Web 2009, Archives & Museum Informatics, Toronto, (2009) .

[37] 

E. Hyvönen, E. Mäkelä, M. Salminen, A. Valo, K. Viljanen, S. Saarela, M. Junnila and S. Kettula, MuseumFinland – Finnish museums on the Semantic Web, Journal of Web Semantics 3: (2) ((2005) ), 224–241. doi:10.1016/j.websem.2005.05.008.

[38] 

E. Hyvönen, H. Rantala, E. Ikkala, M. Koho, J. Tuominen, B. Anafi, S. Thomas, A. Wessman, E. Oksanen, V. Rohiola, J. Kuitunen and M. Ryyppö, Citizen science archaeological finds on the Semantic Web: The FindSampo framework, Antiquity, A Review of World Archaeology 95: (382) ((2021) ), 24. doi:10.15184/aqy.2021.87.

[39] 

E. Hyvönen, S. Saarela and K. Viljanen, Application of ontology-based techniques to view-based semantic search and browsing, in: Proceedings of the First European Semantic Web Symposium, Springer, (2004) .

[40] 

E. Hyvönen, L. Sinikallio, P. Leskinen, S. Drobac, R. Leal, M.L. Mela, J. Tuominen, H. Poikkimäki and H. Rantala, Publishing and using parliamentary Linked data on the Semantic Web: ParliamentSampo system for parliament of Finland, (2024) , in open review: https://www.semantic-web-journal.net/content/publishing-and-using-parliamentary-linked-data-semantic-web-parliamentsampo-system.

[41] 

E. Hyvönen, L. Sinikallio, P. Leskinen, M.L. Mela, J. Tuominen, K. Elo, S. Drobac, M. Koho, E. Ikkala, M. Tamper, R. Leal and J. Kesäniemi, Finnish Parliament on the Semantic Web: Using ParliamentSampo data service and semantic portal for studying political culture and language, in: Digital Parliamentary Data in Action (DIPADA 2022), Workshop at the 6th Digital Humanities in Nordic and Baltic Countries Conference, CEUR WS Proceedings, Vol. 3133: , (2022) , https://ceur-ws.org/Vol-3133/paper05.pdf.

[42] 

E. Hyvönen, M. Tamper, E. Ikkala, S. Sarsa, A. Oksanen, J. Tuominen and A. Hietanen, Publishing and using legislation and case law as Linked Open Data on the Semantic Web, in: The Semantic Web: ESWC 2020 Satellite Events, Lecture Notes in Computer Science, Vol. 12124: , Springer, (2020) , pp. 110–114. doi:10.1007/978-3-030-62327-2_19.

[43] 

E. Hyvönen, J. Tuominen, M. Alonen and E. Mäkelä, Linked Data Finland: A 7-star model and platform for publishing and re-using linked datasets, in: ESWC 2014: The Semantic Web: ESWC 2014 Satellite Events, Springer, (2014) , pp. 226–230. doi:10.1007/978-3-319-11955-7_24.

[44] 

E. Hyvönen, K. Viljanen and O. Suominen, HealthFinland – Finnish health information on the Semantic Web, in: The Semantic Web (Proceedings of ISWC 2007), Springer, (2007) . doi:10.1007/978-3-540-76298-0_560.

[45] 

E. Hyvönen, K. Viljanen, J. Tuominen and K. Seppälä, Building a national Semantic Web ontology and ontology service infrastructure – The FinnONTO approach, in: The Semantic Web: Research and Applications, 5th European Semantic Web Conference, ESWC 2008, Springer, (2008) , pp. 95–109. doi:10.1007/978-3-540-68234-9_10.

[46] 

E. Ikkala, E. Hyvönen, H. Rantala and M. Koho, Sampo-UI: A full stack JavaScript framework for developing semantic portal user interfaces, Semantic Web – Interoperability, Usability, Applicability 13: (1) ((2022) ), 69–84. doi:10.3233/SW-210428.

[47] 

E. Ikkala, J. Tuominen, J. Raunamaa, T. Aalto, T. Ainiala, H. Uusitalo and E. Hyvönen, NameSampo: A Linked Open Data infrastructure and workbench for toponomastic research, in: Proceedings of the 2nd ACM SIGSPATIAL Workshop on Geospatial Humanities, GeoHumanities’18, ACM, New York, NY, USA, (2018) , pp. 2–129. ISBN 978-1-4503-6032-6. doi:10.1145/3282933.3282936.

[48] 

T. Känsälä and E. Hyvönen, A semantic view-based portal utilizing learning object metadata, in: 1st Asian Semantic Web Conference (ASWC2006), Semantic Web Applications and Tools Workshop, (2004) , https://seco.cs.aalto.fi/publications/2006/kansala-hyvonen-2006-semantic-portal-lom.pdf.

[49] 

M. Koho, T. Burrows, E. Hyvönen, E. Ikkala, K. Page, L. Ransom, J. Tuominen, D. Emery, M. Fraas, B. Heller, D. Lewis, A. Morrison, G. Porte, E. Thomson, A. Velios and H. Wijsman, Harmonizing and publishing heterogeneous pre-modern manuscript metadata as Linked Open Data, Journal of the Association for Information Science and Technology (JASIST) 73: (2) ((2022) ), 240–257. doi:10.1002/asi.24499.

[50] 

M. Koho, E. Heino and E. Hyvönen, SPARQL faceter – client-side faceted search based on SPARQL, in: Joint Proceedings of the 4th International Workshop on Linked Media and the 3rd Developers Hackshop, CEUR Workshop Proceedings, Vol. 1615: , (2016) , http://www.ceur-ws.org/Vol-1615.

[51] 

T. Koltay, Data literacy for researchers and data librarians, Journal of Librarianship and Information Science 49: (1) ((2015) ), 3–14. doi:10.1177/0961000615616450.

[52] 

J. Kurki and E. Hyvönen, Collaborative metadata editor integrated with ontology services and faceted portals, in: Workshop on Ontology Repositories and Editors for the Semantic Web (ORES 2010) at ESWC 2010, CEUR Workshop Proceedings, Vol. 596: , (2010) .

[53] 

J.E. Labra Gayo, E. Prud’hommeaux, I. Boneva and D. Kontokostas, Validating RDF Data, Synthesis Lectures on the Semantic Web: Theory and Technology, Vol. 7: , Morgan & Claypool Publishers LLC, (2017) , pp. 1–328. doi:10.2200/s00786ed1v01y201707wbe016.

[54] 

M. Laukkanen, K. Viljanen, M. Apiola, P. Lindgren and E. Hyvönen, Towards ontology-based yellow page services, in: Proceedings of WWW2004 Workshop, Application Design, Development, and Implementation Issues, New York, CEUR WS Proceedings, Vol. 105: , (2004) , https://ceur-ws.org/Vol-105/iwebs-www2004.pdf.

[55] 

R. Leal, J. Kesäniemi, M. Koho and E. Hyvönen, Relevance feedback search based on automatic annotation and classification of texts, in: 3rd Conference on Language, Data and Knowledge (LDK 2021), Open Access Series in Informatics (OASIcs), Vol. 93: , Schloss Dagstuhl – Leibniz-Zentrum für Informatik, (2021) , pp. 18–11815. doi:10.4230/OASIcs.LDK.2021.18.

[56] 

P. Leskinen and E. Hyvönen, Linked Open Data service about historical Finnish academic people in 1640–1899, in: DHN 2020 Digital Humanities in the Nordic Countries. Proceedings of the Digital Humanities in the Nordic Countries 5th Conference, CEUR Workshop Proceedings, Vol. 2612: , (2020) , pp. 284–292, http://ceur-ws.org/Vol-2612/short14.pdf.

[57] 

P. Leskinen, E. Hyvönen and J. Tuominen, Members of Parliament of Finland knowledge graph and its Linked Open Data service, in: Proceedings of SEMANTiCS – in the Era of Knowledge Graphs, Studies on the Semantic Web, IOS Press, (2021) , pp. 255–269. doi:10.3233/SSW210049.

[58] 

E. Mäkelä, K. Hypén and E. Hyvönen, BookSampo – lessons learned in creating a semantic portal for fiction literature, in: The Semantic Web – ISCW 2011, Springer, (2011) , pp. 173–188. doi:10.1007/978-3-642-25093-4_12.

[59] 

E. Mäkelä and E. Hyvönen, SPARQL SAHA, a configurable Linked Data editor and browser as a service, in: Proceedings of the ESWC 2014 Demonstration Track, Springer, (2014) .

[60] 

E. Mäkelä, K. Lagus, L. Lahti, T. Säily, M. Tolonen, M. Hämäläinen, S. Kaislaniemi and T. Nevalainen, Wrangling with non-standard data, in: Proceedings of the Digital Humanities in the Nordic Countries 5th Conference, CEUR Workshop Proceedings, Vol. 2612: , (2020) , pp. 81–96, https://ceur-ws.org/Vol-2612/paper6.pdf.

[61] 

E. Mäkelä, T. Ruotsalo and Hyvönen, How to deal with massively heterogeneous cultural heritage data – lessons learned in CultureSampo, Semantic Web – Interoperability, Usability, Applicability 3: (1) ((2012) ), 85–109. doi:10.3233/SW-2012-0049.

[62] 

S.T. March and G.F. Smith, Design and natural science research on information technology, Decision Support Systems 15: (4) ((1995) ), 251–266, ISSN 01679236. doi:10.1016/0167-9236(94)00041-2.

[63] 

G. Marchionini, Exploratory search: From finding to understanding, Communications of the ACM 49: (4) ((2006) ), 41–46. doi:10.1145/1121949.1121979.

[64] 

J.L. Martinez-Rodriguez, A. Hogan and I. Lopez-Arevalo, Information extraction meets the Semantic Web: A survey, Semantic Web – Interoperability, Usability, Applicability 11: (2) ((2020) ), 255–335. doi:10.3233/SW-180333.

[65] 

G. Miyakita, P. Leskinen and E. Hyvönen, Using Linked Data for prosopographical research of historical persons: Case U.S. congress legislators, in: Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection. 7th International Conference, EuroMed 2018, Springer, Nicosia, Cyprus, (2018) , pp. 150–162. doi:10.1007/978-3-030-01765-1_18.

[66] 

D. Naskar and B. Dutta, Ontology and ontology libraries: A study from an ontofier and an ontologist perspective, in: ETD 2016 “Data and Dissertations”. 19th International Symposium on Electronic Theses and Dissertations, Lille, France, July 11–13, 2016, (2016) , pp. 11–13, https://etd2016.sciencesconf.org/92726.html.

[67] 

A. Oksanen, M. Tamper, J. Tuominen, A. Hietanen and E. Hyvönen, Anoppi: A pseudonymization service for Finnish court documents, in: Legal Knowledge and Information Systems. JURIX 2019: The Thirty-Second Annual Conference, M. Araszkiewicz and V. Rodríguez-Doncel, eds, IOS Press, (2019) , pp. 251–254. doi:10.3233/FAIA190335.

[68] 

K. Peffers, T. Tuunanen, M.A. Rothenberger and S. Chatterjee, A design science research methodology for information systems research, Journal of Management Information Systems 24: (3) ((2007) ), 45–77, ISSN 07421222. doi:10.2753/MIS0742-1222240302.

[69] 

S. Pessala, K. Seppälä, O. Suominen, M. Frosterus, J. Tuominen and E. Hyvönen, MUTU: An analysis tool for maintaining a system of hierarchically linked ontologies, in: Proceedings of the Workshop on Ontologies Come of Age Workshop (ISWC 2011), (2011) , https://seco.cs.aalto.fi/publications/2011/pessala-et-al-mutu-2011.pdf.

[70] 

H. Rantala, A. Ahola, E. Ikkala and E. Hyvönen, How to create easily a data analytic semantic portal on top of a SPARQL endpoint: Introducing the configurable Sampo-UI framework, in: VOILA! 2023 Visualization and Interaction for Ontologies, Linked Data and Knowledge Graphs 2023, CEUR Workshop Proceedings, Vol. 3508: , (2023) , https://ceur-ws.org/Vol-3508/paper3.pdf.

[71] 

L. Rietveld and R. Hoekstra, The YASGUI family of SPARQL clients, Semantic Web – Interoperability, Usability, Applicability 8: (3) ((2017) ), 373–383. doi:10.3233/SW-150197.

[72] 

M. Salvadores, P.R. Alexander, M.A. Musen and N.F. Noy, BioPortal as a dataset of linked biomedical ontologies and terminologies in RDF, Semantic Web – Interoperability, Usability, Applicability 4: (3) ((2013) ), 277–284. doi:10.3233/SW-2012-0086.

[73] 

K. Seppälä and E. Hyvönen, Asiasanaston muuttaminen ontologiaksi. Yleinen suomalainen ontologia esimerkkinä FinnONTO-hankkeen mallista (Changing a Keyword Thesaurus into an Ontology. General Finnish Ontology as an Example of the FinnONTO Model), National Library, Plans, Reports, Guides, (2014) , https://www.doria.fi/handle/10024/96825.

[74] 

T. Sidoroff and E. Hyvönen, Semantic E-goverment portals – a case study, in: Proceedings of the ISWC-2005 Workshop Semantic Web Case Studies and Best Practices for eBusiness SWCASE05, (2005) , http://www.seco.hut.fi/publications/2005/sidoroff-hyvonen-semantic-e-government-2005.pdf.

[75] 

L. Sinikallio, S. Drobac, M. Tamper, R. Leal, M. Koho, J. Tuominen, M.L. Mela and E. Hyvönen, Plenary debates of the Parliament of Finland as Linked Open Data and in Parla-CLARIN markup, in: Proceedings, Language, Data and Knowledge (LDK 2021), Vol. 93: , Schloss Dagstuhl – Leibniz-Zentrum für Informatik GmbH, (2021) , pp. 1–17. doi:10.4230/OASIcs.LDK.2021.8.

[76] 

S. Staab and R. Studer (eds), Handbook on Ontologies, 2nd edn, Springer, (2009) .

[77] 

O. Suominen and E. Hyvönen, Improving the quality of SKOS vocabularies with Skosify, in: Proceedings of the 18th International Conference on Knowledge Engineering and Knowledge Management (EKAW 2012), Springer, (2012) , pp. 383–397. doi:10.1007/978-3-642-33876-2_34.

[78] 

O. Suominen, E. Hyvönen, K. Viljanen and E. Hukka, HealthFinland – a national semantic publishing network and portal for health information, Journal of Web Semantics 7: (4) ((2009) ), 287–297. doi:10.1016/j.websem.2009.09.003.

[79] 

O. Suominen, A. Johansson, H. Ylikotila, J. Tuominen and E. Hyvönen, Vocabulary services based on SPARQL endpoints: ONKI light on SPARQL, in: Poster Proceedings of the 18th International Conference on Knowledge Engineering and Knowledge Management (EKAW 2012), (2012) , https://seco.cs.aalto.fi/publications/2012/suominen-et-al-onkilight-2012.pdf.

[80] 

O. Suominen, S. Pessala, J. Tuominen, M. Lappalainen, S. Nykyri, H. Ylikotila, M. Frosterus and E. Hyvönen, Deploying national ontology services: From ONKI to finto, in: Proceedings of the Industry Track at the International Semantic Web Conference 2014, CEUR Workshop Proceedings, Vol. 1383: , (2014) , ISSN 1613-0073, http://www.ceur-ws.org/Vol-1383.

[81] 

O. Suominen, H. Ylikotila, S. Pessala, M. Lappalainen, M. Frosterus, J. Tuominen, T. Baker, C. Caracciolo and A. Retterath, Publishing SKOS vocabularies with Skosmos, Manuscript, National Library of Finland, (2015) , https://skosmos.org/publishing-skos-vocabularies-with-skosmos.pdf.

[82] 

M. Tamper, P. Leskinen, E. Ikkala, A. Oksanen, E. Mäkelä, E. Heino, J. Tuominen, M. Koho and E. Hyvönen, AATOS – a configurable tool for automatic annotation, in: Proceedings, Language, Data and Knowledge (LDK 2017), Springer, (2017) . doi:10.1007/978-3-319-59888-8_24.

[83] 

M. Tamper, A. Oksanen, J. Tuominen, A. Hietanen and E. Hyvönen, Automatic annotation service: Utilizing a named entity linking tool in legal domain, in: The Semantic Web: ESWC 2020 Satellite Events, Springer, (2019) , pp. 208–213. doi:10.1007/978-3-030-62327-2_36.

[84] 

D. Tunkelang, Faceted Search, Morgan & Claypool, Palo Alto, California, (2009) . doi:10.2200/S00190ED1V01Y200904ICR005.

[85] 

J. Tuominen, M. Frosterus, K. Viljanen and E. Hyvönen, ONKI SKOS server for publishing and utilizing SKOS vocabularies and ontologies as services, in: The Semantic Web: Research and Applications. ESWC 2009, Springer, (2009) . doi:10.1007/978-3-642-02121-3_56.

[86] 

J. Tuominen, T. Kauppinen, K. Viljanen and E. Hyvönen, Ontology-based query expansion widget for information retrieval, in: Proceedings of the 5th Workshop on Scripting and Development for the Semantic Web (SFSW 2009), 6th European Semantic Web Conference (ESWC 2009), CEUR Workshop Proceedings, Vol. 449: , (2009) , http://ceur-ws.org/Vol-449/.

[87] 

J. Tuominen, N. Laurenne and E. Hyvönen, Biological names and taxonomies on the Semantic Web – managing the change in scientific conception, in: Proceedings of the 8th Extended Semantic Web Conference (ESWC 2011), Springer, (2011) . doi:10.1007/978-3-642-21064-8_18.

[88] 

J. Tuominen, N. Laurenne, M. Koho and E. Hyvönen, The birds of the World Ontology AVIO, in: The Semantic Web: ESWC 2013 Satellite Events, Springer, (2013) , pp. 300–301. doi:10.1007/978-3-642-41242-4_51.

[89] 

J. Tuominen, E. Mäkelä, E. Hyvönen, A. Bosse, M. Lewis and H. Hotson, Reassembling the republic of letters – a Linked Data approach, in: Proceedings of the Digital Humanities in the Nordic Countries 3rd Conference (DHN 2018), CEUR Workshop Proceedings, Vol. 2084: , (2018) , pp. 76–88, http://www.ceur-ws.org/Vol-2084/paper6.pdf.

[90] 

Y. Tzitzikas, N. Manolis and P. Papadakos, Faceted exploration of RDF/S datasets: A survey, Journal of Intelligent Information Systems 48: (2) ((2017) ), 329–364. doi:10.1007/s10844-016-0413-8.

[91] 

K. Viljanen, J. Tuominen and E. Hyvönen, Ontology libraries for production use: The Finnish ontology library service ONKI, in: The Semantic Web: Research and Applications (Proceedings of ESWC 2009), Springer, (2009) , pp. 781–795. doi:10.1007/978-3-642-02121-3_57.

[92] 

G. Vilone and L. Longo, Notions of explainability and evaluation approaches for explainable artificial intelligence, Information Fusion 76: ((2021) ), 89–106. doi:10.1016/j.inffus.2021.05.009.

[93] 

A. Zaveri, A. Rula, A. Maurino, R. Pietrobon, J. Lehmann and S. Auer, Quality assessment for Linked Data: A survey, Semantic Web – Interoperability, Usability, Applicability 7: (1) ((2016) ), 63–93. doi:10.3233/SW-150175.

[94] 

M. Zeng and J. Qin, Metadata, 3rd edn, ALA Neal-Schuman, Chicago, (2022) . ISBN 978-0-8389-4875-0.