ETL Components Settings:


Name of Graph:

For the HTML pages and Pubby, the Graph http://fios:saiku is used.
For saiku, the Graph http://fios:saikumanually is used.

RDF file of data cube "FIOS 2.0 Data Cube for SEC/YHOF":

Here is the Link to the RDF File for the Data Cube, used in saiku.

SPARQL construct queries to populate data cube "FIOS 2.0 Data Cube for SEC/YHOF":

The following Construct Query is used to populate the data cube "Fios 2.0 Data Cube for SEC/YHOF"

PREFIX dc: <http://purl.org/dc/elements/1.1/>
PREFIX sdmx-measure: <http://purl.org/linked-data/sdmx/2009/measure#>
PREFIX edgar: <http://edgarwrap.ontologycentral.com/vocab/>
PREFIX gesis-dbpedia-stats2: <http://lod.gesis.org/dbpedia-stats/>
PREFIX smartdbwrap: <http://smartdbwrap.appspot.com/>
PREFIX qb: <http://purl.org/linked-data/cube/>
PREFIX refgovukyear: <http://reference.data.gov.uk/id/year/>
PREFIX refgovukmonth: <http://reference.data.gov.uk/id/month/>
PREFIX dcterms: <http://purl.org/dc/terms/>
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema/>
PREFIX skosclass: <http://ddialliance.org/ontologies/skosclass/>
PREFIX dropedia: <http://agkwebserver2.agk.uni-karlsruhe.de/~dropedia/index.php/Special:URIResolver/>
PREFIX eus: <http://ontologycentral.com/2009/01/eurostat/ns/>
PREFIX smartlocation: <http://smartdbwrap.appspot.com/id/location/>
PREFIX dbpedia: <http://dbpedia.org/resource/>
PREFIX owl: <http://www.w3.org/2002/07/owl/>
PREFIX smartanalysisobject: <http://smartdbwrap.appspot.com/id/analysisobject/>
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns/>
PREFIX rdfh: <http://lod2.eu/schemas/rdfh/>
PREFIX dropedialocal: <http://localhost/Dropedia/index.php/Special:URIResolver/>
PREFIX skos: <http://www.w3.org/2004/02/skos/core/>
PREFIX gesis-dbpedia-stats: <http://lod.gesis.org/dbpedia-stats/ns/>
PREFIX refgovukday: <http://reference.data.gov.uk/id/day/>
PREFIX rdfh-inst: <http://lod2.eu/schemas/rdfh-inst/>

INSERT INTO GRAPH <http://fios:saikumanually>
{?ds qb:structure <http://public.b-kaempgen.de:8080/fios#secyhofdsd>.} from <http://fios:saiku> where { ?ds qb:structure ?dsd. }

SPARQL query to add skos:notation names to companies:

PREFIX foaf: <http://xmlns.com/foaf/0.1/>
PREFIX skos: <http://www.w3.org/2004/02/skos/core/>

INSERT INTO GRAPH <http://fios:saikumanually>
{?conceptone skos:notation ?foafnameone}
where { { select ?concept as ?conceptone min(?foafname) as ?foafnameone from <http://fios:saiku>
where { ?concept foaf:name ?foafname }
group by ?concept } }

SPARQL query to create company and SIC levels of issuer dimension:

PREFIX fios: <http://public.b-kaempgen.de:8080/fios#>

INSERT INTO GRAPH <http://fios:saikumanually> {
?company skos:member fios:issuerCodeListCompanyLevel.
?sic skos:member fios:issuerCodeListSicLevel.
?company skos:narrower ?sic.
} from <http://fios:saiku>
where { ?company <http://public.b-kaempgen.de:8080/pubby/vocab%23assignedSic> ?sic }

LDSpider settings:

While testing FIOS 2.0, we tested also different parameters for crawling data. However, mainly we used a Breadth-first search with a depth of 3 and a maximum of 10 PLD.

Seedlist

Example of a seedlist

FIOS preprocessed rdf data

An example of a crawled and preprocessed data file can be downloaded here

Link to etl-fios:

Link to the source code of the fios-etl java program to execute the fios-etl process.

Endpoint

Endpoint of the FIOS 2.0 System

Download

You can download all created HTML pages, Seedlist and the RDf file here