We consider the feasibility of processing billions of RDF triples on a single commodity machine using streaming and sorting techniques and focusing on RDF processing tasks relevant for Linked Data consumption: data filtering and transformation, RDFS inference, owl:sameAs smushing and statistics extraction. To investigate this research question we built rdfpro (RDF Processor), an open source tool that provides streaming and sorting-based processors for the considered tasks and allows their sequential and parallel composition in complex pipelines. An empirical evaluation of rdfpro in four application scenario—dataset analysis, filtering, merging and massaging—shows the effectiveness of the tool and allows to positively answer our research question.

Processing Billions of RDF Triples on a Single Machine using Streaming and Sorting

Corcoglioniti, Francesco;Rospocher, Marco;Mostarda, Michele;Amadori, Marco
2015

Abstract

We consider the feasibility of processing billions of RDF triples on a single commodity machine using streaming and sorting techniques and focusing on RDF processing tasks relevant for Linked Data consumption: data filtering and transformation, RDFS inference, owl:sameAs smushing and statistics extraction. To investigate this research question we built rdfpro (RDF Processor), an open source tool that provides streaming and sorting-based processors for the considered tasks and allows their sequential and parallel composition in complex pipelines. An empirical evaluation of rdfpro in four application scenario—dataset analysis, filtering, merging and massaging—shows the effectiveness of the tool and allows to positively answer our research question.
978-1-4503-3196-8
File in questo prodotto:
File Dimensione Formato  
sac2015.pdf

solo utenti autorizzati

Tipologia: Documento in Post-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 454.77 kB
Formato Adobe PDF
454.77 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/301833
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact