<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The Linked Data Benchmark Council (LDBC)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Irini Fundulaki</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Josep Larriba Pey</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>David Dominguez-Sal</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ioan Toma</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dieter Fensel</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Barry Bishop</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Thomas Neumann</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Orri Erling</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Neubauer</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paul Groth</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Frank van Harmelen</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Peter Boncz</string-name>
        </contrib>
      </contrib-group>
      <abstract>
        <p>In the last years we have seen an explosion of massive amounts of graph shaped data coming from a variery of applications that are related to social networks (Facebook, Twitter, blogs and other on-line media) and telecommunication networks. Furthermore, the W3C Linking Open Data Initiative [8] has boosted the publication and interlinkage of a large number of datasets on the Semantic Web [2] resulting to the Linked Open Data Cloud. These datasets with billions of RDF triples such as Wikipedia[5], U.S. Census bureau [4], CIA World Factbook[1], DBPedia [5], and government sites1 have been created and published online. Moreover, numerous datasets and vocabularies from e-science are published nowadays as RDF graphs most notably in life and earth sciences, astronomy [6][7][3] in order to facilitate community annotation and interlinkage of both scienti c and scholarly data of interest. Technology and bandwidth now provide the opportunities for compiling, publishing and sharing massive Linked Data datasets. A signi cant number of commercial semantic repositories (i.e., RDF databases with reasoner and query-engine) which are the cornerstone of the Semantic Web exist. Neverthless at the present time, there is no: { comprehensive suite of benchmarks that encourage the advancement of technology by providing both academia and industry with clear targets for performance and functionality. { independent authority for developing benchmarks and verifying the results of those engines. The same holds for the emerging eld of noSQL graph databases, which share with RDF a graph data model, pattern- and pathoriented query languages.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>The Linked Data Benchmark Council (LDBC) project aims to provide a
solution to this problem by making insightful the critical properties of graph and
RDF data management technology, and stimulating progress through
compettion. This is timely and urgent since non-relational data management is
emerging as a critical need for the new data economy based on large, distributed,
heterogeneous, and complexly structured data sets. This new data management
paradigm also provides an opportunity for research results to impact young
innovative companies working on RDF and graph data management to start playing
a signi cant role in this new data economy.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Objectives &amp; Outcomes</title>
      <p>The main technical objective of the Linked Data Benchmark Council (LDBC)
is the development of benchmarks for di erent technology areas including core
data management (query processing, query optimisation, transactions), graph
analysis, data integration and reasoning. More speci cally, LDBC aims at the:
{ development of new benchmarks that will spur research and industry progress
in large-scale graph and RDF data management. This includes setting
challenges that will lead to signi cant progress in:
scalability, storage, indexing and query optimization techniques for RDF
and graph database solutions beyond Terabyte scales.
quantitatively and qualitatively assess di erent solutions for data
integration, and
computationally cheaper reasoning in RDF engines.
{ establishment of an industry-neutral entity, the LDBC foundation for
developing graph and RDF benchmarks, auditing benchmark results, and
publishing audited results. The LDBC Foundation will work in the same spirit
as the Transaction Processing Council (TPC) that has estabished a widely
accepted by the industry, set of benchmarks for relational database
management systems. It will be responsible for:
specifying benchmarks, benchmarking procedures and verifying/publishing
results.
providing a TPC-style auditing service for certifying results published
by vendors for benchmarks endorsed by LDBC.
training auditors for its benchmarking, creating a long-lasting business
model for auditing benchmark results.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Target Audiences</title>
      <p>The target audiences of LDBC that will comprise the core of the LDBC
foundation as well as bene ting from and using the project results in the areas of
technology, market and education are:
{ Technology Users: This group includes both private and commercial users of
RDF and graph databases that will use or integrate this technology for the
bene ts it has over traditional relational database management techniques.
{ Researchers: This category includes a broad range of researchers from those
who focus on graph-shaped data representations, query languages and
optimisations, all the way to researchers from other elds who use this
technology.
{ Technology Vendors: This group is made up of commercial developers of
RDF and graph database software components. It includes vendors who sell
the software they produce as well as those who sell only services around their
(open-source) products.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>1. Cia world factbook. https://www.cia.gov/library/publications/the-worldfactbook/index.html.</mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hendler</surname>
          </string-name>
          , and
          <string-name>
            <given-names>O.</given-names>
            <surname>Lassila. The Semantic Web. SCIENTIFIC AMERICAN-AMERICAN</surname>
          </string-name>
          <string-name>
            <surname>EDITION</surname>
          </string-name>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <article-title>3. The UMD Astronomy Information</article-title>
          and Knowledge Group.
          <article-title>Astonomy Ontology in OWL. archive</article-title>
          .astro.umd.edu.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <article-title>The 2000 US Census</article-title>
          . www.rdfabout.com/demo/census.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>5. DBPedia. www.dbpedia.org.</mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Gene</given-names>
            <surname>Ontology</surname>
          </string-name>
          . www.geneontology.org.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>7. UniProtRDF. dev.isb-sib.ch/projects/uniprot-rdf.</mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>W3C</given-names>
            <surname>Linking Open</surname>
          </string-name>
          <article-title>Data</article-title>
          . esw.w3.org/topic/SweoIG/TaskForces/CommunityProjects/LinkingOpenData.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>