<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Flyspeck in a Semantic Wiki</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Christoph Lange</string-name>
          <email>ch.lange@jacobs-university.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sean McLaughlin</string-name>
          <email>seanmcl@gmail.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Florian Rabe</string-name>
          <email>f.rabe@jacobs-university.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Computer Science, Jacobs University Bremen</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computer Science, Carnegie Mellon University</institution>
          ,
          <addr-line>Pittsburgh</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Semantic wikis have been successfully applied to many problems in knowledge management and collaborative authoring. They are particularly appropriate for scientific and mathematical collaboration. In previous work we described an ontology for mathematical knowledge based on the semantic markup language OMDoc and a semantic wiki using both. We are now evaluating these technologies in concrete application scenarios. In this paper we evaluate the applicability of our infrastructure to mathematical knowledge management by focusing on the Flyspeck project, a formalization of Thomas Hales' proof of the Kepler Conjecture. After describing the Flyspeck project and its requirements in detail, we evaluate the applicability of two wiki prototypes to Flyspeck, one based on Semantic MediaWiki and another on our mathematics-specific semantic wiki SWiM.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Scientific communication consists mainly of ex- Publication Application
tcihfiacnwgionrgkdcoocnusmistesntosf, caonldlabaogrraetaivtedlyeaaluotfhsocriienng- ECxopmerpiumteen/t Prove
them. Common instances are writing down first CreaTthiveity
hypotheses, commenting on results of experi- Visualize Spiral FSopremcaiflyiz/e
ments or project steps, and structuring,
annotating, or re-organizing existing items of knowledge, Com− Conjecture Teaching
as depicted in Buchberger’s figure on the right. municat(iBon. Buchberger, 1995)
Semantic markup languages for representing structures of scientific knowledge,
and editing tools understanding them, are a promising approach to supporting
this work.Besides generic approaches like SALT [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], the most extensive work in
semantic markup has been in the domain of mathematics. Mathematical logic,
depending on symbols and relationships between symbols, naturally lends itself
well to formal exposition. Languages like MathML [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], OpenMath [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], and
OMDoc [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] were developed to represent the clearly defined and hierarchical
structures of mathematics in a way that preserves the intricate relationships.
OMDoc employs Content MathML or OpenMath for structurally representing
mathematical objects (symbols, numbers, equations, etc.) and adds two layers
on top: Objects or informal text can be annotated as mathematical statements
(symbol declarations, definitions, axioms, theorems, proofs, examples, etc.), and
collections of interrelated statements can be grouped into theories.
      </p>
      <p>
        With SWiM, a semantic wiki for mathematical knowledge management [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ],
we have investigated collaborative editing of OMDoc documents. Additionally,
we host a public knowledge base and experimental ground about mathematical
knowledge management on the web, powered by Semantic MediaWiki3. It has
become evident that a wiki is a suitable tool for supporting the workflow of
incremental formalization inherent to scientific writing. Wikis have not only shown
to be appropriate for writing, but are also effective for project management, e. g. in
corporate settings [
        <xref ref-type="bibr" rid="ref23 ref36">23, 36</xref>
        ]. We are therefore interested in applying our technologies
to scientific knowledge engineering projects.
      </p>
      <p>
        The target of our case study is the Flyspeck
Project, which seeks to formally verify Thomas
Hales’ proof of the Kepler Conjecture [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ]. This
conjecture asserts that the density of a packing of
unit spheres in 3 dimensions is at most =(3p2),
the density of the face centered cubic and hexagonal
close packings. Posed by Kepler in 1611, it formed (http://tinyurl.com/3bxx2t)
part of Hilbert’s 18th problem, and until its solution Fig. 1. The face centered
was recognized as one of the most famous unsolved cubic packing
problems of mathematics. Hales’ proof, completed in 1995, was not accepted
immediately by the mathematical community. Besides its considerable length,
the proof relies essentially on computer calculations. The 300 pages of text and
many thousands of lines of computer code made checking the proof for errors in
the referee process unusually difficult, leading to a publication delay of nearly 10
years. In 2003, Hales proposed using computers to rigorously check the entire
proof in detail, including the computer code. He dubbed this effort Flyspeck 4.
The software systems used in such formalizations are called theorem provers or
proof assistants 5, examples being Isabelle [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ], Coq [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], and Twelf [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ]. With
adequate human assistance they can verify that a purported proof follows from a
given set of axioms and inference rules.
      </p>
      <p>
        Modern proof assistants are still far from being able to check proofs at the
level given in most journals and textbooks. A typical estimate is that it takes
about a week to formalize a single page of mathematical text. Hales expects that
it will take around 20 man-years to complete Flyspeck. Hales is compiling a LATEX
3 http://mathweb.org/wiki/
4 The word “flyspeck” means, “to examine closely”. It was found by Hales using a
regular expression search of an English dictionary for the expression “F.*P.*K”, for
“Formal Proof of Kepler”
5 The word “formalize” is used in many contexts in this field. In the remainder of this
paper, we use “formal” and “formalize” loosely, possibly referring to any degree of
colloquial or scientific formalization. We use “computerized” to mean that a theorem,
proof or definition has been expressed in a proof assistant. Note that we consider
computerized definitions and proofs formal “documents” as well.
book [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] of lemmas from different areas of mathematics that are needed in his
proof. Its 450 pages contain a significant percentage of the mathematical results
used in the proof, covering such disparate topics as plane, solid, and spherical
geometry, graph theory and hypermaps, single and multivariable calculus, and
plane and spherical trigonometry.
      </p>
      <p>
        The first steps toward a computerized proof have already been taken. Nipkow
and Bauer [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] proved the correctness of a fundamental algorithm in Isabelle.
The other two main parts of the computer code, linear programming and global
optimization, are currently being investigated in doctoral dissertations [
        <xref ref-type="bibr" rid="ref28 ref39">39, 28</xref>
        ].
A project page documents some of this progress and has a source repository
containing the book of lemmas, as well as the formalized definitions of some
important functions and inequalities [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Despite this considerable progress on
the computer code, the bulk of the mathematical formalization remains to be
done. This formalization will consist of two broad phases. First, a number of
elementary mathematical theories (e.g. spherical geometry) need to be defined
and the relevant lemmas proved. Then the specific aspects of the Kepler proof
that relies on the elementary results need to be formalized. Given the content of
the book mentioned above, we suspect that Flyspeck, in its final form, will consist
of dozens of theories, with hundreds of definitions and thousands of lemmas.
      </p>
      <p>Flyspeck is particularly appealing as a use case for a semantic wiki approach.
While the ultimate result is to be a highly formal computerized proof, the current
proof involves both highly formal and semi-formal mathematical knowledge. It
contains descriptive and motivating yet informal text that should be preserved
for human understanding. This quasi-formal information would be difficult to
present in a strictly formal setting of a proof assistant. Secondly, the large number
of lemmas, many independent or only loosely coupled, suggests a “crowdsourcing”
approach will be beneficial. Both can be supported by a (semantic) wiki, as we
will show in the following.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Supporting Flyspeck in a Semantic Wiki</title>
      <p>
        Our focus in this work is on making the extent and structure of Flyspeck
comprehensible, communicating where work needs to be done, and allowing
collaborators to improve the structure and finally to contribute computerized
proofs. For this the outline of the whole proof from the book [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] needs to be
represented in the wiki, where the mathematical statements (including definitions,
lemmas, and theorems) are available in a human-readable way (with formulae
in LATEX or presentational MathML) as well as a computerized presentation
suitable for using in a theorem prover. In order to obtain a well-structured
network of knowledge items, each mathematical statement should be presented
on one wiki page, which shows its human-readable representation taken from
the book, offers additional space for annotation, and allows for downloading a
formal representation. Here, we are not yet considering formal proof checking
inside the wiki, but rather using the wiki for communication about the projects
and annotation of informal text.
2.1
      </p>
      <sec id="sec-2-1">
        <title>Scenario</title>
        <p>An example usage scenario is as follows (cf. fig. 2). A user wishes to contribute
to Flyspeck. She looks at our wiki main page, which shows her what still needs
to be done. Preferring trigonometry, she searches for open problems in that field.
This returns a list of lemmas related to analysis from which she can choose one
that seems possible given her time constraints. She reads the text of a paper
proof culled from Hales’ book and annotated by other wiki collaborators and
downloads the relevant formal definitions and lemmas. She uses a proof assistant
to begin formalizing the paper proof. At some point, she needs clarification on
some definition and additionally has an idea on how to generalize this lemma.
She thus asks for help, makes comments on the discussion pages of the wiki, and
refines the annotations of the lemma. She completes her proof, and uploads the
proof assistant file to the wiki. The wiki uses a theorem prover to check the proof
for correctness and, if it is correct, adds it to the database.</p>
        <p>To do
Unproven lemmas:
Topic Lemma Score Discussion
HTryipgeornmomapestry 14..32 .3. . .5. p.osts
[Download Twelf representation]
Page type: Overview</p>
        <p>references
Lemma 1.3
The cosine is an even function.</p>
        <p>The sine is an odd function.
scions(( xx)) == cossi(nx()x)
[Download Twelf representation]
Page type: Lemma
Topic: Trigonometry
Proven: no (3 attempts)</p>
        <sec id="sec-2-1-1">
          <title>1. Browse</title>
        </sec>
        <sec id="sec-2-1-2">
          <title>2. Download usesSymbol</title>
          <p>Cosine
cocCsoCos:osRisni!neeR; x 7! : : :</p>
          <p>cos
[Download Twelf representation]
TPT[PoaD[PgpoaDoeigpacwoeig:ctweny:TtplnyTtorpelyiaorg:peidaog:eDdno:TDeonTDwfiemownfieemeilnfietfteilnirtfotryiiertnoryipenorpnerseesnetnattaitoino]n]</p>
          <p>Topic: Trigonometry
With this scenario in mind, we propose that the wiki should minimally offer:
A knowledge base of the theory, constant, and lemma definitions.
A theory browser where a user can browse the knowledge by category, or
search with keywords.</p>
          <p>An editor to annotate and structure informal texts on their way to
computerization.</p>
          <p>A download area where one can download existing computerized definitions,
lemmas, and proofs.</p>
          <p>An upload area where one can upload new proofs.</p>
          <p>Discussion pages to discuss issues involved in the formalizations.</p>
          <p>
            The following set of annotations should support this minimal infrastructure:
Categorization by topic: In the beginning, one would mirror the narrative
structure of the book (e. g. “sphere” being a subsection of “primitive volumes”,
which in turn is a section of the chapter “volume calculations”). Standardized
ways of classifying mathematical topics, such as the Mathematical Subject
Classification (MSC) [
            <xref ref-type="bibr" rid="ref1">1</xref>
            ], could be added later.
          </p>
          <p>Project-organization metadata such as whether the proof of a lemma has
already been computerized, or if someone is currently attempting a proof.</p>
          <p>This is essential so that two people do not duplicate work.</p>
          <p>Dependency links: These can be links from individual symbols in
mathematical formulae to the place where they are declared, or from any page p to
other pages containing knowledge that is required for understanding p: either
pages in the same wiki, or external resources like PlanetMath or Wikipedia
articles. Authors should be able to add them where they are missing.
Discussion posts should be strongly tied to the topic being discussed, and
classified into categories like question, answer, explanation, etc.</p>
          <p>An enticing page for visitors and potential collaborators should give an
impression of the extent and structure of the project (e. g. its size and its
specialization into diverse fields of mathematics). For the developer, there should
be tools for browsing and querying the knowledge. Not only should it be possible
to query knowledge items by their annotations, but important query results must
also be available as dynamically generated lists. Examples for queries are:
1. “Which lemmas about composite regions need to be proved?”
2. “What lemmas are difficult to prove?”
(a) . . . in the sense that many people have already attempted them, but given
up
(b) . . . in the sense that many people have asked questions in the related
discussion
3. “Are there textual resources I can read in order to understand the Jordan</p>
          <p>Curve Theorem?”
4. “What other lemmas could help me to prove this one?” (e. g. because they
prove a related statement)</p>
          <p>
            A volunteer who is willing to work out and contribute a computerized proof for
a lemma should be able to download a self-contained computerized representation
of this lemma and everything it depends on. Different notions of “dependency”
can be supported, the most straightforward being that a lemma depends on the
declarations and definitions of all symbols it uses and on the transitive closure of
all symbols used by the latter. Related lemmas could be downloaded and assumed
as axioms, under the assumption that those will be proved later, perhaps by
other collaborators. Finally, assuming that the Flyspeck book [
            <xref ref-type="bibr" rid="ref10">10</xref>
            ] is written in a
linear order, all definitions and lemmas before the current one in the narrative
order could be used.
          </p>
          <p>
            During the formalization of the knowledge, we anticipate that the definitions
will undergo refactoring in order to facilitate the actual development of the
proofs. (Historically, this has been the case with many large computerized proofs,
cf. [
            <xref ref-type="bibr" rid="ref5">5</xref>
            ].) Refactoring support by the wiki would thus be advantageous. In fact, as
definitions rely so heavily on each other, and the lemma statements rely on the
definitions, Hales needs to oversee the computerization of the definitions so that
the mathematical constants are correct6. This could be done by allowing him and
other experienced mathematicians to rate the contributions of the collaborators.
3
          </p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Case Studies and Evaluation</title>
      <p>
        So far, the Flyspeck project has four core members who collaborate via
GoogleCode [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. While the services offered by GoogleCode (a Subversion repository, a
mailing list, and others) were found to be sufficient for the core development team,
we were not satisfied with the wiki integrated into the GoogleCode web interface.
Lacking support for mathematical formulae, it would not even allow for presenting
the theorems and lemmas to be computerized in a human-readable fashion. This is
important, as we suspect people would prefer to look at traditional mathematics
text than proof assistant scripts when browsing. Furthermore, GoogleCode offers
very little structuring support, which we believe will be essential for browsing
and querying Flyspeck’s large knowledge collection.
      </p>
      <p>
        In the following sections, we evaluate two semantic wiki prototypes for their
applicability to Flyspeck with regard to their support for annotations, browsing,
and querying, as specified in section 2.2. One is based on Semantic MediaWiki, the
other one on our own semantic wiki SWiM. For the case study, we took a simplified
view of Flyspeck, using only the TEX sources of the Flyspeck book [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and a
Twelf [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] computerization of the definitions and lemmas of the chapter dealing
with the foundations of trigonometry. The goal was to present the trigonometry
chapter in a compelling way that we believed would scale 2-3 orders of magnitude.
      </p>
      <p>
        Both systems are semantic wikis, where one resource (e. g. one mathematical
theorem) is represented by one wiki page and relations between resources by links
between pages. Both pages and links can be typed with terms from ontologies [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ],
which are either preloaded into the wiki or modeled ad hoc [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. This is the
prevalent approach of adding semantics to wikis, although other ways have been
investigated [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ]. Note that we have developed an ontology for mathematical
knowledge (see sec. 3.2), but as this only focuses on the most essential structures,
keeping it extensible in the wiki may be beneficial. Semantic wikis offer enhanced
navigation capabilities. For example, they can usually display a summary of all
typed links, grouped by type, for each page. They support searching for pages
by type or by a page being source or target of a typed link7. Such queries can
either be executed interactively or automated as inline queries embedded into
6 For example, one can represent a vector as a function from the integers to the reals, or
as a tuple of reals. The operations of vector spaces will depend on this representation,
etc.
7 Both explicit and inferred links (RDF triples) can be considered [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]
the content of a page [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Both systems we consider support this basic set of
semantic wiki features.
3.1
      </p>
      <sec id="sec-3-1">
        <title>Semantic MediaWiki 1.0</title>
        <p>
          Semantic MediaWiki [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] is a semantic extension to MediaWiki, the system
driving Wikipedia. Plain MediaWiki supports mathematical formulae written in
LATEX and allows for categorizing pages. Semantic MediaWiki interprets category
membership as an instance-of relationship and supports the creation and editing
of typed links (called properties). External ontologies can be referenced from the
wiki, but at most sites powered by Semantic MediaWiki, site-specific ontologies
are developed in an ad hoc manner [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ].
        </p>
        <p>Prototype In Semantic MediaWiki, we imported the Twelf master source of
Flyspeck via a custom upload page. The Twelf file was first enhanced by special
comment lines marking the beginning and end of a declaration with information
about topical categorization. The Twelf upload page handler breaks an uploaded
file down into declarations and creates two wiki pages for each Twelf declaration:
one page that just contains the Twelf listing, categorized in the OMDoc document
ontology (e. g. Lemma; see section 3.2), and one container page that includes the
Twelf page via MediaWiki’s template inclusion mechanism, but also allows for
including a LATEX representation and leaves space for free-form annotations made
by the contributors. Additionally, MediaWiki offers a discussion page for each
page of mathematical content. The Twelf pages are overwritten on every import
from the master source, whereas existing container pages remain untouched. This
allows one to change the computerized version of a Twelf constant in the master
source (e. g. if it is incorrectly specified) and re-importing it without losing the
semantic markup and comments. During the import of a new symbol x, the
upload extension recognizes all previously imported symbols y in the definition
of the new symbol and creates links between x; y in the wiki.</p>
        <p>
          The generated annotations can be used for browsing, either via the “fact
box” (the summary of all typed links), or by the special “browse” page. For
querying, Semantic MediaWiki offers a simple triple search, as well as inline
queries. The query language corresponds to the small description logic EL++ [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ],
which, for example, does not support unrestricted negation. A query for unproven
lemmas about a certain topic could only be performed if the “unprovenness” were
explicitly annotated. The following queries additionally ask for lemmas available
in a Twelf formalization:
&lt;ask&gt;[[Category:Unproven]] [[Category:Lemma]]
        </p>
        <p>[[Category:Trigonometry]] [[written in::Twelf]]&lt;/ask&gt;</p>
        <p>Exporting computerized representations of knowledge items is not yet
supported conveniently. The Twelf listings can be viewed on their own pages, but
due to the auto-generated symbol links in the source code, these are not suitable
8 See http://mathweb.org/wiki/Flyspeck</p>
        <p>Fig. 3. A Flyspeck lemma in Semantic MediaWiki8
for download. One would either have to implement a special Twelf download
page that cleans these sources again, or one would have to implement the symbol
linking as an extension of the rendering process.</p>
        <p>Evaluation We found the ad hoc ontology development useful while
prototyping the annotations that might be required for Flyspeck, e. g. project-related
metadata like the information whether a lemma has already been proven, or
categorization by topic. Semantic MediaWiki did not meet the requirements in
places where ontologies already existed. For example, in structures of
mathematical documents, it was possible to reference vocabulary from the OMDoc
document ontology (see below), but not to apply further inference rules given
there to items of mathematical knowledge. This is because Semantic MediaWiki
does not support a full import of external ontologies. Most annotations were
modeled by categorization, i. e. instantiation of classes—certainly not the most
formal way of structuring knowledge in view of many classes just corresponding
to narrative sections of the book, but the one that is supported best by Semantic
MediaWiki. The inline queries were intuitive to write but not as powerful as
required. Complex reasoning tasks like inference of dependencies are not possible
in Semantic MediaWiki; in the restricted domain-specific setting of Flyspeck one
could realize them by hard-coded extension functions. Semantic MediaWiki does
not understand the semantics of mathematical formulae, as the LATEX formulae
cannot be annotated. The Twelf listings could be annotated, but at the cost of
making them harder to download.
3.2</p>
        <p>
          SWiM 0.2
SWiM is a semantic wiki targeted at mathematical knowledge management.
Based on the general-purpose semantic wiki IkeWiki [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ], it adds support for
browsing, editing, rendering, importing and exporting mathematical documents
written in OMDoc. The semantics of mathematical knowledge is mainly captured
in the OMDoc markup, and more explicitly in a document ontology ; whenever a
wiki page containing OMDoc fragments is saved, its type and its (typed) relations
to other items of mathematical knowledge in the wiki are extracted from the
OMDoc XML markup and explicitly represented as RDF triples using terms
of the OMDoc document ontology [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. This ontology models those aspects of
the three layers of mathematical knowledge supported by OMDoc to the extent
supported by the expressivity of OWL-DL [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ], including a limited inference of
dependencies. Modeling all modules of the OMDoc specification in this ontology
is not totally complete, though most mathematical statements as well as key
aspects of theories have been implemented. Relevant classes for Flyspeck would be
Lemma/Theorem/Corollary /. . . (all being subclasses of Assertion), Proof, Symbol
(a symbol declaration), Definition, and the properties Proof–proves–Assertion
and Symbol–hasDefinition–Definition.
        </p>
        <p>Statement</p>
        <p>depends on
Definition
v
uses
hasDefinition</p>
        <p>Symbol</p>
        <p>uses
Lemma</p>
        <p>Assertion
Corollary</p>
        <p>v
proves</p>
        <p>Proof
Theorem</p>
        <p>In the current version 0.2 of SWiM, the browsing of mathematical documents
is powered by the document ontology; whenever RDF triples having the current
page as subject or object are available9 the IkeWiki user interface can display
them either as navigation links (see figure 5) or in a graph view. Documents
are presented as XHTML+MathML, with mathematical symbols linked to their
declarations.</p>
        <p>Prototype We manually converted part of the trigonometry lemmas to OMDoc
for SWiM. Additionally, we can auto-generate OMDoc documents from the Twelf
source with a converter and import them into SWiM using the built-in import
functionality.</p>
        <p>
          As every SWiM page has an associated discussion page and discussion posts
are semantically represented using the SIOC ontology [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ], one can support the
coordination of the project by queries like query 2b from section 2.2. Work on
determining a relevant subset of OMDoc and its document ontology for discussions
9 In a mathematical document such as those we consider, most of these triples use
from the OMDoc document ontology.
        </p>
        <p>Fig. 5. A Flyspeck lemma in SWiM
is currently in progress. Pages and non-OMDoc links can be annotated with
types from ontologies loaded into the wiki10.</p>
        <p>
          Another powerful feature of SWiM is that authors can embed inline SPARQL
queries into wiki pages. Query 1 can be posed without explicitly annotating
“unprovenness”, making use of negation as failure [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]:
SELECT ?l WHERE { ?l rdf:type odo:Lemma .
        </p>
        <p>?l swrc:isAbout &lt;Composite_Regions&gt; .</p>
        <p>OPTIONAL { ?p rdf:type odo:Proof .</p>
        <p>?p odo:proves ?l . }</p>
        <p>FILTER ( ! bound(?p) ) }</p>
        <p>As OMDoc supports all degrees of formalizing mathematical knowledge,
computerized data can be downloaded in their OMDoc representation using
SWiM’s export feature and then be converted to Twelf by client-side software [14,
chap. 25.2].</p>
        <p>Evaluation Annotating mathematical structures with SWiM is easy if the
builtin OMDoc editor is used. Other annotations required for Flyspeck, such as
categorizations or information about the progress of the project, can be made,
but not in an ad hoc way, which we would have found useful in the prototyping
phase. Instead, one would have to import an existing ontology into the wiki,
or create it using the built-in ontology editor, and then one would be able to
annotate documents using terms from that ontology.</p>
        <p>Browsing is well supported, with incoming and outgoing navigation links
being displayed. Additionally, the neighborhood of the current resource in the
RDF graph can be browsed visually.</p>
        <p>
          Queries are powerful, but not always short and intuitive (see above).
Alternatively, one could enhance the ontology and make use of the integrated
Pellet OWL-DL reasoner (see [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]), which supports a more powerful logic than
Semantic MediaWiki, and get the same result with a simple query for instances
10 Types of OMDoc links are automatically extracted from the markup; see above.
of a specially defined class. For unproven lemmas, the following axiom would
suffice:
        </p>
        <p>LemmaWithoutProof</p>
        <p>Lemma u :(9proves 1:Proof)</p>
        <p>
          However, it remains to be evaluated how well the wiki scales with DL reasoning
enabled. First experiments with Pellet let the system considerably slow down (an
experience also made by the IkeWiki author [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]), so alternatives will have to be
investigated as well.
        </p>
        <p>System
Ontology availability
Ontology editing/
extensibility
Page annotation
Inline queries
Browsing
Reasoning
Semantics/annotation
of formulae
Annotation of
computerized content</p>
        <p>Semantic MediaWiki SWiM
none built in sufficient (OMDoc)
easy, ad hoc in place easy, but only via
dedi</p>
        <p>cated user interface
easy but not sufficiently easy and expressive
expressive
easy to write but not suffi- harder to write but more
ciently powerful powerful
intuitive intuitive, optional graph</p>
        <p>browser
not sufficient powerful but slow
not supported very powerful but harder</p>
        <p>
          to author
not directly supported powerful (OMDoc
by our extension markup)
Outside of wikis, the combination of computerized proofs and human-readable
text has been investigated in Isar [
          <xref ref-type="bibr" rid="ref38">38</xref>
          ], an alternative literate programming
language for Isabelle, and in Mizar [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ], whose language of Mizar is close to
mathematical vernacular. In contrast to Isar, there is a large web-based library
of Mizar proofs. It is browsable and searchable on the web but managed in a
centralized and hierarchical way, which is not comparable to wiki collaboration.
        </p>
        <p>
          Informal mathematical knowledge is currently managed in comprehensive
encyclopediae like the mathematical sections of Wikipedia11 or in PlanetMath11,
which focuses on mathematics and is powered by a highly customized wiki-like
system. The pages in these systems are categorized and searchable in full-text,
with additional metadata records in PlanetMath. Neither of the systems is a
semantic wiki, and for lacking typed links they fail to answer queries essential for
11 See http://www.wikipedia.org or http://www.planetmath.org, respectively,
and [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] for a more comprehensive evaluation.
Flyspeck, such as query 1 from section 2.2, and they do not link mathematical
symbols to their declarations; instead, the author has to provide links he considers
relevant in the text surrounding the formula.
        </p>
        <p>
          Recently, there is a growing interest in integrating proof assistants with wikis.
Logiweb is not a wiki but a distributed system for publishing machine checked
mathematics in high-quality PDF that shares part of the key wiki principles [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
Anybody can contribute to a Logiweb site and edit new pages in a simple text
syntax. On the other hand, Logiweb does not offer other essential features. For
example, browsing by traversing links is supported neither in the editor nor in
the generated PDF, and a built-in search or query facility is not offered. Logiweb
does not allow for exchanging knowledge as required for Flyspeck: Documents
can only be exported in presentational formats like PDF or TEX, but their
semantic structures cannot be exported in mathematical markup or theorem
proving languages. The way Logiweb checks proofs is not compatible with other
theorem provers, as all calculi and proof tactics need to be defined in the Logiweb
system itself. ProofWiki is an integration of the ProofWeb Coq frontend into
MediaWiki [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Coq’s export tools are used to generate browsable HTML or
LATEX with linked symbols from the proof scripts. Generating index pages, such
as lists of all definitions or all theorems, is planned, but not yet in a way that
could be customized by users. So far, there is just text search, and dependencies
among knowledge items are only computed for exporting proofs but not used
for browsing inside the system. Pages can either be formal proof scripts (with
restricted possibilities to include informal comments) or informal wiki pages.
Semi-formal documents or stepwise formalizing of knowledge are not supported.
Importing and exporting Coq proof scripts to and from the wiki is possible. While
the authors provide instructions on how to integrate other theorem provers, doing
so would be a lot of work, as there is no abstraction layer or metalanguage for
exchanging or converting data. Both Logiweb and ProofWiki are “semantic” in the
sense that the integrated proof checker utilizes the mathematical knowledge in the
wiki pages. But the semantics is not utilized for anything else, such as facilitating
browsing or editing, or connecting to semantic web services. Developing and
verifying formal proofs in the wiki is not yet the focus of Flyspeck in this early
stage, but it may be required later.
5
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion and Further Work</title>
      <p>Our preliminary experiments lead us to believe that, due to its rich semantic
web and OMDoc infrastructure, future work toward supporting Flyspeck should
continue in the SWiM infrastructure. For the text-based page format of
MediaWiki, features that rely on structures like the linking of symbols could only be
realized in an ad hoc way using, say, regular expressions. Relying on the XML
infrastructure of OMDoc, these features are either already available or easier
to develop. However, rapidly prototyping our first ideas about the wiki support
required for Flyspeck was easier in Semantic MediaWiki due to its ability to
design ad hoc ontologies and its implementation in the interpreted language
PHP.</p>
      <p>
        Importing For this case study, we created OMDoc from Twelf. OMDoc also offers
support for the alternative workflow of stepwise formalization as well. One could
either start by converting the Flyspeck book from LATEX to HTML with MathML
formulae and formalize the presentation markup into content markup step by step,
or one could start the formalization on the TEX side. There, one would formalize
the book to sTEX, a content-oriented TEX notation for OMDoc, which can then
be converted to OMDoc [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Either way involves a TEX-to-XML transformation,
which has been tested in large scale in our group [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        Annotating The case study showed that the editing of ontologies in SWiM should
become more flexible. While a fixed OMDoc document ontology can be preloaded,
it should be possible to add other annotations ad hoc. We have not focused on
document editing in detail here, but additional editing services relying on the
document ontology are planned for SWiM 0.3 [
        <xref ref-type="bibr" rid="ref20 ref21">20, 21</xref>
        ]. Finally, using the module
system of OMDoc and refactoring the knowledge into more smaller theories
could help to simplify the structure of Flyspeck for browsing and to explicate
the dependencies between components of the proof.
      </p>
      <p>
        Browsing In the Semantic MediaWiki prototype we realized that the narrative
structure of the book is not adequately represented by a simple hierarchy of
categories. OMDoc has more powerful ways of putting content into narrative
structures [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. We are going to cover them with the document ontology and
utilize them for browsing.
      </p>
      <p>
        Querying Proof search will be greatly simplified if the semantic-aware search
engine MathWebSearch [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] is used. It applies substitution tree indexing to
mathematical formulae. That means, for example, that a query for R f (x ? z)dx
would also find R f (y + z)dy. Equivalence up to -renaming of bound variables
is obviously essential for a serious query language.
      </p>
      <p>Different Theorem Provers If several parts of the proof are done in different
theorem provers, highly non-trivial and mostly novel translations become
necessary to provide one single proof object. Here OMDoc could be used as an
exchange format between theorem prover languages, and formal translations
could be specified in OMDoc itself. While this line of research is interesting, it is
difficult for us to foresee what kinds of translations, if any, will be needed.
Download Dependencies, which we need for bundling download packages, can
partly be inferred by a DL reasoner using the document ontology, but for a
complete support of OMDoc’s notion of dependency, an OMDoc-specific calculus
will have to be applied, which is currently in development.
Upload We have not implemented uploading a proof directly to the wiki to have
it checked. This is easy in theory as we simply need to hook up the theorem
prover, but requires some effort to get the theorem prover to run on the wiki
server. This should be done soon, as it will relieve the maintainers.
Acknowledgments We would like to thank Stefan Decker, Michael Kohlhase,
and Immanuel Normann for their feedback particularly during the case studies.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. American Mathematical Society.
          <source>2000 mathematics subject classification</source>
          . http: //www.ams.org/msc/,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. arXMLiv:
          <article-title>Translating the ar iv to xml+mathml, 2007</article-title>
          . http://kwarc.info/ projects/arXMLiv/.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Bertot</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Castéran</surname>
          </string-name>
          .
          <article-title>Interactive theorem proving and program development: Coq'Art: the Calculus of Inductive Constructions. Texts in theoretical computer science</article-title>
          . Springer,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>P.</given-names>
            <surname>Corbineau</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Kaliszyk</surname>
          </string-name>
          .
          <article-title>Cooperative repositories for formal proofs</article-title>
          . In Kauers et al. [
          <volume>12</volume>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>G.</given-names>
            <surname>Gonthier</surname>
          </string-name>
          .
          <article-title>A computer-checked proof of the four colour theorem</article-title>
          .
          <source>Unpublished manuscript</source>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>T.</given-names>
            <surname>Groza</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Handschuh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Möller</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Decker. SALT -</surname>
          </string-name>
          <article-title>Semantically Annotated LATEX for scientific publications</article-title>
          . In E. Franconi,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kifer</surname>
          </string-name>
          , and W. May, editors,
          <source>ESWC</source>
          , volume
          <volume>4519</volume>
          of Lecture Notes in Computer Science. Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>K.</given-names>
            <surname>Grue</surname>
          </string-name>
          .
          <article-title>The layers of Logiweb</article-title>
          . In Kauers et al. [
          <volume>12</volume>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>T.</given-names>
            <surname>Hales</surname>
          </string-name>
          .
          <article-title>A proof of the Kepler conjecture</article-title>
          .
          <source>Annals of Mathematics</source>
          ,
          <volume>162</volume>
          :
          <fpage>1065</fpage>
          -
          <lpage>1185</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>T.</given-names>
            <surname>Hales</surname>
          </string-name>
          .
          <article-title>The Kepler conjecture</article-title>
          .
          <source>Discrete and Computational Geometry</source>
          ,
          <volume>36</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>269</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>T.</given-names>
            <surname>Hales</surname>
          </string-name>
          .
          <article-title>Flyspeck : A Blueprint of the Formal Proof of the Kepler Conjecture</article-title>
          . Unpublished manuscript,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>T.</given-names>
            <surname>Hales</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>McLaughlin</surname>
          </string-name>
          .
          <article-title>The Flyspeck Project</article-title>
          . http://code.google.com/p/ flyspeck,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>M. Kauers</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Kerber</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Miner</surname>
          </string-name>
          , and W. Windsteiger, editors.
          <source>MKM/Calculemus</source>
          <year>2007</year>
          ,
          <article-title>number</article-title>
          4573 in LNAI. Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Kohlhase. sTEX: A LATEX-based workflow for OMDoc</article-title>
          .
          <source>In OMDoc - An open markup format for mathematical documents [Version</source>
          <volume>1</volume>
          .2] [14], chapter
          <volume>26</volume>
          .15.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>M.</given-names>
            <surname>Kohlhase. OMDoc -</surname>
          </string-name>
          <article-title>An open markup format for mathematical documents [Version 1</article-title>
          .2]. Number 4180 in LNAI. Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>M. Kohlhase</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Müller</surname>
            , and
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Müller</surname>
          </string-name>
          .
          <article-title>Documents with flexible notation contexts as interfaces to mathematical knowledge</article-title>
          . In P. Libbrecht, editor,
          <source>Mathematical User Interfaces Workshop</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>M.</given-names>
            <surname>Kohlhase</surname>
          </string-name>
          and
          <string-name>
            <surname>I. Şucan.</surname>
          </string-name>
          <article-title>A search engine for mathematical formulae</article-title>
          . In T. Ida,
          <string-name>
            <given-names>J.</given-names>
            <surname>Calmet</surname>
          </string-name>
          , and D. Wang, editors,
          <source>Artificial Intelligence and Symbolic Computation</source>
          , AISC, number 4120 in LNAI. Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>M. Krötzsch</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Schaffert</surname>
            , and
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Vrandečić</surname>
          </string-name>
          .
          <article-title>Reasoning in semantic wikis</article-title>
          . In G. Antoniou,
          <string-name>
            <given-names>U.</given-names>
            <surname>Aßmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Baroglio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Decker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Henze</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.-L.</given-names>
            <surname>Pătrânjan</surname>
          </string-name>
          , and R. Tolksdorf, editors,
          <source>3rd Reasoning Web Summer School</source>
          , volume
          <volume>4636</volume>
          <source>of LNCS</source>
          . Springer,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Lange. The OMDoc document ontology</article-title>
          . http://kwarc.info/projects/ docOnto/omdoc.html,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Lange. SWiM - a semantic wiki for mathematical knowledge management</article-title>
          .
          <source>Technical Report 5</source>
          , Jacobs University Bremen,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Lange</article-title>
          .
          <article-title>SWiM development roadmap</article-title>
          . https://trac.kwarc.info/swim/ roadmap/,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <given-names>C.</given-names>
            <surname>Lange</surname>
          </string-name>
          .
          <article-title>Towards scientific collaboration in a semantic wiki</article-title>
          .
          <source>In A. Hotho and B</source>
          . Hoser, editors,
          <source>Bridging the Gap between Semantic Web and Web 2.0</source>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Lange. SWiM - a semantic wiki for mathematical knowledge management</article-title>
          . In S. Bechhofer,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hauswirth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hoffmann</surname>
          </string-name>
          , and M. Koubarakis, editors,
          <source>ESWC</source>
          , volume
          <volume>5021</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>832</fpage>
          -
          <lpage>837</lpage>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <given-names>B.</given-names>
            <surname>Leuf</surname>
          </string-name>
          and
          <string-name>
            <given-names>W.</given-names>
            <surname>Cunningham</surname>
          </string-name>
          .
          <article-title>The Wiki Way: Collaboration and Sharing on the Internet</article-title>
          .
          <string-name>
            <surname>Addison-Wesley Professional</surname>
          </string-name>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Mathematical Markup</surname>
          </string-name>
          <article-title>Language (MathML) version 3.0</article-title>
          . W3C working draft,
          <source>World Wide Web Consortium</source>
          ,
          <year>2007</year>
          . http://www.w3.org/TR/MathML3.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>D. L. McGuinness</surname>
            and
            <given-names>F. van Harmelen. OWL</given-names>
          </string-name>
          <article-title>web ontology language overview</article-title>
          .
          <source>W3C recommendation, W3C</source>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>26. Mizar mathematical library. Web Page at http://mizar.org/library/.</mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27. T. Nipkow, G. Bauer, and
          <string-name>
            <given-names>P.</given-names>
            <surname>Schultz. Flyspeck</surname>
          </string-name>
          <string-name>
            <surname>I</surname>
          </string-name>
          :
          <article-title>Tame Graphs</article-title>
          . In U. Furbach and N. Shankar, editors,
          <source>International Joint Conference on Automated Reasoning</source>
          , volume
          <volume>4130</volume>
          <source>of LNCS</source>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <given-names>S.</given-names>
            <surname>Obua</surname>
          </string-name>
          .
          <article-title>Proving bounds for real linear programs in isabelle/HOL</article-title>
          . In J. Hurd and
          <string-name>
            <surname>T. F</surname>
          </string-name>
          . Melham, editors,
          <source>Theorem Proving in Higher Order Logics</source>
          , volume
          <volume>3603</volume>
          <source>of LNCS</source>
          . Springer,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <source>The Open Math standard, version 2.0. Technical report, The Open Math Society</source>
          ,
          <year>2004</year>
          . http://www.openmath.org/standard/om20.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30. E. Oren,
          <string-name>
            <given-names>R.</given-names>
            <surname>Delbru</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Möller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Völkel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Handschuh</surname>
          </string-name>
          .
          <article-title>Annotation and navigation in semantic wikis</article-title>
          . In Völkel et al. [
          <volume>37</volume>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <given-names>L.</given-names>
            <surname>Paulson</surname>
          </string-name>
          . Isabelle:
          <string-name>
            <given-names>A Generic</given-names>
            <surname>Theorem</surname>
          </string-name>
          <string-name>
            <surname>Prover</surname>
          </string-name>
          , volume
          <volume>828</volume>
          <source>of LNCS</source>
          . Springer,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <given-names>F.</given-names>
            <surname>Pfenning</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Schürmann</surname>
          </string-name>
          .
          <article-title>System description: Twelf : A meta-logical framework for deductive systems</article-title>
          . In H. Ganzinger, editor,
          <source>16th International Conference on Automated Deduction (CADE)</source>
          , volume
          <volume>1632</volume>
          <source>of LNAI</source>
          . Springer,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33. E.
          <string-name>
            <surname>Prud</surname>
          </string-name>
          <article-title>'hommeaux and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Seaborne</surname>
          </string-name>
          .
          <article-title>SPARQL query language for RDF</article-title>
          .
          <source>W3C Recommendation, World Wide Web Consortium</source>
          ,
          <year>2008</year>
          . http://www.w3.org/TR/ 2008/REC-rdf
          <string-name>
            <surname>-</surname>
          </string-name>
          sparql-query-
          <volume>20080115</volume>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <article-title>Sites using Semantic MediaWiki</article-title>
          . http://www.semantic-mediawiki.org/w/index. php?title=Sites_using_Semanti%c_
          <source>MediaWiki&amp;oldid=781</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>SIOC - Semantically-Interlinked Online</surname>
            <given-names>Communities</given-names>
          </string-name>
          ,
          <year>2007</year>
          . http://sioc-project.
          <source>org/.</source>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <given-names>D.</given-names>
            <surname>Tapscott</surname>
          </string-name>
          and
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Williams</surname>
          </string-name>
          . Wikinomics - How Mass Collaboration Changes Everything. Portfolio,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>M. Völkel</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Schaffert</surname>
          </string-name>
          , and S. Decker, editors.
          <source>1st Workshop on Semantic Wikis</source>
          , volume
          <volume>206</volume>
          <source>of CEUR Workshop Proceedings</source>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38. M. Wenzel.
          <article-title>Isar - a generic interpretative approach to readable formal proof documents</article-title>
          . In Y. Bertot,
          <string-name>
            <given-names>G.</given-names>
            <surname>Dowek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hirschowitz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Paulin</surname>
          </string-name>
          , and L. Théry, editors,
          <source>Theorem Proving in Higher Order Logics: TPHOLs'99</source>
          , volume
          <volume>1690</volume>
          <source>of LNCS</source>
          , pages
          <fpage>167</fpage>
          -
          <lpage>184</lpage>
          . Springer,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <given-names>R.</given-names>
            <surname>Zumkeller</surname>
          </string-name>
          .
          <article-title>Formal global optimisation with taylor models</article-title>
          . In U. Furbach and N. Shankar, editors,
          <source>International Joint Conference on Automated Reasoning</source>
          , volume
          <volume>4130</volume>
          <source>of LNCS</source>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>