<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A novel representation of terms related to infectious disease epidemiology for epidemic modeling</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mathias Brochhausen</string-name>
          <email>mbrochhausen@uams.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Josh Hanna</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>William R. Hogan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Biomedical Informatics University of Pittsburgh Pittsburgh</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Health Outcomes and Policy University of Florida Gainesville</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Division of Biomedical Informatics University of Arkansas for Medical Sciences Little Rock</institution>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Michael M. Wagner</institution>
          ,
          <addr-line>John D. Levander</addr-line>
          ,
          <country>Nicholas E. Millett</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Shawn T. Brown Pittsburgh Supercomputing Center Carnegie Mellon University Pittsburgh</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2014</year>
      </pub-date>
      <fpage>21</fpage>
      <lpage>26</lpage>
      <abstract>
        <p>-The Apollo Structured Vocabulary (Apollo-SV) is a Web Ontology Language 2 (OWL 2) representation of terms related to epidemic simulation. We are developing Apollo-SV by ontological analysis of the information used and created by epidemic simulators and the entities this information is about. A key finding of our analysis is that the input of an epidemic simulator is properly understood as (1) a representation of an ecosystem at simulator time zero, (2) information about infectious diseases of interest in the ecosystem, and (3) information about plans to control the diseases. This insight is reflected in the scope of Apollo-SV, which includes terms from the domains of both infectious disease epidemiology and population biology. We also found that some definitions in the Infectious Disease Ontology (IDO), including 'infection', 'infection acquisition', 'infectious disease', 'pathogen', and 'host', were not compatible with the meanings of the terms as used in epidemic simulation; thus, we created new definitions of these terms. Our analysis of epidemic simulators-which are mathematical models of phenomena studied by infectious disease epidemiology-afforded several advantages that likely explain why we discovered limitations of IDO. As a result, we recommend that development of biomedical ontologies intended for reuse consider the perspective of the overlapping biological science(s) involved. Apollo-SV is freely available at: http://purl.obolibrary.org/obo/apollo_sv.owl.</p>
      </abstract>
      <kwd-group>
        <kwd>disease transmission models</kwd>
        <kwd>epidemic simulators</kwd>
        <kwd>biomedical ontology</kwd>
        <kwd>infectious disease epidemiology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The science and practice of infectious disease epidemiology,
like climate science, is increasingly reliant on computational
simulation. The simulators—known as epidemic simulators or
more generally disease transmission models (DTMs)1—require
machine-interpretable information about pathogens, rates of</p>
    </sec>
    <sec id="sec-2">
      <title>1 DTMs also model endemic infections such as malaria.</title>
      <p>
        In this paper, we describe one element of our proposed
standards—the Apollo Structured Vocabulary (Apollo-SV).
Apollo-SV is an OWL 2 representation of terms related to
epidemic simulation. The other two elements are an XML
Schema Document (XSD), which defines the syntax for
simulator input, and a database schema that defines the
representation of simulator output. Apollo-SV defines the
terminology used in the XSD and database schema. These
elements are described in Wagner et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
2 Closing schools is one infectious disease control strategy that
simulators study for the control of influenza epidemics. The duration
of the closure is the length of time during which schools are closed.
      </p>
      <p>METHODS
We developed Apollo-SV for use in a set of Web services
designed to improve access to epidemic simulators. We begin
this section with an overview of these services, then detail our
methods to develop Apollo-SV, including conformance to
OBO Foundry Principles, methods to ensure validity for its
intended use, and multi-disciplinary development.</p>
      <p>The Apollo Web Services: Briefly, the Apollo Web Services are
a set of Web services designed to allow a publicly available,
Web-based, end-user application to access multiple epidemic
simulators through requests to a single Broker service (Fig. 1).</p>
      <p>In Figure 1, the Simple End User Application (SEUA)
creates an infectious disease scenario for simulation, encoded
in an XML document that conforms to the Apollo XSD, which
uses terminology defined by Apollo-SV. The SEUA invokes
the runSimulation() method of the Broker service with the
infectious disease scenario. The Broker service invokes the
Translator service, which translates the infectious disease
scenario into the native terminology and syntax of the
requested simulator(s).</p>
      <p>In accordance with Foundry principles, we write a textual
definition for every term that we create. Because formal
ontological textual definitions often use the technical language
of ontologists, we created an elucidation annotation for classes
in Apollo-SV. The elucidation restates the definition in
language more familiar to subject matter experts. We also
axiomatize Apollo-SV terms wherever possible (e.g., Fig. 2-5).</p>
      <p>
        In accordance with the Foundry principle of orthogonality,
which stipulates that a given term is defined only once across
all ontologies, we search for and import pre-existing
ontological representations into Apollo-SV. Besides importing
entire ontologies, we import selected classes, individuals, and
properties using the Minimum Information to Reference an
External Ontology Term (MIREOT) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] Protégé plugin that we
developed [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        We also adhere to Foundry naming conventions [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. We
edit our terms to (1) avoid connectives ('and', 'or'), (2) prefer
singular nouns, (3) avoid the use of negations, and (4) avoid
catch-all terms such as "Unknown x".
      </p>
      <p>To help link the OWL file with the XSD, we create a
Unique Apollo Label (UAL) for classes in Apollo-SV. The
UAL is the exact XSD type or attribute name to which the
class in Apollo-SV corresponds, for example,
InfectiousDisease and basicReproductionNumber.</p>
      <p>Analysis of simulators’ input and output files, and
documentation: We analyzed the input and output files of four
epidemic simulators. We also analyzed documentation, such as
user guides and published papers. We reviewed terms that we
extracted from these resources with the developers of the
simulators to identify relevant but missing terms, to discover
synonymy among terms, and to detect and resolve ambiguity.</p>
      <sec id="sec-2-1">
        <title>Validation by representation in XSD message syntax: We</title>
        <p>further refine our OWL DL representations by using the terms
in the XSD representation as it progressively expands to be
able to represent the input of four simulators.</p>
      </sec>
      <sec id="sec-2-2">
        <title>Validation by automatic translation: The process of</title>
        <p>developing the mappings from the XSD and Apollo-SV terms
to the native language of the simulators identifies additional
issues with Apollo-SV that we feed back into our analysis.</p>
      </sec>
      <sec id="sec-2-3">
        <title>Validation by implementation in a user application: The SEUA</title>
        <p>exposes Apollo-SV definitions and elucidations in tool tips that
appear when the mouse hovers over a term. This view
identifies problems with elucidations by placing them into the
context of an end-user configuring a simulator, and wanting to
understand what is meant by a term.</p>
        <p>Public release: To encourage adoption of Apollo-SV and to
allow external scientific review, comments, and requests for
additions, we make Apollo-SV publicly available at
http://purl.obolibrary.org/obo/apollo_sv.owl, a permanent URL
(PURL). We also ensure that Apollo-SV is easily accessible for
browsing and download at the Web-based Ontobee portal:
http://www.ontobee.org/browser/index.php?o=APOLLO_SV.
The issue tracker and under-development version of
ApolloSV are located at our Google Code site. The PURL to the
development version of Apollo-SV is
http://purl.obolibrary.org/obo/apollo_sv/dev/apollo_sv.owl.</p>
      </sec>
      <sec id="sec-2-4">
        <title>Multi-disciplinary development: The team developing Apollo</title>
        <p>SV comprises personnel with backgrounds in simulator
development, disease surveillance, medicine, biomedical
informatics, medical terminologies, ontological engineering,
artificial intelligence, and formal logic. All these individuals,
including a simulator developer (author SB), have been
actively engaged in review of Apollo-SV, and their feedback
guides design decisions.</p>
        <p>III.</p>
        <p>RESULTS</p>
        <p>Overall, Apollo-SV has 594 classes: 287 that we created
new in Apollo-SV and 307 that we imported: 57 via MIREOT
(Table I) and 250 from entire ontologies. The number of
imported classes is artificially high because the import of entire
ontologies brings classes into Apollo-SV we do not require.</p>
        <p>The core classes in Apollo-SV represent key entities of
interest to infectious disease epidemiology and population
biology (Table II). Throughout the course of developing the
Apollo standard, we reached the conclusion that the input to an
epidemic simulator is properly understood as a representation
of an ecosystem at simulator time zero, with additional
information about infectious diseases and planned or ongoing
interventions to control them. This conclusion motivates the
inclusion in Apollo-SV of terms from population biology. In
turn, the ecosystem viewpoint heavily influenced our
definitions of key terms in infectious disease epidemiology.</p>
        <p>At present, Apollo-SV and the XSD enable configuration
of three epidemic simulators with the same infectious disease
scenario in the SEUA. We are piloting a fourth simulator. They
are (1) a compartmental model developed by authors MMW,
NEM, and JDL (disease agnostic); (2) the FRED model
developed by the University of Pittsburgh Public Health
Dynamics Laboratory in collaboration with the Pittsburgh
Supercomputing Center and the School of Computer Science at
Carnegie Mellon University, University of Pittsburgh and
Imperial College (influenza A in humans); and (3) the FluTE
model developed by the University of Washington and Fred
Hutchinson Cancer Research Center in Seattle and the Los
Alamos National Laboratories (influenza A in humans).</p>
        <p>With respect to Foundry orthogonality, we attempted to
reuse IDO’s definitions of ‘infection’, ‘pathogen’, ‘host’, but
had to create new definitions (and thus new representations) for
them in Apollo-SV as discussed in the following sections.</p>
      </sec>
      <sec id="sec-2-5">
        <title>A. Infection</title>
      </sec>
      <sec id="sec-2-6">
        <title>IDO defines infection as a material entity that is:</title>
      </sec>
      <sec id="sec-2-7">
        <title>A part of an extended organism that itself has as part a population of one or more infectious agents and that is (1) clinically abnormal in virtue of the presence of this infectious agent population, or (2) has a disposition to bring clinical</title>
        <p>TABLE II. CLASSES IN APOLLO-SV BY SUBDOMAIN
Domain
Infectious disease
epidemiology
Population biology</p>
        <p>Classes in Apollo-SV
Infection
Pathogen
Latent period
Contaminated thing
Contamination
Infectious disease
scenario
Transmission
coefficient
Disease
transmission model
Susceptible
population
Infectious
population
Ecosystem
Abiotic ecosystem
Population
Population
infection and
immunity census</p>
        <p>Infection acquisition
Host
Infectious period
Contamination acquisition
Basic reproduction
number
Transmission probability
Infectious disease control
strategy
Exposed population
Resistant population
Biotic ecosystem
Community
Population census
Abiotic ecosystem census
abnormality to immunocompetent organisms of the same</p>
      </sec>
      <sec id="sec-2-8">
        <title>Species as the host (the organism corresponding to the extended organism) through transmission of a member or offspring of a member of the infectious agent population.</title>
        <p>
          However, epidemic simulators represent infection as a
process, because that is how ‘infection’ is defined in infectious
disease epidemiology. For example, [
          <xref ref-type="bibr" rid="ref13 ref14">13, 14</xref>
          ] define ‘infection’
as the invasion of a host organism's tissue by pathogens, the
multiplication of those pathogens, and the reaction of the
host’s tissue(s) to the pathogens and the toxins they produce.
        </p>
        <p>Also, the IDO definition requires that an infection cause
clinical abnormality in an individual of a particular species.
However, infectious disease epidemiology recognizes the
existence of species that do not experience clinical
abnormalities when infected with a particular pathogen. The
importance in epidemic simulation is that members of species
that can experience clinical abnormalities when infected can
acquire infection with the pathogen from a ‘carrier’ species.</p>
        <p>Apollo-SV defines ‘infection’ as: A reproduction of a
pathogen in (a part of) the tissue of an organism from another
species (Fig. 2).</p>
        <p>This biologically-grounded definition recognizes that two
species are interacting and—from the pathogen species point of
view—infection is a process of reproduction. The definition
only requires reproduction of one species within the tissues of
an individual (organism) from another species.</p>
      </sec>
      <sec id="sec-2-9">
        <title>B. Infection Acquisition (reformulation of Transmission</title>
      </sec>
      <sec id="sec-2-10">
        <title>Process)</title>
        <p>IDO imports two definitions of ‘transmission process’ from
the Transmission Ontology:</p>
      </sec>
      <sec id="sec-2-11">
        <title>1. A process that is the means during which the pathogen is</title>
        <p>transmitted directly or indirectly from its natural
reservoir, a susceptible host or source to a new host.</p>
      </sec>
      <sec id="sec-2-12">
        <title>2. Suggested definition: A process by which a pathogen passes from one host organism to a second host organism of the same Species.</title>
        <p>The second, “suggested definition” erroneously restricts
transmission to occur only between two hosts of the same
species. It is thus not usable in infectious disease epidemiology
or any other science that deals with cross-species transmission.</p>
        <p>The first definition of ‘transmission process’ has two major
problems. The first problem is that it is circular, defining
‘transmission process’ in terms of a pathogen being
transmitted, with no definition of ‘transmitted.’</p>
        <p>The second problem is an ontological one. It attributes to
one process the property of being the means by which
something else happens. For example, assume droplet spread
of infection from one host to another by a sneeze. This
definition equates the sneeze with the transmission process.
That is, it says that only the sneeze exists, but it also has the
property of “having transmitted the pathogen”. However,
equating the sneeze to the transmission process is nonsensical
because for transmission to be complete, the second host must
have an infection. But this infection will not begin for minutes
to hours after the sneeze is over. The sneeze cannot somehow
extend itself in time until an infection is established, but
conversely not extend in time when no infection results. There
exist two distinct processes: the sneeze and the transmission.</p>
        <p>We also had the insight that it is only the second host who
acquires the infection that undergoes a change during the
process. Therefore, we chose to rename it ‘infection
acquisition’. We recognize that we are diverging from
standard terminology in the field, but anyone wishing to add an
alternative label to the infection acquisition class in Apollo-SV
could do so without changing the meaning of the class.</p>
        <p>Apollo-SV defines ‘infection acquisition’ as: The
biological process of pathogen organism(s) entering (the body
of) a host organism from a contagious host or a contaminated
thing and reproducing using host resources.</p>
        <p>As with our definition of ‘infection’, this definition is
biologically grounded and recognizes that from the pathogen
species’ point of view, infection acquisition is the entry into a
host and the beginning of reproduction there. Note that
ApolloSV’s definition of ‘contaminated thing’ is general and includes
natural reservoirs, vector organisms that are not infected (a.k.a.
mechanical vectors), and fomites like contaminated pencils.</p>
      </sec>
      <sec id="sec-2-13">
        <title>C. Host</title>
      </sec>
      <sec id="sec-2-14">
        <title>IDO defines ‘host’ as: An organism bearing a host role</title>
        <p>This definition is not sufficient in and of itself to
understand what IDO refers to by ‘host’. It is also necessary to
review its definitions of ‘host role’ and ‘extended organism’:
1. ‘Host role’: A role borne by an organism in virtue of the
fact that its extended organism contains a material
entity other than the organism.</p>
      </sec>
      <sec id="sec-2-15">
        <title>2. ‘Extended organism’: An object aggregate consisting of an organism and all material entities located within the organism, overlapping the organism, or occupying sites formed in part by the organism.</title>
        <p>Under these definitions, any organism that has an artificial
joint, a penny in its gut, or an arrow through its chest is a host.
The fact that a person with a prosthetic knee is a “host” is
counterintuitive. This definition is too admissive for our use
cases (and for clinical medicine, too): any foreign material
entity inside the organism’s body renders the organism a host.</p>
        <p>In addition, from the ontological perspective, we doubt
there is any such entity as host role. First, according to BFO, a
role is manifested or realized in one or more processes.
However, because there is no representation of the infection
process in IDO, infection cannot be the realization. No other
process in IDO suffices, either. If there is no process that
realizes a role, then by definition of ‘role’, there is no role.</p>
      </sec>
      <sec id="sec-2-16">
        <title>Apollo-SV defines host as: An organism that has as part some tissue that is the location of an infection (Fig. 3).</title>
        <p>We therefore distinguish pathogen and host based on which
one is reproducing inside tissue (pathogen) and which one is
the location of the reproduction (host).</p>
      </sec>
      <sec id="sec-2-17">
        <title>D. Pathogen</title>
        <p>IDO defines ‘pathogen’ as: A material entity with a
pathogenic disposition.</p>
        <p>Again, this definition requires the definitions of other terms to
understand its meaning:
1. ‘Pathogenic disposition’: A disposition to initiate
processes that result in a disorder.</p>
      </sec>
      <sec id="sec-2-18">
        <title>2. ‘Disorder’: A material entity which is clinically abnormal and part of an extended organism. Disorders are the physical basis of disease.</title>
        <p>Thus per IDO any material that causes injury is a pathogen,
including the endotoxin of Clostridium difficile or an overdose
of acetaminophen. IDO does have an infectious agent class as a
subtype to pathogen that refers specifically to organisms that
enter into a host cause injury. But this definition is not how
infectious disease epidemiology uses the term ‘pathogen’.</p>
        <p>IDO also asserts pathogens must typically cause disease.
However, attenuated poliovirus used in oral polio vaccines
infects the gut mucosa of humans and thus is a pathogen (or
infectious agent per IDO), but it causes disease in only one per
2.7 million first doses of vaccine.</p>
        <p>Apollo-SV defines ‘pathogen’ as: A material entity that is
the bearer of a disposition that, when realized, is realized as an
infection (Fig. 4).</p>
      </sec>
      <sec id="sec-2-19">
        <title>E. Infectious disease</title>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>IDO defines ‘infectious disease’ as:</title>
      <sec id="sec-3-1">
        <title>A disease whose physical basis is an infectious disorder.</title>
        <p>Per IDO, infectious disorder is a subytpe of infection.
However, we require a representation of infectious disease that
is consistent with our definition of ‘infection’ as a process. But
because IDO defines ‘infection’ and thus by inheritance
‘infectious disorder’ as a material entity, we could not reuse
this definition of ‘infectious disease’.</p>
        <p>
          Apollo-SV defines ‘infectious disease’ as: A disease that
inheres in a host and, when realized, is realized as a disease
course that is causally preceded by an infection (Fig. 5). This
definition is compatible with the OBO Foundry definition of
disease, which is in the Ontology of General Medical Science
(OGMS) [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. We thus were able to reuse the OGMS
definition of disease, in keeping with the Foundry principle of
orthogonality.
        </p>
        <p>Note that the disease inheres only in the host. From the
pathogen’s perspective, there is no clinical abnormality (which
is a necessary condition to meet the definition of disease in
OGMS). For the pathogen, infection is perfectly normal.</p>
        <p>IV.</p>
        <p>DISCUSSION
Apollo-SV version 2.0.1 is an ontology for use in representing
DTM input and output. It includes core terms from infectious
disease epidemiology and population biology. Apollo-SV
currently supports the representation of infectious disease
scenarios that can be run on three epidemic simulators and the
results of the simulations.</p>
        <p>We set a high priority on implementing Apollo-SV in a
Web service for three reasons. First, we wanted to demonstrate
the capability to initialize multiple simulators with one
infectious disease scenario to motivate the adoption of Apollo.
In addition, we wanted to lower barriers to adoption by making
available a reference implementation. Lastly, implementation
is the basis of our iterative development and refinement
process that ensures Apollo is production ready and flexible,
which also lowers the barriers to adoption.</p>
        <p>A key insight from our iterative development of Apollo-SV
and XSD is that a simulator configuration is properly
understood as a representation of an ecosystem at a particular
time. This insight led us to include in Apollo-SV key terms
from population biology, such as ‘ecosystem’ and ‘census’.
Furthermore, it led us to our redefinition of ‘infection’, which
was central to redefining other IDO terms.</p>
        <p>Fig. 5. Representation of the equivalent class axiom for "infectious disease"
in Apollo-SV. The graphical representation is analogous to Fig. 1.</p>
        <p>A key result of our development of Apollo-SV was that we
could not reuse IDO definitions of ‘infection’, ‘host’,
‘pathogen’, and ‘infectious disease’, and thus we created the
definitions presented here. This result was surprising because
we had anticipated reuse of IDO at the outset of Apollo-SV
development. Given that we did not expect this result, it is
worth considering the possible reasons behind it.</p>
        <p>A key reason is that our concentration on how terms are
used in biological sciences—especially population biology—
exposed many issues. This focus differed fundamentally from
IDO’s concentration on how the terms are used in clinical
medicine. In particular, our focus led us to a requirement to
represent the process of infection as opposed to the
steadystate, material-entity view of IDO.</p>
        <p>So what then led us to the perspective of population
biology? We believe the reason we reached this perspective, as
well as ontological clarity elsewhere in Apollo-SV, is that
working with epidemic simulators quickly brought into view
the key phenomena studied (that are also of relevance to
epidemic simulation) and their fundamental nature. These
simulators are mathematical models in the field of infectious
disease epidemiology. They have explicit ontological
commitments that have been rigorously vetted through peer
review of research using the models (as well as the models
themselves). In addition, these ontological commitments
comprise the core entities involved in infections and their
acquisition, leading us to confront the issues involved in
representing them from the outset. It is likely that IDO, by
contrast, started with a disease focus and worked from there
towards the nature of infection. Finally, because these
simulators make a relatively small number of ontological
commitments, we had the ability to to devote sufficient time to
ontological analysis while still achieving demonstrable
progress in implementing the SEUA. Because implementing
the SEUA is central to validating Apollo standards, we thus
also achieved rapid validation.</p>
        <p>We conclude that biomedical ontology developers should
incorporate the perspective of the basic sciences that study the
phenomena underlying clinical practice, such as medicine and
public health practice, when developing ontologies of clinical
phenomena. When mathematical models of such phenomena
exist, they are potentially useful starting points for analysis.</p>
        <p>
          We also could not reuse prior work on other ontologies that
have overlap with Apollo-SV. This work includes the
Epidemiology Ontology (EO) [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] and the Ontology for
Simulation Modeling of Population Health (SimPHO) [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ].
EO (like Apollo-SV) strives to meet Foundry principles [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ].
However it, like IDO, also defines ‘infection’ as a material
entity. It erroneously defines infection acquisition as occuring
only in humans. It does not axiomatize its classes.
Okhmatovskaia et al. do not define for SimPHO [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ] any of the
terms in Table I. Further comparison is not possible because
SimPHO is not publicly available for review/reuse3.
        </p>
        <p>Note that Apollo-SV is still a significant work in progress.
We represented entities sufficient to cover the input and output
of just three simulators and did pilot work on a fourth
simulator. We have also done preliminary work to represent
other types of information in infectious disease epidemiology.</p>
        <p>
          Our future plans include harmonizing Apollo-SV
definitions with IDO (we plan to submit the issues described
here to the IDO issue tracker) and expanding Apollo-SV to
cover additional simulators and types of information used in
infectious disease epidemiology. We also plan to study the
3 The link provided at http://surveillance.mcgill.ca/trac/star/
wiki/StarComponents/Ontology is broken as of this writing.
potential to generate the XSD from the ontology, a successful
strategy in other projects [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>ACKNOWLEDGMENTS</title>
      <p>This work was funded by award R01GM101151 from the
National Institute for General Medical Sciences (NIGMS).
This paper does not represent the view of NIGMS. This work
used the Protégé resource, which is supported by grant
GM10331601 from NIGMS.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J. J.</given-names>
            <surname>Grefenstette</surname>
          </string-name>
          , S. T. Brown,
          <string-name>
            <given-names>R.</given-names>
            <surname>Rosenfeld</surname>
          </string-name>
          , et al.
          <article-title>FRED (A Framework for Reconstructing Epidemic Dynamics): an open-source software system for modeling infectious diseases and control strategies using census-based populations</article-title>
          .
          <source>BMC Public Health</source>
          ,
          <year>2013</year>
          ;
          <volume>13</volume>
          :
          <fpage>940</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Chao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Halloran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. J.</given-names>
            <surname>Obenchain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and I. M.</given-names>
            <surname>Longini</surname>
          </string-name>
          , Jr., “
          <article-title>FluTE, a publicly available stochastic influenza epidemic simulation model</article-title>
          .”
          <source>PLoS Computational Biology</source>
          .
          <source>2010 Jan;6</source>
          (
          <issue>1</issue>
          ):
          <fpage>e1000656</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Halloran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. M.</given-names>
            <surname>Ferguson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Eubank</surname>
          </string-name>
          , et al.
          <article-title>Modeling targeted layered containment of an influenza pandemic in the United States</article-title>
          .
          <source>Proc Natl Acad Sci USA</source>
          .
          <source>2008 Mar</source>
          <volume>25</volume>
          ;
          <volume>105</volume>
          (
          <issue>12</issue>
          ):
          <fpage>4639</fpage>
          -
          <lpage>44</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>M. M. Wagner</surname>
          </string-name>
          et al.
          <article-title>Apollo: giving application developers a single point of access to public health models using structured vocabularies and Web services</article-title>
          .
          <source>AMIA Annu Symp Proc. 2013 Nov</source>
          <volume>16</volume>
          ;
          <year>2013</year>
          :
          <fpage>1415</fpage>
          -
          <lpage>24</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>P.</given-names>
            <surname>Grenon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          , “
          <article-title>Biodynamic Ontology: Applying BFO in the Biomedical Domain”</article-title>
          , in D. M. Pisanelli (ed.),
          <source>Ontologies in Medicine: Proceedings of the Workshop on Medical Ontologies, Rome October</source>
          <year>2003</year>
          (
          <article-title>Studies in Health</article-title>
          and Technology Informatics,
          <volume>102</volume>
          (
          <year>2004</year>
          )), Amsterdam: IOS Press,
          <year>2004</year>
          ,
          <fpage>20</fpage>
          -
          <lpage>38</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ashburner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Rosse</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Bug</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Ceusters</surname>
          </string-name>
          , et al, “
          <article-title>The OBO Foundry: Coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
          <source>” Nat Biotechnol</source>
          <year>2007</year>
          ,
          <volume>25</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1251</fpage>
          -
          <lpage>5</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <article-title>[7] The Open Biological and Biomedical Ontologies, “OBO Foundry Principles</article-title>
          .” http://www.obofoundry.org/crit.shtml. Last accessed:
          <volume>05</volume>
          /13/2014
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <fpage>W3C</fpage>
          , “OWL 2
          <string-name>
            <given-names>Web</given-names>
            <surname>Ontology Language Primer (Second Edition</surname>
          </string-name>
          .” http://www.w3.org/TR/owl2-primer.
          <source>Last accessed 05/12/2014</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Courtot</surname>
          </string-name>
          et al. “
          <article-title>MIREOT: the Minimum Information to Reference an External Ontology Term”</article-title>
          <year>2009</year>
          . http://dx.doi.org/10.1038/npre.
          <year>2009</year>
          .
          <volume>3576</volume>
          .1.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hanna</surname>
          </string-name>
          et al. “
          <article-title>Simplifying MIREOT; a MIREOT Protege Plugin</article-title>
          .
          <source>” Proceedings of the ISWC 2012 Posters &amp; Demonstrations Track;</source>
          <year>2012</year>
          :
          <fpage>11</fpage>
          -
          <lpage>15</lpage>
          . http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>914</volume>
          /paper_48.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Schober</surname>
          </string-name>
          et al. “
          <article-title>Survey-based naming conventions for use in OBO Foundry ontology development</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2009</year>
          ,
          <volume>10</volume>
          :
          <fpage>125</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>L. G.</given-names>
            <surname>Cowell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith. Infectious Disease</surname>
          </string-name>
          <article-title>Ontology</article-title>
          . In: V Sintchenko, ed. Infectious Disease Informatics: Springer New York;
          <year>2010</year>
          . p.
          <fpage>373</fpage>
          -
          <lpage>95</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>J. M. Last</surname>
          </string-name>
          (ed.),
          <source>A Dictionary of Epidemiology. 4th Edition</source>
          . Oxford, Oxford University Press,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>M. T. O'Toole</surname>
          </string-name>
          (ed.),
          <source>Mosby's Disctionary of Medicine, Nursing, and Health Profession. 9th Edition</source>
          . St. Louis: Elsevier,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>R. H.</given-names>
            <surname>Scheuermann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Ceusters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          , “
          <article-title>Toward an Ontological Treatment of Disease and Diagnosis”</article-title>
          ,
          <source>Proceedings of the 2009 AMIA Summit on Translational Bioinformatics</source>
          ,
          <year>2009</year>
          ,
          <fpage>116</fpage>
          -
          <lpage>120</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>C.</given-names>
            <surname>Pesquita</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Ferreira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. M.</given-names>
            <surname>Couto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Silva</surname>
          </string-name>
          .
          <article-title>The epidemiology ontology: an ontology for the semantic annotation of epidemiological resources</article-title>
          .
          <source>J Biomed Sem</source>
          ,
          <year>2014</year>
          ;
          <volume>5</volume>
          :
          <fpage>4</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Okhmatovskaia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Finès</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Buckeridge</surname>
          </string-name>
          , et al.
          <article-title>SimPHO: An Ontology for Simulation Modeling of Public Health</article-title>
          . In C. Laroque et al.,
          <source>eds. Proceedings of the 2012 Winter Simulation Conference:</source>
          <fpage>883</fpage>
          -
          <lpage>94</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>I. Sim</surname>
          </string-name>
          et al. “
          <article-title>The Ontology of Clinical Research (OCRe): An informatics foundation for the science of clinical research</article-title>
          .
          <source>J. Biomed. Inf</source>
          .
          <year>2013</year>
          . http://dx.doi.org/10.1016/j.jbi.
          <year>2013</year>
          .
          <volume>11</volume>
          .002.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>