<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Decision-making Format for the Semantic Web</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Eva Blomqvist STLab</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>ISTC-CNR eva.blomqvist@istc.cnr.it</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Don McGarry MITRE Corporation</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Marion Ceruti Jeff Waters Space and Naval Warfare Systems Center Pacific</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper describes the work of the W3C Decisions and Decision-making Incubator1, with the goal to identify requirements for a standard decision format, through a set of use cases, and to develop a rst version of a potential standard format for representing decisions, ful lling the requirements of the use cases and exploiting semantic web standards. Ongoing e orts include the identi cation and modelling of `decision patterns' and development of proof-ofconcept applications to validate assumptions and patterns.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        The time and e ort we spend converting our decisions into
work products, such as briefs, proposals, and communication
of decisions in meetings, conversations, and emails, could be
reduced if we had a standard format for representing and
sharing decisions. Our tools could be instrumented to
generate our decisions in a format that could be shared and also
track the state of decisions within the decision-making
process. Instrumentation could support the development of a
metric of information ow and help us optimize our decision
processes across our organization or enterprise [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
Visibility of the decisions in their formation and evolution would
enable proactive management and assistance from others [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>Usage Scenarios</title>
      <p>
        Sharing decisions across a broad and diverse set of users
and systems is an important aspect of situational awareness
in many domains, for instance, in emergency management2.
During an emergency, decisions must be shared among
emergency managers and rst responders from multiple
organizations, jurisdictions, and functional capabilities. For
example, decisions to route patients must be shared among rst
responders in the eld who are sending the patients, those
who are doing the transport, the medical facilities receiving
the patients, and the patient's families and relatives.
1For more information, or to participate in the Decisions Incubator,
please review the charter at http://www.w3.org/2005/Incubator/de
cision/charter and visit the wiki at http://www.w3.org
/2005/Incubator/decision/wiki/Main Page.
2For more information on emergency and incident management, see
for example the National Incident Management System, December
2008, published by the U.S. Department of Homeland Security at
http://www.fema.gov/pdf/emergency/nims/NIMS core.pdf.
First responders and emergency managers work under
difcult conditions using current mechanisms for information
sharing; they need improved solutions. For example,
paperbased Incident Command forms provide an initial
standardization of emergency information3. An Incident Command
Structure (ICS) can organize responders into a hierarchical
structure of sections (e.g. Operations, Planning, Logistics,
Finance) and roles (e.g. Incident Commander, Public
Information O cer, Safety O cer)4. XML-based standards
are being developed to improve sharing of emergency
information. The Organization for the Advancement of
Structured Information Systems (OASIS) has a family of
standards known as the Emergency Data Exchange Language
(EDXL)5. The Emergency Data Exchange Language
Common Alerting Protocol (EDXL-CAP) exempli es simple,
useful, and understandable information-exchange formats. What
EDXL-CAP did for alerts, a Common Decision Exchange
Protocol (CDEP) could do for decisions [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        An important next step is to utilize the semantic web
standards, including RDF, SPARQL, OWL and GRDDL to
integrate information for dynamic queries across datasets, and
for inferencing using the underlying ontologies (e.g.
indicating that the emergency equipment named X in one
jurisdiction is the same as the type named Y in another
jurisdiction). Initial steps in this direction are already being taken,
e.g., through the OASIS Distribution Element (DE)
supporting packaging and addressing of emergency management
information for purposes such as routing. The standard
has links to externally-managed `lists' representing concepts
such as `senderRole', `receiverRole' and `keywords'.
Ontologies should encapsulate, in a machine-understandable
manner, such information sharing policies. Implicitly present
is the underlying decision-making process, continuing at all
levels through an emergency. The decision format advocated
in this paper will support the move toward the use of linked
data [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and the recognition of the signi cance of
information sharing policies utilizing semantic standards.
      </p>
      <p>The need for representing, sharing and managing
decisions in a machine-understandable format is not exclusive
to emergency management. One example of another critical
3For examples of incident command forms, see http://training.
fema.gov/EMIWeb/IS/ICSResource/ICSResCntr Forms.htm.
4For more information on ICS, see the online training provided
by the U.S. Federal Emergency Management Agency, Lesson 3, at
http://emilms.fema.gov/IS100A/indexMenu.htm.
5For a good overview of EDXL, see http://en.wikipedia.org
/wiki/EDXL. The EDXL family of standards is available at the
OASIS website: http://www.oasis-open.org/home/index.php.
domain of interest is organizational innovation. Each
person is a `decision-maker' at some level in the organization.
The decisions a person makes are critical to the success of
an organization, so aspects of decision-making and objective
measures of the decision-making process become signi cant.
Decisions involve weighing reasonable options based on
metrics in order to take an action. If we granulize the
decisionmaking process by considering each member of our
organization as a decision-maker, then we can support the
representation and sharing of individual innovative actions. Most
organizations attempt to solve this problem through direct
or indirect person-to-person communication (e.g., meetings,
telecons) or unstructured collaborative tools (email, chat,
wiki). XML formats can support notice-type publishing of
activities, e.g, RSS or ATOM feeds; however, there remains
an opportunity to showcase semantic standards to capture
decision-making to improve the querying, inferencing, and
integration with underlying ontology support.</p>
      <p>The focus of this paper is on the information sharing
aspects of a decision, which is fostered by a format which is
concise, generic, i.e., domain independent, and tiered. The
more concise the format, the more quickly it can be
understood and accepted by developers and users alike.
1.2</p>
    </sec>
    <sec id="sec-3">
      <title>Project Goals</title>
      <p>
        The work performed by this incubator activity is designed
to help organizations improve integration of human decisions
into computer systems, to track and manage digitally the
decision-making process, to enable improved
informationow metrics, to maintain an archive of the decisions and
the decision-making process, to enable semi-automation of
certain decision-making processes, to improve information
sharing, and ultimately, to support better, rapid, and agile
decision making [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The potential standard format should
provide concise, generic, structured assessments and
decisions that allow `drill down', support pedigree and con
dence, enable approvals and vetting, de ne options
considered, including decision criteria with weighting, links to
previous decisions and sub-decisions, and support exible
structuring of complex decisions [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. However, to reach its full
potential, the proposed decision format must be compatible
with semantic web tools and standards, to provide semantic
interoperability and to provide a basis for reasoning that can
ease development of advanced applications.
      </p>
      <p>In summary the main goals of the incubator are:
To discover a set of requirements for a standard
decision format, through a set of use cases.</p>
      <p>To develop a draft of a potential standard format for
representing decisions, ful lling the requirements of
the use case and exploiting semantic web standards.</p>
    </sec>
    <sec id="sec-4">
      <title>METHODOLOGY BACKGROUND</title>
      <p>Creating a vocabulary for expressing decisions that
exploits semantic web standards means, in practice, creating
a set of ontology modules that can be linked in a network,
to be used independently or together in di erent
combinations. The main tools we use for this practical task is the
eXtreme Design ontology engineering methodology and the
notion of Ontology Design Patterns (ODPs), supported by
the ontology development environment NeOn Toolkit6.
6http://www.neon-toolkit.org</p>
      <p>
        Under the assumption that classes of problems in ontology
design can be solved by applying common solutions (as
experienced in software engineering), ODPs can support design
reusability. ODPs can be of several types [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], e.g, focusing
on logical language constructs, architectural issues, naming,
or on the e cient provision of reasoning services. In this
paper we focus on Content ODPs (CPs), which are small or
cleverly modularized ontologies with explicit documentation
of design rationales. CPs can be used as building blocks in
ontology design [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. As an example we describe a CP called
AgentRole. It represents the relation between agents, e.g.,
people, and the roles they play, e.g., manager and
meeting chair. Figure 1 shows the UML diagram7 of the OWL8
building block representing this CP.
      </p>
      <p>
        CPs are collected in di erent catalogues, such as the ODP
portal 9. In addition to their diagrammatic representation,
CPs are described using catalogue-entry elds (c.f. software
pattern templates), such as name, intent, covered
requirements, consequences, and building block, linking to an OWL
realization of the pattern. The requirements an ODP covers
are expressed using Competency Questions (CQs) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], i.e.,
typical natural-language queries.
2.2
      </p>
      <p>eXtreme Design</p>
      <p>
        With the name `eXtreme Design' (XD) we identify an
agile approach to ontology engineering [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In this paper we
focus on XD for CP reuse in ontology design. In XD a
development project is characterized by two sets: (i) the problem
space, composed of the actual modeling issues (local
problems), e.g., to model steps in a decision making process; (ii)
the solution space, made up of reusable modeling solutions,
e.g., a piece of an ontology that models sequences of events
(a CP). Each CP, as well as the local problem, is related to
ontology requirements expressed as CQs or sentences. If a
local problem can be described in terms of the CQs of a CP
then that CP can be reused for building the solution. XD
does not prescribe a speci c method for matching the local
problem to patterns, and at the moment the only tool
support available are search functionalities utilizing the textual
descriptions of the patterns.
      </p>
      <p>
        XD is a test-driven and task-focused approach that
results in highly modular ontologies. The main principles of
XD include the intensive use of CPs, and extensive
collaboration [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The iterative work ow of XD contains 12 steps.
The project is initiated in the rst four steps, which
in7For notation details, see: http://www.topquadrant.com/products/
TB Composer.html
8http://www.w3.org/2004/OWL/
9http://www.ontologydesignpatterns.org
clude, scoping, and requirements engineering (e.g., deriving
the CQs from user stories). In steps ve through nine the
CQs are divided into into small, coherent sets and ontology
modules produced realize those sets of CQs. These steps
include unit tests on each module before its release. The
three nal steps integrate modules into a coherent solution,
focusing on collaboration and integration.
      </p>
    </sec>
    <sec id="sec-5">
      <title>ONGOING WORK</title>
      <p>In this section we describe our ongoing e orts and how
we apply the XD methodology to support these e orts. We
proceed in a bottom-up fashion, starting from the use cases
and deriving requirements for a representation format that
can be realized as ontology modules based on ODPs.
However, we have also encountered a number of cases where this
leads to the development of general ODPs themselves.
3.1</p>
    </sec>
    <sec id="sec-6">
      <title>Use Cases</title>
      <p>Use cases are in our context general scenarios,
horizontal with respect to application domains (i.e., they are
represented in multiple domains), where the envisioned
decision format can give some substantial bene t. So far, ve
use cases have been identi ed (the list is continuously
extended). The use cases are intended to be general and not
domain speci c, in terms of industry domain. Their detailed
description, including resulting requirements in the form of
CQs can be found in the Incubator wiki10. Background and
related work for two of the use cases are described more in
depth in Sections 3.1.1 and 3.1.2.</p>
      <p>Measuring Information Flow - Where a decision
process representation can help answering questions
such as `When did a certain process begin and end?',
`How much time was spent on a certain step in the
process?', and `What is the average time for making a
certain type of decision?'.</p>
      <p>
        Linked Data Supporting Decisions - Where linked
data [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] supports decision making, and a decision
representation format could help answer questions such
as `What data support this decision?', `What were the
options and the criteria used for this decision?', and
`How were the options assessed?'
Automatic Assessment of Options - Where a
decision format is intended to support semi-automatic
decision making by automatic assessment of options
through some metric. In this case questions are for
instance `What are the metrics for this decision and to
what options do they apply?', `What are the relative
weights of di erent metrics?', and `How will the
metrics be combined to generate an overall assessment?'
Interoperability - For example, a shared decision
representation can support interoperation between
different command and control units and between
decision makers and people implementing decisions.
Situational Awareness - A representation of
decisions and the decision-making process can support
systems and/or organizations to be aware of the
decision status, to identify situations, such as the
situation when important information is missing, and to
10http://www.w3.org/2005/Incubator/decision/wiki/Final Report
Use Cases
base new decisions on the collected knowledge in the
recorded decisions of the organization.
3.1.1
      </p>
      <sec id="sec-6-1">
        <title>Measuring Information Flow</title>
        <p>
          Research shows that an analytical solution of information
velocity is intractable but metrics that support the
understanding of information ow can be useful [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. An
agentbased model for information ow can be used to
characterize physical analogs to causal measures [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. In this use case,
interactions and exchanges can be modeled as physical
properties. Information, its suppliers, and consumers are then
treated as agents. The behavior of the agents and system as
a whole can be discussed and infodynamic analogs of
thermodynamic and other physical quantities associated with
these processes could be explored [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. The use of
conceptual analogs from the physical domain implies the viability
of future ontologies to characterize information ow.
3.1.2
        </p>
      </sec>
      <sec id="sec-6-2">
        <title>Automatic Assessment of Options</title>
        <p>
          Design considerations have been described and
exemplied for implementing a decision-acquisition system based on
a CDEP [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. CDEP is an XML- and REST-based protocol
for representing generic human decisions in a simple,
interoperable format. The characteristics of decisions can be
expressed using CDEP and its proposed XML format [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. The
CDEP concepts will be considered, and enhanced, within
the currently envisioned decision format, and a conversion
XSLT stylesheet will enable interoperability across these
formats as needed. The use case ontology would allow for the
consideration of multiple data sources, multiple decision
options, and the tracking of decision con dence throughout the
decision-making process.
3.2
        </p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Decision Patterns</title>
      <p>The decision patterns include concrete decision format
components, as well as generic patterns, hence, both:
The ontology modules that we propose as a starting
point for creating a standard in this eld,
and the more general ODPs that we discover and
develop as a result of this e ort.</p>
      <p>The rst module draft that was produced corresponds to the
use case of `Measuring Information Flow' listed above. This
ontology module is a specialization of the Transition ODP11.
In this case we found an ODP already available that we could
specialize and create a speci c decision-process pattern. In
other cases, such as when viewing a decision as a past event,
no `event-pattern' was available in the ODP portal.
Therefore, we are creating general ODPs to be specialized in the
decision ontology modules. By treating general (rather than
domain-speci c) use cases of decision-making, we make sure
that the developed modules are actually reusable patterns,
rather than a solution tailored to one speci c application.
All decision patterns will be implemented in RDF/OWL.
Eight patterns are identi ed so far, but need to be created.
Four examples are described below:</p>
      <p>A `Statement with variable'-pattern, to describe queries,
such as the question underlying a decision.
`Filter' and `Aggregation'-patterns, where a lter would
represent criteria applicable to some data, e.g., a set
11http://ontologydesignpatterns.org/wiki/Submissions:Transition
of options, and an aggregation would represent a way
to combine data, e.g., grouping options.</p>
      <p>A `Normalization'-pattern that models transformations
of values into a common scale, for comparing options.
A `Weighting'-pattern to express the relative
importance of data, e.g., weighting of assessment criteria.
3.3</p>
    </sec>
    <sec id="sec-8">
      <title>Proof-of-concept Application</title>
      <p>
        To verify the requirements and the ontology modules, and
to demonstrate the usefulness of such a format, a
demonstration system is being developed at the Space and Naval
Warfare Systems Center Paci c. Initially, the system will focus
on enabling decision making using open linked data sets [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
The user has four modules, or screens. In the Topic screen,
the user enters the key question of the decision, keywords,
and where the decision result will appear. The keywords
will drive a search for relevant open-linked data sets. Next,
the user selects a data set from which the entries provide a
named set of options. From the Options screen, the user
selects the properties to use as metrics. On the Metrics screen,
the user selects ltering criteria to reduce the options. The
user can additionally assign weights to the metrics. When
a similar decision is encountered, users can e ciently select
a named set of Options or Metrics to aid reuse of decision
components. A semi-automatic learning process will be
considered for future releases, proposing named sets of options
or metrics found useful to other users, based on
similarity of questions and keywords. On the Assessment screen,
the ltered options appear in an ordered list based on the
weighted metrics. The user selects one or more options as
the answer to the decision question. The user is returned
to the Topic screen where the answer(s) is/are recorded and
visible. Throughout the process, the time spent in the
various stages is tracked to assess information ow. Future
versions of this system will support manual entry of decisions,
a more robust set of ltering criteria, integration of multiple
datasets, and mobile applications for e ciency in the eld.
The decision format discussed here will be used to manage
the decision as a whole, and its modular components.
3.4
      </p>
    </sec>
    <sec id="sec-9">
      <title>Experiences</title>
      <p>An important outcome, apart from the requirements and a
proposed decision representation, will be experiences related
to the XD methodology and ODPs. XD has been used in the
project both as a framework for the modelling but also as a
means for teaching ontology engineering to participants less
familiar with semantic technologies. So far we found that
the level of detail of the XD methodology is highly bene
cial for teaching ontology engineering to novice modelers. It
introduces an intuitive way of scoping the problem, through
modularization, and it allows the modeler to draw on
previous experiences of others through ODPs. We envision that
the project will bene t the further development of XD, and
XD will be validated through valuable experiences.</p>
    </sec>
    <sec id="sec-10">
      <title>OUTLOOK</title>
      <p>In September 2010, the project reached its half-way point
and should be completed by the end of March 2011. By
that time the project will have a set of requirements for a
potential decision-representation standard, i.e., the use cases
(initial set in Section 3.1), and a rst draft of such a
representation, i.e., the decision patterns (initial ideas in Section
3.2). We intend to submit any patterns developed (both
general and speci c to decision-making) to the ODP portal.
We expect to present a set of proof-of-concept applications
(see Section 3.3). These applications will show the
potential of our draft patterns. The applications will be used to
validate our results against current practices in di erent
domains, e.g., to validate the hypothesis that linked data are
suitable to support decision making and that automatic
assessment of options is possible in certain use cases. During
the project, we will make the problems and possible
solutions visible in di erent communities, e.g., the semantic web
community, domain speci c interest groups, and standards
organizations. We envision that at the end of the project
we can propose a standardization e ort in the context of
W3C. We can pursue several use cases and application ideas
as separate research projects.
5.</p>
    </sec>
    <sec id="sec-11">
      <title>ACKNOWLEDGMENTS</title>
      <p>The authors thank the O ce of Naval Research for their
support of this work. This paper is the work of U.S.
Government employees performed in the course of their employment
and no copyright subsists therein.
6.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Heath</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          .
          <article-title>Linked Data - The Story So Far</article-title>
          .
          <source>International Journal on Semantic Web and Information Systems</source>
          ,
          <volume>5</volume>
          (
          <issue>3</issue>
          ):1{
          <fpage>22</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>E. Blomqvist.</surname>
          </string-name>
          <article-title>OntoCase-Automatic Ontology Enrichment Based on Ontology Design Patterns</article-title>
          .
          <source>In ISWC</source>
          <year>2009</year>
          , 8th International Semantic Web Conference, volume
          <volume>5823</volume>
          <source>of LNCS</source>
          , pages
          <volume>65</volume>
          {
          <fpage>80</fpage>
          , Washington, DC, November
          <year>2009</year>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          .
          <article-title>Ontology Design Patterns</article-title>
          . In Handbook on Ontologies, 2nd Ed.,
          <source>International Handbooks on Information Systems</source>
          . Springer,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gruninger</surname>
          </string-name>
          and
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Fox</surname>
          </string-name>
          .
          <article-title>The role of competency questions in enterprise engineering</article-title>
          .
          <source>In Proceedings of the IFIP WG5.7 Workshop on Benchmarking - Theory and Practice</source>
          ,
          <year>1994</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Daga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          , and
          <string-name>
            <surname>E. Blomqvist.</surname>
          </string-name>
          <article-title>eXtreme Design with Content Ontology Design Patterns</article-title>
          .
          <source>In Proc. of WOP</source>
          <year>2009</year>
          ,
          <article-title>collocated with ISWC-2009</article-title>
          , volume
          <volume>516</volume>
          . CEUR Workshop Proceedings, November
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Waters</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ceruti</surname>
          </string-name>
          .
          <article-title>Modeling and simulation of information ow: A study of infodynamic quantities</article-title>
          .
          <source>In Proc. of the 15th International Command and Control Research and Technology Symposium (ICCRTS</source>
          <year>2010</year>
          ), Santa Monica, CA,
          <year>June 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Waters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ceruti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Patel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Eitelberg</surname>
          </string-name>
          .
          <article-title>Decision-acquisition system based on a common decision-exchange protocol</article-title>
          .
          <source>In Proc. of the 15th International Command and Control Research and Technology Symposium (ICCRTS</source>
          <year>2010</year>
          ), Santa Monica, CA,
          <year>June 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Waters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Patel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Eitelberg</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Ceruti</surname>
          </string-name>
          .
          <article-title>Information velocity metric for the ow of information through an organization: Application to decision support</article-title>
          .
          <source>In Proc. of the 14th ICCRTS (ICCRTS</source>
          <year>2009</year>
          ), Washington, DC,
          <year>June 2009</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>