<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Sensemaking Tools for
Understanding Research Literatures: Design, Implementation and User Evaluation. Int. Jnl. Human
Computer Studies</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Knowledge Federation as Hypermedia Discourse</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Simon Buckingham Shum</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Knowledge Media Institute, The Open University</institution>
          ,
          <addr-line>Milton Keynes, MK7 6AA</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2008</year>
      </pub-date>
      <volume>64</volume>
      <issue>5</issue>
      <fpage>20</fpage>
      <lpage>22</lpage>
      <abstract>
        <p>The motivation behind the concept of Knowledge Federation resonates closely with the orientation of the Hypermedia Discourse project1 and the Knowledge Cartography focus of a forthcoming book.2 We are concerned with the co-evolution of new tools and practices for “bringing together” ideas, sharing the KF orientation that meaning is always contextualised, that truth is often contested, and that social processes are central to the task of meaning-making in non-trivial domains. We try to add a sharper focus to what is meant by “social processes” by focusing specifically on the form of discourse by which problems are framed, and meaning is constructed in teams of analysts, e.g. deliberation over alternatives, dialogue seeking common ground, or rational debate and argumentation. Our work thus draws on the conceptual foundations offered by fields such as argumentation, cognitive coherence relations and organisational sensemaking. Hypermedia points to the engineering and aesthetics of managing webs of meaningful connections as visualizable networks of claims, issues, potential solutions, evidence, and so forth. One of our Hypermedia Discourse tools is Compendium3 which has an established user community whom we support online and with an annual workshop, and around which has developed a relatively well developed set of practices for effective use in sensemaking.4 A recently launched tool is Cohere5 which is a Web 2.0 platform for making connections between ideas, including argumentation. We are designing Cohere to be as open as possible, interoperable and extensible via REST services and web feeds. These tools are finding application in a wide ranging contexts, with sensemaking around climate change being a particular focus of our current efforts.6 The remainder of this paper introduces KF participants to our orientation to our shared concerns. It opens with a recent keynote address7 which motivated the concept of Hypermedia Discourse, followed by a more detailed description of the rationale behind the design of the Cohere web application.8</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Hypermedia Discourse:</title>
    </sec>
    <sec id="sec-2">
      <title>Contesting Networks of Ideas and Arguments</title>
      <sec id="sec-2-1">
        <title>Simon Buckingham Shum</title>
        <p>Knowledge Media Institute, The Open University, Milton Keynes, UK
www.kmi.open.ac.uk/sbs
Abstract. This invited contribution motivates the Hypermedia Discourse
research programme, investigating the reading, writing and contesting of ideas
as hypermedia networks grounded in discourse schemes. We are striving for
cognitively and computationally tractable conceptual structures: fluid enough
to serve as augmentations to group working memory, yet structured enough to
support long term memory. I will describe how such networks can be (i)
mapped by multiple analysts to visualize and interrogate the claims and
arguments in a literature, and (ii) mapped in real time to manage a team's
information sources, competing interpretations, arguments and decisions,
particularly in time- pressured scenarios where harnessing collective
intelligence is a priority. Given the current geo-political and environmental
context, the growth in distributed teamwork, and the need for multidisciplinary
approaches to wicked problems, there has never been a greater need for
sensemaking tools to help diverse stakeholders build common ground.</p>
        <sec id="sec-2-1-1">
          <title>1 Introduction</title>
          <p>I want to talk about the challenge of our generation. […] Our challenge, our
generation’s unique challenge, is learning to live peacefully and sustainably in an
extraordinarily crowded world. [...] The way of solving problems requires one
fundamental change, a big one, and that is learning that the challenges of our
generation are not us versus them, they are not us versus Islam, us versus the
terrorists, us versus Iran, they are us, all of us together on this planet against a set of
shared and increasingly urgent problems. [...] But we are living in a cloud of
confusion, where we have been told that the greatest challenge on the planet is us
versus them, a throwback to a tribalism that we must escape for our own survival.</p>
        </sec>
      </sec>
      <sec id="sec-2-2">
        <title>Jeffrey Sachs: 2007 Reith Lectures: http://www.bbc.co.uk/radio4/reith2007</title>
        <p>With these “minds”, a person will be well equipped to deal with what is expected, as
well as with what cannot be anticipated; without these minds, a person will be at the
mercy of forces that he or she can’t understand, let alone control. [...] The disciplined
mind… the synthesizing mind… the creating mind… the respectful mind… the ethical
mind.</p>
      </sec>
      <sec id="sec-2-3">
        <title>Howard Gardner: Five Minds for the Future. Harvard Univ. Press, 2006: p.2</title>
        <p>The context in which we find ourselves presents problems on a global scale which
will require negotiation and collaboration across national, cultural and intellectual
boundaries. At the same time we are in a climate which questions claims to
knowledge, and in which the quality of discourse is often poor. This, I suggest,
presents both major challenges and unique opportunities for us as a community
dedicated to understanding how to provide computational support for negotiating the
construction of coherent, conceptual structures. We have choices about the kinds of
problems we work on, the way in which we do our modelling, and the functionalities
of the systems we offer. What do we have to offer?</p>
        <p>My thesis is that part of the solution could be discourse-oriented tools to help
capture, comprehend, and manage competing interpretations and arguments for
action. There is a particular need to provide languages for communities to agree and
disagree in principled ways. This paper considers the challenge of evolving
interactive tools that are flexible enough to mediate and capture discourse between
stakeholders with different perspectives, yet introduce sufficient structure to provide
computational services. The Hypermedia Discourse research programme1 is focused
on co-evolving the semantics, user interfaces, technical infrastructure, and human
work practices to embed such tools in highly pressured, real time sensemaking
scenarios, face-to-face and over the internet, as well as to support extended,
asynchronous discourse lasting from a few days to many years.</p>
      </sec>
      <sec id="sec-2-4">
        <title>Discourse means different things in different fields. It is used here in a broad sense</title>
        <p>
          to cover the diversity of verbal and written workplace communication that we want to
support, which would include the framing of problems, review of solutions, and
argumentation. Discourse communities refers to communities of practice [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] and
other networks of people who “make and take perspectives” [
          <xref ref-type="bibr" rid="ref2 ref32">2</xref>
          ].
        </p>
        <p>
          The paper is organised as follows. I start by motivating the need for tools to assist
with sensemaking in socially complex scenarios, in particular, to manage discourse
when tackling wicked problems [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. The attributes required of tools to support the
expression, exploration and contesting of perspectives in shifting, contentious
domains defines a new class of tool for Hypermedia Discourse. The Compendium
methodology and tool is then introduced as a relatively mature exemplar, before
concluding with directions for future research.
        </p>
        <sec id="sec-2-4-1">
          <title>2 Sensemaking</title>
          <p>
            The world, indeed our lives, make sense to the extent that we can sustain a coherent
narrative about who we are and why we matter. If the story fragments, our identity
crumbles if we cannot re-integrate it into our narrative [
            <xref ref-type="bibr" rid="ref3 ref33">3</xref>
            ]. When we are confronted
by breaches in normality, Karl Weick draws our attention to sensemaking as literally
“the making of sense”: sharing interpretations using different representations of the
situation. He proposes that: Sensemaking is about such things as placement of items
into frameworks, comprehending, redressing surprise, constructing meaning,
interacting in pursuit of mutual understanding, and patterning. [
            <xref ref-type="bibr" rid="ref30">30</xref>
            ], p.6
          </p>
        </sec>
      </sec>
      <sec id="sec-2-5">
        <title>1 Hypermedia Discourse project: http://kmi.open.ac.uk/projects/hyperdiscourse</title>
        <p>
          Weick’s concern is to characterise what people do in socially complex situations,
when confronted by incomplete evidence and competing interpretations : The point
we want to make here is that sensemaking is about plausibility, coherence, and
reasonableness. Sensemaking is about accounts that are socially acceptable and
credible. […] It would be nice if these accounts were also accurate. But in an
equivocal, postmodern world, infused with the politics of interpretation and
conflicting interests and inhabited by people with multiple shifting identities, an
obsession with accuracy seems fruitless, and not of much practical help, either. [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ],
p.61
        </p>
      </sec>
      <sec id="sec-2-6">
        <title>In other words, when there is uncertainty, what else is there to do but through discourse, construct a narrative to fill in the gaps?</title>
        <sec id="sec-2-6-1">
          <title>3 Argumentative Discourse</title>
          <p>
            Sensemaking wrestles with conflicting interpretations, tracks technical facts with
emerging issues and ideas as the problem is reframed, and tries to reconcile
sociopolitical arguments. This is a formidable functional requirements specification for a
software tool to satisfy. Elsewhere [
            <xref ref-type="bibr" rid="ref34 ref35 ref4 ref5">4, 5</xref>
            ] we trace the work of design and policy
planning theorist Horst Rittel, whose characterisation in the 1970’s of “wicked
problems” has continued to resonate since: Wicked and incorrigible [problems]...defy
efforts to delineate their boundaries and to identify their causes, and thus to expose
their problematic nature. [
            <xref ref-type="bibr" rid="ref22">22</xref>
            ]
          </p>
          <p>
            Rittel concluded that many problems confronting policy planners and designers
were qualitatively different to those that could be solved by formal models or
methodologies, classed as the ‘first-generation’ design methodologies. Instead, an
argumentative approach to such problems was required: First generation methods
seem to start once all the truly difficult questions have been dealt with.
…[Argumentative design] means that the statements are systematically challenged in
order to expose them to the viewpoints of the different sides, and the structure of the
process becomes one of alternating steps on the micro-level; that means the
generation of solution specifications towards end statements, and subjecting them to
discussion of their pros and cons. [
            <xref ref-type="bibr" rid="ref22">22</xref>
            ]
          </p>
        </sec>
      </sec>
      <sec id="sec-2-7">
        <title>This intersects with Doug Engelbart’s 40+ year mission to develop software tools</title>
        <p>
          to augment human intellect, our “collective capability for coping with complex,
urgent problems” [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Our work in a variety of domains has led to the definition of a
class of ‘augmentation system’ to assist argumentative design in Rittel’s terms, and
other modes of workplace discourse more broadly.
        </p>
        <sec id="sec-2-7-1">
          <title>4 Hypermedia Discourse</title>
        </sec>
      </sec>
      <sec id="sec-2-8">
        <title>Discourse modelling is at once both useful and limited. It is limited in the sense that,</title>
        <p>like any model, it captures only key features of the world’s richness, in our case, the
richness of textual prose and verbal discourse.2 However – if done appropriately –
stripping out detail to focus on underlying structure can yield cognitive,
computational and theoretical benefits:
• Cognitive: a well designed external representation exploits the human perceptual
and cognitive system to direct attention to relevant information;
• Computational: a formal model also provides machines with structure to reason
with;
• Theoretical: the removal of detail may assist in identifying generalisable patterns
across diverse contexts (see discussion of Cognitive Coherence Relations later).</p>
        <p>The function of a medium is to make it possible for people to express, and work
with, structure. Sensemaking calls for a particular kind of discourse, expressed
through one or more media. Hypermedia can be thought of as the craft, art, science
and engineering of managing structure, specifically, relationships, making it the
primary discourse modelling medium for several reasons:
• Modelling discourse relations: an utterance only has meaning in a context, that is,
when juxtaposed with others before and after it, and in relation to other possible
utterances that make its selection significant.
• Expressing different perspectives on a conceptual space: diverse stakeholders
are usually needed to define and resolve wicked problems, so support tools need to
provide support for modelling flexibly, to show agreements and differences
between viewpoints.
• Supporting the incremental formalization of ideas: as understanding develops,
so that patterns can be captured using representations that are intuitive, fast in real
time usage scenarios, and expressive enough to enable computational support.
• Rendering structural visualizations: to assist users in grasping complex
interconnections between ideas and information.
• Connecting heterogeneous content: the content that stakeholders refer to during
sensemaking can range from media fragments which offer little or no obvious
structure, to material sufficiently structured to support forms of machine reasoning;
similarly, relationships may range from associations expressed spatially or as
untyped links, to being formally grounded in a known semantic schema.
4.1 Key Characteristics
Bringing these concepts together, we can define a class of tools designed to model
discourse as hypermedia networks, with the objective of making the process and
product of discourse tangible and manipulable through the combination of:
• A discourse ontology: A set of explicit constructs that express a subset of the
richness of human verbal or written communication. An example (discussed</p>
      </sec>
      <sec id="sec-2-9">
        <title>2 As described later, there are ways to compensate for the terseness of modelling by integrating</title>
        <p>
          source texts, audio and video as richer resources for humans (and possibly machines) to
supplement the discourse model.
below) is IBIS; another that we have been developing is the ScholOnto discourse
schema [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ].
• One or more notations: Symbol system(s) for rendering the ontology. For
instance, IBIS can be rendered as a textual outline, and as a directed graph flowing
from left to right, or from top to bottom. Each has different affordances which can
complement each other as coupled visualizations.
• An intuitive user interface: These tools are intended for knowledge workers in
diverse sectors of society, not only for discourse modellers, knowledge engineers
or information scientists. The notations are therefore just part of designing the
overall cognitive and aesthetic experience of working with the tool.
• Computational services: The above come together as augmentation of human
capability through software implementation. For instance, “services” would
include more efficient capture, interpretation, sharing, retrieval, discovery and
integration of discourse modelled in the ‘knowledge repository’. Interoperability
not only with other relevant tools, but also compatibility with existing work
practices will contribute to the overall service augmentation.
• Literacy and fluency: The tool’s functionality is only part of the story, however.
        </p>
      </sec>
      <sec id="sec-2-10">
        <title>We must also examine the capabilities assumed on the part of the user, which we will do under the heading of literacy, the ability to read and write ideas in the new medium in a manner appropriate to the context, ideally moving towards fluency.</title>
        <sec id="sec-2-10-1">
          <title>5 Compendium</title>
        </sec>
      </sec>
      <sec id="sec-2-11">
        <title>Having defined the key characteristics of a Hypermedia Discourse system, we focus now on the most mature approach we have developed, in terms of its dissemination and breadth of use. This has provided a longitudinal case study to reflect on issues of knowledge technology adoption and practice [9].</title>
      </sec>
      <sec id="sec-2-12">
        <title>Compendium is a dialogical medium for modelling the discourse around problems.</title>
        <p>We are aiming for a tool which in the hands of skilled users, can facilitate the capture
and structuring ideas, not only to model discourse, but also to model problem domains
in a manner that invites and structures contributions, whether this is in a synchronous
or asynchronous discussion. It is optimised for use in what is arguably the most
demanding context of deployment for a knowledge representation tool: real time
collaborative modelling. The software is a free Java application for all platforms,
including the source code. Downloads and other community resources are coordinated
via the not-for-profit Compendium Institute: www.CompendiumInstitute.org
5.1 Ontology</p>
      </sec>
      <sec id="sec-2-13">
        <title>Compendium is a direct descendent of Conklin’s gIBIS prototype [13] and the 1990’s</title>
      </sec>
      <sec id="sec-2-14">
        <title>QuestMap product. Its ontology expresses Rittel’s IBIS and similar Design Rationale</title>
        <p>
          schemes such as MacLean et al’s Questions-Options-Criteria (QOC) [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. The focus
is on capturing key issues, possible responses to these, and relevant arguments. Users
can define their own ontology if they wish, or map concepts in a completely
unconstrained manner. Entities are described in free text, while labels may be free text
or grounded in a predefined scheme. Additional semantics can be expressed textually
by defining one or more Tag groups, which operate as flat keyword spaces, analogous
to web-based tagging, whereby tag combinations can be used to define different
searchable views of the database. Semantics can, additionally, be expressed visually,
either by predefining a palette of icons, or by selecting images to reflect ideas as they
emerge in discussion (eg. from a library, or by searching the Web).
5.2 Notation
Some people use Compendium to support their preferred style of concept mapping
[
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. However, following the gIBIS system, Compendium is designed specifically to
render IBIS as a directed graph, normally with a root issue on the left, with the
structure of the developing conversation about this issue growing to the right of the
screen. User customizable icons distinguish different entities, and link colours with
optional labels indicate relational semantics. Links typically point from right to left, to
reflect the conversational dynamic that new contributions (added to the right)
respond-to existing ones.
        </p>
        <p>
          The discourse-orientation of the approach, and the demands of real time
participatory modelling to capture the progress of meetings, have led to a number of
notational strategies. A root Issue (signalled with a question mark icon) provides
the orientation to a map, establishing the problematic context for the discussion: Why
are we here? To tackle this issue. Two discourse modelling methodologies have
developed around the capabilities of Compendium. Dialogue Mapping is a set of skills
developed by Conklin [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ] for mapping IBIS structures in real time during a meeting
in order to support the analysis of wicked problems, as defined by Rittel. In Dialogue
        </p>
      </sec>
      <sec id="sec-2-15">
        <title>Mapping, Issues are usually unconstrained freetext expressions summarising an agenda item or a participant’s contribution, with Ideas responding to them, and any associated arguments (Fig. 1).</title>
      </sec>
      <sec id="sec-2-16">
        <title>Conversational Modelling [23] incorporates and extends Dialogue Mapping by</title>
        <p>deriving Issues from a modelling methodology (or for instance, an organizational
procedure/best practice). Issue nodes can be saved as reusable issue-template
structures to seed different kinds of discussions. Fig. 2 shows a fragment of one
template, with Idea icons serving as placeholders for responses. These lead to
consequent Issues to be considered (on the right).</p>
        <p>In addition, the modelling methodology specifies that the placeholder Ideas appear
in three different views, indicated by the numeral 3 on each Idea icon. Rolling the
mouse over this numeral displays a menu of hyperlinks to these other views. When
views are labelled informatively, this facility provides rich context at a glance to the
different ‘conversations’ in which a node is being discussed. Node label
autocompletion assists the reuse of these granular chunks, offering users a menu of
existing nodes which they can select from as they type.</p>
      </sec>
      <sec id="sec-2-17">
        <title>With the addition of catalogues of reusable nodes, metadata tagging and multiple linked issue-templates, Compendium provides generic building blocks to construct a discourse-oriented modelling environment for team deliberation (Tate et al [28] document the customisation of Compendium in an hour from receipt of a planning</title>
        <p>methodology). Conversational Modelling enables the real time capture of both
expected, well-structured information through the use of issue templates, with the
flexibility to capture unexpected, ad hoc information and discussions as they arise.</p>
      </sec>
      <sec id="sec-2-18">
        <title>From a more formal knowledge representation perspective, we represent semantics</title>
        <p>using a variety of conventions. In a NASA field trial (Fig. 3), science metadata was
represented using templates which look like visual forms, with each Issue inviting the
team to answer (or if necessary debate) the values of the ‘slots’.</p>
        <p>An issue-template such as this provides a user-friendly way to engage in
participatory modelling which permits argumentation if necessary, and results in a set
of semantic assertions amenable to automated analysis (data entry into a simulation
engine in this case). Each Issue in fact embodies the relational semantic connecting its
answer to the entity represented by the containing map. However, rather than ask the
team to complete sets of semantic triples, they are offered a set of question mark icons
to which they need to link lightbulb icons. Thus, Fig. 2 provides an interface to elicit</p>
        <p>Fig. 3. The science team completes a template which will be later read by a software agent
the structured assertion &lt;user’s answer&gt; will_be_affected_by &lt;emerging problem
1&gt;, while FIG. 3 will elicit &lt;WorkSiteWater&gt; hasPerformer &lt;user’s answer&gt;.</p>
      </sec>
      <sec id="sec-2-19">
        <title>Relational semantics are also expressed in the link types, but for speed – a key</title>
        <p>requirement in real time mapping under pressure – link types are set to be unlabelled
by default, with the semantics loaded on the nodes’ iconic language. Every link can be
classified and labelled if desired using the default IBIS linkset, or a user defined
linkset.
5.3 Intuitive User Interface
There are many improvements that could be made to Compendium, but as the
preceding figures show, it looks familar to users of concept mapping or graph-editing
applications. It comes with IBIS preloaded, and hypermedia functionality which
makes it simple to (i) create navigational links to a given database view, and (ii) reuse
a hypertext node simultaneously in different views by copying and pasting. A
keyword tagging scheme combined with search assists with filtering nodes across
many maps.</p>
      </sec>
      <sec id="sec-2-20">
        <title>Complete beginners can learn to map simple but well-formed IBIS structures after</title>
        <p>working through a tutorial on the Compendium Institute website. End users can
express quite sophistcated data and relationships without needing to perform
complicated technical actions or remember arcane commands. The user feedback on
the website reflects the personal sense of satisfaction that users have with the tool.
5.4 Computational Services</p>
      </sec>
      <sec id="sec-2-21">
        <title>We earlier defined “services” as the set of affordances at the intersection of ontology,</title>
        <p>notation, user interface, and the human and machine reasoning these enable.</p>
      </sec>
      <sec id="sec-2-22">
        <title>Compendium’s display has a number of visual affordances which enable one to read</title>
        <p>off information about the state of an analysis that is not immediately obvious, either in
conventional text documents or other concept mapping approaches. This includes
unresolved issues, competing ideas, the extent to which explicit evidence is used to
back ideas, and the ‘depth’ of node reuse and tagging (an indicator of the degree of
modelling utilised).</p>
        <p>
          When Compendium is interfaced to other tools, its database can be automatically
populated or reasoned about. Examples include the use of software agents to
autonomously read data and pass this to a simulation and planning engine, and also to
populate the database with multimedia data for subsequent analysis by scientists [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ];
the exchange of issues with a planning tool which could analyse the option space
exhaustively or raise new issues [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]; the export of populated issue templates to
different notational formats for other stakeholders to work on [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ].
        </p>
        <p>
          Most recently, we have automated the exchange of Compendium data with an RDF
triplestore, in order to deliver a video conferencing capture and semantic replay tool
[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. Fig. 4 illustrates the complementary use of video from meetings to ‘fill in the
gaps’ that a terse conceptual graph cannot possibly express; conversely, Compendium
provides semantic indexing within and across meetings, enabling users to jump to the
point in a meeting when, for instance, an argument was made.
5.5 Literacy and Fluency
Advanced tools are more effective when used expertly. The concept of services must,
therefore, be qualified by the degree of literacy and fluency that the user brings. Our
research agenda is directed towards understanding the whole learning curve
associated with reading and writing in this new medium. We have analysed the
cognitive tasks that a beginner must learn [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] and there are training programmes to
help with initial adoption of the tool, but equally, we need to characterise expert,
‘fluent’ use of the tool in the most demanding contexts we work in, namely,
supporting real time sensemaking in time pressured teams (e.g. [
          <xref ref-type="bibr" rid="ref10 ref28">10, 28</xref>
          ]).
        </p>
      </sec>
      <sec id="sec-2-23">
        <title>Constructing a language for fluency should help to expand the boundaries of expertise, improve the apprenticing of new practitioners, foreground new functionalities that the tool should provide, and illuminate an emerging literacy in this new medium.</title>
      </sec>
      <sec id="sec-2-24">
        <title>Selvin [24, 25] has begun to explore the nature of fluency in what he terms</title>
      </sec>
      <sec id="sec-2-25">
        <title>Participatory Hypermedia Construction. Detailed analysis of screen recordings from teleconferences and face-to-face meetings is providing an account of the representational moves that Compendium mappers make, and the different roles they can play in meetings.</title>
        <sec id="sec-2-25-1">
          <title>6 Semantic Scholarly Publishing and Annotation</title>
        </sec>
      </sec>
      <sec id="sec-2-26">
        <title>A second instantiation of the Hypermedia Discourse concept is the suite of tools</title>
        <p>developed in the Scholarly Ontologies project.3 Unlike Compendium, which simply
offers Web exports and supports the embedding of websites in IBIS conversational
models, these tools were conceived from the start as distributed Web applications.</p>
      </sec>
      <sec id="sec-2-27">
        <title>The design rationale is the need for representational infrastructure to evolve the</title>
        <p>current prose document and associated practices for publishing and contesting
research results and – equally significant – authors’ interpretations of their
significance. Within current research into ‘e-Science’ (UK) and
‘Grid/cyberinfrastructure’ (USA), this is a neglected part of the scholarly lifecycle,
which is ironic: we engage in research in order to substantiate knowledge level claims.
Perhaps, however, the absence of activity in this latter stage of research should not
surprise us, because we are of course dealing with the difficult issue of computational
support for an intrinsically pragmatic process, by which a discourse community (in
this case, research peers) negotiates what some reported facts should be taken to
mean. The emerging Pragmatic Web community has as a primary focus the interplay
between formal representation and context, conversations and commitments to action,
and it will be interesting to see how this takes shape.</p>
      </sec>
      <sec id="sec-2-28">
        <title>We detail elsewhere [27, 29] the design and evaluation of ClaiMaker and the</title>
        <p>
          associated suite of tools for authoring (ClaiMapper), querying (ClaimFinder) and the
collaborative, semantic annotation (ClaimSpotter) of research claims and
argumentation. These are less mature than Compendium, proof of concept research
tools which are not publicly available. Space precludes as detailed a treatment as
Compendium, but ClaiMaker’s ‘hypermedia discourse profile’ below conveys the
essence of the approach:
• Discourse ontology: A two-layer relational taxonomy which provides base
relational classes in which ‘dialects’ from different discourse communities are
grounded (Fig. 5).
• Notation: A conceptual graph of claims that can be visualized using different
schemes to show discourse connections between concepts annotated onto the
literature.
• User interface: We have investigated a variety of interaction paradigms for
annotation tools, in order to help untrained users create semantic annotations.
• Computational services: The use of a richer discourse scheme than IBIS
enables us to offer more powerful services. For instance, the semantic citation
maps can be filtered in response to queries such as, What documents report data
that challenges this author’s hypothesis?What is the lineage of this concept: the
key ideas on which this work builds? (Fig. 6)
• Literacy and fluency: Being less mature than Compendium, we do not yet
have a large enough user community to provide a good description of what it
means to read and write such argumentative networks, particularly beyond
initial learning. Our empirical studies provide insight into how untrained and
more expert users construct and query claim networks [
          <xref ref-type="bibr" rid="ref27 ref29">27, 29</xref>
          ].
        </p>
      </sec>
      <sec id="sec-2-29">
        <title>3 Scholarly Ontologies project: http://kmi.open.ac.uk/projects/scholonto</title>
        <sec id="sec-2-29-1">
          <title>7 Conclusions and Future Work</title>
        </sec>
      </sec>
      <sec id="sec-2-30">
        <title>The complexity of the dilemmas we face at an organizational, societal and global</title>
        <p>scale forces us into sensemaking activity. The requirements on tools to support such
work have motivated basic and applied action research into a new class of
Hypermedia Discourse tool to mediate, structure and augment the expressing and
contesting of perspectives that may agree and disagree in principled ways. Such tools
are hybrids borrowing from concept mapping, information visualization, discourse
relations and decision-support. We need tools flexible enough for real time use in
meetings, structured enough to help manage longer term memory, and powerful
enough to filter the complexity of extended deliberation and debate on an
organizational or global scale.</p>
        <p>
          I suggest that this focus on the intersection of discourse and hypermedia provides
insights into a number of pressing problems:
• We have to talk. The only way that anything is accomplished in this world is by
people talking, building trust and sufficient common ground that they can frame
problems in mutually meaningful ways, and commit to action in mutually
acceptable ways. The challenge for a community such as ours is understand how to
weave software support into the social fabric without ripping it, but possibly in the
process, enriching that fabric to exploit the new threads we have to offer. The work
summarised here points to possible ways to evolve network-native infrastructures
for synchronous and asynchronous discourse, that step out of the shadow of the
printing press and conventional meetings (building on their strengths, but
transcending their limitations).
• Modelling in the absence of consensus. Knowledge-based systems (including for
our purposes the data models and ontologies underpinning the Semantic Web)
encapsulate consensus models of the problem domain, and how to reason about it.
How can we provide computational services in the absence of consensus, when one
group’s assumption is another group’s problem? This is the domain of discourse,
especially argumentation, in which we provide a language for stakeholders to agree
and disagree in principled ways. Compendium uses a semiformal network
representation optimised for real time use. ClaiMaker uses finer grained semantics
for modelling asynchronously in a more detailed manner.
• Negotiating the knowledge capture bottleneck. In knowledge engineering, but
also in less formal approaches to Knowledge Management (KM), Organizational
Memory and Design Rationale (DR), the cost/benefit tradeoff must be negotiated
to acquire useful abstractions of naturally occurring activity, and experts’
descriptions thereof. The Compendium approach emphasises the collaborative
modelling of information, ideas and argument in order to add immediate value to
the users (useful working memory), as well as seeding the long term memory
required for KM. This has, for instance, provided a way of tackling the DR capture
bottleneck [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
      </sec>
      <sec id="sec-2-31">
        <title>Future work will continue to co-evolve tools and practices, study the skills</title>
        <p>
          associated with high performance discourse modelling, and develop conceptual
frameworks that recognise the complexity of modelling, mediating and mapping real
discourse about wicked problems. Specific challenges we are working on include:
• Distributed, online apprenticeship in hypermedia discourse. The Compendium
community now has members who are recognised ‘expert mappers’, but they are a
scarce resource. A very applied concern is how to use the internet to spread this
literacy through the creation of e-learning resources and ‘e-apprenticeship’.
• Social networks and folksonomic tagging. Behind a conceptual structure are
people. We are integrating our social networking tools with our conceptual
networking tools to support Open Sensemaking Communities, learners and
educators who must self-organise around open source learning resources, but by
extension, any epistemic community on the internet. Based on the ScholOnto
project, we have prototyped and formatively evaluated a next generation social
bookmarking tool for linking tags via discourse connectives, moving from the
annotation of isolated keywords on web reosources, to a mode knowledge
construction and negotiation: from tag clouds to tag webs [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ].
• Hypermedia discourse engines as computational theory. We are investigating
the potential of modelling and reasoning over an upper level relational ontology,
derived from linguistics coherence relations research [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. If it is the case that we
perceive ‘coherence’ in a medium because it structures elements according to a
small, bounded set of relational primitives, then it should be possible to model and
reason over such structures in a manner which is ‘coherent’ across different
domains of discourse, languages and even cultures. Such an engine would be a
formal expression, and test, of the hypotheses generated by this theory.
        </p>
      </sec>
      <sec id="sec-2-32">
        <title>To return to our opening quote from Gardner’s Five Minds for the Future, perhaps</title>
        <p>Hypermedia Discourse tools provide a way to move fluidly between the different
minds: a way to provide representational scaffolding for disciplined modelling, but
permitting the creative breaking of patterns when needed and the forging of new
syntheses; a way to show respect for diverse stakeholders’ concerns by explicitly
integrating them into the conversation; a way to bring into an analysis ‘messy’
requirements such as ethical principles, as well as hard data and constraints. We have
some evidence from our case studies that we’re on the right track, but there remains
much to do.</p>
      </sec>
      <sec id="sec-2-33">
        <title>Acknowledgements. I am grateful to Al Selvin, Clara Mancini, Jack Park and David</title>
      </sec>
      <sec id="sec-2-34">
        <title>Kolb whose comments improved earlier versions of this paper. The evolution of</title>
      </sec>
      <sec id="sec-2-35">
        <title>Compendium has been a long term action research programme with Al Selvin,</title>
      </sec>
      <sec id="sec-2-36">
        <title>Maarten Sierhuis and Jeff Conklin, with programming by Michelle Bachler. Its</title>
        <p>development has been funded by the UK’s research councils EPSRC, ESRC and</p>
      </sec>
      <sec id="sec-2-37">
        <title>JISC. The Meeting Replay tool is joint work with the Universities of Manchester and</title>
      </sec>
      <sec id="sec-2-38">
        <title>Southampton as part of the JISC Memetic project. The Scholarly Ontologies project</title>
        <p>was funded by the EPSRC, and is the product of work with Victoria Uren, Gangmin</p>
      </sec>
      <sec id="sec-2-39">
        <title>Li, Clara Mancini, Bertrand Sereno, Enrico Motta and John Domingue. The William</title>
        <p>and Flora Hewlett Foundation is now supporting the work through the Open</p>
      </sec>
      <sec id="sec-2-40">
        <title>University’s OpenLearn initiative.</title>
        <p>Cohere: Towards Web 2.0 Argumentation</p>
        <p>Simon BUCKINGHAM SHUM*</p>
        <p>Knowledge Media Institute, The Open University, UK
Abstract: Students, researchers and professional analysts lack effective tools to
make personal and collective sense of problems while working in distributed teams.</p>
        <p>Central to this work is the process of sharing—and contesting—interpretations via
different forms of argument. How does the “Web 2.0” paradigm challenge us to
deliver useful, usable tools for online argumentation? This paper reviews the
current state of the art in Web Argumentation, describes key features of the Web
2.0 orientation, and identifies some of the tensions that must be negotiated in
bringing these worlds together. It then describes how these design principles are
interpreted in Cohere, a web tool for social bookmarking, idea-linking, and
argument visualization.
1. Introduction: The Need for Distributed, Collective Sensemaking Tools
The societal, organizational, scientific and political contexts in which we find ourselves
present problems on a global scale which will require negotiation and collaboration
across national, cultural and intellectual boundaries. This, I suggest, presents both
major challenges and unique opportunities for us, as the community dedicated to
understanding computational support for argumentation: our challenge is to work with
relevant stakeholders to co-evolve new practices with flexible, usable tools for
communities to express how they agree and disagree in principled ways, as part of
building common ground and mutual understanding.</p>
        <p>
          While our previous work has focused on the real time mapping of issues, dialogue
and argument in contexts such as e-science teams [
          <xref ref-type="bibr" rid="ref1 ref31">1</xref>
          ] and personnel rescue [
          <xref ref-type="bibr" rid="ref2 ref32">2</xref>
          ], this
paper focuses specifically on the challenge of designing engaging, powerful tools for
distributed, primarily asynchronous work which, in particular, exploits the strengths of
the “Web 2.0 paradigm”. The paper begins by reflecting on the kinds of expectations
that Web users and developers now bring, before surveying the current state of the art
in Web Argumentation tools. We then describe how Web 2.0 principles, as introduced,
have informed the design of a prototype tool called Cohere, concluding with a vision of
how COMMA researchers might extend or interoperate with it as it moves towards a
Web services platform.
*
        </p>
        <p>Correspondence to: Knowledge Media Institute, The Open University, Milton Keynes, MK7 6AA, UK.</p>
        <p>
          Tel: +44 (0) 1908 655723; Fax: +44 (0) 1908 653196; http://kmi.open.ac.uk/people/sbs
2. The Web 2.0 Paradigm
A lot is being written about the Web 2.0 paradigm, a term first dubbed in 2004 [
          <xref ref-type="bibr" rid="ref3 ref33">3</xref>
          ].
While some dismiss it as marketing hype, it does serve as a useful umbrella term to
cover significant new patterns of behaviour on the Web. There are many lists of the key
characteristics of Web 2.0, not all of which are relevant to our concerns (e.g. e-business
models). In this section we select several characteristics for their impact on the user
experience of collective information structuring. Together these present a challenge to
the design of practical Web Argumentation tools, given the expectations that users now
have from their everyday experience of the Web. If we cannot create tools within the
new landscape, argumentation tools will remain a much smaller niche than they should
be — and as this paper seeks to demonstrate, need be.
2.1. Simple but Engaging Multimedia User Interfaces
The World Wide Web has established itself as the default platform for delivering
interactive information systems to professionals and the public. Although early Web
applications lacked the elegance and interactivity of desktop applications due to the
need for the client to communicate every state change to the server, the gap is closing
rapidly with the emergence of good graphic design principles, controlled layout and
stylesheet management, and critically, so-called Rich Internet Applications: interactive
multimedia capabilities such as Adobe Flash embedded as standard browser plugins,
and approaches such as AJAX (Asynchronous JavaScript And XML) for caching local
data to increase the responsiveness of the user interface [
          <xref ref-type="bibr" rid="ref34 ref4">4</xref>
          ]. Users increasingly expect
Web applications to have a clean, uncluttered look, and to be as responsive as offline
tools. Given a choice of Web offerings, the user experience can determine whether or
not a tool is adopted.
2.2. Emergent, Not Predefined, Structure and Semantics
Argumentation focuses on a particular kind of semantic structure for organising
elements. Of central interest, therefore, is the Web 2.0 emphasis away from predefined
information organizing schemes, towards self-organised, community indexing
(‘tagging’) of elements, resulting in so-called “folksonomies” that can be rendered as
tag clouds and other visualizations. Persuading ‘normal people’ (in contrast to skilled
information scientists or ontology engineers) to create structured, sometimes high
quality, metadata was previously thought impossible, and the success and limits of this
approach is now the subject of a new research field that studies collaborative tagging
patterns, e.g. [
          <xref ref-type="bibr" rid="ref35 ref5">5</xref>
          ].
        </p>
        <p>
          Another way in which this emphasis expresses itself is in the new generation of
tools that make it easy to publish one’s opinion of the world. Free, remotely hosted
blogging tools such as Wordpress and Blogger make it very easy for non-technical
users to create a personally tailored journal or diary and syndicate their ideas. Blogs
demonstrate one way to negotiate the formality gulf successfully, providing expressive
freedom (essentially, traditional prose and graphics), with just enough structure to reap
some benefits of hypertext (entries are addressable as URLs, timestamped, tagged, and
syndicated as web feeds – see below). The limitation of blogging at present is that like
the Web at large, there are no semantics on the links between postings, thus failing to
provide any support for an analyst who wants to gain an overview of the moves in a
debate, or indeed, any kind of inter-post relationship.
2.3. Social Networks
Web 2.0 applications are dominated, although not exclusively restricted to, sites that
either seek explicitly to connect people with people, often via the artifacts that they
share. They are designed such that the greater the numbers participating, the higher the
return on effort invested. Social tools provide a range of ways in which users are made
aware of peer activity, for instance, alerting when another user ‘touches’ your material
(e.g. by reusing it, making it a favourite, tagging it), or by mining social network
structure to suggest contacts in a professional network. Social tools also provide
mechanisms for building reputation, from the trivial (how many “friends” one has), to
potentially more meaningful indices, such as authority based on the quality of material
or feedback that a user posts, or professional endorsements.
2.4. Data Interoperability, Mashups and Embedded Content
A core idea behind the Web 2.0 paradigm is access to data over the web from multiple
applications. Web feeds using RSS and Atom have become the lingua franca for
publishing and subscribing to XML data in a simple manner that many non-technical
users now handle daily. Public APIs and web services enable the more sophisticated
access that enterprise architectures require, while semantic web services promise to
overlay ontologies on these layers so that they can be configured according to function.
“Mashups” of data sources fuse disparate datasets around common elements (e.g.
geolocation, person, date, product), often accessed via customisable user interfaces such as
Google Maps [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. While many mashups typically need to be crafted by a programmer,
others can be generated by end-users, given a sufficiently flexible environment. The
results of a search may bring together data in new ways.
        </p>
        <p>
          The phenomenal growth of web applications such as Google Maps, YouTube,
Flickr and Slideshare is in part due to the ease with which users can embed remotely
hosted material in their own websites. By providing users with the ‘snippet’ code
(which may be HTML or JavaScript), such applications empower users to in turn
provide their readers with attractively presented access to the material, which can in
turn be embedded by those readers in their sites. The material thus spreads ‘virally’, as
the links to a resource increase: it is no longer necessary to visit a web page to access
its content.
3. Web Argumentation Tools
A significant strand in COMMA research focuses on the design, implementation and
evaluation of practical software tools for creating and analysing arguments. Following
the entity-relationship modelling paradigm that lends itself so well to software, as well
as the work of pioneering argument and evidence mapping theorists such as Wigmore
and Toulmin, these tools provide a way to construct arguments as structures comprising
semantically linked elements taken from one or more argumentation schemes. The
argument structures may be left implicit behind text-centric user interfaces, or rendered
explicitly as trees or networks to help the author and reader visualize and edit the
argument [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. The intended users of such tools include members of the public engaged
in a public consultations and societal debate [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ], students or educators in a learning
context [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ], lawyers [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], and analysts in many other walks of professional life such as
public policy [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] and scholarly publishing [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. Research in this field examines issues
including the translation of argumentation theory into computable representations [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ],
the nature of expert fluency with such tools [
          <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
          ], and empirical studies of the tools’
usage in all of the above domains.
        </p>
        <p>
          In light of the high design standards and new possibilities that the Web 2.0
paradigm sets, it is clear that existing tools have limitations. First, there are desktop
applications like Compendium [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ] and Rationale [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] with high quality user interfaces
refined through the feedback from their extensive user communities: however, these are
limited to publishing read-only maps to the Web, either as JPEG images, or as
interactive image maps. Single user applications like CmapTools which have been
migrated to ‘groupware’ versions provide remote editing of maps, but do not exploit
the Web 2.0 functions described above.
        </p>
        <p>
          Finally and most relevant, there are a number of Web-native applications, designed
from the start to support large scale, multi-user construction. Some websites now
provide a very simple structure for structuring the two sides of a debate, while others
provide a more articulated argumentation language. Beginning with the least structured,
we see the emergence of sites such as Debatepedia, which is modelled on Wikipedia,
providing a debating resource showing unstructured prose arguments for and against a
particular proposal, demarcated in two columns [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. CoPe_it! [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] is designed for
community deliberation, and provides a way to synchronise views between IBIS graphs
(it also integrates with Compendium in this respect), an IBIS outline tree, and a
conventional threaded discussion forum. CoPe_it! also provides a mechanism to
evaluate the strength of a position, and so represents another interesting development.
Its interaction design is at present rather rudimentary compared to Web 2.0 interfaces.
It does not have an end-user customisable semantics, interoperability with existing
Web data sources, or mechanisms to syndicate content outside the application.
        </p>
        <p>
          Parmenides is designed to support web-based policy consultation with the public,
and incorporates a formal model of argumentation [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. It provides a forms-based,
questionnaire interface to elicit views from the user, populating an argumentation
structure, which it then reasons over to elicit further views. Parmenides enforces a
particular argument ontology (it was not designed as a social web application) and does
not appear to support any other Web 2.0 characteristics.
        </p>
        <p>
          ClaiMaker [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] was a Web 1.0 era application, developed in our own prior work
modelling the claims and arguments in research literatures. ClaiMaker, and its sister
tool ClaimSpotter [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], provided vehicles for us to validate empirically the usability of
the data model and a number of user interface paradigms. This has led us to carry the
core data model through into Cohere, while relaxing the constraint that restricted users
to the predefined classifications of nodes and links. Cohere’s visualizations are also
versions of those first prototyped in ClaiMaker.
        </p>
        <p>
          TruthMapping goes much further than this, aiming specifically at tackling some of
the limitations of threaded discussion forums, with a clear distinction between
unsupported premises, which when supported become claims, and a way to post
rebuttals and responses to each of these [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. DebateMapper uses a combined graphical
and outline structure to map debates using the IBIS scheme, with contributions tagged
as issues, positions and arguments [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ]. DebateMapper perhaps illustrates most clearly
some the Web 2.0 interaction design principles, but provides no open semantics, or an
open architecture to enable services on the data. The ArgDF system [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] is the first
argumentation tool to adopt a Semantic Web architecture based around the W3C
standard Resource Description Framework (RDF) for distributed data modelling and
interchange. Moreover, ArgDF is probably the first interactive tool to ground its
argument representation in the recently proposed Argument Interchange Format (AIF)
[
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. This combination of AIF+RDF is a notable advance. However, while proving the
conceptual and technical feasibility of a semantic web orientation for argumentation, it
does not yet have a user community, and it cannot be regarded as a Web 2.0 application
as defined above.
4. The Cohere system
We now describe how we are trying to incorporate the Web 2.0 principles introduced
above to create an environment called Cohere [cohereweb.net] which aims to be
semantically and technically open, provide an engaging user experience and social
network, but provide enough structure to support argument analysis and visualization.
4.1. Emergent Semantics: Negotiating the Formalization Gulf
In any user-driven content website, the challenge is to keep entry barriers as low as
possible to promote the growth of the community, yet maintain coherence of navigation
and search, through the careful design of the data model and user interface. The
combination of data model and user interface must seek the right balance between
constraint and freedom. This Web 2.0 orientation might seem to be in tension with an
environment designed to promote rigorous thinking and argumentation. Our approach
is to start with relaxed constraints in order to foster engagement with the idea of
structuring ideas in general, but provide tools to incrementally add structure as the user
recognises the value that it adds in a given context.
        </p>
        <p>Cohere is, therefore, styled to invite playful testing by people who may not first
and foremost be interested in argumentation. Instead, the website invites them to make
connections between ideas. This broader framing aims to meet the need of many
sensemaking communities to express how ideas or resources are related (whether or not
this is argumentative) in a way that goes beyond plain text blog postings, wikis or
discussion forums. A typical pair of connected Ideas in Cohere is illustrated in Figure 1.
In Cohere, users are free to enter any text as an Idea and its detailed description.
The examples seeding the database convey implicitly that Idea labels are generally
short and succinct. Users are encouraged by the user interface to reuse existing Ideas,
with an autocomplete menu dropping down as they type to show matching Ideas
already published: as far as possible, we want them to describe the same Idea using the
same label.</p>
        <p>Users must, however, constrain their contributions by:
 creating labelled connections between Ideas (e.g. is an example of)
 reusing, or creating, a connection from a list of either positive, neutral or
negative connections
Users can optionally:
 assign roles to Ideas (e.g. Scenario; Problem)
 add descriptive details (displayed when the Info icon is clicked)
 assign websites to Ideas (listed when the Idea is selected)</p>
        <p>
          The Cohere data model is inherited from the ClaiMaker prototype [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. The
essence is summarised informally in Figure 2.
        </p>
        <p>
          The provision of mechanisms to enable flexible linking of web resources around
what we are calling Ideas is a goal shared by the Topic Maps community [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ], whose
data model is very close to that of Cohere. Intruigingly, the two were developed
entirely independently, yet arrived at the same core data model, which we take to be a
form of empirical validation. In the more formally defined, and more wide-ranging
Topic Map Data Model, topics (=Cohere Ideas) point to one or more resources
(=websites); topics can be linked by associations (=connections), and topics may play
one or more roles within a given association (=roles). A Web 2.0 application called
Fuzzzy [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ] is based on the Topic Map standard and shares some similarities with
Cohere, as does the HyperTopic system [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ]; neither, however, provide support for
argumentation.
        </p>
        <p>
          While not mandating that the user engage in argumentation, the language of
deliberation and argument is nonetheless at the heart of Cohere: (i) the roles that Ideas
can play in a connection include the IBIS scheme’s Question, Answer, Pro, Con and
the user can define new ones (e.g. Datum, Claim, Warrant for Toulmin); (ii) the
connection types offered to users are clustered by positive, neutral or negative polarity,
with defaults including discourse moves such as proves, is consistent with, challenges,
refutes. These default connection types are also leveraged in the predefined
visualization filters offered by the Connection Net tab, described later (Figure 6).
While the interface makes it clear that users may choose to ignore the defaults and
create their own connection language, and the roles Ideas can play, the fact that all
connections are classed as broadly positive, neutral or negative provides a way to
express not only disagreement in the world of discourse, but could signify inhibitory
influence (e.g. in biological or ecological systems modelling), or antagonistic
relationships (e.g. in social networks). It is entirely up to the individual or team to
define their modelling scheme.
4.2. Visualizing IBIS-Based Dialogue Mapping in Cohere
The default roles that an Idea can play in a connection are Questions, Answers, Pros
and Cons, derived from the Issue-Based Information System (IBIS) developed by Rittel
[
          <xref ref-type="bibr" rid="ref29">29</xref>
          ], and implemented in the Compendium tool referred to earlier. This is used to
model what Walton and Krabbe [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ] classified as deliberation dialogues over the pros
and cons of possible courses of action to address a dilemma.
        </p>
        <p>Our previous work has demonstrated the value of real time IBIS dialogue mapping
in meetings, and the use of IBIS as an organising scheme around which an analyst can
map, asynchronously, the structure of public policy debates which can then be
published as read-only maps on the Web [31]. Cohere now provides a platform for
collaborative deliberation and debate mapping over the internet, with primarily
asynchronous use in mind to start with. (Real time mapping requires a tool like
Compendium which has a user interface optimised for rapid mapping. However, it is
our intention to optimise for real time mapping in the longer term, perhaps by adapting
Compendium as an applet for Cohere).
4.3. Visualizing Argumentation Schemes and Critical Questions in Cohere
In related work [32], we have demonstrated how Walton’s argumentation schemes and
associated Critical Questions, rendered as XML files in the Argument Markup
Language [33], can be transformed into Compendium XML and expressed as IBIS
structures in Compendium. The resulting argumentation scheme templates can now be
modelled in Cohere as illustrated in Figure 3.
4.4. Social Networking and Reputation
All Ideas other than one’s own have their owner clearly indicated iconically. Clicking
this displays the user profile, making it possible to learn more about the person behind
the ideas. We are beginning to add metrics to make users aware when they arrive at the
site how many active users there are, and what the most recently posted, reused and
linked Ideas are. Web feeds in the future will enable users to request notification
whenever one of their Ideas is embedded in someone else’s connection, or in someone
else’s website (see below).
4.5. Interoperability: Web Data as Platform
Central to O’Reilly’s notion of Web 2.0 is the notion of web data as the platform on
which many applications can compute. Cohere exposes and consumes data in a variety
of ways:
 Publishing and importing XML Web feeds
 Importing XML data from the Compendium offline dialogue and argument
mapping tool
 Embedding pointers to its data in other applications as URLs and HTML ‘snippets’
 Exposing data in a variety of standards to engage different communities</p>
        <p>Web feeds: Cohere seeks to build on the significant effort that many users already
invest in social bookmarking with folksonomic tagging tools such as del.icio.us, or in
blogging with tools such as Blogger or Wordpress. These are currently two of the most
dominant ways in which users share their views, and Cohere aims to leverage this by
enabling users to import/refresh the Web feed (RSS or Atom) for any bookmarking or
blogging site. Entries are converted into Ideas and annotated with the relevant URL,
ready for linking. We are in the process of implementing an RSS feed so that users can
track new Ideas as they are published. We plan to develop this capability, so that
individual Ideas can be subscribed to, with alerts everytime someone connects to or
from them.</p>
        <p>Ideas and views as URLs: It is increasingly hard to find an artifact or building
these days without a URL on it. The web depends on the URL as a way for
nontechnical users to connect web pages, save searches, and disseminate sites of interest
via standard tools such as email, slides and wordprocessors. The design of URLs goes
beyond cool top level domain names, to the art of URLs that communicate their content
to people, in contrast to machine-generated addresses that have no obvious pattern.</p>
        <p>It was considered essential, therefore, to make Cohere’s content addressable and
accessible as URLs. This required the creation of a guest login status for non-registered
users to successfully reach an address, and the design of a URL syntax that specified
the visualization type and search criteria. The URL for an Idea, a triple, or a
Connection List/Net is accessed by the user in what has become the conventional
manner, by clicking on a URL icon to copy and paste the address that pops up.</p>
        <p>Embedding ideas and views in other websites: Once a URL addressing scheme
is in place, it becomes possible to provide such embeddable snippets for users, as
introduced above. Pasting this &lt;iframe&gt; code into a web page creates an embedded,
interactive view onto the Cohere database, which reproduces the buttons to get the
URL and snippet code, to encourage further dissemination (Figure 4).</p>
        <p>Multiple Import/Export data formats: By the time of the conference, we will
have implemented further data formats for importing and exporting Cohere structures.
A priority is to provide Argument Interchange Format compatibility, with other
candidates being Topic Maps, Conceptual Graphs, and OWL.
4.6. Mashup Visualizations
Our objective is to help forge links not only between Ideas, but between the people
publishing them. As Cohere starts to be used, it is inevitable that popular Ideas will be
duplicated: if the site is successful, we can expect many people to be working on the
Idea Global Warming, or making reference to everyday concepts such as Capitalism or
World Wide Web. We have started to design views that help render the structures that
will result from many users working on common Ideas. This is a long term challenge,
but Figure 5 shows the first tool called Connection Net, which uses a self-organising
graph layout algorithm that can render all of one’s personal data, or filtered views of
the world’s data. In particular, Ideas with a border are used by more than one person,
and as shown, right-clicking on it enables the user to view all the owners of that Idea.
In this way, just as folksonomies enable disparate users to discover related resources
and people, Cohere aims to reveal new connections and users working on the same Idea,
or perhaps more interestingly, making similar or contrasting connections.</p>
        <p>Filter buttons in the Connection Net view make use of the connection types, as
shown in Figure 6. A number of saved filters are shown, for example, Contrast
searches the database from a focal Idea on a specific subset of connection types of a
contrasting nature, e.g. challenges, has counterexample, is inconsistent with, refutes.
Users can define their own custom searches, and in the future will be able to save them
as shown in the example buttons.
4.7. Implementation
Cohere is implemented on Linux, Apache HTTP server, MySQL database, and PHP.
The user interface exploits the AJAX approach to caching data in the browser to create
a highly responsive interface, with few delays between action and feedback. Cascading
Style Sheets are used extensively to control presentation. In addition, a Java applet
from the Prefuse information visualization classes [34] has been customised to provide
self-organising, interactive graph visualizations under the Connection Net tab.
Compendium (op cit) serves as an offline mapping tool (a cross-platform Java desktop
application with Apache Derby or MySQL database). Data is uploaded to Cohere
currently using the Compendium XML scheme. Cohere is currently a freely hosted
application, and an open source release is planned by end of 2008.
5. Present Limitations, and Future Work
This project is tackling a complex but important challenge: to create tools providing a
compelling user experience by harnessing two forces that seem on first inspection to
pull in opposite directions: on the one hand, informal social media with low entry
thresholds and few interaction constraints, and on the other, mechanisms for structuring
ideas and discourse. We have presented the design rationale behind Cohere, a web
application for structuring and visualizing information and arguments, publishing Ideas,
and discovering new intellectual peers. In order to balance the informal+formal design
criteria, we bias to the informal, with interface and architectural mechanisms to add
structure as desired. Understandably, Cohere is being trialled initially by individuals
testing it for personal reflection and information management, but ultimately, we hope
to augment distributed communities engaged in intentional, collective sensemaking.</p>
        <p>
          We are now in disussion with other COMMA research groups to explore how their
argument modelling approaches could be integrated with Cohere. We are moving to a
web services architecture [cf. 35] and plan to enable data exchange via the W3C’s RDF
and OWL, and the proposed Argument Interchange Format [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. These developments
are designed to evolve Cohere from a closed web application, towards a collaboration
platform for structured, social argumentation and deliberation for wider
experimentation by both end-users, developers and argumentation researchers. Future
technical work will support different argument layouts, more flexible visualizations,
group permissions, and the management of template ‘pattern libraries’ (currently
managed via the offline Compendium tool). Our pilot usability evaluations are leading
to interface changes that are being added at the time of writing, and will be followed by
more in depth studies in the lab (cf. [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]), and with end-user communities.
        </p>
        <p>Finally, our goal with Cohere is to provide an environment for the emergence of
social and argument structures. While not currently exposed in the user interface,
Cohere has built into its data model the Cognitive Coherence Relations modelling
scheme described in the COMMA’08 debate modelling paper by Benn et al. [36],
which seeks an integrated approach to modelling social networks and argument
networks. A future objective is to investigate this modelling paradigm within Cohere.
Acknowledgements: Cohere is implemented by Michelle Bachler, with contributions from Michele Pasin
and Alex Little, to whom I am indebted. The Open Sensemaking Communities Project
[www.kmi.open.ac.uk/projects/osc] is funded by the William and Flora Hewlett Foundation, as part of the
Open University’s OpenLearn Initiative [www.open.ac.uk/openlearn].
6. References</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Boden</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The Business of Talk</article-title>
          . Polity, Cambridge (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Boland</surname>
            ,
            <given-names>R.J.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tenkasi</surname>
            ,
            <given-names>R.V.</given-names>
          </string-name>
          :
          <article-title>Perspective Making and Perspective Taking in Communities of Knowing</article-title>
          .
          <source>Organization Science</source>
          <volume>6</volume>
          (
          <issue>4</issue>
          ),
          <fpage>350</fpage>
          -
          <lpage>372</lpage>
          (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bruner</surname>
            ,
            <given-names>J.S.</given-names>
          </string-name>
          : Acts of Meaning. Harvard University Press, Cambridge, MA (
          <year>1990</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.:</surname>
          </string-name>
          <article-title>The Roots of Computer Supported Argument Visualization</article-title>
          . In: Kirschner,
          <string-name>
            <given-names>P.A.</given-names>
            ,
            <surname>Buckingham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Carr</surname>
          </string-name>
          , C. (eds.) Visualizing Argumentation, pp.
          <fpage>3</fpage>
          -
          <lpage>24</lpage>
          . Springer, London (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Hammond</surname>
          </string-name>
          , N.:
          <source>Argumentation-Based Design Rationale: What Use at What Cost? Int. J. Human-Computer Studies</source>
          <volume>40</volume>
          (
          <issue>4</issue>
          ),
          <fpage>603</fpage>
          -
          <lpage>652</lpage>
          (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          , et al.:
          <article-title>Graphical Argumentation and Design Cognition</article-title>
          .
          <source>HumanComputer Interaction</source>
          <volume>12</volume>
          (
          <issue>3</issue>
          ),
          <fpage>267</fpage>
          -
          <lpage>300</lpage>
          (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          , et al.:
          <article-title>Modelling Naturalistic Argumentation in Research Literatures: Representation and Interaction Design Issues</article-title>
          .
          <string-name>
            <surname>Int. J. Intelligent</surname>
          </string-name>
          <article-title>Systems (Special Issue on Computational Modelling of Natural Argument)</article-title>
          (in Press)
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          , et al.:
          <article-title>Memetic: An Infrastructure for Meeting Memory</article-title>
          .
          <source>In: Proc. 7th Int. Conf. on the Design of Cooperative Systems. 2006 of Conf</source>
          .
          <article-title>Carry-le-</article-title>
          <string-name>
            <surname>Rouet</surname>
          </string-name>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.J.</surname>
          </string-name>
          , et al.:
          <article-title>Hypermedia Support for Argumentation-Based Rationale: 15 Years on from gIBIS and QOC</article-title>
          . In: Dutoit,
          <string-name>
            <surname>A.</surname>
          </string-name>
          , et al. (eds.) Rationale Management in Software Engineering, pp.
          <fpage>111</fpage>
          -
          <lpage>132</lpage>
          . Springer, Heidelberg (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Clancey</surname>
            ,
            <given-names>W.J.</given-names>
          </string-name>
          , et al.:
          <article-title>Automating CapCom Using Mobile Agents and Robotic Assistants</article-title>
          .
          <source>In: 1st Space Exploration Conf. 2005 of Conf. Orlando</source>
          , FL (
          <year>2005</year>
          ), http:// eprints.aktors.
          <source>org/375</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Conklin</surname>
          </string-name>
          , J.:
          <article-title>Dialogue Mapping: Reflections on an Industrial Strength Case Study</article-title>
          . In: Kirschner,
          <string-name>
            <given-names>P.A.</given-names>
            ,
            <surname>Buckingham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Carr</surname>
          </string-name>
          , C. (eds.) Visualizing Argumentation, Springer, London (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Conklin</surname>
          </string-name>
          , J.: Dialogue Mapping:
          <article-title>Building Shared Understanding of Wicked Problems</article-title>
          . Wiley, Chichester (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Conklin</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Begeman</surname>
            ,
            <given-names>M.L.:</given-names>
          </string-name>
          <article-title>gIBIS: A Hypertext Tool for Exploratory Policy Discussion</article-title>
          .
          <source>ACM Transactions on Office Information Systems</source>
          <volume>4</volume>
          (
          <issue>6</issue>
          ),
          <fpage>303</fpage>
          -
          <lpage>331</lpage>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Engelbart</surname>
          </string-name>
          , D.C.
          <article-title>: A Conceptual Framework for the Augmentation of Man's Intellect</article-title>
          . In: Howerton,
          <string-name>
            <surname>P.</surname>
          </string-name>
          , Weeks. (eds.) Vistas in Information Handling, pp.
          <fpage>1</fpage>
          -
          <lpage>29</lpage>
          . Spartan Books, Washington, DC, London (
          <year>1963</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Lave</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wenger</surname>
          </string-name>
          , E.:
          <article-title>Situated Learning: Legitimate Peripheral Participation</article-title>
          . Cambridge University Press, Cambridge (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>MacLean</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <string-name>
            <surname>Questions</surname>
          </string-name>
          , Options, and
          <article-title>Criteria: Elements of Design Space Analysis</article-title>
          .
          <source>Human-Computer Interaction</source>
          <volume>6</volume>
          (
          <issue>3</issue>
          &amp; 4),
          <fpage>201</fpage>
          -
          <lpage>250</lpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Mancini</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          : Cinematic Hypertext.
          <article-title>Investigating a New Paradigm</article-title>
          .
          <source>In: Frontiers in Artificial Intelligence and Applications</source>
          . IOS Press, Amsterdam (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Mancini</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckingham Shum</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Modelling Discourse in Contested Domains: A Semiotic and Cognitive Framework</article-title>
          .
          <source>Int. J. Human-Computer Studies</source>
          <volume>64</volume>
          (
          <issue>11</issue>
          ),
          <fpage>1154</fpage>
          -
          <lpage>1171</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>McCall</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          : Fundamentals - Rationale
          <string-name>
            <surname>Representation</surname>
            , Capture and Use. In: Dutoit,
            <given-names>A.</given-names>
          </string-name>
          , et al. (eds.) Rationale Management in Software Engineering, pp.
          <fpage>49</fpage>
          -
          <lpage>52</lpage>
          . Springer, Heidelberg (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Novak</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          : Learning, Creating, and
          <article-title>Using Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations</article-title>
          . LEA, Mawah, NJ (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Park</surname>
          </string-name>
          , J.:
          <article-title>Topic Mapping: A View of the Road Ahead</article-title>
          . In: Maicher,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Park</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. (eds.) TMRA</surname>
          </string-name>
          <year>2005</year>
          .
          <article-title>LNCS (LNAI)</article-title>
          , vol.
          <volume>3873</volume>
          , Springer, Heidelberg (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Rittel</surname>
            ,
            <given-names>H.W.J.: Second</given-names>
          </string-name>
          <string-name>
            <surname>Generation Design Methods</surname>
          </string-name>
          .
          <source>Interview in: Design Methods Group 5th Anniversary Report: DMG Occasional Paper</source>
          , vol.
          <volume>1</volume>
          , pp.
          <fpage>5</fpage>
          -
          <lpage>10</lpage>
          (
          <year>1984</year>
          ). In: Cross, N. (ed.)
          <article-title>Developments in Design Methodology (reprinted</article-title>
          ), pp.
          <fpage>317</fpage>
          -
          <lpage>327</lpage>
          , J. Wiley &amp; Sons, Chichester (
          <year>1972</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Selvin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Supporting Collaborative Analysis and Design with Hypertext Functionality</article-title>
          .
          <source>Journal of Digital Information</source>
          <volume>1</volume>
          (
          <issue>4</issue>
          ) (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Selvin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Fostering Collective Intelligence: Helping Groups Use Visualized Argumentation</article-title>
          . In: Kirschner,
          <string-name>
            <given-names>P.A.</given-names>
            ,
            <surname>Buckingham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Carr</surname>
          </string-name>
          , C. (eds.) Visualizing Argumentation, Springer, London (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Selvin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Aesthetic and Ethical Implications of Participatory Hypermedia Practice</article-title>
          ,
          <source>Technical Report KMI-05-17</source>
          , Knowledge Media Institute, Open University (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Selvin</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.J.</surname>
          </string-name>
          :
          <article-title>Rapid Knowledge Construction: A Case Study in Corporate Contingency Planning Using Collaborative Hypermedia</article-title>
          .
          <source>Knowledge and Process Management</source>
          <volume>9</volume>
          (
          <issue>2</issue>
          ),
          <fpage>119</fpage>
          -
          <lpage>128</lpage>
          (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Sereno</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckingham Shum</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Motta</surname>
          </string-name>
          , E.:
          <article-title>Formalization, User Strategy and Interaction Design: Users' Behaviour with Discourse Tagging Semantics</article-title>
          .
          <source>In: Workshop on Social and Collaborative Construction of Structured Knowledge. 16th Int. World Wide Web Conference</source>
          , Banff, Canada, May 8-
          <issue>12</issue>
          ,
          <year>2007</year>
          (
          <year>2007</year>
          ), [http://www2007.org/workshops/ paper_30.pdf]
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Tate</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <article-title>Co-OPR: Design and Evaluation of Collaborative Sensemaking and Planning Tools for Personnel Recovery</article-title>
          ,
          <source>Technical Report KMI-06-07</source>
          , Knowledge Media Institute, Open University (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Uren</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          , et al.:
          <article-title>Sensemaking Tools for Understanding Research Literatures: Design, Implementation and User Evaluation</article-title>
          .
          <source>Int. J. Human Computer Studies</source>
          <volume>64</volume>
          (
          <issue>5</issue>
          ),
          <fpage>420</fpage>
          -
          <lpage>445</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Weick</surname>
            ,
            <given-names>K.E.</given-names>
          </string-name>
          : Sensemaking in Organizations. Sage Publications, Thousand Oaks, CA (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Sierhuis</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <given-names>Buckingham</given-names>
            <surname>Shum</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          (
          <year>2008</year>
          ).
          <article-title>Human-Agent Knowledge Cartography for e-Science</article-title>
          .
          <source>In: Knowledge Cartography</source>
          , (Eds.)
          <string-name>
            <surname>Okada</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckingham Shum</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sherborne</surname>
          </string-name>
          , T. Springer
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Tate</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckingham Shum</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dalton</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mancini</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Selvin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Co-OPR: Design and Evaluation of Collaborative Sensemaking and Planning Tools for Personnel Recovery</article-title>
          .
          <source>Technical Report KMI-06-07</source>
          , Open University, UK. www.kmi.open.ac.uk/publications/pdf/KMI-TR-
          <volume>06</volume>
          -07.pdf
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>O</given-names>
            <surname>'Reilly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            and
            <surname>Battelle</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>The State of the Internet Industry</article-title>
          .
          <source>Opening Presentation, Web</source>
          <volume>2</volume>
          .0 Conference, Oct.
          <volume>5</volume>
          -
          <issue>7</issue>
          <year>2004</year>
          , San Francisco, CA.
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Garrett</surname>
            ,
            <given-names>J.J.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Ajax: A New Approach to Web Applications</article-title>
          .
          <source>Adaptive Path (Feb. 18</source>
          ,
          <year>2005</year>
          )
          <article-title>: www</article-title>
          .adaptivepath.com/ideas/essays/archives/000385.php
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Golder</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Huberman</surname>
            ,
            <given-names>B.A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Usage Patterns of Collaborative Tagging Systems</article-title>
          .
          <source>Journal of Information Science</source>
          ,
          <volume>32</volume>
          (
          <issue>2</issue>
          ).
          <fpage>198</fpage>
          -
          <lpage>208</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>