<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Ontologies for the Behavioural and Social Sciences: Opportunities and Challenges</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Janna Hastings</string-name>
          <email>hastings@ovgu.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Robert West</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Susan Michie</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Caitlin Notley</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sharon Cox</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Behavioural Science and Health, University College London</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Clinical</institution>
          ,
          <addr-line>Educational and Health Psychology</addr-line>
          ,
          <institution>University College London</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Computer Science, Otto von Guericke Universität Magdeburg</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Norwich Medical School, University of East Anglia</institution>
          ,
          <addr-line>Norwich</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This report summarises the presentations and discussions that took place during the first Ontologies for Research in the Behavioural and Social Sciences (OntoBess) workshop, held in Bozen-Bolzano and virtually on the 18th September 2021. The workshop highlighted the relevance of ontologies to address overarching challenges in the behavioural and social sciences, including evidence synthesis in the face of conflicting findings, challenging definitions for key entities, and the need to incorporate and advance theory. It also highlighted the perspectives and resources that the behavioural and social sciences can bring to the ontology development community.</p>
      </abstract>
      <kwd-group>
        <kwd>ontologies</kwd>
        <kwd>behavioural science</kwd>
        <kwd>social sciences</kwd>
        <kwd>ontobess</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Use of ontologies has become widespread in the biomedical sciences and in many other domains
[
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ]. However, they have not yet been widely adopted within the social and behavioural
sciences. Recently, interest in the development and use of ontologies for advancing the behavioural
and social sciences has been growing (e.g. [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. Recent applications of ontologies within the
social and behavioural sciences include the Human Behaviour Change Project [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ] and the
Addiction Ontology (AddictO; [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]). Relatedly, an ontology that addresses social aspects within
the biomedical domain is the Ontology for Medically Related Social Entities (OMRSE; [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]).
      </p>
      <p>Alongside the International Conference on Biomedical Ontologies and as part of the Bolzano
Summer of Knowledge, a workshop was held addressing the use of ontologies to advance
research for the behavioural and social sciences. The workshop aimed to provide a forum for
the discussion of all aspects related to the use and development of ontologies for research in
the social and behavioural sciences, and for the description of social, behavioural and economic
variables in studies involving humans or in population studies. Specific topics that were of
interest included the representation of population and personal attributes, behavioural and
USA
socioeconomic attributes, measurement, research methods and formal descriptions of social
research studies, relating social theory and ontologies, and the adoption of upper-level and
mid-level ontologies for the behavioural and social sciences. An important additional objective
of the workshop was to initiate the formation of a community of practice and exchange around
the development of ontologies for the social and behavioural sciences.</p>
      <p>The workshop presentations and accompanying discussions covered diverse aspects within
this overarching theme. The next section discusses these presentations in the context of three
overarching topics: (1) ontologies for evidence synthesis, (2) challenging definitions for the
behavioural and social science domains, and (3) theories and ontologies.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Current Status and Topics</title>
      <sec id="sec-2-1">
        <title>2.1. Ontologies for Evidence Synthesis</title>
        <p>One of the longstanding challenges in the behavioural and social sciences is the need for robust,
reliable and up-to-date synthesis of the evidence base in order to answer questions, guide future
research, and provide guidance to policymakers and practitioners. This was also one of the
central applications areas where ontologies are foreseen to make a diference to these disciplines,
which was reflected in the topics presented and discussed at the workshop.</p>
        <p>
          Professor Susan Michie gave the keynote for the workshop, during which she described the
development of the Behaviour Change Intervention Ontology (BCIO, [
          <xref ref-type="bibr" rid="ref4 ref9">4, 9</xref>
          ]) and its use for the
annotation of intervention literature in support of the automation of evidence synthesis for the
behaviour change domain in the context of the Human Behaviour Change Project (HBCP). The
HBCP is a proof-of-principle project showcasing the use of artificial intelligence technologies
for the management of behavioural intervention evidence, incorporating both an automated
information extraction part and an automated prediction part, both of which are organised
around the ontology to provide the semantic structure for the domain. The BCIO consists
of an upper level and several largely independent lower-level modules such as for behaviour,
population attributes, settings [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] and modes of delivery [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ], each of which consists of several
or even a few hundred classes. Each class may be used in annotations if it is mentioned in the
context of the text describing an intervention in the literature.
        </p>
        <p>
          Professor Caitlin Notley spoke on the motivation for the development and use of ontologies
arising from recent experiences performing systematic reviews of the evidence in the context
of the e-cigarette literature. E-cigarettes and related products have been the subject of intense
debate in recent years, with their relative risks, harms and benefits for reducing the burden of
smoking-associated disease through supporting smoking cessation being subject to difering
interpretations in the evidence base (e.g. [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]). Professor Notley illustrated how many challenges
in synthesis in this evidence based related to vague or poorly defined groupings in the literature,
and how even central and widely used classes such as “youth” as an age-defined group of
individuals, were poorly and incompatibly defined across diferent studies, leading for example
to challenges in synthesising evidence relating to youth e-cigarette use and the adoption of
lfavours [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
        </p>
        <p>Continuing the theme of ontologies for the purpose of evidence synthesis, Professor Robert
West followed next by giving a detailed look at the specification of behavioural outcomes in
behavioural intervention descriptions, noting all the diferent factors that need to be detailed
and ofering a preliminary semantic formalisation of an outcome specification that would enable
automated comparison of outcomes.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Challenging Definitions in the Behavioural and Social Science Domains</title>
        <p>Professors Mark Fox and Kate Ruf presented an ontology for specifying and defining the social
and environmental impacts of social purpose organisations, the Common Impact Data Standard
(CIDS), targeting the application area of enabling standardised reporting of and comparisons
between such impacts. This ontology is part of a wider efort to enable an infrastructure for
maximising the impact of social organisations through better understanding the pathways from
organisational activities to real-world outcomes. The CIDS aims to serve as an integrative
framework that allows diferent ways of measuring impact to be interconverted and thus
rendered comparable, in part through the consensus-driven definition of overarching dimensions
of impact.</p>
        <p>
          On a diferent topic but also with policy relevance, Dr Adrien Barton spoke about the
ontological definition and classification of nudging, a well-known and yet in some ways controversial
behaviour change technique that involves changing the organisation of the environment in order
to influence people to behave in ways that are beneficial to their health. Dr Barton emphasised
the need to distinguish between nudges themselves, which he defines as environmental
dispositions, and the processes that give rise to those nudges and that activate them. These entities
are all classified beneath Basic Formal Ontology (BFO; [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]), a top-level ontology widely used
in the biomedical sciences among other domains. The classification of the entities in diferent
ontologies beneath a common top-level ontology, or at least in terms of inter-convertible
toplevel ontologies, is helpful in enabling the ontologies to be used together. A discussion ensued
about which top-level ontology might be best suited to representing entities in the behavioural
and social sciences, and the criteria by which top-level ontologies might be selected, evaluated
and compared – itself a fruitful direction of additional research at the interface between the
behavioural and social sciences and the applied ontology community.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Theories and Ontologies</title>
        <p>Professor Michie also discussed the relationship between theories, which are an integral
component of the behavioural sciences, and ontologies [14]. Theory proposition, development and
refinement is an integral part of the advancement of the behavioural and social sciences, and as
such it makes sense to ask how ontologies and theories are related and how they difer in scope
and purpose. Theories propose testable hypotheses and explanations for what the entities are
in a given domain and how they are related. Their purpose is to advance the understanding of
the domain. However, they may speak to only a subset of the entities in the domain or seek to
explain just a partial or specific phenomenon. Ontologies, on the other hand, do not represent
testable hypotheses as such, nor seek to provide explanations for phenomena. They aim to
provide a shareable and re-usable representation of the entities in the domain in as theory-neutral a
way as possible in order to enable consistent descriptions in data and text across many diferent
contexts, as a kind of interlingua. Thus, it even makes sense to try to link theories to ontologies
in order to make semantic-driven theory integration and comparison possible, which is exactly
what the Ontology-Based Modelling System [15, 16], also presented by Professor Michie, aims
to enable just such a connection between theory constructs and ontology classes, with a view
to systematically comparing theories about behaviour and behaviour change.</p>
        <p>Continuing the theme of ontology to theory mappings, for the last presentation of the
workshop, Irshad Ally and Professor Werner Ceusters discussed the findings arising from their
eforts to map the constructs from motivational learning theories to BFO classes, with outcomes
of the study presented both in terms of the learning exercise involved in coming to terms with
the distinctions between upper-level entities in the BFO top-level ontology, and in terms of the
challenges with unambiguously interpreting and defining the entities from such theories based
on their available documentation.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Opportunities and Challenges</title>
      <p>It became evident through a multitude of the discussions that took place during the session that
there is a clear need for the advantages ofered by ontologies in these domains: clarity of
reporting and exchange, interpretation and integration of data and evidence, and clearer semantics
for theories towards cumulative science. However, several challenges were also highlighted,
including barriers to the understanding of the nature, purpose and scope of ontologies within
the communities of research and practice in these domains, a shortage of available materials for
wider education and dissemination, a need for tools and resources supporting the development
of ontologies for these domains, and the lack of standardised infrastructures for sharing relevant
content.</p>
      <p>In particular, the behavioral and social science domains are characterized by a very large
number of distinct semantic types – individuals, populations, interventions, the full range and
scope of behaviors, population and personal attributes, location attributes, and moreover all the
semantic types from biomedicine which may also have relevance in some intervention contexts.
Added to this semantic complexity, there are very heterogeneous ways in which such semantic
types are described in the literature, are theorised about, are defined and operationalised, and
contexts in which they are applied. Moreover, the theoretical frameworks in which such research
is conducted may introduce technical terminology from diferent theoretical backgrounds which
may be dificult for a language model to disentangle, as there are a wide range of diferent
theories and constructs in use within behavioral science more broadly, and as yet no systematic
way to map their overlaps and commonalities.</p>
      <p>A further challenge is that there is a lack of an organized repository for all literature or
data relevant to the behavioral sciences. Relevant literature spans several diferent disciplines
including psychology, the social sciences, and economics as well as the more medically-oriented
branches e.g. behavioral medicine. These disciplines may have quite diferent publication
practices, and in some of these even discovering the existence of the relevant literature may be
subject to a “paywall”. There is also limited publicly available data aside from text - there is
significantly less publicly available structured and ontology-annotated data, and any research
data involving humans is subject to privacy and ethical concerns that may mean that this
situation will not change dramatically in the future.</p>
      <p>Finally, a particular challenge for the development and adoption of ontologies for the
behavioural and social sciences is, when viewed from a diferent perspective, also equally valid as
an important argument for their adoption: the terminology that is used in scientific studies in
the behavioral sciences overlaps with informal and colloquial usages of vocabulary and
terminology and are therefore frequently polysemous. While in the biomedical sciences, technical
vocabulary includes gene names, drug names and disease names, each of which is strongly
semantically typed and forms a vocabulary that for the most part is distinct from the
vocabularies used in other sciences and domains, in the behavioral and social sciences the terminology
that is used reflects human activities and concerns, social structures and patterns of behaviour.
These entities are also referred to frequently within other disciplines, as many studies that
involve humans, even biomedical studies of drugs and diseases, will ultimately need to refer to
population groups, activities and behaviors.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions and Next Steps</title>
      <p>The workshop aimed to initiate conversations and exchanges amongst the broader community
of persons developing and using ontologies for the behavioural and social sciences. The
workshop underlined the importance of ontologies across a wide range of applications within
the behavioural and social sciences, and emphasised that while the subject matter might be
in some ways more challenging than the more narrowly focused subject matter of biomedical
ontologies, the time is ripe to harness synergies and opportunities to advance this integrative
ifeld. In hybrid format (in-person and online), the workshop was well attended, with more than
30 participants overall, indicating that there is at least the beginnings of a robust community
to draw from. It was clear, however, that the hybrid workshop format provided a restricted
opportunity for discussion and sharing of experiences as compared to that ofered by face-to-face
workshops, and it was agreed that an important future step will be to try to hold an in-person
follow-up workshop as soon as it is safe to do so given the global pandemic situation.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments References</title>
      <p>Thanks to all presenters and participants of the OntoBess workshop for stimulating contributions
and discussions.
or cessation., Addiction (2021). URL: https://research-portal.uea.ac.uk/en/publications/
youth-use-of-e-liquid-flavours-a-systematic-review-exploring-patt, publisher: Wiley.
[14] J. Hastings, S. Michie, M. Johnston, Theory and ontology in behavioural science, Nature
Human Behaviour 4 (2020) 226–226. URL: http://www.nature.com/articles/s41562-020-0826-9.
doi:10.1038/s41562- 020- 0826- 9.
[15] R. West, C. A. Godinho, L. C. Bohlen, R. N. Carey, J. Hastings, C. E. Lefevre, S. Michie,
Development of a formal system for representing behaviour-change theories, Nature Human
Behaviour 3 (2019) 526–536. URL: https://www.nature.com/articles/s41562-019-0561-2.
doi:10.1038/s41562- 019- 0561- 2, number: 5 Publisher: Nature Publishing Group.
[16] J. Hale, J. Hastings, R. West, C. E. Lefevre, A. Direito, L. C. Bohlen, C. Godinho,
N. Anderson, S. Zink, H. Groarke, S. Michie, An ontology-based modelling system
(OBMS) for representing behaviour change theories applied to 76 theories, Wellcome
Open Research 5 (2020) 177. URL: https://wellcomeopenresearch.org/articles/5-177/v1.
doi:10.12688/wellcomeopenres.16121.1.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Arp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Spear</surname>
          </string-name>
          ,
          <article-title>Building Ontologies with Basic Formal Ontology</article-title>
          , The MIT Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Haendel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. G.</given-names>
            <surname>Chute</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. N.</given-names>
            <surname>Robinson</surname>
          </string-name>
          , Classification, Ontology, and
          <string-name>
            <given-names>Precision</given-names>
            <surname>Medicine</surname>
          </string-name>
          ,
          <source>New England Journal of Medicine</source>
          <volume>379</volume>
          (
          <year>2018</year>
          )
          <fpage>1452</fpage>
          -
          <lpage>1462</lpage>
          . URL: http://www.nejm. org/doi/10.1056/NEJMra1615014. doi:
          <volume>10</volume>
          .1056/NEJMra1615014.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>K. R.</given-names>
            <surname>Larsen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Michie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. B.</given-names>
            <surname>Hekler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Gibson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Spruijt-Metz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ahern</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Cole-Lewis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. J. B.</given-names>
            <surname>Ellis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Hesse</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. P.</given-names>
            <surname>Moser</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Yi</surname>
          </string-name>
          ,
          <article-title>Behavior change interventions: the potential of ontologies for advancing science and practice</article-title>
          ,
          <source>Journal of Behavioral Medicine</source>
          <volume>40</volume>
          (
          <year>2017</year>
          )
          <fpage>6</fpage>
          -
          <lpage>22</lpage>
          . doi:
          <volume>10</volume>
          .1007/s10865-016-9768-0.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.</given-names>
            <surname>Michie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>West</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. N.</given-names>
            <surname>Finnerty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Norris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. J.</given-names>
            <surname>Wright</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Marques</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>J.</given-names>
            Thomas, J.
          </string-name>
          <string-name>
            <surname>Hastings</surname>
          </string-name>
          ,
          <article-title>Representation of behaviour change interventions and their evaluation: Development of the Upper Level of the Behaviour Change Intervention Ontology</article-title>
          ,
          <source>Wellcome Open Research</source>
          <volume>5</volume>
          (
          <year>2020</year>
          )
          <article-title>123</article-title>
          . URL: https://wellcomeopenresearch.org/ articles/5-123/v1. doi:
          <volume>10</volume>
          .12688/wellcomeopenres.15902.1.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Michie</surname>
          </string-name>
          , J. Thomas,
          <string-name>
            <given-names>M.</given-names>
            <surname>Johnston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P. M.</given-names>
            <surname>Aonghusa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Shawe-Taylor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Kelly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Deleris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. N.</given-names>
            <surname>Finnerty</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Marques</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Norris</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. O'Mara-Eves</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>West</surname>
          </string-name>
          ,
          <article-title>The Human Behaviour-Change Project: harnessing the power of artificial intelligence and machine learning for evidence synthesis and interpretation</article-title>
          ,
          <source>Implementation Science</source>
          <volume>12</volume>
          (
          <year>2017</year>
          )
          <article-title>121</article-title>
          . URL: https://doi.org/10.1186/s13012-017-0641-5. doi:
          <volume>10</volume>
          .1186/s13012-017-0641-5.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S.</given-names>
            <surname>Michie</surname>
          </string-name>
          , J. Thomas,
          <string-name>
            <given-names>P.</given-names>
            <surname>Mac</surname>
          </string-name>
          <string-name>
            <surname>Aonghusa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>West</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Johnston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Kelly</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. ShaweTaylor</given-names>
            , J.
            <surname>Hastings</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bonin</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. O'Mara-Eves</surname>
          </string-name>
          ,
          <article-title>The Human Behaviour-Change Project: An artificial intelligence system to answer questions about changing behaviour</article-title>
          ,
          <source>Wellcome Open Research</source>
          <volume>5</volume>
          (
          <year>2020</year>
          )
          <article-title>122</article-title>
          . URL: https://wellcomeopenresearch.org/articles/5-122/v1. doi:
          <volume>10</volume>
          .12688/wellcomeopenres.15900.1.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hastings</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cox</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>West</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Notley</surname>
          </string-name>
          , Addiction Ontology:
          <article-title>Applying Basic Formal Ontology in the Addiction domain</article-title>
          ,
          <source>Qeios</source>
          (
          <year>2020</year>
          ). URL: https://www.qeios.com/read/ HZHJIP. doi:
          <volume>10</volume>
          .32388/HZHJIP.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Hicks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hanna</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Welch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Brochhausen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. R.</given-names>
            <surname>Hogan</surname>
          </string-name>
          ,
          <article-title>The ontology of medically related social entities: recent developments</article-title>
          ,
          <source>Journal of Biomedical Semantics</source>
          <volume>7</volume>
          (
          <year>2016</year>
          )
          <article-title>47</article-title>
          . URL: https://doi.org/10.1186/s13326-016-0087-8. doi:
          <volume>10</volume>
          .1186/s13326-016-0087-8.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A. J.</given-names>
            <surname>Wright</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Norris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. N.</given-names>
            <surname>Finnerty</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Marques</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Hastings</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>West</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Michie</surname>
          </string-name>
          ,
          <article-title>Ontologies relevant to behaviour change interventions: a method for their development</article-title>
          ,
          <source>Wellcome Open Research</source>
          <volume>5</volume>
          (
          <year>2020</year>
          )
          <article-title>126</article-title>
          . URL: https:// wellcomeopenresearch.org/articles/5-126/v2. doi:
          <volume>10</volume>
          .12688/wellcomeopenres.15908.2.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>E.</given-names>
            <surname>Norris</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Marques</surname>
            ,
            <given-names>A. N.</given-names>
          </string-name>
          <string-name>
            <surname>Finnerty</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          <string-name>
            <surname>Wright</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>West</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Hastings</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Williams</surname>
            ,
            <given-names>R. N.</given-names>
          </string-name>
          <string-name>
            <surname>Carey</surname>
            ,
            <given-names>M. P.</given-names>
          </string-name>
          <string-name>
            <surname>Kelly</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Michie</surname>
          </string-name>
          ,
          <article-title>Development of an Intervention Setting Ontology for behaviour change: Specifying where interventions take place (</article-title>
          <year>2020</year>
          ). URL: http://bura.brunel.ac.uk/handle/2438/20971. doi:
          <volume>10</volume>
          .12688/wellcomeopenres.15904.1, accepted:
          <fpage>2020</fpage>
          -
          <lpage>06</lpage>
          -12T20:
          <fpage>54</fpage>
          :13Z Publisher: F1000 Research Ltd.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>M. M. Marques</surname>
            ,
            <given-names>R. N.</given-names>
          </string-name>
          <string-name>
            <surname>Carey</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Norris</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Evans</surname>
            ,
            <given-names>A. N.</given-names>
          </string-name>
          <string-name>
            <surname>Finnerty</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Hastings</surname>
            , E. Jenkins,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Johnston</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>West</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Michie</surname>
          </string-name>
          , Delivering Behaviour Change Interventions:
          <article-title>Development of a Mode of Delivery Ontology</article-title>
          ,
          <source>Wellcome Open Research</source>
          <volume>5</volume>
          (
          <year>2020</year>
          )
          <article-title>125</article-title>
          . URL: https:// wellcomeopenresearch.org/articles/5-125/v1. doi:
          <volume>10</volume>
          .12688/wellcomeopenres.15906.1.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hartmann-Boyce</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>McRobbie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Butler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Lindson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bullen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Begh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Theodoulou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Notley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. A.</given-names>
            <surname>Rigotti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Turner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. R.</given-names>
            <surname>Fanshawe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Hajek</surname>
          </string-name>
          ,
          <article-title>Electronic cigarettes for smoking cessation</article-title>
          ,
          <source>Cochrane Database of Systematic Reviews</source>
          (
          <year>2021</year>
          ). URL: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD010216.pub6/full. doi:
          <volume>10</volume>
          .1002/14651858.CD010216.pub6, publisher: John Wiley &amp; Sons, Ltd.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C.</given-names>
            <surname>Notley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gentry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cox</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dockrell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Havill</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Attwood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Munafo</surname>
          </string-name>
          ,
          <article-title>Youth Use of E-Liquid Flavours - A systematic review exploring patterns of use of e liquid flavours and associations with continued vaping, tobacco smoking uptake,</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>