<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Recent Refinements of the NeuroPsychological Testing Ontology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alexander P. Cox</string-name>
          <email>apcox@buffalo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kiernan L. Johnson</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lauren M. Wishnie</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Aaron S. Kemp</string-name>
          <email>ASKemp@uams.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jonathan P. Bona</string-name>
          <email>JPBona@uams.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander D. Diehl</string-name>
          <email>addiehl@buffalo.edu</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Biomedical Informatics, UAMS</institution>
          ,
          <addr-line>4301 W. Markham, Little Rock, AR 72205</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Biomedical Informatics, University at Buffalo</institution>
          ,
          <addr-line>77 Goodall St., Buffalo, New York 14203</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Psychiatry, University of Arkansas for Medical Sciences (UAMS)</institution>
          ,
          <addr-line>4301 W. Markham, Little Rock, AR 72205</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The NeuroPsychological Testing Ontology is designed to represent neuropsychological assessments, the cognitive processes and functions they assess, and associated data. This paper provides an overview of recent ontology development efforts as well as its current data applications and future development goals.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Neuropsychological testing</kwd>
        <kwd>cognitive domains</kwd>
        <kwd>ADNI</kwd>
        <kwd>applied ontology</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The NeuroPsychological Testing Ontology (NPT) [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ] is designed to represent standardized
neuropsychological assessments, such as those used by the Alzheimer's Disease Neuroimaging
Initiative (ADNI) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. NPT provides a set of classes for the annotation of neuropsychological testing
data and is designed to enable integration of results from a variety of neuropsychological tests by (i)
representing the tests in greater granularity, and (ii) connecting assays and sub-assays to the cognitive
function(s) they measure. In this way, data generated from multiple tests that are about a given cognitive
domain can be readily aggregated and studied. This is true regardless of whether the data are from entire
tests, test sub-sections, or individual test components. The selected cognitive domain can be as broad
or specific as desired and multiple domains can be combined. NPT’s overarching goal is to increase the
accuracy and usability of neuropsychological tests to support efforts to increase understanding of
cognitive domains and the conditions that affect them.
      </p>
      <p>Many diseases are associated with, result in, or are diagnosed based on the presence or absence of
certain neuropsychological signs and symptoms. Hence, neuropsychological testing plays an important
role in the development of clinical pictures used in the diagnosis of patients with a range of neurological
diseases and disorders such as Alzheimer’s disease, multiple sclerosis, or following stroke or traumatic
brain injury. Two initial goals of this project are to leverage the results of neuropsychological
assessments to (i) test hypotheses about the diagnosis of Alzheimer’s disease and (ii) identify patient
populations that are likely to convert from mild cognitive impairment to dementia.</p>
      <p>
        NPT is being developed in compliance with the OBO Foundry principles [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. It extends the Ontology
for Biomedical Investigations (OBI) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. NPT is a corollary project of the Neurological Disease
Ontology (ND) [
        <xref ref-type="bibr" rid="ref1 ref7">1, 7</xref>
        ], which represents diseases, disorders, and syndromes that are associated with
neurodegeneration.
      </p>
      <p>
        In building NPT, we have relied upon source tests, such as the Folstein Mini-Mental State Exam [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
and Montreal Cognitive Assessment [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], as well as upon textbooks [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ] and articles about these
neuropsychological tests and the cognitive functions they measure. NPT is built using the schema for
representing assays that has been developed in OBI and consequently currently imports all of OBI.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. New Developments</title>
      <p>The NeuroPsychological Testing Ontology (NPT) was initially developed during 2012-2013. At the
end of this initial development stage, NPT was at version 1.7.2. NPT version 2.0 is pending release and
contains approximately 550 NPT terms. This number is expected to grow quickly as representations of
additional neuropsychological tests get added.</p>
      <p>While the previous effort provided a good start on these efforts, there are multiple reasons for
continuing the NPT effort. First, there are many more neuropsychological tests in use. These tests
provide supplementary perspectives and data for identical, overlapping, or additional cognitive
functions and domains. Second, there are often many versions of the “same” test and it is important to
capture which test version is used as well as the differences between versions so their results can be
combined as accurately as possible. This is particularly important to ensure greater fidelity when
conducting meta-analyses. Third, many NPT terms previously either lacked definitions or benefited
from improved or more informative definitions or other annotations. Fourth, while NPT already
included many logical axioms to provide built-in reasoning, some axioms have been refactored while
others have been added.</p>
      <p>The status of neuropsychological assessments represented in NPT is shown in Table 1.</p>
      <p>The overarching goal of the current NPT development effort is to ensure robust test representations
to support mapping, ingestion into triple stores, and the retrieval and compilation of neuropsychological
assessment data. An important component of this is to account for variation in test versions and test
administration by representing, for example, the specific word list, prompts, and scoring used for a
given word recall assay. This is accomplished, in part, by the creation of the NPT-ADNI application
ontology. While NPT is designed to represent “generic” versions of standardized neuropsychological
assessments, NPT-ADNI is designed to represent highly specific terms that may be unique to a single
version of a generic assessment. For example, NPT contains the term ‘MoCA delayed recall assay’ and
NPT-ADNI adds the term ‘MoCA delayed recall daisy assay’ to specify one of the target words for that
version of the MoCA. The increased semantic content is intended to facilitate more fine-grained
analysis of data, which is hypothesized to be useful for both clinical and test design analyses.</p>
      <p>
        NPT and NPT-ADNI are currently being applied to MoCA and MMSE data from the ADNI dataset.
MoCA and MMSE ADNI data has been mapped using the Karma data integration tool [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. These
mappings are then used to generate triples for the entire ADNI dataset, which includes more than 6,800
MoCA and 12,100 MMSE test results as of January 2021. The triples are loaded into a GraphDB
instance where they can be queried using customizable SPARQL queries to further analyze the
aggregated data. The power of these queries will increase as additional assay data are added.
      </p>
      <p>
        Future work will expand NPT’s coverage to include additional cognitive tests and enhance current
test representations. Despite the use of different assessment instruments, applying NPT to
diseasespecific data repositories, such as ADNI [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] or the Parkinson’s Progression Markers Initiative [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], will
confer the ability to identify neuroimaging measures that correspond with cognitive impairment profiles
across common functional domains. Accordingly, NPT offers a basis for the semantic representation of
impaired cognitive functions across distinct neurodegenerative pathologies (e.g., Alzheimer’s disease
vs. Parkinson’s disease). This will be used to mine neuroimaging measures to identify candidate
biomarkers of cognitive impairment specific to a given etiology. In this way we expect NPT will serve
as a valuable tool to integrate neuropsychological data from multiple sources to look for commonalities
and differences that will give insights into diagnosis and treatment of neurodegenerative disease.
      </p>
    </sec>
    <sec id="sec-3">
      <title>4. Acknowledgements</title>
      <p>The authors thank Mark Jensen and Kinga Szigeti for their contributions to the development of the
initial iteration of NPT. ADD is supported by NCATS 5UL1TR001412-06.</p>
    </sec>
    <sec id="sec-4">
      <title>5. References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Cox</surname>
            <given-names>AP</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jensen</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Duncan</surname>
            <given-names>W</given-names>
          </string-name>
          , et al.
          <article-title>Ontologies for the Study of Neurological Disease</article-title>
          .
          <source>Presented July 22, 2012 at ICBO 2012: 3rd International Conference on Biomedical Ontology workshop “Towards an Ontology of Mental Functioning”</source>
          , Graz, Austria. URL: https://github.com/addiehl/neurological-disease-ontology/blob/master/docs/ICBO2012_Paper.pdf
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Cox</surname>
            <given-names>AP</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jensen</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruttenberg</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Szigeti</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diehl</surname>
            <given-names>AD</given-names>
          </string-name>
          .
          <article-title>Measuring cognitive functions: hurdles in the development of the neuropsychological testing ontology</article-title>
          .
          <source>Proceedings of the 4th International Conference on Biomedical Ontology</source>
          .
          <year>2013</year>
          , CEUR Workshop Proceedings, Montreal, Canada, July 7-
          <issue>12</issue>
          ,
          <year>2013</year>
          . URL: http://CEUR-WS.org/Vol-
          <volume>1060</volume>
          /icbo2013_submission_46.pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <article-title>[3] The NeuroPsychological Testing Ontology</article-title>
          ,
          <source>GitHub Repository</source>
          ,
          <year>2021</year>
          . URL: https://github.com/addiehl/neuropsychological-testing-ontology
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Weiner</surname>
            <given-names>MW</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aisen</surname>
            <given-names>PS</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jack</surname>
            <given-names>CR</given-names>
          </string-name>
          Jr, et al.
          <article-title>The Alzheimer's disease neuroimaging initiative: progress report and future plans</article-title>
          .
          <source>Alzheimers Dement</source>
          .
          <year>2010</year>
          ;
          <volume>6</volume>
          (
          <issue>3</issue>
          ):
          <fpage>202</fpage>
          -
          <lpage>11</lpage>
          .
          <year>e7</year>
          . doi:
          <volume>10</volume>
          .1016/j.jalz.
          <year>2010</year>
          .
          <volume>03</volume>
          .007
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Smith</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ashburner</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rosse</surname>
            <given-names>C</given-names>
          </string-name>
          , et al.
          <article-title>The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
          <source>Nat Biotechnol</source>
          .
          <year>2007</year>
          ;
          <volume>25</volume>
          (
          <issue>11</issue>
          ):
          <fpage>1251</fpage>
          -
          <lpage>1255</lpage>
          . doi:
          <volume>10</volume>
          .1038/nbt1346
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Bandrowski</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brinkman</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brochhausen</surname>
            <given-names>M</given-names>
          </string-name>
          , et al.
          <article-title>The Ontology for Biomedical Investigations</article-title>
          .
          <source>PLoS One</source>
          .
          <year>2016</year>
          ;
          <volume>11</volume>
          (
          <issue>4</issue>
          ):
          <fpage>e0154556</fpage>
          .
          <article-title>Published 2016 Apr 29</article-title>
          . doi:
          <volume>10</volume>
          .1371/journal.pone.0154556
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Jensen</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cox</surname>
            <given-names>AP</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chaudhry</surname>
            <given-names>N</given-names>
          </string-name>
          , et al.
          <source>The Neurological Disease Ontology. Journal of Biomedical Semantics</source>
          <volume>4</volume>
          ,
          <issue>42</issue>
          (
          <year>2013</year>
          ). URL: https://doi.org/10.1186/2041-1480-4-42
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Folstein</surname>
            <given-names>MF</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Folstein</surname>
            <given-names>SE</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McHugh</surname>
            <given-names>PR</given-names>
          </string-name>
          .
          <article-title>Mini-mental state: A practical method for grading the cognitive state of patients for the clinician</article-title>
          .
          <source>J Psychiatr Res</source>
          <year>1975</year>
          ;
          <volume>12</volume>
          :
          <fpage>189</fpage>
          -
          <lpage>198</lpage>
          . doi:
          <volume>10</volume>
          .1016/
          <fpage>0022</fpage>
          -
          <lpage>3956</lpage>
          (
          <issue>75</issue>
          )
          <fpage>90026</fpage>
          -
          <lpage>6</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Nasreddine</surname>
            <given-names>ZS</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phillips</surname>
            <given-names>NA</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bédirian</surname>
            <given-names>V</given-names>
          </string-name>
          , et al.
          <article-title>The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment</article-title>
          .
          <source>J Am Geriatr Soc</source>
          .
          <year>2005</year>
          ;
          <volume>53</volume>
          (
          <issue>4</issue>
          ):
          <fpage>695</fpage>
          -
          <lpage>699</lpage>
          . doi:
          <volume>10</volume>
          .1111/j.1532-
          <fpage>5415</fpage>
          .
          <year>2005</year>
          .
          <volume>53221</volume>
          .x
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Lezak</surname>
            <given-names>MD</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Howieson</surname>
            <given-names>DB</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loring</surname>
            <given-names>DW</given-names>
          </string-name>
          . (Eds.) (
          <year>2004</year>
          ).
          <source>Neuropsychological Assessment (4th ed.)</source>
          . Oxford: Oxford University Press. https://doi.org/10.1007/s00415-005-0003-0
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Mitrushina</surname>
            <given-names>M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boone</surname>
            <given-names>KB</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Razani</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>D'Elia</surname>
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Handbook of Normative Data for Neuropsychological Assessment (2nd ed</article-title>
          .). Oxford: Oxford University Press.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <article-title>Karma data integration tool</article-title>
          . URL: https://usc-isi-i2.github.io/karma/
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Marek</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jennings</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lasch</surname>
            <given-names>S</given-names>
          </string-name>
          , et al.
          <article-title>The Parkinson Progression Marker Initiative (PPMI). Progress in neurobiology</article-title>
          .
          <source>2011 Dec</source>
          <volume>1</volume>
          ;
          <issue>95</issue>
          (
          <issue>4</issue>
          ):
          <fpage>629</fpage>
          -
          <lpage>35</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.pneurobio.
          <year>2011</year>
          .
          <volume>09</volume>
          .005
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>