<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Data Framework to Understand the Lived Context for Dementia</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Caregiver Empowerment Marta Belay</string-name>
          <email>mwbelay@aggies.ncat.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Charles Henry</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daran Wynn</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tonya Smith-Jackson</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Industrial and Systems Engineering, NC A &amp;T State University</institution>
          ,
          <addr-line>Greensboro, NC 27411</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Agitation in dementia patients is characterized by several features, such as physical and verbally aggressive and nonaggressive behaviors. Such behaviors affect not only the patients, but also their caregivers' quality of life. The onset of agitated behaviors can be unpredictable and can also be influenced by environmental factors, which introduce challenges to caregivers when caring people with dementia (PWD). The purpose of this study is to analyze multiple forms of qualitative and quantitative data obtained through behavioral and environmental sensors. Data about body gestures, activity and task sequences, ambient light, sound and temperature will be obtained. Caregiver logs and medical history from nurses and psychiatrists are the sources of qualitative data. Data framework will be used to collect, structure, extract, analyze, interpret and integrate various formats and large amount of data. This approach helps to conceptualize the lived context of PWD. The information discovered will be used to generate trained models to identify the patterns of agitation associated with the environmental factors. It will also be used to develop a monitoring and dashboard system so caregivers and healthcare providers can understand and avoid environmental triggers. The research outcome will provide cost effective technology to reduce or prevent agitation in dementia.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Dementia is a general term, which describes conditions
characterized by decline in memory or cognitive function
that affects a person’s ability to perform day-to-day
activities
        <xref ref-type="bibr" rid="ref1">(Alzheimer’s Association, 2014)</xref>
        . The occurrence rate
of all types of dementia among individuals older than 71
was 13.9% in 2002
        <xref ref-type="bibr" rid="ref19">(Plassman et al., 2007)</xref>
        . This rate
corresponds to 3.4 million individuals in the USA. The
prevalence rate of dementia has been found to increase with age
from 5% of those aged between 71 and 79 years to 37.4%
of those aged 90 and older
        <xref ref-type="bibr" rid="ref19">(Plassman et al., 2007)</xref>
        . The
most common cause of dementia is Alzheimer’s disease. In
the United States, an estimated 5.2 million people have
Alzheimer’s disease and it is estimated that in every 67
seconds someone develops the disease. By the
midcentury, the occurrence is estimated to be every 33 seconds
        <xref ref-type="bibr" rid="ref1">(Alzheimer’s Association, 2014)</xref>
        . According to the World
Health Organization (WHO) statistics, about 35.6 million
people are affected by dementia worldwide, and
Alzheimer’s disease contributes to 60-70% of the cases
(WHO, 2012).
      </p>
      <p>
        Agitation is a common and challenging consequence of
dementia, which occurs in 90% of the patients
        <xref ref-type="bibr" rid="ref6">(Colombo et
al., 2007)</xref>
        . Various stages of dementia require different sets
of skills from caregivers, and most caregivers do not have
training in possible interventions. This results in stress and
increased caregiver burden and also leads to
institutionalization of patients in long term care facilities
        <xref ref-type="bibr" rid="ref27">(Steinberg et
al., 2008)</xref>
        . In addition, it incurs higher economic cost to
provide the necessary care for a person with dementia
(PWD). The cost of dementia care in 2010 was estimated
to be between $157 billion and $215 billion by a
nationwide study (Hurd et al., 2013). In 2013, the estimated
economic value of care provided by unpaid caregivers was
$220.2 billion. Similarly, aggregate cost of care provided
with payment was $214 billion
        <xref ref-type="bibr" rid="ref1">(Alzheimer’s Association,
2014)</xref>
        .
      </p>
      <p>Empowering caregivers to reduce stress and agitation in
PWD will have positive impacts on the PWD, the
caregiver, and the associated cost of care can be reduced. The
following is a case scenario describing the experience of a
caregiver attending her mother from Alzheimer’s
association webpage (www.alz.org).
“I’ve been the primary caregiver for my mother with
dementia/Alzheimer for the past nine years. She’s 86 and is
fading away by inches and by bits and pieces. It is so
unbelievably cruel and torturous to watch someone who was an
excellent teacher and active lover of life be whittled away
by this hideous disease a tiny bit at a time. I’m convinced
she contracted it through hormone replacement therapy,
which she had for too long and past the age of 75. I really
don’t know how to convey how horrible this is for her and
for me. She has suffered more than we can ever know, both
physically and mentally. I have given 20 percent of my life
to caring for her 24/7. Predictably, my life has received no
attention at all. I have no husband, no family, no career,
no retirement, and no plans for the future. I’ve had to
endure my own personal heartaches in silence, including
losing several beloved pets over the years, losing relatives
and my own battle with skin cancer. Everything is
secondary when you are a caregiver. Your life is forfeited, and
because this battle cannot be won, you will ultimately fail.
There is simply no way to put a good face on this
experience.”</p>
      <p>
        Such stories are common among caregivers. Caregivers
of PWD have a 50% chance of experiencing depression
due to the stressors they experience with the changed
behavior, unpredictability, reduced cognitive abilities and
role changes
        <xref ref-type="bibr" rid="ref24">(Schulz et al., 1995)</xref>
        . Caregivers with
depression have increased morbidity and mortality
        <xref ref-type="bibr" rid="ref22">(Pruchno and
Potashnik, 1989)</xref>
        , and PWD in these dyads have shorter
times before institutionalization
        <xref ref-type="bibr" rid="ref26">(Schulz et, al., 1999)</xref>
        .
Institutionalization may be linked to a more rapid
psychological decline, since the individual is placed in an unfamiliar
environment at a critical period and becomes cared for by
individuals they do not know.
      </p>
      <p>To address this significant challenge, a research team,
comprised of investigators at NC A&amp;T State University,
University of Virginia and the Carilion Center for Healthy
Aging, has focused on the goal to identify
engineeringbased interventions to increase caregiver empowerment
through the use of tools to predict and minimize agitation
episodes among PWD. The envisioned system, Behavioral
and Environmental Sensing and Intervention (BESI), is a
complex cyber-socio-physical system that incorporates
technologies, social dyads and contexts. In other words, the
Cyber-socio-physical system is consisted of three
subsystems which comprise of various components. This complex
system will be used to acquire multiple forms of
descriptive data to build a knowledge base of the ecosystem
surrounding agitation. Data will be analyzed to understand the
lived context of a PWD and to develop a model that can be
used to predict agitation events associated with the
environmental conditions. A monitoring system which
recognizes agitation epochs will be developed to send real time
notification for caregivers. Secured web-based interface
monitoring system will be used to display the sensor data
for health care providers, caregivers and other authorized
users. The web-interface will be refined with input from
nurses, caregivers, and health informatics to ensure it is
user friendly and easily interpreted. Sensor data will be
grouped by category such as physical agitation,
temperature and noise level, and other environmental stimuli.
Users can further navigate the interface to view data from
individual sensors.</p>
      <p>As a result, caregivers can intervene on the PWD and the
environment before agitation escalates. BESI will be an
empowering tool for caregivers of PWD with cost effective
solution. Yet, the challenge of BESI lies in the immensity
of the data; where data forms, types, sources, and scales
vary extensively. This paper describes the frameworks that
serve as taxonomies and ontologies to assist our research
team to plan, collect, extract, analyze, and interpret the
multiple data streams from the BESI project. As the
research is at its early stage, the conceptual data framework
which facilitates the data collection and analysis, and
which also forms the basis for the advancement of the
technology is presented in this paper.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Literature Review</title>
      <p>
        In modern data-intensive science, more consideration has
been given to the challenges of handling massive data
formats and volumes. Considering the data ecosystem as a
whole is very essential to truly address the challenges of
very diverse multidisciplinary data. Understanding
complex system problems involving heterogeneous and diverse
interdisciplinary research data requires mixed data
integration and analysis
        <xref ref-type="bibr" rid="ref17">(Parsons et al., 2011)</xref>
        . A conceptual data
framework can be used to map the relationships and
dependencies among various scientific data sources, types of
data produced and used, and curation activities associated
with the data
        <xref ref-type="bibr" rid="ref8">(Cragin et al., 2010)</xref>
        . Conceptual mapping of
data frameworks can also be used to reduce qualitative
data, analyze themes and interconnections in the data
(Onwuegbuzie et al., 2009). Data frameworks are helpful
to identify types of data to be collected and data analysis
techniques to be used
        <xref ref-type="bibr" rid="ref17">(Parsons et al., 2011)</xref>
        . They also
serve as aids to develop new methods of analysis.
      </p>
      <p>
        The three V’s (volume, variety and velocity) are
characteristics of big data. Volume refers to the large amount of
data, variety refers to different types of data and velocity
stands for the rate of data accumulation
        <xref ref-type="bibr" rid="ref5">(Berman, 2013)</xref>
        .
The greatest benefit of big data is the ability to link
seemingly different disciplines for the purpose of developing
and testing hypotheses that cannot be approached within a
single knowledge domain. With few exceptions, big data is
ordinarily analyzed in incremental steps; the data are
extracted, reviewed, reduced, normalized, transformed,
visualized, interpreted and re-analyzed with different methods
        <xref ref-type="bibr" rid="ref4">(Bari et al., 2014)</xref>
        . Big data has many implications for
patients, healthcare providers, researchers and other
healthcare constituents. It will also impact how these
players engage with the healthcare ecosystem, especially when
external data, regionalization, mobility and social
networking are involved (
        <xref ref-type="bibr" rid="ref11 ref15">Murdoch and Detsky, 2013</xref>
        ).
      </p>
      <p>
        Data mining, knowledge extraction, information
discovery, information harvesting and data pattern
processing are some of the names used in the past to refer
to the process of finding useful patterns in data
        <xref ref-type="bibr" rid="ref9">(Fayyad et
al., 1996)</xref>
        , also known as knowledge discovery.
        <xref ref-type="bibr" rid="ref9">Fayyad et
al. (1996)</xref>
        define knowledge discovery as a series of
activities for making sense of data. They distinguish data
mining as a specific step in the knowledge discovery
process which focuses on the application of certain
algorithms to extract useful information (knowledge). In
contrast to these distinct views of knowledge discovery and
data mining,
        <xref ref-type="bibr" rid="ref20">Peng et al. (2008)</xref>
        use combined process of
data mining knowledge discovery (DMKD). They define
DMKD as extraction of useful information (knowledge)
from data and this extraction is achieved by learning new
methods and techniques. These methods and techniques are
used in the pre-processing and post processing of data,
specifically for discovering previously unknown patterns
and building predictive models from the data
        <xref ref-type="bibr" rid="ref14 ref20">(Peng et al.,
2008; Maimon et al., 2010)</xref>
        .
      </p>
      <p>
        Previous works which focus on monitoring agitation
behaviors were reviewed. Bankole et al. (2012) conducted a
study to explore the ability of a custom inertial wireless
body sensor network (BSN) to detect and quantify
agitation. The initial study was focused on validating the BSN.
The research work consisted of data collection on selected
subjects at different times of the day. From assessment of
the pilot results, it was concluded that the BSN was a valid
measure of agitation. The ability of the BSN for continuous
and real-time monitoring was also examined
        <xref ref-type="bibr" rid="ref3">(Bankole et
al., 2011)</xref>
        .
      </p>
      <p>In summary, a data framework is used to plan, structure,
and organize different data formats and large amounts of
data for data analysis and data integration in
multidisciplinary research. It helps to integrate, process,
visualize, and present data in a meaningful way.
Knowledge discovery processes are implemented to
prepare, select and cleanse data. Proper interpretations of
mined data from the research domain are possible using
these processes. Constructing an integrated and interactive
data framework with the application of knowledge
discovery and data mining will provide a map of mixed
analytical landscape for multidisciplinary researchers. This
data framework can also facilitate research team
communication, collaboration and the development of
shared mental models. Most importantly, data frameworks
support reasoned action when analyzing data. If
frameworks are organized and agreed upon ahead of time
while researchers are focusing on the primary research
questions and objectives, the analytical processes and
reasoning from the data will be more aligned with the line
of inquiry established by the problem to be addressed and
the research goals. In this way, research integrity is
maintained.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Purpose of the Research</title>
      <p>The purpose of this research is to develop and implement a
data framework for the research and design team to apply
data structuring and analysis on complex systems. The
investigators are developing a cyber-socio-physical system to
assist caregivers and providers in the management of
agitation in dementia. The cyber-socio-physical system is a
complex system based on its characteristics –
interrelatedness, autonomous components, and dynamic.</p>
      <p>The study to be conducted will use a remote
ethnographic approach to collect data about the physical agitation of a
PWD and the natural living environments of the PWD and
caregivers. This is achieved by making use of different
sensors on the patient as well as the surrounding
environment. Body-worn sensors are placed on the PWD, which
capture the movement of the patient at multiple parts of the
body to detect different stages of physical agitation.
Environmental acoustic sensors are installed to capture
information about ambient noise and speech features. Light and
temperature sensors are used to measure ambient
environmental conditions. Additional set of motion sensors are
installed near doorways to detect movement from one room
to another. The sensor networks, wireless devices and
laptop-based stations (physical structures), algorithms and
computations constitute the cyber subsystem.</p>
      <p>Different subjective measures are used to recognize the
agitation events, frequency, type, and stress level
experienced by the caregivers. These measures will help to
quantify agitated behaviors and their impact on the PWD and
caregiver separately as well as on the dyad as a unit. PWD,
caregiver-healthcare providers, the PWD-Caregiver dyad,
patient’s family and friends make up the social subsystem.
Agitation is influenced by a number of environmental
factors such as ambient temperature, sound and light level,
social density etc. It is important to track knowledge of this
environment which makes up the physical subsystem to
minimize the occurrence of agitation events in the patients.</p>
      <p>The problem space addressed by this research is three
fold:
1. The volume and variety of the data requires an
organizing data framework that guides input, structuring,
and analysis of the various forms of data
2. The complexity of the system (cyber-socio-physical)
requires a data framework to organize team members’
integrated mental models as the system is developed
from concept to final prototype
3.The data framework is needed to facilitate the data to
design translation process to achieve the final
outcomes to benefit caregivers and PWD</p>
    </sec>
    <sec id="sec-4">
      <title>4. Data Framework Development Process and Results</title>
      <p>
        Developing a conceptual framework for a specific study
incorporates a system of concepts, assumptions,
expectation, beliefs and theories that support the research
(Wang et al., 1995). Idea association can be regarded as the
catalyst that facilitates the interaction among researchers
and design participants. By linking the researchers’ and
designers long term memory internally and previous
participant knowledge externally, diverse design ideas can be
generated
        <xref ref-type="bibr" rid="ref12">(Lai and Chang, 2006)</xref>
        .In the BESI project, a
team that consists of multidisciplinary experts from
computer and electrical engineering, human factors and
ethnography, geriatric psychiatry, and nursing conducted a
brainstorming session to enhance their previous knowledge
about the cyber-socio-physical system with additional
innovative perspectives. Individual ideas were linked with
greater technical depth to generate the following flow
chart. The flow chart shows the basic steps followed to
generate the integrated and inclusive data framework.
      </p>
      <p>Figure 1 demonstrates the data framework of the BESI
project. This data framework accounts for the interactions
of the components of the cyber-socio-physical subsystems.
Cyber-socio-physical systems are comprised of three
subsystems. The cyber subsystem consists of the inertial
bodyworn sensors, environmental sensors, wireless Bluetooth
devices and computers. The sensor stream provides
continuous data about body motions and ambient living space
conditions. Similarly, the wireless Bluetooth gives
information about the location of person in a house in different
times of the day and night. A base workstation
communicates with all the sensors and wireless devices. Data
extractions from the sensory devices are done by applying
different signal processing algorithms. The extracted data will
have different format such as binary, continuous, ratio.</p>
      <p>The social subsystem encompasses the dementia patient,
caregivers, nurses, patient’s family and friends, health care
providers. Interviews, caregiver diaries, assessment
batteries are used to collect data. The collected data provides
information about behavioral pathology in dementia patients,
cognitive level, aggressive and non-aggressive agitation
symptoms, dementia stage, functional capacity, sleep
quality, quality of life for the caregivers and patients, etc.
Content analysis and score calculations are applied to filter
useful data from the collected information. It is important
to understand the various levels of social subsystems
within the BESI system. There are individual social
subsystems, dyadic social sub-systems (i.e., PWD-caregiver;
caregiver-healthcare provider), and group-level subsystems
(more than two individuals).</p>
      <p>The Physical/environmental subsystem consists of
environmental conditions that surround the dementia patients.
Temperature, sound and light intensity, physical movement
and speech features represent the physical subsystem.
Ambient conditions and gross movement data are gathered
using environmental and door way sensors. Various formats
(i.e. relative frequencies of codes, ratio, categorical,
binary) of the desired information are extracted from the
collected data using algorithms.</p>
      <p>The researchers can use the following data framework to
plan and organize their data collection, extraction, and
analysis activities. For instance, to monitor the behavior of
a PWD and their environment, body-worn and
environmental sensors are used. These sensors continuously
provide data about the physical movement of the patient and
ambient conditions in the room. However, sensory raw
data is often difficult to understand and interpret, especially
when sensory data comes from multiple sensors. It should
be noted that the sensor data is collected every second and
when this frequency of data collection is repeated for
multiple sensors, the researchers would be facing challenge of
handling and interpreting large amounts of data. Therefore,
researchers should divide the complex system into
subsystems and then apply the data framework to extract and
interpret the data from each subsystem independently.</p>
      <p>In addition, the data interpreted from each subsystem
should be integrated and correlated with each other to have
knowledge of the whole system behavior. The sensory data
from the cyber and physical subsystems, for instance,
should be converted to meaningful form to identify
patterns of movement which allow categorization of the
patient’s behavior and the environmental conditions
respectively. This can be achieved by simultaneous collection
and separate interpretation of the data from both
subsystems. The interpreted data are then integrated to identify
the environmental condition which contributes to the
agitation.</p>
    </sec>
    <sec id="sec-5">
      <title>Discussion and Conclusion</title>
      <p>A complete data framework provides researchers the
advantage of dealing with complex systems in several ways.
It enables identification of subsystems of a complex system
and helps to identify individual subsystem data sources and
data acquisition mechanisms. It provides a platform
towards extraction of useful information from the different
subsystems. It helps to correlate the data from the
subsystems which are useful for understanding of the entire
system which in our research is definition of the lived context
of PWD’s. The project will have very diverse and large da
ta sets to be collected and analyzed (Table 1). This table
was generated through mock-up data set that is currently
under development. The time scales, formats, sources, and
numerical scales will differ. The large volume of data,
frequency of data collection, and variety of the data which
come from multiple sensors demand data framework that
guides inputs, structuring, extraction, and analysis. This
framework will also evolve more as the research team
proceeds through the different project phases.</p>
      <p>Verification and validation of basic BESI sensing and
environmental assessment will be done in a controlled
setup and in the homes of PWD’s. Reliability of body-worn
sensors is validated based on caregiver diaries and
assessment batteries of agitation events. Data from caregivers
will be obtained through tablet diaries with structured
prompts and a time-stamped report. This data is
simultaneously collected with body worn-sensor data. Constant
comparison, narrative and content analysis are used to
analyze qualitative data from caregivers, whereas one or more
algorithms and statistical techniques are used to analyze
data from sensor streams. The results of quantitative
analysis of both quantitative and qualitative data are combined
at the interpretation level to validate the accuracy of sensor
activities. However, each data set remains analytically
separate from each other. Therefore, to plan the data collection
and analysis processes at the intersection of the two
subsystems, it is important to use BESI data framework.</p>
      <p>Data mining knowledge discovery (DMKD) approaches
will be carried out to extract useful information
(knowledge) from the each of the subsystems. Useful
information from sensor streams will be analyzed to
identify agitation epochs (pre-agitation, agitation,
postagitation) and to model associated environmental
conditions, which lead to slow or rapid perseverance of
agitation episodes. Besides, sensor data will be combined
with subjective data to support an integrated observation of
the social context of an agitation event. Finally, the
analyzed data and the model developed will be used to
inform design of monitoring system in which caregivers
and health care providers can get just in time notification
about the agitation epochs and triggers.</p>
      <p>Data frameworks in multi-disciplinary research facilitate
team communication and exchange of information in the
process of understanding and analyzing complex systems.
It enhances knowledge and shared experience about which
data analysis techniques can be integrated, how and why
they are combined. In this regard, the BESI data
framework will provide an excellent perspective to the
importance of multi-disciplinary research collaborations to
address critical societal needs.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgement</title>
      <p>This research is jointly funded by National Science
Foundation and National Institute of Health under one
Award number IIS-1418622.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>Alzheimer's &amp; Dementia</source>
          Volume
          <volume>10</volume>
          ,
          <string-name>
            <surname>Issue</surname>
            <given-names>2</given-names>
          </string-name>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <article-title>Alzheimer's association, Muffet's Story http</article-title>
          ://www.alz.org/living_with_alzheimers_15512.
          <string-name>
            <surname>asp Bankole</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith-Jackson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knight</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brantley</surname>
            ,
            <given-names>J.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barth</surname>
            <given-names>A.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lach</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2012</year>
          .
          <article-title>Validation of NonInvasive Body Sensor Network Technology in the Detection of Agitation in Dementia</article-title>
          .
          <source>American Journal of Alzheimer's Disease &amp; Other Dementias</source>
          <volume>27</volume>
          (
          <issue>5</issue>
          ):
          <fpage>346</fpage>
          -
          <lpage>354</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Bankole</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Knight</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smith-Jackson</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hanson</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barth</surname>
            <given-names>A.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lach</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <year>2011</year>
          .
          <article-title>Continuous, NonInvasive Assessment of Agitation in Dementia Using Inertial Body Sensors</article-title>
          , Wireless Health, San Diego, USA.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Bari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chaouchi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jung</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <year>2014</year>
          <article-title>Predictive analytics for dummies New Jersey John Wiley</article-title>
          &amp; Sons, Inc.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Berman</surname>
            ,
            <given-names>J.J.</given-names>
          </string-name>
          <year>2013</year>
          <article-title>Principles of big data: Preparing, sharing, and analyzing complex information Waltham</article-title>
          , MA: Elsevier Inc.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Colombo</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vitali</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cairati</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaccaro</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Andreoni</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guaita</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <year>2007</year>
          .
          <article-title>Behavioral and psychotic symptoms of dementia (BPSD) improvements in a special care unit: a factor analysis</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <source>Archives of Gerontology and Geriatrics</source>
          <volume>44</volume>
          (
          <issue>Supplement 1</issue>
          ):
          <fpage>113</fpage>
          -
          <lpage>120</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Cragin</surname>
            ,
            <given-names>M. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palmer</surname>
            ,
            <given-names>C. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chao</surname>
            ,
            <given-names>T. C.</given-names>
          </string-name>
          <year>2010</year>
          .
          <article-title>Relating data practices, types, and curation functions: An empirically derived framework</article-title>
          .
          <source>Proceedings of the American Society for Information Science and Technology</source>
          .
          <volume>47</volume>
          (
          <issue>1</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
          . Pittsburgh, USA Daley,
          <string-name>
            <surname>B. J</surname>
          </string-name>
          ,
          <year>2004</year>
          .
          <article-title>Using concept maps in qualitative research</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Fayyad</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          , Pitaetsky-shapiro,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Smyth</surname>
          </string-name>
          ,
          <string-name>
            <surname>P. 1996</surname>
          </string-name>
          <article-title>Knowledge Discovery and Data Mining: Towards a Unifying Framework</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <source>KDD-96 Proceedings.</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>M.</surname>
          </string-name>
          <year>2013</year>
          .
          <article-title>Monetary Costs of Dementia in the United States</article-title>
          .
          <source>The New England Journal of Medicine</source>
          <volume>368</volume>
          :
          <fpage>1326</fpage>
          -
          <lpage>1334</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Lai</surname>
            ,
            <given-names>I. C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Chang</surname>
            <given-names>T. W.</given-names>
          </string-name>
          <year>2006</year>
          .
          <article-title>A distributed linking system for supporting idea association during the conceptual design stage</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <source>Design studies</source>
          Vol
          <volume>27</volume>
          ,
          <string-name>
            <surname>Issue</surname>
            <given-names>6</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pages</surname>
          </string-name>
          685-
          <fpage>710</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Maimon</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Rokach</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <year>2010</year>
          .
          <article-title>Data Mining and Knowledge Discovery Handbook Second Edition</article-title>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Murdoch</surname>
            ,
            <given-names>T. B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Detsky</surname>
            ,
            <given-names>A. S.</given-names>
          </string-name>
          <year>2013</year>
          .
          <article-title>The Inevitable Application of Big Data to Health Care</article-title>
          .
          <source>The Journal of the American Medical Association</source>
          Vol
          <volume>309</volume>
          , No.
          <volume>13</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          2009.
          <article-title>A Qualitative Framework for Collecting and</article-title>
          Analyzing Data in Focus Group Research.
          <source>International journal of qualitative methods 8</source>
          (
          <issue>3</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Parsons</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Godøy</surname>
          </string-name>
          , Ø.,
          <string-name>
            <surname>LeDrew</surname>
          </string-name>
          , E.,
          <string-name>
            <surname>De Bruin</surname>
            ,
            <given-names>T. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Danis</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomlinson</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carlson</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <year>2011</year>
          .
          <article-title>A conceptual framework for managing very diverse data for complex interdisciplinary science</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <source>Journal of Information Science</source>
          <volume>37</volume>
          (
          <issue>6</issue>
          ):
          <fpage>555</fpage>
          -
          <lpage>569</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Plassman</surname>
            ,
            <given-names>B. L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Langa</surname>
            , K. M, Fisher,
            <given-names>G. G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heeringa</surname>
            ,
            <given-names>S. G</given-names>
          </string-name>
          , Weir,
          <string-name>
            <given-names>D. R.</given-names>
            ,
            <surname>Ofstedal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. B.</given-names>
            ,
            <surname>Burke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            ,
            <surname>Hurd</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. D.</given-names>
            ,
            <surname>Potter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. G.</given-names>
            ,
            <surname>Rodgers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. L.</given-names>
            ,
            <surname>Steffens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.C.</given-names>
            ,
            <surname>Willis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.J.</given-names>
            ,
            <surname>Wallaceg</surname>
          </string-name>
          ,
          <string-name>
            <surname>R.B.</surname>
          </string-name>
          <year>2007</year>
          .
          <article-title>Prevalence of Dementia in the United States: The Aging Demographics</article-title>
          , and Memory Study Neuroepidemiology,
          <volume>29</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>125</fpage>
          -
          <lpage>132</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Peng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kou</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shi</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <year>2008</year>
          .
          <article-title>A descriptive framework for the field of data mining and knowledge discovery</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <source>International Journal of Information Technology &amp; Decision Making</source>
          . Vol.
          <volume>7</volume>
          , No.
          <volume>4</volume>
          :
          <fpage>639</fpage>
          -
          <lpage>682</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Pruchno</surname>
            ,
            <given-names>R.A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Potashnik</surname>
            ,
            <given-names>S.L.</given-names>
          </string-name>
          <year>1989</year>
          . Caregiving Spouses.
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <article-title>Physical and mental health in perspective</article-title>
          .
          <source>Journal of the American Geriatric Society</source>
          <volume>37</volume>
          (
          <issue>8</issue>
          ):
          <fpage>697</fpage>
          -
          <lpage>705</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>O</given-names>
            <surname>'Brien</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. T.</given-names>
            ,
            <surname>Bookwala</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Fleissner</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.</surname>
          </string-name>
          <year>1995</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <article-title>Psychiatric and physical morbidity effects of dementia caregiving: prevalence, correlates, and causes</article-title>
          .
          <source>Gerontologist</source>
          <volume>35</volume>
          (
          <issue>6</issue>
          ):
          <fpage>771</fpage>
          -
          <lpage>779</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          <string-name>
            <surname>Schulz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          and Beach,
          <string-name>
            <surname>S.R.</surname>
          </string-name>
          <year>1999</year>
          .
          <article-title>Caregiving as a risk factor for mortality: the Caregiver Health Effects Study</article-title>
          .
          <source>Journal of the American Medical Association</source>
          <volume>282</volume>
          (
          <issue>23</issue>
          ):
          <fpage>2215</fpage>
          -
          <lpage>2219</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          <string-name>
            <surname>Steinberg</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zandi</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lyketsos</surname>
            ,
            <given-names>C. G.</given-names>
          </string-name>
          , WelshBohmer,
          <string-name>
            <given-names>K. A.</given-names>
            ,
            <surname>Norton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. C.</given-names>
            ,
            <surname>Breitner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. C. S.</given-names>
            ,
            <surname>Steffens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. C.</given-names>
            ,
            <surname>Tschanz</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. T.</surname>
          </string-name>
          , and Cache County Investigators.
          <year>2008</year>
          .
          <article-title>Point and 5-year period prevalence of neuropsychiatric symptoms in dementia: the Cache County Study</article-title>
          .
          <source>International Journal of Geriatric Psychiatry</source>
          <volume>23</volume>
          (
          <issue>2</issue>
          ):
          <fpage>170</fpage>
          -
          <lpage>177</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          <string-name>
            <surname>Trochim</surname>
            ,
            <given-names>W.M.K.</given-names>
          </string-name>
          <year>2006</year>
          .
          <article-title>Research methods knowledge base</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <source>Retrieved on March 20</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          http://www.anatomyfacts.com/research/researchmethodsknowled gebase.pdf
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Y .R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Storey</surname>
            ,
            <given-names>C.V.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Firth</surname>
            ,
            <given-names>P.C.</given-names>
          </string-name>
          <year>1995</year>
          .
          <article-title>A Framework for Analysis of Data Quality Research</article-title>
          .
          <source>IEEE Transactions on knowledge and data engineering</source>
          Vol.
          <volume>7</volume>
          , no. 4.
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <string-name>
            <surname>Fact</surname>
          </string-name>
          sheet No.
          <volume>362</volume>
          ,
          <year>Apr 2012</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>