<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Multi-Modal Data for Early Detection of Alzheimer's Disease</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Carmela Comito</string-name>
          <email>carmela.comito@icar.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Clara Pizzuti</string-name>
          <email>clara.pizzuti@icar.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marcello Sammarra</string-name>
          <email>marcello.sammarra@icar.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Annalisa Socievole</string-name>
          <email>annalisa.socievole@icar.cnr.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Alzheimer's Disease</institution>
          ,
          <addr-line>Brain Networks, Multi-modal data fusion, Artificial Intelligence, Prediction, Pro-</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute for High Performance Computing and Networking</institution>
          ,
          <addr-line>Via P. Bucci 8-9/C, Rende, 87036</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Early diagnosis of Alzheimer's disease (AD) is crucial for providing timely treatment and care to patients. However, current diagnostic methods rely on clinical symptoms and biomarkers, which are often unreliable and invasive. Brain networks model the brain's structure and function in AD and other brain diseases. To fully capture their complexity, we need multi-modal models that combine diferent types of data, such as structural and functional connectivity, clinical and genetic information. This gives us a holistic view of the disease's many aspects. In this paper, we argue that brain networks and multi-modal data fusion can improve early diagnosis of AD by capturing the complex and heterogeneous nature of the disease. Using brain network modeling and multi-modal data fusion, we envisage a novel framework for detecting AD and its prodromal stages. The framework can simultaneously capture network properties from multi-modal as well as longitudinal datasets, which provide complementary information.</p>
      </abstract>
      <kwd-group>
        <kwd>gression</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>CEUR
ceur-ws.org</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        the disease and predicting its progression. Various measurements have been developed and
assessed for detecting AD, typically encompassing physical health examinations,
neuropsychological assessments, and brain imaging techniques. Biomarkers are usually categorized into
physiological, cognitive, behavioral, and psychological domains. Among the non-cognitive tests,
neuroimaging techniques are commonly utilized, while the Mini Mental State Examination
(MMSE) [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ] stands out as one of the most widely recognized cognitive assessments.
      </p>
      <p>However, current diagnostic methods rely on clinical symptoms and biomarkers, which are
often unreliable and invasive. Clinical symptoms are subjective and vary across individuals
and stages of the disease. Biomarkers, such as cerebrospinal fluid (CSF) and amyloid-beta (Aβ),
require invasive procedures and expensive equipment. Moreover, both clinical symptoms and
biomarkers are not sensitive enough to detect the early and prodromal stages of AD, such as
mild cognitive impairment (MCI) and subjective cognitive decline (SCD).</p>
      <p>To capture the various symptoms of AD, including subtle changes that occur throughout the
progression of the disease, there’s widespread agreement that a reliable method for detecting
early-stage Alzheimer’s disease cannot rely solely on measurements from one source. Instead,
it should employ a multi-modal approach by combining diferent types of biomarkers. Each
type of data reveals unique aspects of the condition, and integrating them all provides a more
comprehensive understanding, ultimately improving diagnostic accuracy.</p>
      <p>
        Over the past few years, the progress in Artificial Intelligence-based methods for analyzing
multi-modal data has fueled research seeking new approaches for early disease detection. In
Comito et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], an overview of the most recent approaches leveraging machine learning
and deep learning techniques for the prediction of Alzheimer’s disease by exploiting the huge
amount of multi-modal data now made available from the public repositories mentioned above
to researchers has been presented. However, current research does not consider an important
modality that recently has attracted the interest of many researchers: the brain connectome
introduced by Sporns et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] in 2005. In particular, in the last ten years, the investigation of
AD progression and early detection has shown promise through the concurrent utilization of
advanced neuroimaging methods and complex network theory. By creating a brain network
from imaging data and representing it using network graphs allows to capture the complex and
dynamic interactions among brain regions, and reflect the changes in the brain structure and
function due to AD. Several studies have shown that brain network analysis can provide useful
insights into the pathophysiology and progression of AD, and can discriminate between AD and
normal aging. Analyzing the complex network of the human brain provides valuable insights
into its structural organization. This allows for the identification of abnormal interaction
patterns or irregularities in the modular structure of brains afected by AD.
      </p>
      <p>The objective of this paper is to explore new avenues and methods to integrate brain networks
within multi-modal learning architecture to improve early diagnosis of Alzheimer’s disease.
To this purpose, the paper proposes a novel framework for detecting AD and its prodromal
stages using brain network modeling and multi-modal data fusion. Unlike existing methods,
our framework can simultaneously capture network properties from multi-modal as well as
longitudinal datasets, which provide complementary information. We use network models to
represent the structural and functional connectivity of the brain regions, and integrate multiple
types of data, such as images, text, audio, etc., to capture the complex and heterogeneous nature
of AD.</p>
      <p>
        The paper is organized as follows. In Section 2, a summary of the current state-of-the-art
multi-modal approaches for AD prediction overviewed in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] is reported. Section 3 discusses
brain networks, highlighting the most relevant trends of the network-based models. Section
4 presents the proposed framework integrating brain networks within multi-modal learning
architectures. Finally, Section 5 concludes the paper.
      </p>
    </sec>
    <sec id="sec-3">
      <title>2. Multi-modal Approaches for AD Prediction</title>
      <p>
        This section summarizes the main data modalities and AI methods utilized in Alzheimer’s
disease research reviewed in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>As far as data modalities are concerned (see Figure 1), neuroimaging (i.e. diferent tipology
of MRI and PET scans) stands out as the most prevalent data modality due to its non-invasive
nature, the availability of large datasets, the advancement of robust AI tools capable of extracting
significant features and classifying images, and the possibility of analyzing both structural and
functional brain anomalies and changes in AD patients.</p>
      <p>Following neuroimaging, biological and genetic markers (APOE-e4, SNPs, CSF) are
predominantly used to identify individuals likely to develop AD. Actually, certain genes and CSF markers
have been linked to an increased risk of the disease. Neuropsychological and cognitive
assessment tests are the third most common, primarily serving as screening tools to pinpoint those
requiring further evaluation. Lastly, demographic and clinical data, including blood markers,
are less frequently employed in the classification and progression tracking of AD.</p>
      <p>The complexity and diversity of the data involved in AD research are, in turn, reflected in
the use of various AI techniques to classify the stages of the disease and predict its progression.</p>
      <p>Traditional ML classifiers like SVM, DT, GB, RF, and LOR are widely used (see Figure 2),
particularly when clinical, demographic, and cognitive data are adopted. On the other hand,
DL methods, including NN, CNN, and RNN, show promise in medical image analysis, which is
crucial for AD diagnosis and monitoring. However, there is a remarkable number of AI methods
(referenced in Figure 2 as “OTHERS”) that are used only in one or two approaches. This
highlights that the application of AI in AD prediction and progression is indeed a multifaceted
ifeld.</p>
      <p>The mixed outcomes of the research in this field suggest that there is no one-size-fits-all
solution, and the choice of technique may depend on the specific dataset and task at hand.
Moreover, the need for careful parameter tuning, data selection, and experimental settings
cannot be overstated, especially when dealing with limited data availability, which is a common
challenge in AD research. The exploration of ensemble neural networks and the comparison of
various ML models underscore the ongoing eforts to refine predictive models for AD.</p>
      <p>Overall, the continuous evolution of AI methods in AD prediction and progression
demonstrates the dynamic nature of the field and the potential for AI to contribute to our understanding
and management of this complex disease.</p>
    </sec>
    <sec id="sec-4">
      <title>3. Brain networks</title>
      <p>
        In the last decade, the study of the progression of Alzheimer’s disease and its early detection
has provided promising results from the joint use of advanced neuroimaging techniques and
complex network theory [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The construction of a brain network from an imaging model
through the formalism of network graphs has significantly improved the understanding of how
the brain of an AD patient behaves. The complex networks-based analysis of the human brain
provides better insights into the network structure, thus uncovering abnormal patterns of
interactions or randomness in the modular structure of an AD-infected brain.
      </p>
      <p>
        Graphs are a mathematical model widely used for studying complex systems. In the literature
on brain networks and neurodegenerative diseases in general, there are diferent ways to
formalize and model the brain through a graph. More formally, the entities of a brain and their
relationships can be represented with a brain network  modeled as a graph  = ( , ,  )
where  is a set of  objects, called nodes or vertices,  ⊆  ×  is a set of links, called edges,
that connect two elements of  , and  ∶  ×  →  is a function which assigns a weight to a
couple (, ) of nodes  and  , if there exists an edge connecting  and  , and 0 if an edge between 
and  does not exist. In almost all the AD-related studies, the nodes of the graph are usually
brain regions, while the edges may capture diferent relationships between regions [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. We
therefore classify brain networks and study their connectivity accordingly, as follows.
      </p>
      <p>
        • Anatomical/structural brain networks: constructed from structural magnetic
resonance imaging (MRI), the edges represent physical connections between regions (e.g., the
estimated white matter connection strength in terms of number of fibers between any
pair of brain regions [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], interregional similarity [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], etc.).
• Functional brain networks: the edges capture the functional interaction (magnetic,
electrical, or hemodynamic/metabolic) between brain regions that are not necessarily
adjacent or physically connected. These networks are usually constructed from imaging
models like functional magnetic resonance imaging (fMRI), electroencephalography
(EEG), and magnetoencephalography (MEG). In recent studies, resting-state functional
magnetic resonance imaging (rs-fMRI) has also been used in AD progression studies. This
imaging technique evaluates the BOLD (Blood oxygenation level-dependent) signal in
various regions of the brain. Its fluctuations, together with other functional connectivity
alterations, are used as AD biomarkers.
• Cortical thickness networks: these are hybrid networks based on structural data with
      </p>
      <p>functional-like edges representing correlations between regions.
• Directed progression networks (DPNets): closely related to cortical thickness networks,
they attempt to capture the temporal progression of the disease, more than the correlations
between regions, similar to the epidemic network models where an edge represents the
spreading of the disease. In this network formalism, the edges are directed and capture
the degree to which one brain region thinning precedes the second region thinning.</p>
      <p>
        To characterize network topology, thresholding sparsification techniques are usually applied to
structural or functional connectivity matrices to remove edges with noisy weights [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        Even if these types of networks are clearly related, the comparison between them and their
joint analysis with the goal of having a systemic and multi-layer view of the disease progression
is not straightforward [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        An important aspect that the study of brain networks has highlighted in recent years is the
detection of building blocks, i.e. the presence of overabundant small subgraphs sharing patterns
of interconnections, called network motifs, occurring with a frequency higher than that in a
random network [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Network motifs have been recognized as fundamental building blocks
of networks [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] giving insights into the functional mechanisms of the analyzed system, and
revealing diferent organization models of the same network.
      </p>
      <p>
        A  of a graph  is defined as an unordered subset  = { 1, … ,   } of nodes of  presenting
a particular pattern of interconnections. Fig. 3 shows five types of motifs among three and four
nodes (Fig. 3(a)-Fig. 3(e)). Their labeling follows the same convention adopted in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The
bi-fan motif, for example, is over-expressed in neuronal networks.
      </p>
      <p>
        Motifs have been largely analyzed in brain networks, especially in structural and functional
networks. In [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], Meier et al. exploit motifs for clustering the functional brain network built
on MEG data. This type of network, called efective connectivity network , is composed by ROIs
linked by their efective connectivity , a measure describing the causal efect of one brain region
      </p>
      <p>RESEARCH | REPORTS
(a)
(b)
(c)
(d)
(e)
spoicotnrinioaplntriaoelngruaelglaruteligaoutniloantion
sia1g(Ar.Fe,1iAMg.,11M–AM,1–M7M)1a–7)rMear)eare</p>
      <p>7
uytrbsutstocrtusutcrrtuaulcrtahulurhablusbhsubs
h1aAoptph,astph(asFt hi(gFs.i(g1F.Ai1g,A.,1A,
eakotvwremkoomrtkiofmstifohstaihvfseavheave
nortnikizosaontfioonnfentoweftonwrekotswrkosrks
esralgylnaerrlygeemrleyamirneasminaasninasnan
owuorrk motif M, our
rmkomtioftMif ,Mo,ulaoryuerr.
8 JULY 2016 • VOL83J
on another region. To calculate this pairwise value between brain regions, the measure of</p>
      <p>
        Phase Transfer Entropy (PTE) is applied. Here, some 3 and 4 nodes motifs are over-expressed,
tornwereskotwrsktorsrutkcrutsutcrrtueumcsroteruesorveesr, motif-based clustering reveals a strong symmetry between the two hemispheres,
supporting the idea of a higher-order organization of the efective connectivity brain network.
oaizmrnagi-tazianotinizoaontfioocnofmco-mBcaot-tiston et al. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] analyze the presence of motifs spanning over a two-layer brain network
of
meaeonmwr-koerwtkhoatrhtkaidt
eidne-nthaotf ihdeaeltnhy- subjects composed of a structural and a functional layer. The multiplex two-layer
      </p>
      <p>network is built by forming a first structural network layer with DW-RMI data (Difusion
ofsr.kFor each network
FroeracehacnhentwetowrMkoargknetic RMI) and a second functional layer with rs-fMRI data. The motifs analyzed are
ihnegr-order clusmtueltriipnlegx, which is statistically overabundant small subgraphs spanning over the two layers
r-doerrdecrlucsltuesrtienrging</p>
      <p>
        and jointly considered. Results show that motifs in whichFigl.i2n.Hkighser-boredetrwcluseteerinnthbeCr. aeleignansrneeugroinoal nnestwoarkt. [Stehe(e29).] have been proposed as pioneers
diicfh- means that dif- (A) The four-node bi-fan motif, which is overexpressed in neuronal networks neurons are known regulators of
emaneasnthsathtadtisftd-ruicft-ural layer also have a functional activity are frequent,(1b). uInttuittivhelye,trhiesmaotrifedesacrlibseosafcrooepeqrautivee nprotpamgatuionlotfiipnfolremxation exposestheirorganization.Theclu
dnes-are exposemdote,if-dshea-ving distant regions with strong functional dynamclusitecr sin.thFeCi.neleaglanlsyf,rontthal eneuaronnalanletywosrkisbassehdoon wthesmottihfine(A). three RME neurons, outgoing con
fromthe nodesonthe lefttothe nodesonthe right.(B)The besthigher-order intermediary of information proce
eareexpexopseodse,dd,ed- The cluster contains three ring motor neurons (RMEL, -V, and -R; cyan) with the largest total number of conn
existence of a reinforcement mechanism between the strumcantyuourtgaoilngaconnndecttiohnse,whficuh nsecrvetiaostnheasolurlcaeyof einfrorsmaftoionr;six lustrationofthehigher-orderclust
if. inner labial sensory neurons (IL2DL, -VR, -R, -DR, -VL, and -L; orange) with locations are the true two-dimen
which the probability of having a link is related to the intemnansyiintcoyminogfcontnhecetioncs,osenrvinngaescthteidoestninatiionnoftinhfoermaotiotnh;aendrfour Mostinformationflowsfromleft to
URA motor neurons (purple) acting as intermediaries. These RME neurons RIH serve as sources of informati
nrdfo.erddu.edu
• Step 2: Compute the spectral ordering s of in thenetwork,in practice,thealgorithmismuch tion) (
sither of nodes SRwecietnhtstudies have highlighted that network motif analythesinsodecs afronm ptheronovrmiadlizeed nmoetiwfLapmlaciaanrk efarstser. fBoyarnaltyhzineg16 real-world networks where higher
rf onfondoedseSswSiwtdhiiatghnosis and progression of Alzheimer’s disease. Friedman• Setetp a3:l.Fin[d1th4e]prwefixesreteofasbwlieth tthoe d2isbtililinong,wueisfohund the computational com- the su
matrix constructed via WM (15). the number of edges m ranges from 159,000 to knowl
Satsehould participate smallest motif conductance (the argument of the plexity to scaleasQ(m1.2).Moreover,thealgorithm when
huoldulpdaprtairctipicaiptAeaDtferom HC patients with directed motif analysis of theirmDinimPuNm), efotrmsa.llyI,Sn: =aadrgdmiintrifoM(Snr),,wthheree ecnanterasoilypbyepoarafllelized, and sampling tech- is not
Sr = {s1, …, sr}. niques can be used to further improve perform- also se
unldd, the set S sthheomuotlidfdistribution provides a new imaging marker for MForCtriIa.ngular motifs, the algorithm scales to ance (16). for the
, ethseetseStsShoshuolduIlndthe next section, a review of the most recent propostaaklesssesvetraulhdouyrsitonpgrocebssrgraapihns ofnsuechtswize.ordkirsectefdo,arndtwheigehtednetworks,aswellasmotifs higher
networkswithbillionsofedgesand,typically,only The framework can be applied to directed, un- (13). S
wenhich oFci gcu.r1s. wHhigenher-oFrdige.r 1n.eHtiwgohrekr-sotrrduecrtunreetswoaOnrnsmkadllernsettwtohrrkseuwithchhutndiuregdsrohfethoeussarnd-saon(1r3d)d.Moeretovrher, it encanealhsotbiewagpplohiedrteonkertw-orocks lrudbersof
hicohccoucrcsurwshwedhniaegnnosisFoifgFA.lizgh1e..im1He.ri’sHgdhiisgeeahrse-eoirsr-rodepreodrrteednr.entewtowrokrsksizet9(1rs3).uAtlthrcouugthtcuhewtroruest-carsseecomasputnatiaodnanl dtare hcomtemhon eihnsoiciahglneihtwgorekhs(rfriee-nodrve-rrsuodsforeedrmeathe
of edges, the algorithm can process motifs up to withpositiveandnegativesignsontheedges,which motifs
tmhea mo(tAif)aHreigihnetrh-oerder s(tAru)cHtuigrehsera-roerdcearpstutrruecdtubryesneatrwecomopclerxaikty pof mtthueaolrgoetritidhfmsfob.rtyrFianognurlaeremtoxw-aoor mtrrukst pvemrlseus ,doistartusiltflesd1ge.s3)aFndocmoertabneolicnxneaet-mcstpeepctr
aomtiof taifrearine itnhethe (A()AH)igHhigerh-eorr-doerdresrtrsutcrutucrteusreasrearceapcatuprteudrebdybnyentwetowrkormkomtiofsti.fsF.oFroerxeaxmapmlep,l
tifs is Q(m1.5), where m is the number of edges works (edges signifying activation versus inhibi- that fi
lyM, ,givenmaotmifs3oa.t1ri.ef NsMheto,wwonrkh-mbearoeste.ifd(sBaa)prpCerlsouhascothewernisngheorfea.(nBe)twColursk16t4ebra8iJUnsLY eg201d6o•VoOfL 3an53 ISnmSUEe6o2t95 wtifoMrk b.Faosread goinvemnomtifoMtif7M.F,oo
7
geinvean ma omtioftMif ,M, momtifostiafsreasrehoshwonwhnehree.r(eB. ()BC)luCsltuesrtienrginogf oafnaentwetowrkorbkabsaesdeodnomn omtiof tMif M.F7o.Froar
frtaomewfoinrdk aaAsimseptsarottfoofntohedNeesftiwnSodrtkahMasetedimtcinoienfaimnppoirzdoeaecsshemSs, tothhteiafnetctwomonrindk-iubmacstiezadenmsceemth,oofdtsiaf(rSce)oa,bnlwedthuoiccrethvaenwalceteh,edfeMfi(nSe),a7wshthiceh r
M
mweowrkorakimaismtnsoettwoork dfiinsrdufipntaidonsaseotsretohtfe osntrfoundctoeurdsaleScshatSnhgaetshtianmittiiamnteimdinbiiymztehiszeedmisseoamsteiofthtcrifooucngohdntuhdceutaapcpntlaiccneatc,ioefn,off(MS()S,w),hwichhicwhew
sheatt of nmodoetisfsSc)utth(afiltled trmianogtilfessccuutt()fitloledthterimanignliemsucmut)nutomtbheermofinnimoduems innuinmsbtaenrcoMefsnoofdtehseinminostitfai
methodologies proper of Network Science and Graph Theory, ofering practical techniques able
onfondoedseSs) St)hathtat momtifosticfsutcu(ftill(efidlletdriatrniagnlegslecsuct)utto) ttohethme imniminiummu mnunmubmebreorf onfondoedseins iinnsintasntac
this catsoeta,ctkhleertheeislimotinthaeitsiomcnsaoostfeift,hctehuceto.rn(esCoils)idToatnhedeebmhioimgohatriefkrce-ruostr[.d5](e.CrT)hneTeshetwemoehtrihgkohdcseluar-rseoterindrciernergansifnergatlwmyoerwkoclruks.tGeirvineng
attractingthinisttehrciesastscdeau,setehto,ettrhheeeirriseaboiislnitoeyntmoesomimtiopfltcifiuyfctt.hue(tCu.n()CdTe)rhsTteahnhdeiignhghigeofhr-tehorer-dmoeroddreenlirenngtweoftowtrhkoercklucslutesrtienrginfgraf
tgh,ematicalinEtnegrienseter(iinng,this casinet,eMres),tt(hine tfhraismceawseo,rMkf7o),rmthse aframmoetiwfaodrkjafcoernmcsy ammatoritxif (aWdja)cebnyccyomunattinri
eic3naa0ttli5cE,anUlgSEinAnteg.wei2nrDoeineepgnrai,onidrnigtdsmt,eehaeisssneatcarteionam-tboueiynlcrtrtiecpeetupslwerotrebro(tsiiioinntnln7og(goatiiinnhdcnaTietslahislnbecilvsseacet1loscaste-an[ho1,sec5cMe]tec.y,p7IuMno)er,fto7htfi)etnhb,hfertoeaahliflnnoermwanfieminrontawgstem,iotfwwa.rkeneAomwrcrneeokvodiereefowkoliigfnrtfgemhot.nehrsvmmeeoasmcstmtarooerotlmeiftvo.iaoffnAtatianfdwajoLaedrakcijgsapeeMclnaneccvnyieaccmnytoamtrrtaraoinxtfrsi(fxao
2
S,IsNAiUty.S,2AWD.eepsDaterLptamafraetymnetettnet, IN twotwnoondoedsecso-cooc-coucrcuinr iannainnsitnasntacnecoef otfhethmeomtiof.tiAf.nAneigeeignevnevcetocrtoorfoaf aLa
adjacency matrix isadthjaecnenccoymmpuatteridx.iTshtheeonrdceorminpgusteodf.tThheenoorddeesripnrgosvidoefdthbeyntohdeecsopmropvoidnee
p,eaWsrttemLsatefnLatya,efaStytteae,nttfIeNo,r dIN• Dragomir and Vrahatis [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] review the current state-of-the-art in network-based
biomarkmn.te,nStt,aSntfao(nr1df5o)rdproduceresasfdonrjaaepdcsrej(teace1nlc5idnce)iycnspaeclmrtyAosaDdmSturdarciixate=grisnisx{osnstiishe1s,sebt…thnyee,sdcunsobsdcm}eiovotpimsdfuiniSpntgeructd=rhtee.eTa{dcsshu.1iTren,rehg…onetr,sdtoisrzeerrend}rdienros.rgfiWinnitsngoecotsrpwefrooatohrfsveeietsnhegnaterhocsnahdiztoeedtsherpe.sWrsopeevrotidpvSerioddvewebdi
r r
blobodaosbmeaidscse-cboioncmodanurkdcetrusacinntacmeno,cleec,ular netw)o,rikssn)aaennadera-atoarp-(o2t)ipmbtriaamiln ahlelivghehlig(ei.hre-.eovror-ldouemrdreetcrrilcucslutesrte(r13(1).3).
      </p>
      <p>
        d fMf(SMr()S,ris a
approaches and connectivity from MRI data on connectivity networks). In this context,
the benefits of monitoring the early stages of the disease by jointly considering genotype
and brain phenotype information as noninvasive biomarkers are discussed. Particular
emphasis is placed on methods that analyze the network substructure through methods
of complex network analysis since disruptions usually occur locally, in diferent brain
regions and molecular pathways, and at diferent rates. Finally, a framework
integrating knowledge from the two information levels, molecular omics-based data collected
from blood samples and brain connectivity obtained from neuroimaging techniques, is
proposed, showing that this multi-level solution can further improve diagnosis.
• In [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], Tijms et al. analyze the structural brain network of gray matter extracted from
      </p>
      <p>MRI images, and the clinical progression in nondemented subjects who have abnormal
amyloid markers in the cerebrospinal fluid (CSF), that is a marker of predementia AD.</p>
      <p>
        The study investigates if network structural measures like size, connectivity density,
degree, clustering coeficient, path length, betweenness centrality, and the small-world
property are somehow associated with the rate of progression to MCI or dementia, using
Cox proportional hazard models to assess associations between the structural measures
and time to clinical progression. Results indicate that when these measures have low
values there is an increased risk of fast progression to MCI. In particular, lower clustering
values, indicative of a more randomly organized network, in specific anatomical areas are
associated with clinical outcomes and fast clinical progression.
• In recent work, [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] Ding et al. investigate the relationship between topological features
of gray matter morphological networks and the clinical cognitive performance of healthy
control subjects (HCs) and patients with SCD or MCI. Analyzing local graph measures, the
networks of SCD and MCI show a significant decrease of degree centrality in the caudate
neucleus and of nodal eficiency in the caudate neucleus, right insula, lenticular nucleus
and putamen. In terms of global topological measures, SCD and MCI patients show
lower values of path length, normalized path length, and global eficiency in their brain
networks. The study concludes that the topological features of the structural gray matter
network can be considered biomarkers that can improve AD prognosis and interventions
in its early stage.
• Friedman et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] define and analyze the DPNets in AD, particularly directed brain
networks where an edge between two regions represents nor the physical connectivity
nor a functional connectivity but the temporal spreading of the pathology. The DPNets
are constructed by evaluating the change in cortical thickness measurements: when a
node A is thinning over time, it is considered infected with a certain probability and
may spread its infection to other nodes. A directed edge connects node A to a node B
if in a late period B shows a higher thinning rate (i.e. B has been ”infected” by A), with
a weight representing an infectious similarity (ISIM). By using several local and global
measures (degree, indegree, outdegree, size of the giant component, path length, global
eficiency, clustering coeficient, modularity and small world properties), the results show
that DPNets are able to classify AD patients looking at clustering (low) and small-world
property (low) values.
• Lama and Kwon [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] design an AD diagnosis approach able to classify subjects into AD,
      </p>
      <p>MCI, or HC, modeling the brains as functional graphs and exploiting graph theory-based
features. The functional brain network is built by setting on each edge the Pearson’s
correlation functional connectivity between ROIs. Then, graph embedding (node2vec)
is used to transform graphs into a vector and applying machine learning techniques.</p>
      <p>To classify the subjects into classes, diferent classification techniques including linear
support vector machines (LVSM) and regularized extreme machine learning (RELM) are
explored. The highest accuracy is obtained by combining LASSO with LSVM.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Fusing Brain Networks and Multi-modal data: Proposed</title>
    </sec>
    <sec id="sec-6">
      <title>Learning Model</title>
      <p>Brain networks are complex and intricate systems that reflect the brain’s structure and function
in various brain diseases, such as AD. Multi-modal data is essential to capture their complexity.
Multi-modal data integrates diferent types of data, such as structural and functional,
connectivity, clinical, and genetic information, to form a holistic understanding of the disease’s
multifaceted nature. Previous research has tried to fuse various modalities.</p>
      <p>
        However, studies investigating the combination and the relationship of the brain connectome
with biomarkers and genetics are very few. Only recently, Yu et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] pointed out the link
between the changes in structural and functional network organization in Alzheimer’s disease
brain and the accumulation of amyloid- and tau in particular parts of the brain. Moreover,
Badhwar et al. [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] proposed a roadmap to fusing multiomics measurement for the diagnosis of
Alzheimer’s disease.
      </p>
      <p>To bridge this gap we propose a novel multi-modal architecture that integrates brain network
with biomarkers and genetics data. Integrating brain networks and multi-modal data within a
learning framework for Alzheimer’s prediction is a promising approach that leverages diverse
sources of information to improve the accuracy and reliability of predictive models. Brain
networks provide a comprehensive representation of the brain’s structural and functional
connectivity patterns, ofering valuable insights into the underlying neurobiology of Alzheimer’s
disease. Multi-modal data, on the other hand, encompasses various types of information such
as neuroimaging scans (e.g., MRI, PET), clinical assessments, genetic markers, and cognitive
scores, each providing unique perspectives on the disease.</p>
      <p>Figure 4 shows the proposed learning framework. The model is crafted for a multi-modal
multitask objective, aiming to grasp Alzheimer’s disease progression and cognitive scores based
on a variety of data. As illustrated in Figure 4, the model initially processes data from five
modalities: neuroimaging, biomarkers, genomics, clinical, and demographics. Specifically,
multimodal data including MRI scans, demographics, medical history, functional assessments,
and neuropsychological test results, are used to develop learning models on various classification
tasks. Local and temporal feature learning in the model is facilitated by exploiting machine and
deep learning cutting-edge methods. The features from various modalities (cognitive scores,
neuropsychological battery, MRI, PET, and assessment modalities) undergo preprocessing to
enhance data quality. AI techniques are utilized for feature reduction, extracting principal
components from high-dimensional MRI and PET data. For example, neuroimaging features
from MRI and PET modalities can be extracted using FreeSurfer. Subsequently, deep features
are independently learned from each modality using both ML and DL approaches like stacked
CNN-BiLSTM models. Abstract deep features obtained from the previous step are then fused to
extract common features from all modalities using a series of dense layers within a deep neural
network. As the final stage of the learning framework, a classification is produced.</p>
      <p>By combining brain networks with multi-modal data in a learning framework, we can
capitalize on the complementary nature of these sources to enhance prediction accuracy and
understand the complex progression of AD. Here are some key points to consider:
• Feature Fusion. Integrating information from brain networks and multi-modal data
involves fusing features extracted from diferent sources into a unified representation. This
can be achieved through techniques such as feature concatenation, attention mechanisms,
or graph-based fusion methods.
• Learning Architecture. The learning framework should incorporate neural network
architectures capable of processing multi-modal inputs and capturing complex relationships
within the data. This may involve the use of deep learning models such as convolutional
neural networks (CNNs), recurrent neural networks (RNNs), or graph neural networks
(GNNs) tailored to handle multi-modal data.
• Regularization and Adaptation. Given the high-dimensional and heterogeneous nature of
multi-modal data, regularization techniques such as dropout, and batch normalization,
can help prevent overfitting and improve generalization performance. Additionally, model
adaptation strategies may be employed to adapt the learning process to diferent data
modalities and patient cohorts.
• Evaluation and Validation. Robust evaluation metrics and validation procedures are
essential for assessing the performance of the learning framework. Cross-validation,
hold-out validation, and external validation on independent datasets can help validate
the generalizability of the predictive models.
• Clinical Interpretability. Interpretable models are crucial for translating predictive insights
into actionable clinical decisions. Techniques such as attention mechanisms, feature
importance analysis, and visualization methods can provide insights into the contribution
of diferent modalities to the prediction task and aid in clinical interpretation.
• The rapid growth of new AI approaches in the last decade has largely overlooked the
importance of computational eficiency in algorithm design and data generation. This has
led to the widespread adoption of complex AI techniques with high computational costs
and energy consumption. This is true also in medical applications, such as AD detection,
where improvements in accuracy come at the cost of increased data availability. The
development of novel algorithms able to deal with limited resources while maximizing
the quality of the results obtained is a main objective of the emerging so-called Green AI
methods. Considering the large volumes of multimodal data nowadays available for AD,
the design and development of new energy-aware AI techniques with low computational
needs and reduced data while reaching high predictive accuracy is a desirable objective
in the near future of AD research.</p>
      <p>Overall, integrating brain networks and multi-modal data within a learning framework holds
great potential for advancing Alzheimer’s prediction research, leading to more accurate and
reliable predictive models that can aid in early diagnosis and personalized treatment planning
for patients.</p>
    </sec>
    <sec id="sec-7">
      <title>5. Conclusion</title>
      <p>In conclusion, early detection of Alzheimer’s disease is paramount for efective intervention
and patient management. However, existing diagnostic methods often fall short, relying heavily
on clinical symptoms and biomarkers that may not provide accurate or timely results. Brain
networks ofer a promising avenue for understanding the complex structural and functional
changes associated with AD. To fully grasp this complexity, a multi-modal approach is
necessary, incorporating various data types such as structural and functional connectivity, clinical
assessments, and genetic information.</p>
      <p>In this paper, we advocate for the integration of brain networks and multi-modal data fusion
to advance early AD diagnosis. By combining these approaches, we can better capture the
diverse and nuanced characteristics of the disease. Our proposed framework seeks to leverage
brain network modeling and multi-modal data fusion to develop a comprehensive understanding
of AD and identify prodromal stages. This innovative approach aims to extract network features
from diverse datasets, including longitudinal data, to enhance diagnostic accuracy and inform
timely interventions for individuals at risk of AD.</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgments</title>
      <p>This work has been partially supported by the project ALCMAEON (F/260014/01-03/X51)
funded by MISE. We acknowledge the support of the PNRR project FAIR - Future AI Research
(PE00000013), Spoke 9 - Green-aware AI, under the NRRP MUR program funded by the
NextGenerationEU.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>F.</given-names>
            <surname>MF</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>SE</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. PR.</surname>
          </string-name>
          ,
          <article-title>Mini-mental state. a practical method for grading the cognitive state of patients for the clinician</article-title>
          ,
          <source>Journal of Psychiatric Research</source>
          <volume>12</volume>
          (
          <year>1975</year>
          )
          <fpage>189</fpage>
          -
          <lpage>198</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A. J.</given-names>
            <surname>Mitchell</surname>
          </string-name>
          ,
          <article-title>The Mini-Mental State Examination (MMSE): Update on Its Diagnostic Accuracy and Clinical Utility for Cognitive Disorders</article-title>
          , Springer International Publishing, Cham,
          <year>2017</year>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Carmela</surname>
          </string-name>
          <string-name>
            <surname>Comito</surname>
          </string-name>
          ,
          <article-title>Clara Pizzuti, Overview of artificial intelligence methods for alzheimer's disease prediction and progression</article-title>
          , in: SITIS Conference,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>O.</given-names>
            <surname>Sporns</surname>
          </string-name>
          , G. Tononi,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kötter</surname>
          </string-name>
          ,
          <article-title>The human connectome: A structural description of the human brain</article-title>
          ,
          <source>PLoS Comput. Biol</source>
          .
          <volume>1</volume>
          (
          <year>2005</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>L.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , J. Qu, H. Ma, T. Chen, T. Liu,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zhu</surname>
          </string-name>
          ,
          <article-title>Exploring alzheimer's disease: a comprehensive brain connectome-based survey</article-title>
          ,
          <source>Psychoradiology</source>
          (
          <year>2024</year>
          )
          <article-title>kkad033</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Friedman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Young</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Asif</surname>
          </string-name>
          , I. Jutla,
          <string-name>
            <given-names>M.</given-names>
            <surname>Liang</surname>
          </string-name>
          , S. Wilson,
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Landsberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Schuf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. D. N.</given-names>
            <surname>Initiative</surname>
          </string-name>
          ,
          <article-title>Directed progression brain networks in alzheimer's disease: properties and classification</article-title>
          ,
          <source>Brain connectivity 4</source>
          (
          <year>2014</year>
          )
          <fpage>384</fpage>
          -
          <lpage>393</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>F.</given-names>
            <surname>Battiston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Nicosia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Chavez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Latora</surname>
          </string-name>
          ,
          <article-title>Multilayer motif analysis of brain networks</article-title>
          ,
          <source>Chaos: An Interdisciplinary Journal of Nonlinear Science</source>
          <volume>27</volume>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>B. M.</given-names>
            <surname>Tijms</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. Ten</given-names>
            <surname>Kate</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Gouw</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Borta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Verfaillie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. E.</given-names>
            <surname>Teunissen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Scheltens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Barkhof</surname>
          </string-name>
          , W. M. van der Flier,
          <article-title>Gray matter networks and clinical progression in subjects with predementia alzheimer's disease</article-title>
          ,
          <source>Neurobiology of aging 61</source>
          (
          <year>2018</year>
          )
          <fpage>75</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>H.</given-names>
            <surname>Ding</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Qi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Dou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Qian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Gao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Zhong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Yang</surname>
          </string-name>
          , et al.,
          <article-title>Topological properties of individual gray matter morphological networks in identifying the preclinical stages of alzheimer's disease: a preliminary study</article-title>
          ,
          <source>Quantitative Imaging in Medicine and Surgery</source>
          <volume>13</volume>
          (
          <year>2023</year>
          )
          <fpage>5258</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Sporns</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. J.</given-names>
            <surname>Saykin</surname>
          </string-name>
          ,
          <article-title>The human connectome in alzheimer disease-relationship to biomarkers and genetics</article-title>
          ,
          <source>Nature Reviews Neurology</source>
          <volume>17</volume>
          (
          <year>2021</year>
          )
          <fpage>545</fpage>
          -
          <lpage>563</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>R.</given-names>
            <surname>Milo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Shen-Orr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Itzkovitz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kashtan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Chklovskii</surname>
          </string-name>
          , U. Alon,
          <article-title>Network motifs: Simple building blocks of complex networks</article-title>
          ,
          <source>Science</source>
          <volume>353</volume>
          (
          <year>2002</year>
          )
          <fpage>824</fpage>
          -
          <lpage>827</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Benson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. F.</given-names>
            <surname>Gleich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Leskovec</surname>
          </string-name>
          ,
          <article-title>Higher-order organization of complex networks</article-title>
          ,
          <source>Science</source>
          <volume>353</volume>
          (
          <year>2016</year>
          )
          <fpage>163</fpage>
          -
          <lpage>166</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Meier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Märtens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hillebrand</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Tewarie</surname>
          </string-name>
          ,
          <string-name>
            <surname>P. Van Mieghem</surname>
          </string-name>
          ,
          <article-title>Motif-based analysis of efective connectivity in brain networks</article-title>
          ,
          <source>in: Complex Networks &amp; Their Applications V: Proceedings of the 5th International Workshop on Complex Networks and their Applications (COMPLEX NETWORKS</source>
          <year>2016</year>
          ), Springer,
          <year>2017</year>
          , pp.
          <fpage>685</fpage>
          -
          <lpage>696</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Friedman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Young</surname>
          </string-name>
          , G. Tremper,
          <string-name>
            <given-names>J.</given-names>
            <surname>Liang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Landsberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Schuf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. D. N.</given-names>
            <surname>Initiative</surname>
          </string-name>
          ,
          <article-title>Directed network motifs in alzheimer's disease and mild cognitive impairment</article-title>
          ,
          <source>PLoS One</source>
          <volume>10</volume>
          (
          <year>2015</year>
          )
          <article-title>e0124453</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>E.</given-names>
            <surname>Nagele</surname>
          </string-name>
          , M. Han,
          <string-name>
            <surname>C. DeMarshall</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Belinka</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Nagele</surname>
          </string-name>
          ,
          <article-title>Diagnosis of alzheimer's disease based on disease-specific autoantibody profiles in human sera</article-title>
          ,
          <source>PloS one 6</source>
          (
          <year>2011</year>
          )
          <article-title>e23112</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>A.</given-names>
            <surname>Dragomir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. G.</given-names>
            <surname>Vrahatis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bezerianos</surname>
          </string-name>
          ,
          <article-title>A network-based perspective in alzheimer's disease: Current state and an integrative framework</article-title>
          ,
          <source>IEEE journal of biomedical and health informatics 23</source>
          (
          <year>2018</year>
          )
          <fpage>14</fpage>
          -
          <lpage>25</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>R. K.</given-names>
            <surname>Lama</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.-R.</given-names>
            <surname>Kwon</surname>
          </string-name>
          ,
          <article-title>Diagnosis of alzheimer's disease using brain network, Frontiers in Neuroscience 15 (</article-title>
          <year>2021</year>
          )
          <fpage>605115</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>B. A.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>GP</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. S.</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>SE</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. H.</surname>
            ,
            <given-names>D. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>M. M.</surname>
          </string-name>
          ,
          <string-name>
            <surname>L. L.</surname>
          </string-name>
          ,
          <string-name>
            <surname>D. RA.</surname>
          </string-name>
          ,
          <string-name>
            <surname>B. P.</surname>
          </string-name>
          ,
          <article-title>A multiomics approach to heterogeneity in alzheimer's disease: focused review and roadmap</article-title>
          ,
          <source>BRAIN</source>
          <volume>143</volume>
          (
          <year>2020</year>
          )
          <fpage>1315</fpage>
          -
          <lpage>1331</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>