=Paper=
{{Paper
|id=Vol-3045/paper04
|storemode=property
|title=Moody's Physics of Notations: High Impact, Little Support
|pdfUrl=https://ceur-ws.org/Vol-3045/paper04.pdf
|volume=Vol-3045
|authors=Janek Ziehmann,Birger Lantow
|dblpUrl=https://dblp.org/rec/conf/ifip8-1/ZiehmannL21
}}
==Moody's Physics of Notations: High Impact, Little Support==
<pdf width="1500px">https://ceur-ws.org/Vol-3045/paper04.pdf</pdf>
<pre>
DŽŽĚLJ͛ƐWŚLJƐŝĐƐŽĨEŽƚĂƚŝŽŶƐ͗,ŝŐŚ/ŵƉĂĐƚ͕>ŝƚƚůĞ^ƵƉƉŽƌƚ
-DQHN=LHKPDQQ1 DQG%LUJHU/DQWRZ1
     
1
    University of Rostock, Albert-Einstein-Str. 22, 18057 Rostock, Germany
      
      
                  ďƐƚƌĂĐƚ
                  'RPDLQ 6SHFLILF /DQJXDJHV IRVWHU WKH DFFHVV RI GRPDLQ H[SHUW NQRZOHGJH LQ (QWHUSULVH
                  0RGHOOLQJ3ODWIRUPVOLNH(FOLSVHZLWK(0)0HWD(GLWDQG$GR;;VXSSRUWWKHGHVLJQRI
                  PHWDPRGHOV IRU 'RPDLQ 6SHFLILF /DQJXDJHV DQG WKH FUHDWLRQ RI PRGHOOLQJ WRROV EDVHG RQ
                  WKHVH PHWDPRGHOV 7\SLFDOO\ D YLVXDO QRWDWLRQ LV XVHG IRU PRGHOOLQJ DQG SDUW RI WKH
                  GHYHORSPHQW RI PRGHOOLQJ WRROV 0RRG\¶V ZRUN RQ 3K\VLFV RI 1RWDWLRQV LV D SURPLQHQW
                  DSSURDFKWRSURYLGHJXLGHOLQHVIRUWKHGHVLJQRIYLVXDOQRWDWLRQV+RZHYHUZKLOHWKHUHDUH
                  WRROVIRUODQJXDJHGHVLJQWKHUHLVRQO\OLWWOHUHVHDUFKRQWRROVXSSRUWIRUODQJXDJHHYDOXDWLRQ
                  EDVHGRQWKH3K\VLFVRI1RWDWLRQV7KLVSDSHUXVHVDV\VWHPDWLFOLWHUDWXUHDQDO\VLVWRLQYHVWLJDWH
                  WKHVWDWHRIWRROVXSSRUWIRULPSOHPHQWLQJRUHYDOXDWLQJWKHSULQFLSOHVFRQWDLQHGLQWKH3K\VLFV
                  RI1RWDWLRQVDSSURDFK)XUWKHUPRUHWKHSDSHUSURYLGHVDQRXWORRNWRSRVVLEOHIXWXUHUHVHDUFK
                  RQWRROEDVHGHYDOXDWLRQRIYLVXDOQRWDWLRQV
                  
                  <ĞLJǁŽƌĚƐϭ
                  3K\VLFVRI1RWDWLRQV1RWDWLRQ'HVLJQ1RWDWLRQ(YDOXDWLRQ7RRO6XSSRUW

ϭ͘ /ŶƚƌŽĚƵĐƚŝŽŶ

    0RRG\¶V3K\VLFVRI1RWDWLRQV 3R1 LVDSURPLQHQWIUDPHZRUNIRUWKHGHVLJQDQGWKHHYDOXDWLRQRI
JUDSKLFDO QRWDWLRQV 0RRG\ EDVHG KLV 3R1 RQ D VXUYH\ RI VFLHQWLILF DUWLFOHV UHJDUGLQJ QRWDWLRQ
HYDOXDWLRQ 7KH VHOHFWHG SULQFLSOHV DUH EDFNHG E\ HPSLULFDO HYLGHQFH +RZHYHU WKHUH LV D ODFN RI
FRPSDUDELOLW\DQGDORWRIDPELJXLW\ZKHQWKH3R1DUHDSSOLHGIRUQRWDWLRQHYDOXDWLRQ$WRROVXSSRUW
WKDWSURYLGHVDFOHDUIRUPDOL]DWLRQZKHUHDSSOLFDEOHDQGWKDWVWDQGDUGL]HVWKHLUDSSOLFDWLRQPD\KHOS
KHUH )XUWKHUPRUH WKH LQWHJUDWLRQ RI VXFK D WRRO VXSSRUW LQ SODWIRUPV OLNH (FOLSVH ZLWK (0)
0HWD(GLWDQG$GR;;DOORZLQJIRUWKHGHVLJQRIPHWDPRGHOVIRU'RPDLQ6SHFLILF/DQJXDJHVDQG
WKHFUHDWLRQRIPRGHOOLQJWRROVEDVHGRQWKHVHPHWDPRGHOVPD\VXSSRUWQRWDWLRQGHVLJQHUVLQSURYLGLQJ
KLJKHUTXDOLW\QRWDWLRQV
    7KLV VWXG\ LQYHVWLJDWHV WKH SRWHQWLDO RI VXFK D WRRO VXSSRUW :KLOH D IRUPDOL]DWLRQ RI VRPH 3R1
SULQFLSOHV LVJHQHUDOO\SRVVLEOH ZH LQYHVWLJDWHG ZKHWKHU VXFKD VXSSRUW LV DFWXDOO\ XVHG LQ QRWDWLRQ
HYDOXDWLRQ6HFWLRQLQWURGXFHVWKH3R1DQGGLVFXVVHVSRVVLELOLWLHVIRUWRROVXSSRUWLQJHQHUDO6HFWLRQ
 LQYHVWLJDWHV WKH 3R1 DSSOLFDWLRQ LQ VFLHQWLILF UHVHDUFK 6HFWLRQ  SURYLGHV D VKRUW VXPPDU\ DQG
RXWORRN

Ϯ͘ DŽŽĚLJ͛ƐWƌŝŶĐŝƉůĞƐ

    0RRG\GHILQHVLQ>@QLQHSULQFLSOHVIRUWKHGHVLJQRIFRJQLWLYHO\HIIHFWLYHYLVXDOQRWDWLRQV7KHVH
SULQFLSOHVZLOOEHLQWURGXFHGEULHIO\LQWKHIROORZLQJDVWKH\QHHGWREHWUHDWHGGLIIHUHQWO\ZLWKUHJDUG
WRDSRWHQWLDOWRROVXSSRUWIRUQRWDWLRQHYDOXDWLRQ
    3ULQFLSOHRI6HPLRWLF&ODULW\7KLVSULQFLSOHGHPDQGVIRUDRQHWRRQHFRUUHVSRQGHQFHEHWZHHQ
V\PEROVDQGFRQFHSWVRIWKHQRWDWLRQ0RRG\GHILQHVIRXUGLIIHUHQWSRVVLEOHGHILFLWVRIYLVXDOQRWDWLRQV
ZLWK UHJDUG WR 6HPLRWLF &ODULW\   6\PERO 5HGXQGDQF\ LI PXOWLSOH V\PEROV UHSUHVHQW WKH VDPH
FRQFHSW  6\PERO2YHUORDGLIDV\PEROUHSUHVHQWVPXOWLSOHFRQFHSWV  6\PERO([FHVVLIWKHUHDUH
    
3R(0¶)RUXPWK,),3:*:RUNLQJ&RQIHUHQFHRQWKH3UDFWLFHRI(QWHUSULVH0RGHOOLQJ1RYHPEHU±/DWYLD
(0$,/MDQHN]LHKPDQQ#XQLURVWRFNGH -=LHKPDQQ ELUJHUODQWRZ#XQLURVWRFNGH %/DQWRZ 
25&,' %/DQWRZ 
               ‹&RS\ULJKWIRUWKLVSDSHUE\LWVDXWKRUV
              8VHSHUPLWWHGXQGHU&UHDWLYH&RPPRQV/LFHQVH$WWULEXWLRQ,QWHUQDWLRQDO &&%< 
              &(85:RUNVKRS3URFHHGLQJV &(85:6RUJ 

                                                                                   31
V\PEROVWKDWGRQRWFRUUHVSRQGWRDFRQFHSWRIWKHQRWDWLRQ  6\PERO'HILFLWLIWKHUHDUHQRWDWLRQ
FRQFHSWVZLWKRXWDFRUUHVSRQGLQJV\PERO>@
    3ULQFLSOH RI 3HUFHSWXDO 'LVFULPLQDELOLW\ 7KH PDLQ LGHD RI WKLV SULQFLSOH LV WR PDNH V\PEROV
FOHDUO\GLVWLQJXLVKDEOHIURPHDFKRWKHU0RRG\SUHVHQWVDQXPEHURIVXJJHVWLRQVLQRUGHUWRUHDFKWKLV
JRDODVVXULQJ9LVXDO'LVWDQFHRIV\PEROVE\XVLQJDKLJKQXPEHURIYLVXDOYDULDEOHVOLNHVKDSHFRORU
VL]HHWFWRPDNHWKHPYLVXDOO\GLIIHUHQW6KDSHLVWKHPRVWLPSRUWDQWYLVXDOYDULDEOHKHUH0RRG\FDOOV
WKLV IDFW 3ULPDF\ RI 6KDSH )XUWKHU UHFRPPHQGDWLRQV DUH WKH XVH RI WH[W WR GLIIHUHQWLDWH EHWZHHQ
V\PEROV 7H[WXDO 'LIIHUHQWLDWLRQ  XVLQJ XQLTXH YDOXHV IRU DW OHDVW RQH YLVXDO YDULDEOH 3HUFHSWXDO
3RSRXW  DQG WR XVH PRUH WKDQ RQH YLVXDO YDULDEOH LQ RUGHU WR PDNH D GLIIHUHQFH EHWZHHQ V\PEROV
 5HGXQGDQW&RGLQJ >@
    3ULQFLSOH RI 6HPDQWLF 7UDQVSDUHQF\ 6HPDQWLF 7UDQVSDUHQF\ GHVFULEHV H[WHQW WR ZKLFK WKH
PHDQLQJRIDV\PEROFDQEHGHULYHGIURPLWVDSSHDUDQFH7KLVFDQUDQJHIURPVHPDQWLFDOO\LPPHGLDWH
V\PEROVZKHUHWKHPHDQLQJFDQEHLQIHUUHGZLWKRXWDGGLWLRQDOLQIRUPDWLRQRYHUVHPDQWLFDOO\RSDTXH
V\PEROV ZKHUH WKHUH LV QR OLQN EHWZHHQ DSSHDUDQFH DQG PHDQLQJ WR VHPDQWLFDOO\ SHUYHUVH V\PEROV
ZKLFKLPSO\DZURQJPHDQLQJIRUWKHPRGHOXVHU7KHSHUIRUPDQFHRIDQRWDWLRQZLWKUHJDUGWRWKLV
SULQFLSOHGHSHQGVRQWKHPRGHOXVHUVDQGVKRXOGWKXVEHHYDOXDWHGLQH[SHULPHQWV+RZHYHU0RRG\
SURYLGHV VRPH JHQHUDO UHFRPPHQGDWLRQV ± WKH XVH RI LFRQV WKDW GHSLFW UHDO REMHFWV 3HUFHSWXDO
5HVHPEODQFH DQGVSHFLDOJUDSKLFDOUHODWLRQV 6HPDQWLFDOO\7UDQVSDUHQWUHODWLRQV VXFKDVLQWHUVHFWLRQV
RUWUHHV,WFDQEHFKHFNHGZKHWKHUWKHVHUHFRPPHQGDWLRQVDUHLPSOHPHQWHGLQDQRWDWLRQ>@
    3ULQFLSOHRI&RPSOH[LW\0DQDJHPHQW7KLVSULQFLSOHGHPDQGVIRUH[SOLFLWPHFKDQLVPVWRGHDO
ZLWK FRPSOH[LW\ $ VLPSOH PHDVXUH IRU PRGHO FRPSOH[LW\ LV WKH QXPEHU RI XVHG HOHPHQWV :LWK
LQFUHDVLQJ PRGHO VL]H OLPLWV DUH UHDFKHG UHJDUGLQJ SHUFHSWLRQ DQG FRJQLWLRQ 8QGHUVWDQGDELOLW\ RI
PRGHOV VXIIHUV 7KHUHIRUH QRWDWLRQV VKRXOG SURYLGH PHFKDQLVPV WR UHGXFH FRPSOH[LW\ 7KH PDLQ
PHFKDQLVPVWRUHDFKWKLVJRDODUH0RGXODUL]DWLRQDQG+LHUDUFK\ /HYHOVRI$EVWUDFWLRQ >@
    3ULQFLSOH RI &RJQLWLYH ,QWHJUDWLRQ 7KHUH VKRXOG EH PHFKDQLVPV WR LQWHJUDWH LQIRUPDWLRQ IURP
GLIIHUHQW PRGHOV 2QH PHFKDQLVP ZRXOG EH &RQFHSWXDO ,QWHJUDWLRQ ,W SURYLGHV DQ RYHUYLHZ RI WKH
PRGHODQGLWVVXEPRGHOVE\SURYLGLQJFRQFHSWVRQDKLJKDEVWUDFWLRQOHYHOWKDWFDQEHFRPELQHGLQ
RUGHUWRUHODWHWKHXVHGVXEPRGHOV3HUFHSWXDO,QWHJUDWLRQKHOSVWKHPRGHOXVHUZLWKQDYLJDWLRQLQWKH
PRGHOVSDFH>@
    3ULQFLSOH RI 9LVXDO ([SUHVVLYHQHVV :KLOH 9LVXDO 'LVWDQFH VHH DERYH  FRQVLGHUV WKH SDLUZLVH
GLIIHUHQFHRIFRQFHSWVZLWKUHJDUGWRYLVXDOYDULDEOHV9LVXDO([SUHVVLYHQHVVDGGUHVVHVWKHXVHRIYLVXDO
YDULDEOHV WKURXJKRXW WKH ZKROH JUDSKLFDO QRWDWLRQ +HQFH WKH TXHVWLRQ LV ZKLFK QXPEHU RI YLVXDO
YDULDEOHV LV XVHG WR H[SUHVV VHPDQWLFV DQG WR GLVWLQJXLVK EHWZHHQ FRQFHSWV ,QIRUPDWLRQ FDUU\LQJ
9DULDEOHV DQGZKLFKQXPEHURIYLVXDOYDULDEOHVLVQRWIRUPDOO\XVHG )UHH9DULDEOHV 0RRG\GHILQHV
DWRWDORIHLJKWYLVXDOYDULDEOHV+RUL]RQWDO3RVLWLRQ9HUWLFDO3RVLWLRQ6L]H%ULJKWQHVV&RORU7H[WXUH
6KDSH DQG 2ULHQWDWLRQ 7KH UHFRPPHQGDWLRQ LV WR XVH DV PXFK ,QIRUPDWLRQFDUU\LQJ 9DULDEOHV DV
SRVVLEOH&RQVHTXHQWO\WKHUHLVDPD[LPXPRIHLJKW
    3ULQFLSOHRI'XDO&RGLQJ*HQHUDOO\WH[WLVQRWDJRRGPHDQVWRFUHDWHDYLVXDOQRWDWLRQ+RZHYHU
WKHUHLVDEHQHILWRIVXSSRUWLQJYLVXDOQRWDWLRQVE\DGGLQJWH[W7KLVFDQEHGRQHE\$QQRWDWLRQVDQGE\
+\EULG6\PEROVZKLFKFRPELQHWH[WDQGJUDSKLFDOREMHFWV>@
    3ULQFLSOHRI*UDSKLF(FRQRP\7KLVSULQFLSOHDGGUHVVHVWKHQXPEHURIDYDLODEOHJUDSKLFDOV\PEROV
IRU PRGHOLQJ 7KHUH LV D UHFRPPHQGHG PD[LPXP RI VL[ V\PEROV $Q H[FHVV RI V\PEROV PDNHV LW
GLIILFXOWIRUWKHPRGHOHUWREHDZDUHRIWKHV\PEROVWKDWFDQEHXVHG0RRG\VXJJHVWVWKUHHVWUDWHJLHV
IRU LQFUHDVLQJ *UDSKLF (FRQRP\   5HGXFH 6HPDQWLF &RPSOH[LW\ +HQFH WKH QXPEHU RI XVHG
FRQFHSWVLVUHGXFHG  ,QWURGXFH6\PERO'HILFLW  ,QFUHDVH9LVXDO([SUHVVLYHQHVV>@
    3ULQFLSOH RI &RJQLWLYH )LW +HUH GLIIHUHQW YLVXDO GLDOHFWV DUH VXJJHVWHG IRU GLIIHUHQW WDVNV DQG
DXGLHQFHV 7KH PDLQ DVVXPSWLRQ XQGHUO\LQJ WKLV SULQFLSOH LV WKDW SUREOHP VROYLQJ SHUIRUPDQFH LV
LQIOXHQFHG E\ WKH SUREOHP UHSUHVHQWDWLRQ WDVN FKDUDFWHULVWLFV DQG SUREOHP VROYHU VNLOOV 7KXV D
SUREOHPSUHVHQWDWLRQVKRXOGILWWRWKHRWKHUWZRIDFWRUV7KLVDJDLQUHTXLUHVLQYROYHPHQWRIPRGHOXVHUV
IRUHYDOXDWLRQ>@
    7KHUH DUH DOVR LQWHUGHSHQGHQFLHV EHWZHHQ WKH IRUPXODWHG SULQFLSOHV IRU QRWDWLRQ GHVLJQ )RU
H[DPSOHLQWURGXFLQJD6\PERO'HILFLWDQGWKXVUHGXFLQJ6HPLRWLF&ODULW\IRVWHUV*UDSKLF(FRQRP\
    $VVXPLQJDIRUPDOGHVFULSWLRQRIWKHYLVXDOQRWDWLRQWKDWLVPDSSHGWRWKHDEVWUDFWQRWDWLRQRID
PHWDPRGHODVLWLVDYDLODEOHRQWKH$GR;;SODWIRUPDIRUPDOYDOLGDWLRQFDQSRWHQWLDOO\EHSHUIRUPHG
IRUWKHPDMRULW\RI0RRG\¶VSULQFLSOHV7DNLQJIRUH[DPSOHWKHSULQFLSOHRI6HPLRWLF&ODULW\MXVWWKH
                                                       32
QXPEHURIPDSSLQJUHODWLRQVEHWZHHQHDFKV\PERORIWKHYLVXDOQRWDWLRQDQGHDFKFRQFHSWRIWKHPHWD
PRGHOQHHGVWREHDQDO\]HG7KXVDWRROEDVHGYDOLGDWLRQRIWKHDGKHUHQFHWRWKHSULQFLSOHVRUDPHWULF
IRU SULQFLSOHV OLNH 9LVXDO ([SUHVVLYHQHVV VHHPV WR EH D VWUDLJKWIRUZDUG ZD\ WR VXSSRUW QRWDWLRQ
GHVLJQHUV
    7KHUHDUHWZRSULQFLSOHVWKDWUHTXLUHHPSLULFDOHYDOXDWLRQ6HPDQWLF7UDQVSDUHQF\DQG&RJQLWLYH
)LW %RWK UHTXLUH WKH FRQVLGHUDWLRQ RI WKH FRJQLWLYH SURFHVVHV RI LQWHQGHG QRWDWLRQ XVHUV 7KXV DQ
H[SHULPHQWDOGHVLJQLQYROYLQJWKHXVHUVFDQKHOSWRHYDOXDWHWKHSHUIRUPDQFHRIQRWDWLRQVUHJDUGLQJ
WKHVHSULQFLSOHV)XUWKHUPRUHWKHDOUHDG\PHQWLRQHGLQWHUGHSHQGHQFLHVEHWZHHQWKHSULQFLSOHVUHTXLUH
VRPHWUDGHRIIVZKHUHWKHRSWLPXPPLJKWEHIRXQGHPSLULFDOO\2YHUDOODQHPSLULFDOHYDOXDWLRQRI
QRWDWLRQVEDVHGDPRQJVWRWKHUVRQFULWHULDGHULYHGIURPFRJQLWLYHILWDQGVHPDQWLFWUDQVSDUHQF\VKRXOG
EHSHUIRUPHGVLQFH0RRG\¶VSULQFLSOHVJHQHUDOO\SURYLGHJXLGHOLQHVEXWQRWJXDUDQW\WKDWDQRWDWLRQ
ILWVLWVSXUSRVH%HVLGHVJHQHUDOWRROVXSSRUWIRUHPSLULFDOVWXGLHVWKHUHLVDOVRDVSHFLILFSRWHQWLDOIRU
WRROVXSSRUWLQHPSLULFDOQRWDWLRQHYDOXDWLRQ)RUH[DPSOHWKHFRYHUDJHRIWKHODQJXDJHV\QWD[VKRXOG
EHWUDFNHGLQVXFKHYDOXDWLRQV'XHWRWKHUHVXOWLQJFRPSOH[LW\DWRROVXSSRUWZRXOGVDYHHIIRUWDQG
UHGXFHSRVVLEOHPLVWDNHVFRPSDUHGWRPDQXDOO\FKHFNLQJWKHPRGHOVXVHGLQH[SHULPHQWVDJDLQVWWKH
IRUPDOO\GHILQHGV\QWD[

ϯ͘ ^LJƐƚĞŵĂƚŝĐ>ŝƚĞƌĂƚƵƌĞŶĂůLJƐŝƐ

ϯ͘ϭ͘ WĂƉĞƌ/ĚĞŶƚŝĨŝĐĂƚŝŽŶĂŶĚ^ĞůĞĐƚŝŽŶ

    $V D VWDUWLQJ SRLQW RQ WKH DUWLFOH SXEOLVKHG LQ  E\ ' / 0RRG\ ³7KH SK\VLFV RI QRWDWLRQV
7RZDUGDVFLHQWLILFEDVLVIRUFRQVWUXFWLQJYLVXDOQRWDWLRQVLQVRIWZDUHHQJLQHHULQJ´>@%DVHGRQWKLV
DUWLFOH D IRUZDUG VHDUFK LQ WKH OLWHUDWXUH GDWDEDVH 6FRSXV ZDV FDUULHG RXW 7KH OLWHUDWXUH GDWDEDVH
6FRSXVZDVFKRVHQDVWKHGDWDEDVHIRUWKLVVLQFH6FRSXVUHSUHVHQWVRQHRIWKHPRVWLPSRUWDQWOLWHUDWXUH
GDWDEDVHVLQWKHILHOGRIVFLHQWLILFUHVHDUFKUHVXOWVIURPRWKHUGDWDEDVHVVXFKDV6SULQJHU/LQN,(((
RU$,6H/DUHDOVRLQFOXGHG2WKHUDUWLFOHVSXEOLVKHGE\0RRG\LQDQGZKLFKDOVRGHDOZLWK
WKH3R1DUHQRWFRQVLGHUHGDVIXUWKHUVWDUWLQJSRLQWVIRUDIRUZDUGVHDUFKGXHWRWKHLUUHODWLYHO\ORZ
QXPEHURIFLWDWLRQVFRPSDUHGWRWKHRI>@
    7KHJHQHUDOSURFHGXUHIRUWKHVHOHFWLRQRIWKHUHVXOWVHWRIWKHIRUZDUGVHDUFKLQWKHFRXUVHRIWKH
V\VWHPDWLF OLWHUDWXUH DQDO\VLV LV EDVHG RQ WKH SURFHGXUH SURSRVHG E\ >@ IRU D V\VWHPDWLF OLWHUDWXUH
DQDO\VLV7KXVWKHDQDO\]HGSDSHUVZHUHSUHVHOHFWHGRQWKHEDVLVRIWKHWLWOHVDQGWKHQIXUWKHUVHOHFWHG
ZLWKWKHKHOSRIWKHDEVWUDFW$VWKHODVWVWHSRIWKHVHOHFWLRQSURFHVVWKHSDSHUVZHUHWKHQVHOHFWHGRQ
WKHEDVLVRIWKHFRQWHQWVRIWKHLUIXOOWH[WV
    7KHIROORZLQJWHUPVVHUYHGDVLQFOXVLRQFULWHULDIRUWKHILUVWVHOHFWLRQVWHS³4XDOLW\´³([SHULPHQW´
³(YDOXDWLRQ´³'HVLJQ´DQG³$QDO\VLV´LQFRPELQDWLRQZLWKFRQFUHWHPRGHOOLQJODQJXDJHVRUQRWDWLRQV
DVZHOODVWKHSKUDVHVYLVXDOQRWDWLRQV´³JUDSKLFDOV\QWD[´RU³YLVXDOFRQVWUXFWV³$OVRLQFOXGHGZHUH
WKHSKUDVHV³DSSOLFDWLRQ>@3R1´RU³DSSOLFDWLRQ>@SK\VLFVRIQRWDWLRQV´UHVSHFWLYHO\3DSHUVKDYH
DOVREHHQLQFOXGHGLILWZDVFOHDUIURPWKHWLWOHWKDWWKDWIRUH[DPSOHDQH[SHULPHQWZDVFDUULHGRXW
EXW WKH WHUP H[SHULPHQW´ ZDV QRW XVHG 7KXV LPSOLFLW PDWFKHV WR WKH RULJLQDO WHUPV ZHUH DOVR
FRQVLGHUHG DV IRU H[DPSOH >@ 7KLV ILUVW VHOHFWLRQ VWHS UHVXOWHG D VHW EHLQJ QDUURZHG GRZQ WR 
SRVVLEO\ UHOHYDQW SDSHUV &RQVLGHULQJ WKH DEVWUDFWV LQ WKH QH[W VWHS D FKHFN ZKHWKHU DFWXDOO\ WKH
HYDOXDWLRQRUWKHGHVLJQRIDYLVXDOQRWDWLRQZDVLQIRFXVRIWKHUHVSHFWLYHSDSHUV7KLVUHVXOWHGLQDVHW
RI  SDSHUV IRU DQDO\VLV 'XULQJ WKH DQDO\VLV RI WKH IXOO WH[WV D PRUH SDSHUV KDG WR EH VLQJOHG RXW
EHFDXVHWKHDSSOLFDWLRQRIGHVLJQJXLGHOLQHVZDVRQO\GRFXPHQWHGUXGLPHQWDU\)LQDOO\WKHDQDO\VLVLV
EDVHGRQVHOHFWHGSXEOLFDWLRQV

ϯ͘Ϯ͘ WĂƉĞƌŶĂůLJƐŝƐ

   7DEOHFODVVLILHVWKHDQDO\]HGSDSHUVZLWKUHJDUGWRWKHLUFRQWHQW2QO\SDSHUVDUHGHDOLQJZLWK
WKH GHVLJQ RI YLVXDO QRWDWLRQV 7KH UHPDLQGHU SULPDULO\ IRFXVHV RQ FRPSDULVRQ DQG HYDOXDWLRQ RI
H[LVWLQJ QRWDWLRQV 5HJDUGLQJ WKH HYDOXDWLRQ VHWWLQJ ZH GLIIHUHQWLDWHG EHWZHHQ HPSLULFDO H[SHUW
VXUYH\VH[SHULPHQWV DQGDQDO\WLFDODSSURDFKHV7KHODWWHUVHWWLQJDQDO\WLFDODSSURDFK±JHQHUDOO\

                                                          33
LQYROYHVDPDQXDODQDO\VLVRIWKHQRWDWLRQZLWKUHJDUGWRVRPHSULQFLSOHVE\WKHDXWKRUVRUE\H[SHUWV
$FRPELQDWLRQRIDQDO\WLFDODQGHPSLULFDOVHWWLQJVDVVXJJHVWHGLQ6HFWLRQFDQDOVREHVHHQWLPHVLQ
WKHUHVXOWVHW,QDGGLWLRQRUDVDOWHUQDWLYHVWRWKH3R1RWKHUIUDPHZRUNVKDYHEHHQDSSOLHGE\VHYHUDO
DXWKRUV)RUH[DPSOHWKH&RJQLWLYH'LPHQVLRQV)UDPHZRUNKDVEHHQDSSOLHGE\>@2WKHUDXWKRUV
XVHGWKH6(48$/)UDPHZRUNRUGHILQHGWKHLURZQDSSURDFK HJ>@ 7KUHHRIWKHSDSHUV
>@GLGQRWUHDOO\UHYHDOWKHHYDOXDWLRQVHWWLQJRUWKHDSSOLHGSULQFLSOHV
   
dĂďůĞϭ
ŶĂůLJnjĞĚWĂƉĞƌƐ;ΎсĂĚĚƌĞƐƐĞĚͿ
       3DSHU             $SSURDFK                   (YDOXDWLRQ6HWWLQJ              'HVLJQ
                    3R1          2WKHU         $QDO\WLFDO          (PSLULFDO            
        >@                                                                           
         >@                                                                           
         >@                                                                           
         >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                             
         >@                                                                             
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                             
        >@                                                                             
        >@                                                                           
        >@                                                                           
         >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                           
         >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                           
        >@                                                                             
        >@                                                                           
        >@                                                                             
        >@                                                                           

                                                   34
       3DSHU            $SSURDFK                  (YDOXDWLRQ6HWWLQJ                       'HVLJQ
                    3R1       2WKHU            $QDO\WLFDO      (PSLULFDO                       
        >@                                                                                  
         >@                                                                                  
        >@                                                                                    
        >@                                                                                  
        >@                                                                                  

    /RRNLQJDWWKHSRWHQWLDOIRUDWRROEDVHGIRUPDOYDOLGDWLRQWKHDSSURDFKHVXVLQJDQDQDO\WLFDOVHWWLQJ
QHHGWREHLQYHVWLJDWHG1RLWHPLQWKHUHVXOWVHWSURYLGHVWRROVXSSRUW:LWK>@RQO\WKUHH
SDSHUVGLVFXVVDIRUPDOL]DWLRQRIQRWDWLRQGHVLJQHYDOXDWLRQ+RZHYHUWKHUHLVDJHQHUDODJUHHPHQWRI
WKH FRQWULEXWLQJ DXWKRUV WR WKHVH SDSHUV WKDW GHVLJQ GHFLVLRQV ZLWK UHJDUG WR VRPH RI WKH SULQFLSOHV
FDQQRWEHIRUPDOO\YDOLGDWHG+HUHDGRFXPHQWDWLRQRIGHFLVLRQVDQGWKHLUUDWLRQDOHLVUHFRPPHQGHG
2QO\RQHSDSHU>@VXJJHVWHGDWRROVXSSRUWEXWQRLPSOHPHQWDWLRQKDVEHHQSURYLGHGVRIDU$OOWKUHH
DSSURDFKHVWRIRUPDOL]DWLRQIRFXVHGRQWKHDSSOLFDWLRQRIWKHFRPSOHWHVHWRI0RRG\¶VSULQFLSOHVDQG
GLGQRWFRQVLGHURWKHUIUDPHZRUNVRURZQSULQFLSOHV
    7KHPDMRULW\RIDQDO\WLFDODSSURDFKHVDOVRIRFXVRQWKH3R1DVLWLVVKRZQLQ7DEOH$FHQWUDO
SUREOHPRIWKHODFNRIIRUPDOL]DWLRQLVWKDWDORWRISDSHUGLVFXVVWKHDSSOLFDWLRQRIWKHSULQFLSOHVWR
HYDOXDWHG QRWDWLRQV EXW WKH UHVXOWV DUH QRW FRPSDUDEOH DQG VRPHWLPHV QRW HYHQ ZHOO MXVWLILHG ,Q
DGGLWLRQ DQ DQDO\WLFDO YDOLGDWLRQ ZLWK UHJDUG WR 6HPDQWLF 7UDQVSDUHQF\ DQG &RJQLWLYH )LW FDQ EH
FRQVLGHUHGDWOHDVWGLIILFXOWORRNLQJDWWKHGLVFXVVLRQLQ6HFWLRQ
    /RRNLQJDWWKHSRWHQWLDORIDVSHFLILFWRROEDVHGVXSSRUWIRUHPSLULFDOHYDOXDWLRQDJDLQQRH[DPSOH
ZDV IRXQG LQ WKH DQDO\]HG SDSHUV 2QO\  RXW RI  SDSHUV KDG PRUH WKDQ  SDUWLFLSDQWV LQ WKH
HYDOXDWLRQSURFHVVRQO\PRUHWKDQ7KXVVWDWLVWLFDOVLJQLILFDQFHLVLQTXHVWLRQIRUPRVWRIWKH
HYDOXDWLRQV$JHQHUDOL]DWLRQWRDODUJHUJURXSRIQRWDWLRQXVHUVLVSUREOHPDWLF8QIRUWXQDWHO\VROXWLRQV
WRWKDWSUREOHPDUHEDUHO\GLVFXVVHG+RZHYHUDWRROVXSSRUWPD\KHOSWRVWUHDPOLQHWKHHYDOXDWLRQ
SURFHVVDQGWRORZHUEDUULHUVIRUSRWHQWLDOSDUWLFLSDQWV

dĂďůĞϮ
ĚĚƌĞƐƐĞĚƌŝƚĞƌŝĂŽĨŶĂůLJƚŝĐĂůƉƉƌŽĂĐŚĞƐ
            3ULQFLSOH                        3DSHU
            6HPLRWLF&ODULW\                 >@
            3HUFHSWXDO'LVFULPLQDELOLW\ >@
            6HPDQWLF7UDQVSDUHQF\            >@
            &RJQLWLYH,QWHJUDWLRQ            >@
            &RJQLWLYH)LW                     >@
            *UDSKLF(FRQRP\                  >@
            'XDO&RGLQJ                       >@
            9LVXDO([SUHVVLYHQHVV            >@
            0DQDJHDEOH&RPSOH[LW\            >@


ϰ͘ ŽŶĐůƵƐŝŽŶĂŶĚKƵƚůŽŽŬ

    7KLVVWXG\KDVVKRZQWKDWWKH3R1KDYHDKLJKLPSDFWFRQVLGHULQJWKHQXPEHURIFLWDWLRQVDQG
KDVOLWWOHWRROVXSSRUWFRQVLGHULQJRQO\RQHSDSHULQWKH6\VWHPDWLF/LWHUDWXUH$QDO\VLVWKDWFRQVLGHUV
WRROVXSSRUW+RZHYHUDORWRISUREOHPVLQQRWDWLRQGHVLJQDQGHYDOXDWLRQDULVHUHGXFHGFRPSDUDELOLW\
RI UHVXOWV DUELWUDU\ DQG DPELJXRXV DSSOLFDWLRQ RI SULQFLSOHV 7KH LQWHJUDWLRQ RI 0RRG\¶V DQG RWKHU
IUDPHZRUNVLQSODWIRUPVIRUQRWDWLRQGHVLJQFDQORZHUWKHEDUULHUVIRUHPSLULFDOHYDOXDWLRQVDQGWKH
ZHOOGRFXPHQWHG IRUPDOL]HG DSSOLFDWLRQRIJXLGHOLQHVWRQRWDWLRQGHVLJQ$QH[WSODQQHGVWHSLVWKH
GHYHORSPHQWRIDPHWDPRGHOEDVHGWRROVXSSRUWIRUH[SHULPHQWGHVLJQLPSOHPHQWHGRQWKH$GR;;
SODWIRUP$ILUVWSURWRW\SHDOUHDG\H[LVWV)XUWKHUPRUHDFRQFHSWRIDQDO\]LQJJUDSKLFDOUHSUHVHQWDWLRQV
LQFRPELQDWLRQZLWKWKHPHWDPRGHOKDVEHHQGHYHORSHGIRUWKLVSODWIRUP
                                                        35
ZĞĨĞƌĞŶĐĞƐ

>@ 0RRG\'7KHSK\VLFVRIQRWDWLRQV7RZDUGDVFLHQWLILFEDVLVIRUFRQVWUXFWLQJYLVXDOQRWDWLRQVLQ
     VRIWZDUHHQJLQHHULQJ,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ    ±
>@ .LWFKHQKDP % 3URFHGXUHV IRU SHUIRUPLQJ V\VWHPDWLF UHYLHZV .HHOH 8. .HHOH 8QLYHUVLW\
         ±
>@ %HUD36RIIHU33DUVRQV-8VLQJH\HWUDFNLQJWRH[SRVHFRJQLWLYHSURFHVVHVLQXQGHUVWDQGLQJ
     FRQFHSWXDOPRGHOV0,64XDUWHUO\0DQDJHPHQW,QIRUPDWLRQ6\VWHPV    ±
>@ 0ROLQD$,5HGRQGR0$2UWHJD0/DFDYH&(YDOXDWLQJDJUDSKLFDOQRWDWLRQIRUPRGHOLQJ
     FROODERUDWLYHOHDUQLQJDFWLYLWLHV$IDPLO\RIH[SHULPHQWV6FLHQFHRI&RPSXWHU3URJUDPPLQJ
       ±
>@ 6RXVD.9DQGHUGRQFNW-+HQGHUVRQ6HOOHUV%*RQ]DOH]3HUH]&(YDOXDWLQJDJUDSKLFDO
     QRWDWLRQ IRU PRGHOOLQJ VRIWZDUH GHYHORSPHQW PHWKRGRORJLHV -RXUQDO RI 9LVXDO /DQJXDJHV DQG
     &RPSXWLQJ    ±
>@ &DQFKp02FKRD6)3HURYLFK'*XWLHUUH])-$QDO\VLVRIQRWDWLRQVIRUPRGHOLQJXVHU
     LQWHUDFWLRQ VFHQDULRV LQ XELTXLWRXV FROODERUDWLYH V\VWHPV -RXUQDO RI $PELHQW ,QWHOOLJHQFH DQG
     +XPDQL]HG&RPSXWLQJ  
>@ )LJO.'HUQWO05RGULJXH]0&%RWWXUL/&RJQLWLYHHIIHFWLYHQHVVRIYLVXDOLQVWUXFWLRQDO
     GHVLJQODQJXDJHV-RXUQDORI9LVXDO/DQJXDJHVDQG&RPSXWLQJ    ±
>@ %RUN ' 6FKUIIHU & .DUDJLDQQLV ' ,QWXLWLYH XQGHUVWDQGLQJ RI GRPDLQVSHFLILF PRGHOLQJ
     ODQJXDJHV 3URSRVLWLRQ DQG DSSOLFDWLRQ RI DQ HYDOXDWLRQ WHFKQLTXH 9ROXPH  /1&6 RI
     /HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJVXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFH
     DQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   
>@ 0LUDQGD7&KDOOHQJHU07H]HO%7$ODFD2)%DULãLü$$PDUDO9*RXOmR0.DUGDV
     *,PSURYLQJWKH8VDELOLW\RID0$6'60/9ROXPH/1$,RI/HFWXUH1RWHVLQ&RPSXWHU
     6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ
     %LRLQIRUPDWLFV   
>@&RUWHV&RUQD[0'XSX\&KHVVD65LHX'0DQGUDQ1(YDOXDWLQJWKHDSSURSULDWHQHVVRI
     WKHESPQVWDQGDUGIRUPRGHOLQJVHUYLFHFKRUHRJUDSKLHVXVLQJDQH[WHQGHGTXDOLW\IUDPHZRUN
     6RIWZDUHDQG6\VWHPV0RGHOLQJ    ±
>@)LJO.6\PEROFKRLFHDQGPHPRU\RIYLVXDOPRGHOV,Q3URFHHGLQJVRI,(((6\PSRVLXPRQ
     9LVXDO/DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ9/+&&  ±
>@3RODQFLF * %SPQO $ ESPQ H[WHQVLRQ IRU PRGHOLQJ RI SURFHVV ODQGVFDSHV &RPSXWHUV LQ
     ,QGXVWU\  
>@$EEDG$QGDORXVVL$'DYLV&-%XUDWWLQ$/ySH]+$6ODDWV7:HEHU%8QGHUVWDQGLQJ
     TXDOLW\ LQ GHFODUDWLYH SURFHVV PRGHOLQJ WKURXJK WKH PHQWDO PRGHOV RI H[SHUWV 9ROXPH 
     /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO
     ,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   ±
>@'MXULFD'0HQGOLQJ-)LJO.7KHLPSDFWRIDVVRFLDWLYHFRORULQJDQGUHSUHVHQWDWLRQDOIRUPDWV
     RQ GHFLVLRQPDNLQJ $Q H\HWUDFNLQJ VWXG\ ,Q /HFWXUH 1RWHV LQ ,QIRUPDWLRQ 6\VWHPV DQG
     2UJDQLVDWLRQ9ROXPH  ±
>@'|UQGRUIHU - 6HHO & &RQWH[W PRGHOLQJ IRU WKH DGDSWLRQ RI PRELOH EXVLQHVV SURFHVVHV ± DQ
     HPSLULFDO XVDELOLW\ HYDOXDWLRQ ,QIRUPDWLRQ 6\VWHPV )URQWLHUV  'HVLJQLQJDQG(YDOXDWLQJ
     9LVXDO1RWDWLRQV
>@*LUDOGR)'(VSDxD6*LUDOGR:-3DVWRU2.URJVWLH-$PHWKRGWRHYDOXDWHTXDOLW\RI
     PRGHOOLQJODQJXDJHVEDVHGRQWKH]DFKPDQUHIHUHQFHWD[RQRP\6RIWZDUH4XDOLW\-RXUQDO  
       ±
>@(O.RXKHQ$*KHUEL$'XPRXOLQ&.KHQGHN)2QWKHVHPDQWLFWUDQVSDUHQF\RIYLVXDO
     QRWDWLRQV([SHULPHQWVZLWKXPO9ROXPHRI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJ
     VXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   
>@.XPPHU75HFNHU-0HQGOLQJ-(QKDQFLQJXQGHUVWDQGDELOLW\RISURFHVVPRGHOVWKURXJK
     FXOWXUDOGHSHQGHQWFRORUDGMXVWPHQWV'HFLVLRQ6XSSRUW6\VWHPV  ±
>@5RHOHQV%3RHOV*7KHGHYHORSPHQWDQGH[SHULPHQWDOHYDOXDWLRQRIDIRFXVHGEXVLQHVVPRGHO
     UHSUHVHQWDWLRQ%XVLQHVVDQG,QIRUPDWLRQ6\VWHPV(QJLQHHULQJ    ±

                                                      36
>@7UXQ]HU(:XOOHQZHEHU$9RJHO+HXVHU%*UDSKLFDOPRGHOLQJQRWDWLRQIRUGDWDFROOHFWLRQ
     DQGDQDO\VLVDUFKLWHFWXUHVLQF\EHUSK\VLFDOV\VWHPVRIV\VWHPV-RXUQDORI,QGXVWULDO,QIRUPDWLRQ
     ,QWHJUDWLRQ  
>@9LGDO 0 0DVVRQL 7 5DPDOKR ) $ GRPDLQVSHFLILF ODQJXDJH IRU YHULI\LQJ VRIWZDUH
     UHTXLUHPHQWFRQVWUDLQWV6FLHQFHRI&RPSXWHU3URJUDPPLQJ  
>@*RQoDOYHV($OPHQGUD&$UDXMR-&DVWUR-*RXOmR0$GGUHVVLQJV\PEROUHGXQGDQF\
     UHSUHVHQWDWLRQVLQLVWDUH[WHQVLRQV,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH  
>@*RQoDOYHV($OPHQGUD&*RXOmR0$UD~MR-&DVWUR-8VLQJHPSLULFDOVWXGLHVWRPLWLJDWH
     V\PERORYHUORDGLQLVWDUH[WHQVLRQV6RIWZDUHDQG6\VWHPV0RGHOLQJ    ±
>@9DQ'HU/LQGHQ'=DPDQVN\$+DGDU,+RZFRJQLWLYHO\HIIHFWLYHLVDYLVXDOQRWDWLRQ"RQ
     WKHLQKHUHQWGLIILFXOW\RIRSHUDWLRQDOL]LQJWKHSK\VLFVRIQRWDWLRQV9ROXPHRI/HFWXUH1RWHV
     LQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ±
>@0XQHHU681DGHHP0.DVL%<RXVDI0+(YDOXDWLQJWKHHIIHFWLYHQHVVRIQRWDWLRQVIRU
     GHVLJQLQJ VHFXULW\ DVSHFWV ,Q ,QWHUQDWLRQDO &RQIHUHQFH RQ $GYDQFHG &RPPXQLFDWLRQ
     7HFKQRORJ\,&$&79ROXPH  ±
>@6HOYLDQGUR1.HOO\7+DZNLQV57KHYLVXDOLQKHULWDQFHVWUXFWXUHWRVXSSRUWWKHGHVLJQRI
     YLVXDOQRWDWLRQV,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH  ±
>@$QZHU6(O$WWDU0$QHYDOXDWLRQRIWKHVWDWHFKDUWGLDJUDPVYLVXDOV\QWD[,Q,&,6$
     WK,QWHUQDWLRQDO&RQIHUHQFHRQ,QIRUPDWLRQ6FLHQFHDQG$SSOLFDWLRQV  
>@&KHUGDQWVHYD<+LOWRQ-5DQD2,YLQV:$PXOWLIDFHWHGHYDOXDWLRQRIWKHUHIHUHQFHPRGHO
     RILQIRUPDWLRQDVVXUDQFH VHFXULW\&RPSXWHUVDQG6HFXULW\  ±
>@'DQJDUVND=)LJO.0HQGOLQJ-$QH[SORUDWLYHDQDO\VLVRIWKHQRWDWLRQDOFKDUDFWHULVWLFVRI
     WKH GHFLVLRQ PRGHO DQG QRWDWLRQ GPQ  ,Q 3URFHHGLQJV ± ,((( ,QWHUQDWLRQDO (QWHUSULVH
     'LVWULEXWHG2EMHFW&RPSXWLQJ:RUNVKRS('2&:9ROXPH6HSWHPEHU  ±
>@'LDPDQWRSRXORX 9 0RXUDWLGLV + $SSO\LQJ WKH SK\VLFV RI QRWDWLRQ WR WKH HYDOXDWLRQ RI D
     VHFXULW\DQGSULYDF\UHTXLUHPHQWVHQJLQHHULQJPHWKRGRORJ\,QIRUPDWLRQDQG&RPSXWHU6HFXULW\
         ±
>@'LDPDQWRSRXORX 9 3DYOLGLV 0 0RXUDWLGLV + (YDOXDWLRQ RI D VHFXULW\ DQG SULYDF\
     UHTXLUHPHQWVPHWKRGRORJ\XVLQJWKHSK\VLFVRIQRWDWLRQ9ROXPH/1&6RI/HFWXUH1RWHV
     LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH
     1RWHVLQ%LRLQIRUPDWLFV   ±
>@'REHVRYD=8VLQJWKHSK\VLFVRIQRWDWLRQWRDQDO\VHPRGHOEXLOGHUGLDJUDPV,Q,QWHUQDWLRQDO
     0XOWLGLVFLSOLQDU\ 6FLHQWLILF *HR&RQIHUHQFH 6XUYH\LQJ *HRORJ\ DQG 0LQLQJ (FRORJ\
     0DQDJHPHQW6*(09ROXPH  ±
>@'REHVRYD=(YDOXDWLRQRIHIIHFWLYHFRJQLWLRQIRUWKHTJLVSURFHVVLQJPRGHOHU$SSOLHG6FLHQFHV
      6ZLW]HUODQG     
>@)LJO.'HUQWO07KHLPSDFWRISHUFHLYHGFRJQLWLYHHIIHFWLYHQHVVRQSHUFHLYHGXVHIXOQHVVRI
     YLVXDOFRQFHSWXDOPRGHOLQJODQJXDJHV9ROXPH/1&6RI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH
      LQFOXGLQJVXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV 
       ±
>@)LJO.5HFNHU-0HQGOLQJ-$VWXG\RQWKHHIIHFWVRIURXWLQJV\PEROGHVLJQRQSURFHVVPRGHO
     FRPSUHKHQVLRQ'HFLVLRQ6XSSRUW6\VWHPV    ±
>@)LJO.8VHUHYDOXDWLRQRIV\PEROVIRUFRUHEXVLQHVVSURFHVVPRGHOLQJFRQFHSWV,Q3URFHHGLQJV
     RIWKHWK(XURSHDQ&RQIHUHQFHRQ,QIRUPDWLRQ6\VWHPV(&,6  ±
>@/DQWRZ % 'HKQH 0 +RO] ) (YDOXDWLQJ QRWDWLRQV IRU SURGXFWVHUYLFH PRGHOLQJ LQ HP
     *HQHUDOFRQFHSWPRGHOLQJYVVSHFLILFODQJXDJH,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH
       ±
>@/LQGHQ'9'=DPDQVN\$+DGDU,$IUDPHZRUNIRULPSURYLQJWKHYHULILDELOLW\RIYLVXDO
     QRWDWLRQ GHVLJQ JURXQGHG LQ WKH SK\VLFV RI QRWDWLRQV ,Q 3URFHHGLQJV   ,((( WK
     ,QWHUQDWLRQDO5HTXLUHPHQWV(QJLQHHULQJ&RQIHUHQFH5(  ±
>@0RRG\'/+H\PDQV30DWXOHYLFLXV5,PSURYLQJWKHHIIHFWLYHQHVVRIYLVXDOUHSUHVHQWDWLRQV
     LQ UHTXLUHPHQWV HQJLQHHULQJ $Q HYDOXDWLRQ RI L  YLVXDO V\QWD[ ,Q 3URFHHGLQJV RI WKH ,(((
     ,QWHUQDWLRQDO&RQIHUHQFHRQ5HTXLUHPHQWV(QJLQHHULQJ  ±
>@0RRG\'/+H\PDQV30DWXOHYLþLXV59LVXDOV\QWD[GRHVPDWWHU,PSURYLQJWKHFRJQLWLYH
     HIIHFWLYHQHVVRIWKHL YLVXDOQRWDWLRQ5HTXLUHPHQWV(QJLQHHULQJ    ±
                                                     37
>@5RDVW & 8UXFKXUWX ( 5HIOHFWLQJ RQ WKH SK\VLFV RI QRWDWLRQV DSSOLHG WR D YLVXDOLVDWLRQ FDVH
     VWXG\ ,Q $&0 ,QWHUQDWLRQDO &RQIHUHQFH 3URFHHGLQJ 6HULHV 9ROXPH 6HSWHPEHU
       ±
>@6DHHG06DOHK)$O,QVDLI6(O$WWDU0(YDOXDWLQJWKHFRJQLWLYHHIIHFWLYHQHVVRIWKHYLVXDO
     V\QWD[RIIHDWXUHGLDJUDPV9ROXPH&&,6RI&RPPXQLFDWLRQVLQ&RPSXWHUDQG,QIRUPDWLRQ
     6FLHQFH  ±
>@6DOHK ) (O$WWDU 0 $ VFLHQWLILF HYDOXDWLRQ RI WKH PLVXVH FDVH GLDJUDPV YLVXDO V\QWD[
     ,QIRUPDWLRQDQG6RIWZDUH7HFKQRORJ\  ±
>@6W|UUOH+)LVK$7RZDUGVDQRSHUDWLRQDOL]DWLRQRIWKHSK\VLFVRIQRWDWLRQVIRUWKHDQDO\VLV
     RI YLVXDO ODQJXDJHV 9ROXPH  /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ
     VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ %LRLQIRUPDWLFV   
     ±
>@'D6LOYD7HL[HLUD0*4XLULQR*.*DLOO\))DOER5$*XL]]DUGL*%DUFHOORV03
     3RQV$V\VWHPDWLFDSSURDFKIRUDSSO\LQJWKHSK\VLFVRIQRWDWLRQ SRQ 9ROXPHRI/HFWXUH
     1RWHVLQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ±
>@=HKQGHU ( 0D\HU 1 *URQLHU * (YDOXDWLRQ RI WKH FRJQLWLYH HIIHFWLYHQHVV RI WKH FRUDV
     PRGHOOLQJ ODQJXDJH 9ROXPH  /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ
     VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ %LRLQIRUPDWLFV   
     ±
>@/DXH58VHRILPDJHGDWDEDVHVWRFUHDWHV\PEROVIRUJUDSKLFDOPRGHOLQJODQJXDJHV,Q/HFWXUH
     1RWHVLQ,QIRUPDWLFV /1, 3URFHHGLQJV6HULHVRIWKH*HVHOOVFKDIWIXU,QIRUPDWLN *, 9ROXPH
       ±'HVLJQLQJDQG(YDOXDWLQJ9LVXDO1RWDWLRQV
>@5RHOHQV%%RUN'$QHYDOXDWLRQRIWKHLQWXLWLYHQHVVRIWKHSJDPRGHOLQJODQJXDJHQRWDWLRQ
     9ROXPH/1%,3RI/HFWXUH1RWHVLQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ±
>@6DQWRV 0 *UDOKD & *RXODR 0 $UDXMR - 0RUHLUD $ 2Q WKH LPSDFW RI VHPDQWLF
     WUDQVSDUHQF\RQXQGHUVWDQGLQJDQGUHYLHZLQJVRFLDOJRDOPRGHOV,Q3URFHHGLQJV,(((
     WK,QWHUQDWLRQDO5HTXLUHPHQWV(QJLQHHULQJ&RQIHUHQFH5(  ±
>@(UGRJDQ*6W¡OHQ.'HVLJQGHFLVLRQVLQWKHGHYHORSPHQWRIDJUDSKLFDOODQJXDJHIRUULVN
     GULYHQVHFXULW\WHVWLQJ9ROXPH/1&6RI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJ
     VXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   ±
     




                                                        38

</pre>