DŽŽĚLJ͛ƐWŚLJƐŝĐƐŽĨEŽƚĂƚŝŽŶƐ͗,ŝŐŚ/ŵƉĂĐƚ͕>ŝƚƚůĞ^ƵƉƉŽƌƚ -DQHN=LHKPDQQ1 DQG%LUJHU/DQWRZ1  1 University of Rostock, Albert-Einstein-Str. 22, 18057 Rostock, Germany   ďƐƚƌĂĐƚ 'RPDLQ 6SHFLILF /DQJXDJHV IRVWHU WKH DFFHVV RI GRPDLQ H[SHUW NQRZOHGJH LQ (QWHUSULVH 0RGHOOLQJ3ODWIRUPVOLNH(FOLSVHZLWK(0)0HWD(GLWDQG$GR;;VXSSRUWWKHGHVLJQRI PHWDPRGHOV IRU 'RPDLQ 6SHFLILF /DQJXDJHV DQG WKH FUHDWLRQ RI PRGHOOLQJ WRROV EDVHG RQ WKHVH PHWDPRGHOV 7\SLFDOO\ D YLVXDO QRWDWLRQ LV XVHG IRU PRGHOOLQJ DQG SDUW RI WKH GHYHORSPHQW RI PRGHOOLQJ WRROV 0RRG\¶V ZRUN RQ 3K\VLFV RI 1RWDWLRQV LV D SURPLQHQW DSSURDFKWRSURYLGHJXLGHOLQHVIRUWKHGHVLJQRIYLVXDOQRWDWLRQV+RZHYHUZKLOHWKHUHDUH WRROVIRUODQJXDJHGHVLJQWKHUHLVRQO\OLWWOHUHVHDUFKRQWRROVXSSRUWIRUODQJXDJHHYDOXDWLRQ EDVHGRQWKH3K\VLFVRI1RWDWLRQV7KLVSDSHUXVHVDV\VWHPDWLFOLWHUDWXUHDQDO\VLVWRLQYHVWLJDWH WKHVWDWHRIWRROVXSSRUWIRULPSOHPHQWLQJRUHYDOXDWLQJWKHSULQFLSOHVFRQWDLQHGLQWKH3K\VLFV RI1RWDWLRQVDSSURDFK)XUWKHUPRUHWKHSDSHUSURYLGHVDQRXWORRNWRSRVVLEOHIXWXUHUHVHDUFK RQWRROEDVHGHYDOXDWLRQRIYLVXDOQRWDWLRQV  <ĞLJǁŽƌĚƐϭ 3K\VLFVRI1RWDWLRQV1RWDWLRQ'HVLJQ1RWDWLRQ(YDOXDWLRQ7RRO6XSSRUW ϭ͘ /ŶƚƌŽĚƵĐƚŝŽŶ 0RRG\¶V3K\VLFVRI1RWDWLRQV 3R1 LVDSURPLQHQWIUDPHZRUNIRUWKHGHVLJQDQGWKHHYDOXDWLRQRI JUDSKLFDO QRWDWLRQV 0RRG\ EDVHG KLV 3R1 RQ D VXUYH\ RI VFLHQWLILF DUWLFOHV UHJDUGLQJ QRWDWLRQ HYDOXDWLRQ 7KH VHOHFWHG SULQFLSOHV DUH EDFNHG E\ HPSLULFDO HYLGHQFH +RZHYHU WKHUH LV D ODFN RI FRPSDUDELOLW\DQGDORWRIDPELJXLW\ZKHQWKH3R1DUHDSSOLHGIRUQRWDWLRQHYDOXDWLRQ$WRROVXSSRUW WKDWSURYLGHVDFOHDUIRUPDOL]DWLRQZKHUHDSSOLFDEOHDQGWKDWVWDQGDUGL]HVWKHLUDSSOLFDWLRQPD\KHOS KHUH )XUWKHUPRUH WKH LQWHJUDWLRQ RI VXFK D WRRO VXSSRUW LQ SODWIRUPV OLNH (FOLSVH ZLWK (0) 0HWD(GLWDQG$GR;;DOORZLQJIRUWKHGHVLJQRIPHWDPRGHOVIRU'RPDLQ6SHFLILF/DQJXDJHVDQG WKHFUHDWLRQRIPRGHOOLQJWRROVEDVHGRQWKHVHPHWDPRGHOVPD\VXSSRUWQRWDWLRQGHVLJQHUVLQSURYLGLQJ KLJKHUTXDOLW\QRWDWLRQV 7KLV VWXG\ LQYHVWLJDWHV WKH SRWHQWLDO RI VXFK D WRRO VXSSRUW :KLOH D IRUPDOL]DWLRQ RI VRPH 3R1 SULQFLSOHV LVJHQHUDOO\SRVVLEOH ZH LQYHVWLJDWHG ZKHWKHU VXFKD VXSSRUW LV DFWXDOO\ XVHG LQ QRWDWLRQ HYDOXDWLRQ6HFWLRQLQWURGXFHVWKH3R1DQGGLVFXVVHVSRVVLELOLWLHVIRUWRROVXSSRUWLQJHQHUDO6HFWLRQ  LQYHVWLJDWHV WKH 3R1 DSSOLFDWLRQ LQ VFLHQWLILF UHVHDUFK 6HFWLRQ  SURYLGHV D VKRUW VXPPDU\ DQG RXWORRN Ϯ͘ DŽŽĚLJ͛ƐWƌŝŶĐŝƉůĞƐ 0RRG\GHILQHVLQ>@QLQHSULQFLSOHVIRUWKHGHVLJQRIFRJQLWLYHO\HIIHFWLYHYLVXDOQRWDWLRQV7KHVH SULQFLSOHVZLOOEHLQWURGXFHGEULHIO\LQWKHIROORZLQJDVWKH\QHHGWREHWUHDWHGGLIIHUHQWO\ZLWKUHJDUG WRDSRWHQWLDOWRROVXSSRUWIRUQRWDWLRQHYDOXDWLRQ 3ULQFLSOHRI6HPLRWLF&ODULW\7KLVSULQFLSOHGHPDQGVIRUDRQHWRRQHFRUUHVSRQGHQFHEHWZHHQ V\PEROVDQGFRQFHSWVRIWKHQRWDWLRQ0RRG\GHILQHVIRXUGLIIHUHQWSRVVLEOHGHILFLWVRIYLVXDOQRWDWLRQV ZLWK UHJDUG WR 6HPLRWLF &ODULW\   6\PERO 5HGXQGDQF\ LI PXOWLSOH V\PEROV UHSUHVHQW WKH VDPH FRQFHSW  6\PERO2YHUORDGLIDV\PEROUHSUHVHQWVPXOWLSOHFRQFHSWV  6\PERO([FHVVLIWKHUHDUH  3R(0¶)RUXPWK,),3:*:RUNLQJ&RQIHUHQFHRQWKH3UDFWLFHRI(QWHUSULVH0RGHOOLQJ1RYHPEHU±/DWYLD (0$,/MDQHN]LHKPDQQ#XQLURVWRFNGH -=LHKPDQQ ELUJHUODQWRZ#XQLURVWRFNGH %/DQWRZ  25&,' %/DQWRZ  ‹&RS\ULJKWIRUWKLVSDSHUE\LWVDXWKRUV  8VHSHUPLWWHGXQGHU&UHDWLYH&RPPRQV/LFHQVH$WWULEXWLRQ,QWHUQDWLRQDO &&%<   &(85:RUNVKRS3URFHHGLQJV &(85:6RUJ   31 V\PEROVWKDWGRQRWFRUUHVSRQGWRDFRQFHSWRIWKHQRWDWLRQ  6\PERO'HILFLWLIWKHUHDUHQRWDWLRQ FRQFHSWVZLWKRXWDFRUUHVSRQGLQJV\PERO>@ 3ULQFLSOH RI 3HUFHSWXDO 'LVFULPLQDELOLW\ 7KH PDLQ LGHD RI WKLV SULQFLSOH LV WR PDNH V\PEROV FOHDUO\GLVWLQJXLVKDEOHIURPHDFKRWKHU0RRG\SUHVHQWVDQXPEHURIVXJJHVWLRQVLQRUGHUWRUHDFKWKLV JRDODVVXULQJ9LVXDO'LVWDQFHRIV\PEROVE\XVLQJDKLJKQXPEHURIYLVXDOYDULDEOHVOLNHVKDSHFRORU VL]HHWFWRPDNHWKHPYLVXDOO\GLIIHUHQW6KDSHLVWKHPRVWLPSRUWDQWYLVXDOYDULDEOHKHUH0RRG\FDOOV WKLV IDFW 3ULPDF\ RI 6KDSH )XUWKHU UHFRPPHQGDWLRQV DUH WKH XVH RI WH[W WR GLIIHUHQWLDWH EHWZHHQ V\PEROV 7H[WXDO 'LIIHUHQWLDWLRQ  XVLQJ XQLTXH YDOXHV IRU DW OHDVW RQH YLVXDO YDULDEOH 3HUFHSWXDO 3RSRXW  DQG WR XVH PRUH WKDQ RQH YLVXDO YDULDEOH LQ RUGHU WR PDNH D GLIIHUHQFH EHWZHHQ V\PEROV 5HGXQGDQW&RGLQJ >@ 3ULQFLSOH RI 6HPDQWLF 7UDQVSDUHQF\ 6HPDQWLF 7UDQVSDUHQF\ GHVFULEHV H[WHQW WR ZKLFK WKH PHDQLQJRIDV\PEROFDQEHGHULYHGIURPLWVDSSHDUDQFH7KLVFDQUDQJHIURPVHPDQWLFDOO\LPPHGLDWH V\PEROVZKHUHWKHPHDQLQJFDQEHLQIHUUHGZLWKRXWDGGLWLRQDOLQIRUPDWLRQRYHUVHPDQWLFDOO\RSDTXH V\PEROV ZKHUH WKHUH LV QR OLQN EHWZHHQ DSSHDUDQFH DQG PHDQLQJ WR VHPDQWLFDOO\ SHUYHUVH V\PEROV ZKLFKLPSO\DZURQJPHDQLQJIRUWKHPRGHOXVHU7KHSHUIRUPDQFHRIDQRWDWLRQZLWKUHJDUGWRWKLV SULQFLSOHGHSHQGVRQWKHPRGHOXVHUVDQGVKRXOGWKXVEHHYDOXDWHGLQH[SHULPHQWV+RZHYHU0RRG\ SURYLGHV VRPH JHQHUDO UHFRPPHQGDWLRQV ± WKH XVH RI LFRQV WKDW GHSLFW UHDO REMHFWV 3HUFHSWXDO 5HVHPEODQFH DQGVSHFLDOJUDSKLFDOUHODWLRQV 6HPDQWLFDOO\7UDQVSDUHQWUHODWLRQV VXFKDVLQWHUVHFWLRQV RUWUHHV,WFDQEHFKHFNHGZKHWKHUWKHVHUHFRPPHQGDWLRQVDUHLPSOHPHQWHGLQDQRWDWLRQ>@ 3ULQFLSOHRI&RPSOH[LW\0DQDJHPHQW7KLVSULQFLSOHGHPDQGVIRUH[SOLFLWPHFKDQLVPVWRGHDO ZLWK FRPSOH[LW\ $ VLPSOH PHDVXUH IRU PRGHO FRPSOH[LW\ LV WKH QXPEHU RI XVHG HOHPHQWV :LWK LQFUHDVLQJ PRGHO VL]H OLPLWV DUH UHDFKHG UHJDUGLQJ SHUFHSWLRQ DQG FRJQLWLRQ 8QGHUVWDQGDELOLW\ RI PRGHOV VXIIHUV 7KHUHIRUH QRWDWLRQV VKRXOG SURYLGH PHFKDQLVPV WR UHGXFH FRPSOH[LW\ 7KH PDLQ PHFKDQLVPVWRUHDFKWKLVJRDODUH0RGXODUL]DWLRQDQG+LHUDUFK\ /HYHOVRI$EVWUDFWLRQ >@ 3ULQFLSOH RI &RJQLWLYH ,QWHJUDWLRQ 7KHUH VKRXOG EH PHFKDQLVPV WR LQWHJUDWH LQIRUPDWLRQ IURP GLIIHUHQW PRGHOV 2QH PHFKDQLVP ZRXOG EH &RQFHSWXDO ,QWHJUDWLRQ ,W SURYLGHV DQ RYHUYLHZ RI WKH PRGHODQGLWVVXEPRGHOVE\SURYLGLQJFRQFHSWVRQDKLJKDEVWUDFWLRQOHYHOWKDWFDQEHFRPELQHGLQ RUGHUWRUHODWHWKHXVHGVXEPRGHOV3HUFHSWXDO,QWHJUDWLRQKHOSVWKHPRGHOXVHUZLWKQDYLJDWLRQLQWKH PRGHOVSDFH>@ 3ULQFLSOH RI 9LVXDO ([SUHVVLYHQHVV :KLOH 9LVXDO 'LVWDQFH VHH DERYH  FRQVLGHUV WKH SDLUZLVH GLIIHUHQFHRIFRQFHSWVZLWKUHJDUGWRYLVXDOYDULDEOHV9LVXDO([SUHVVLYHQHVVDGGUHVVHVWKHXVHRIYLVXDO YDULDEOHV WKURXJKRXW WKH ZKROH JUDSKLFDO QRWDWLRQ +HQFH WKH TXHVWLRQ LV ZKLFK QXPEHU RI YLVXDO YDULDEOHV LV XVHG WR H[SUHVV VHPDQWLFV DQG WR GLVWLQJXLVK EHWZHHQ FRQFHSWV ,QIRUPDWLRQ FDUU\LQJ 9DULDEOHV DQGZKLFKQXPEHURIYLVXDOYDULDEOHVLVQRWIRUPDOO\XVHG )UHH9DULDEOHV 0RRG\GHILQHV DWRWDORIHLJKWYLVXDOYDULDEOHV+RUL]RQWDO3RVLWLRQ9HUWLFDO3RVLWLRQ6L]H%ULJKWQHVV&RORU7H[WXUH 6KDSH DQG 2ULHQWDWLRQ 7KH UHFRPPHQGDWLRQ LV WR XVH DV PXFK ,QIRUPDWLRQFDUU\LQJ 9DULDEOHV DV SRVVLEOH&RQVHTXHQWO\WKHUHLVDPD[LPXPRIHLJKW 3ULQFLSOHRI'XDO&RGLQJ*HQHUDOO\WH[WLVQRWDJRRGPHDQVWRFUHDWHDYLVXDOQRWDWLRQ+RZHYHU WKHUHLVDEHQHILWRIVXSSRUWLQJYLVXDOQRWDWLRQVE\DGGLQJWH[W7KLVFDQEHGRQHE\$QQRWDWLRQVDQGE\ +\EULG6\PEROVZKLFKFRPELQHWH[WDQGJUDSKLFDOREMHFWV>@ 3ULQFLSOHRI*UDSKLF(FRQRP\7KLVSULQFLSOHDGGUHVVHVWKHQXPEHURIDYDLODEOHJUDSKLFDOV\PEROV IRU PRGHOLQJ 7KHUH LV D UHFRPPHQGHG PD[LPXP RI VL[ V\PEROV $Q H[FHVV RI V\PEROV PDNHV LW GLIILFXOWIRUWKHPRGHOHUWREHDZDUHRIWKHV\PEROVWKDWFDQEHXVHG0RRG\VXJJHVWVWKUHHVWUDWHJLHV IRU LQFUHDVLQJ *UDSKLF (FRQRP\   5HGXFH 6HPDQWLF &RPSOH[LW\ +HQFH WKH QXPEHU RI XVHG FRQFHSWVLVUHGXFHG  ,QWURGXFH6\PERO'HILFLW  ,QFUHDVH9LVXDO([SUHVVLYHQHVV>@ 3ULQFLSOH RI &RJQLWLYH )LW +HUH GLIIHUHQW YLVXDO GLDOHFWV DUH VXJJHVWHG IRU GLIIHUHQW WDVNV DQG DXGLHQFHV 7KH PDLQ DVVXPSWLRQ XQGHUO\LQJ WKLV SULQFLSOH LV WKDW SUREOHP VROYLQJ SHUIRUPDQFH LV LQIOXHQFHG E\ WKH SUREOHP UHSUHVHQWDWLRQ WDVN FKDUDFWHULVWLFV DQG SUREOHP VROYHU VNLOOV 7KXV D SUREOHPSUHVHQWDWLRQVKRXOGILWWRWKHRWKHUWZRIDFWRUV7KLVDJDLQUHTXLUHVLQYROYHPHQWRIPRGHOXVHUV IRUHYDOXDWLRQ>@ 7KHUH DUH DOVR LQWHUGHSHQGHQFLHV EHWZHHQ WKH IRUPXODWHG SULQFLSOHV IRU QRWDWLRQ GHVLJQ )RU H[DPSOHLQWURGXFLQJD6\PERO'HILFLWDQGWKXVUHGXFLQJ6HPLRWLF&ODULW\IRVWHUV*UDSKLF(FRQRP\ $VVXPLQJDIRUPDOGHVFULSWLRQRIWKHYLVXDOQRWDWLRQWKDWLVPDSSHGWRWKHDEVWUDFWQRWDWLRQRID PHWDPRGHODVLWLVDYDLODEOHRQWKH$GR;;SODWIRUPDIRUPDOYDOLGDWLRQFDQSRWHQWLDOO\EHSHUIRUPHG IRUWKHPDMRULW\RI0RRG\¶VSULQFLSOHV7DNLQJIRUH[DPSOHWKHSULQFLSOHRI6HPLRWLF&ODULW\MXVWWKH 32 QXPEHURIPDSSLQJUHODWLRQVEHWZHHQHDFKV\PERORIWKHYLVXDOQRWDWLRQDQGHDFKFRQFHSWRIWKHPHWD PRGHOQHHGVWREHDQDO\]HG7KXVDWRROEDVHGYDOLGDWLRQRIWKHDGKHUHQFHWRWKHSULQFLSOHVRUDPHWULF IRU SULQFLSOHV OLNH 9LVXDO ([SUHVVLYHQHVV VHHPV WR EH D VWUDLJKWIRUZDUG ZD\ WR VXSSRUW QRWDWLRQ GHVLJQHUV 7KHUHDUHWZRSULQFLSOHVWKDWUHTXLUHHPSLULFDOHYDOXDWLRQ6HPDQWLF7UDQVSDUHQF\DQG&RJQLWLYH )LW %RWK UHTXLUH WKH FRQVLGHUDWLRQ RI WKH FRJQLWLYH SURFHVVHV RI LQWHQGHG QRWDWLRQ XVHUV 7KXV DQ H[SHULPHQWDOGHVLJQLQYROYLQJWKHXVHUVFDQKHOSWRHYDOXDWHWKHSHUIRUPDQFHRIQRWDWLRQVUHJDUGLQJ WKHVHSULQFLSOHV)XUWKHUPRUHWKHDOUHDG\PHQWLRQHGLQWHUGHSHQGHQFLHVEHWZHHQWKHSULQFLSOHVUHTXLUH VRPHWUDGHRIIVZKHUHWKHRSWLPXPPLJKWEHIRXQGHPSLULFDOO\2YHUDOODQHPSLULFDOHYDOXDWLRQRI QRWDWLRQVEDVHGDPRQJVWRWKHUVRQFULWHULDGHULYHGIURPFRJQLWLYHILWDQGVHPDQWLFWUDQVSDUHQF\VKRXOG EHSHUIRUPHGVLQFH0RRG\¶VSULQFLSOHVJHQHUDOO\SURYLGHJXLGHOLQHVEXWQRWJXDUDQW\WKDWDQRWDWLRQ ILWVLWVSXUSRVH%HVLGHVJHQHUDOWRROVXSSRUWIRUHPSLULFDOVWXGLHVWKHUHLVDOVRDVSHFLILFSRWHQWLDOIRU WRROVXSSRUWLQHPSLULFDOQRWDWLRQHYDOXDWLRQ)RUH[DPSOHWKHFRYHUDJHRIWKHODQJXDJHV\QWD[VKRXOG EHWUDFNHGLQVXFKHYDOXDWLRQV'XHWRWKHUHVXOWLQJFRPSOH[LW\DWRROVXSSRUWZRXOGVDYHHIIRUWDQG UHGXFHSRVVLEOHPLVWDNHVFRPSDUHGWRPDQXDOO\FKHFNLQJWKHPRGHOVXVHGLQH[SHULPHQWVDJDLQVWWKH IRUPDOO\GHILQHGV\QWD[ ϯ͘ ^LJƐƚĞŵĂƚŝĐ>ŝƚĞƌĂƚƵƌĞŶĂůLJƐŝƐ ϯ͘ϭ͘ WĂƉĞƌ/ĚĞŶƚŝĨŝĐĂƚŝŽŶĂŶĚ^ĞůĞĐƚŝŽŶ $V D VWDUWLQJ SRLQW RQ WKH DUWLFOH SXEOLVKHG LQ  E\ ' / 0RRG\ ³7KH SK\VLFV RI QRWDWLRQV 7RZDUGDVFLHQWLILFEDVLVIRUFRQVWUXFWLQJYLVXDOQRWDWLRQVLQVRIWZDUHHQJLQHHULQJ´>@%DVHGRQWKLV DUWLFOH D IRUZDUG VHDUFK LQ WKH OLWHUDWXUH GDWDEDVH 6FRSXV ZDV FDUULHG RXW 7KH OLWHUDWXUH GDWDEDVH 6FRSXVZDVFKRVHQDVWKHGDWDEDVHIRUWKLVVLQFH6FRSXVUHSUHVHQWVRQHRIWKHPRVWLPSRUWDQWOLWHUDWXUH GDWDEDVHVLQWKHILHOGRIVFLHQWLILFUHVHDUFKUHVXOWVIURPRWKHUGDWDEDVHVVXFKDV6SULQJHU/LQN,((( RU$,6H/DUHDOVRLQFOXGHG2WKHUDUWLFOHVSXEOLVKHGE\0RRG\LQDQGZKLFKDOVRGHDOZLWK WKH3R1DUHQRWFRQVLGHUHGDVIXUWKHUVWDUWLQJSRLQWVIRUDIRUZDUGVHDUFKGXHWRWKHLUUHODWLYHO\ORZ QXPEHURIFLWDWLRQVFRPSDUHGWRWKHRI>@ 7KHJHQHUDOSURFHGXUHIRUWKHVHOHFWLRQRIWKHUHVXOWVHWRIWKHIRUZDUGVHDUFKLQWKHFRXUVHRIWKH V\VWHPDWLF OLWHUDWXUH DQDO\VLV LV EDVHG RQ WKH SURFHGXUH SURSRVHG E\ >@ IRU D V\VWHPDWLF OLWHUDWXUH DQDO\VLV7KXVWKHDQDO\]HGSDSHUVZHUHSUHVHOHFWHGRQWKHEDVLVRIWKHWLWOHVDQGWKHQIXUWKHUVHOHFWHG ZLWKWKHKHOSRIWKHDEVWUDFW$VWKHODVWVWHSRIWKHVHOHFWLRQSURFHVVWKHSDSHUVZHUHWKHQVHOHFWHGRQ WKHEDVLVRIWKHFRQWHQWVRIWKHLUIXOOWH[WV 7KHIROORZLQJWHUPVVHUYHGDVLQFOXVLRQFULWHULDIRUWKHILUVWVHOHFWLRQVWHS³4XDOLW\´³([SHULPHQW´ ³(YDOXDWLRQ´³'HVLJQ´DQG³$QDO\VLV´LQFRPELQDWLRQZLWKFRQFUHWHPRGHOOLQJODQJXDJHVRUQRWDWLRQV DVZHOODVWKHSKUDVHVYLVXDOQRWDWLRQV´³JUDSKLFDOV\QWD[´RU³YLVXDOFRQVWUXFWV³$OVRLQFOXGHGZHUH WKHSKUDVHV³DSSOLFDWLRQ>@3R1´RU³DSSOLFDWLRQ>@SK\VLFVRIQRWDWLRQV´UHVSHFWLYHO\3DSHUVKDYH DOVREHHQLQFOXGHGLILWZDVFOHDUIURPWKHWLWOHWKDWWKDWIRUH[DPSOHDQH[SHULPHQWZDVFDUULHGRXW EXW WKH WHUP H[SHULPHQW´ ZDV QRW XVHG 7KXV LPSOLFLW PDWFKHV WR WKH RULJLQDO WHUPV ZHUH DOVR FRQVLGHUHG DV IRU H[DPSOH >@ 7KLV ILUVW VHOHFWLRQ VWHS UHVXOWHG D VHW EHLQJ QDUURZHG GRZQ WR  SRVVLEO\ UHOHYDQW SDSHUV &RQVLGHULQJ WKH DEVWUDFWV LQ WKH QH[W VWHS D FKHFN ZKHWKHU DFWXDOO\ WKH HYDOXDWLRQRUWKHGHVLJQRIDYLVXDOQRWDWLRQZDVLQIRFXVRIWKHUHVSHFWLYHSDSHUV7KLVUHVXOWHGLQDVHW RI  SDSHUV IRU DQDO\VLV 'XULQJ WKH DQDO\VLV RI WKH IXOO WH[WV D PRUH SDSHUV KDG WR EH VLQJOHG RXW EHFDXVHWKHDSSOLFDWLRQRIGHVLJQJXLGHOLQHVZDVRQO\GRFXPHQWHGUXGLPHQWDU\)LQDOO\WKHDQDO\VLVLV EDVHGRQVHOHFWHGSXEOLFDWLRQV ϯ͘Ϯ͘ WĂƉĞƌŶĂůLJƐŝƐ 7DEOHFODVVLILHVWKHDQDO\]HGSDSHUVZLWKUHJDUGWRWKHLUFRQWHQW2QO\SDSHUVDUHGHDOLQJZLWK WKH GHVLJQ RI YLVXDO QRWDWLRQV 7KH UHPDLQGHU SULPDULO\ IRFXVHV RQ FRPSDULVRQ DQG HYDOXDWLRQ RI H[LVWLQJ QRWDWLRQV 5HJDUGLQJ WKH HYDOXDWLRQ VHWWLQJ ZH GLIIHUHQWLDWHG EHWZHHQ HPSLULFDO H[SHUW VXUYH\VH[SHULPHQWV DQGDQDO\WLFDODSSURDFKHV7KHODWWHUVHWWLQJDQDO\WLFDODSSURDFK±JHQHUDOO\ 33 LQYROYHVDPDQXDODQDO\VLVRIWKHQRWDWLRQZLWKUHJDUGWRVRPHSULQFLSOHVE\WKHDXWKRUVRUE\H[SHUWV $FRPELQDWLRQRIDQDO\WLFDODQGHPSLULFDOVHWWLQJVDVVXJJHVWHGLQ6HFWLRQFDQDOVREHVHHQWLPHVLQ WKHUHVXOWVHW,QDGGLWLRQRUDVDOWHUQDWLYHVWRWKH3R1RWKHUIUDPHZRUNVKDYHEHHQDSSOLHGE\VHYHUDO DXWKRUV)RUH[DPSOHWKH&RJQLWLYH'LPHQVLRQV)UDPHZRUNKDVEHHQDSSOLHGE\>@2WKHUDXWKRUV XVHGWKH6(48$/)UDPHZRUNRUGHILQHGWKHLURZQDSSURDFK HJ>@ 7KUHHRIWKHSDSHUV >@GLGQRWUHDOO\UHYHDOWKHHYDOXDWLRQVHWWLQJRUWKHDSSOLHGSULQFLSOHV  dĂďůĞϭ ŶĂůLJnjĞĚWĂƉĞƌƐ;ΎсĂĚĚƌĞƐƐĞĚͿ 3DSHU $SSURDFK (YDOXDWLRQ6HWWLQJ 'HVLJQ  3R1 2WKHU $QDO\WLFDO (PSLULFDO  >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    >@    34 3DSHU $SSURDFK (YDOXDWLRQ6HWWLQJ 'HVLJQ  3R1 2WKHU $QDO\WLFDO (PSLULFDO  >@    >@    >@    >@    >@     /RRNLQJDWWKHSRWHQWLDOIRUDWRROEDVHGIRUPDOYDOLGDWLRQWKHDSSURDFKHVXVLQJDQDQDO\WLFDOVHWWLQJ QHHGWREHLQYHVWLJDWHG1RLWHPLQWKHUHVXOWVHWSURYLGHVWRROVXSSRUW:LWK>@RQO\WKUHH SDSHUVGLVFXVVDIRUPDOL]DWLRQRIQRWDWLRQGHVLJQHYDOXDWLRQ+RZHYHUWKHUHLVDJHQHUDODJUHHPHQWRI WKH FRQWULEXWLQJ DXWKRUV WR WKHVH SDSHUV WKDW GHVLJQ GHFLVLRQV ZLWK UHJDUG WR VRPH RI WKH SULQFLSOHV FDQQRWEHIRUPDOO\YDOLGDWHG+HUHDGRFXPHQWDWLRQRIGHFLVLRQVDQGWKHLUUDWLRQDOHLVUHFRPPHQGHG 2QO\RQHSDSHU>@VXJJHVWHGDWRROVXSSRUWEXWQRLPSOHPHQWDWLRQKDVEHHQSURYLGHGVRIDU$OOWKUHH DSSURDFKHVWRIRUPDOL]DWLRQIRFXVHGRQWKHDSSOLFDWLRQRIWKHFRPSOHWHVHWRI0RRG\¶VSULQFLSOHVDQG GLGQRWFRQVLGHURWKHUIUDPHZRUNVRURZQSULQFLSOHV 7KHPDMRULW\RIDQDO\WLFDODSSURDFKHVDOVRIRFXVRQWKH3R1DVLWLVVKRZQLQ7DEOH$FHQWUDO SUREOHPRIWKHODFNRIIRUPDOL]DWLRQLVWKDWDORWRISDSHUGLVFXVVWKHDSSOLFDWLRQRIWKHSULQFLSOHVWR HYDOXDWHG QRWDWLRQV EXW WKH UHVXOWV DUH QRW FRPSDUDEOH DQG VRPHWLPHV QRW HYHQ ZHOO MXVWLILHG ,Q DGGLWLRQ DQ DQDO\WLFDO YDOLGDWLRQ ZLWK UHJDUG WR 6HPDQWLF 7UDQVSDUHQF\ DQG &RJQLWLYH )LW FDQ EH FRQVLGHUHGDWOHDVWGLIILFXOWORRNLQJDWWKHGLVFXVVLRQLQ6HFWLRQ /RRNLQJDWWKHSRWHQWLDORIDVSHFLILFWRROEDVHGVXSSRUWIRUHPSLULFDOHYDOXDWLRQDJDLQQRH[DPSOH ZDV IRXQG LQ WKH DQDO\]HG SDSHUV 2QO\  RXW RI  SDSHUV KDG PRUH WKDQ  SDUWLFLSDQWV LQ WKH HYDOXDWLRQSURFHVVRQO\PRUHWKDQ7KXVVWDWLVWLFDOVLJQLILFDQFHLVLQTXHVWLRQIRUPRVWRIWKH HYDOXDWLRQV$JHQHUDOL]DWLRQWRDODUJHUJURXSRIQRWDWLRQXVHUVLVSUREOHPDWLF8QIRUWXQDWHO\VROXWLRQV WRWKDWSUREOHPDUHEDUHO\GLVFXVVHG+RZHYHUDWRROVXSSRUWPD\KHOSWRVWUHDPOLQHWKHHYDOXDWLRQ SURFHVVDQGWRORZHUEDUULHUVIRUSRWHQWLDOSDUWLFLSDQWV  dĂďůĞϮ ĚĚƌĞƐƐĞĚƌŝƚĞƌŝĂŽĨŶĂůLJƚŝĐĂůƉƉƌŽĂĐŚĞƐ 3ULQFLSOH 3DSHU 6HPLRWLF&ODULW\ >@ 3HUFHSWXDO'LVFULPLQDELOLW\ >@ 6HPDQWLF7UDQVSDUHQF\ >@ &RJQLWLYH,QWHJUDWLRQ >@ &RJQLWLYH)LW >@ *UDSKLF(FRQRP\ >@ 'XDO&RGLQJ >@ 9LVXDO([SUHVVLYHQHVV >@ 0DQDJHDEOH&RPSOH[LW\ >@  ϰ͘ ŽŶĐůƵƐŝŽŶĂŶĚKƵƚůŽŽŬ 7KLVVWXG\KDVVKRZQWKDWWKH3R1KDYHDKLJKLPSDFWFRQVLGHULQJWKHQXPEHURIFLWDWLRQVDQG KDVOLWWOHWRROVXSSRUWFRQVLGHULQJRQO\RQHSDSHULQWKH6\VWHPDWLF/LWHUDWXUH$QDO\VLVWKDWFRQVLGHUV WRROVXSSRUW+RZHYHUDORWRISUREOHPVLQQRWDWLRQGHVLJQDQGHYDOXDWLRQDULVHUHGXFHGFRPSDUDELOLW\ RI UHVXOWV DUELWUDU\ DQG DPELJXRXV DSSOLFDWLRQ RI SULQFLSOHV 7KH LQWHJUDWLRQ RI 0RRG\¶V DQG RWKHU IUDPHZRUNVLQSODWIRUPVIRUQRWDWLRQGHVLJQFDQORZHUWKHEDUULHUVIRUHPSLULFDOHYDOXDWLRQVDQGWKH ZHOOGRFXPHQWHG IRUPDOL]HG DSSOLFDWLRQRIJXLGHOLQHVWRQRWDWLRQGHVLJQ$QH[WSODQQHGVWHSLVWKH GHYHORSPHQWRIDPHWDPRGHOEDVHGWRROVXSSRUWIRUH[SHULPHQWGHVLJQLPSOHPHQWHGRQWKH$GR;; SODWIRUP$ILUVWSURWRW\SHDOUHDG\H[LVWV)XUWKHUPRUHDFRQFHSWRIDQDO\]LQJJUDSKLFDOUHSUHVHQWDWLRQV LQFRPELQDWLRQZLWKWKHPHWDPRGHOKDVEHHQGHYHORSHGIRUWKLVSODWIRUP 35 ZĞĨĞƌĞŶĐĞƐ >@ 0RRG\'7KHSK\VLFVRIQRWDWLRQV7RZDUGDVFLHQWLILFEDVLVIRUFRQVWUXFWLQJYLVXDOQRWDWLRQVLQ VRIWZDUHHQJLQHHULQJ,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ    ± >@ .LWFKHQKDP % 3URFHGXUHV IRU SHUIRUPLQJ V\VWHPDWLF UHYLHZV .HHOH 8. .HHOH 8QLYHUVLW\     ± >@ %HUD36RIIHU33DUVRQV-8VLQJH\HWUDFNLQJWRH[SRVHFRJQLWLYHSURFHVVHVLQXQGHUVWDQGLQJ FRQFHSWXDOPRGHOV0,64XDUWHUO\0DQDJHPHQW,QIRUPDWLRQ6\VWHPV    ± >@ 0ROLQD$,5HGRQGR0$2UWHJD0/DFDYH&(YDOXDWLQJDJUDSKLFDOQRWDWLRQIRUPRGHOLQJ FROODERUDWLYHOHDUQLQJDFWLYLWLHV$IDPLO\RIH[SHULPHQWV6FLHQFHRI&RPSXWHU3URJUDPPLQJ  ± >@ 6RXVD.9DQGHUGRQFNW-+HQGHUVRQ6HOOHUV%*RQ]DOH]3HUH]&(YDOXDWLQJDJUDSKLFDO QRWDWLRQ IRU PRGHOOLQJ VRIWZDUH GHYHORSPHQW PHWKRGRORJLHV -RXUQDO RI 9LVXDO /DQJXDJHV DQG &RPSXWLQJ    ± >@ &DQFKp02FKRD6)3HURYLFK'*XWLHUUH])-$QDO\VLVRIQRWDWLRQVIRUPRGHOLQJXVHU LQWHUDFWLRQ VFHQDULRV LQ XELTXLWRXV FROODERUDWLYH V\VWHPV -RXUQDO RI $PELHQW ,QWHOOLJHQFH DQG +XPDQL]HG&RPSXWLQJ   >@ )LJO.'HUQWO05RGULJXH]0&%RWWXUL/&RJQLWLYHHIIHFWLYHQHVVRIYLVXDOLQVWUXFWLRQDO GHVLJQODQJXDJHV-RXUQDORI9LVXDO/DQJXDJHVDQG&RPSXWLQJ    ± >@ %RUN ' 6FKUIIHU & .DUDJLDQQLV ' ,QWXLWLYH XQGHUVWDQGLQJ RI GRPDLQVSHFLILF PRGHOLQJ ODQJXDJHV 3URSRVLWLRQ DQG DSSOLFDWLRQ RI DQ HYDOXDWLRQ WHFKQLTXH 9ROXPH  /1&6 RI /HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJVXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFH DQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV    >@ 0LUDQGD7&KDOOHQJHU07H]HO%7$ODFD2)%DULãLü$$PDUDO9*RXOmR0.DUGDV *,PSURYLQJWKH8VDELOLW\RID0$6'60/9ROXPH/1$,RI/HFWXUH1RWHVLQ&RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ %LRLQIRUPDWLFV    >@&RUWHV&RUQD[0'XSX\&KHVVD65LHX'0DQGUDQ1(YDOXDWLQJWKHDSSURSULDWHQHVVRI WKHESPQVWDQGDUGIRUPRGHOLQJVHUYLFHFKRUHRJUDSKLHVXVLQJDQH[WHQGHGTXDOLW\IUDPHZRUN 6RIWZDUHDQG6\VWHPV0RGHOLQJ    ± >@)LJO.6\PEROFKRLFHDQGPHPRU\RIYLVXDOPRGHOV,Q3URFHHGLQJVRI,(((6\PSRVLXPRQ 9LVXDO/DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ9/+&&  ± >@3RODQFLF * %SPQO $ ESPQ H[WHQVLRQ IRU PRGHOLQJ RI SURFHVV ODQGVFDSHV &RPSXWHUV LQ ,QGXVWU\   >@$EEDG$QGDORXVVL$'DYLV&-%XUDWWLQ$/ySH]+$6ODDWV7:HEHU%8QGHUVWDQGLQJ TXDOLW\ LQ GHFODUDWLYH SURFHVV PRGHOLQJ WKURXJK WKH PHQWDO PRGHOV RI H[SHUWV 9ROXPH  /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   ± >@'MXULFD'0HQGOLQJ-)LJO.7KHLPSDFWRIDVVRFLDWLYHFRORULQJDQGUHSUHVHQWDWLRQDOIRUPDWV RQ GHFLVLRQPDNLQJ $Q H\HWUDFNLQJ VWXG\ ,Q /HFWXUH 1RWHV LQ ,QIRUPDWLRQ 6\VWHPV DQG 2UJDQLVDWLRQ9ROXPH  ± >@'|UQGRUIHU - 6HHO & &RQWH[W PRGHOLQJ IRU WKH DGDSWLRQ RI PRELOH EXVLQHVV SURFHVVHV ± DQ HPSLULFDO XVDELOLW\ HYDOXDWLRQ ,QIRUPDWLRQ 6\VWHPV )URQWLHUV  'HVLJQLQJDQG(YDOXDWLQJ 9LVXDO1RWDWLRQV >@*LUDOGR)'(VSDxD6*LUDOGR:-3DVWRU2.URJVWLH-$PHWKRGWRHYDOXDWHTXDOLW\RI PRGHOOLQJODQJXDJHVEDVHGRQWKH]DFKPDQUHIHUHQFHWD[RQRP\6RIWZDUH4XDOLW\-RXUQDO    ± >@(O.RXKHQ$*KHUEL$'XPRXOLQ&.KHQGHN)2QWKHVHPDQWLFWUDQVSDUHQF\RIYLVXDO QRWDWLRQV([SHULPHQWVZLWKXPO9ROXPHRI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJ VXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV    >@.XPPHU75HFNHU-0HQGOLQJ-(QKDQFLQJXQGHUVWDQGDELOLW\RISURFHVVPRGHOVWKURXJK FXOWXUDOGHSHQGHQWFRORUDGMXVWPHQWV'HFLVLRQ6XSSRUW6\VWHPV  ± >@5RHOHQV%3RHOV*7KHGHYHORSPHQWDQGH[SHULPHQWDOHYDOXDWLRQRIDIRFXVHGEXVLQHVVPRGHO UHSUHVHQWDWLRQ%XVLQHVVDQG,QIRUPDWLRQ6\VWHPV(QJLQHHULQJ    ± 36 >@7UXQ]HU(:XOOHQZHEHU$9RJHO+HXVHU%*UDSKLFDOPRGHOLQJQRWDWLRQIRUGDWDFROOHFWLRQ DQGDQDO\VLVDUFKLWHFWXUHVLQF\EHUSK\VLFDOV\VWHPVRIV\VWHPV-RXUQDORI,QGXVWULDO,QIRUPDWLRQ ,QWHJUDWLRQ   >@9LGDO 0 0DVVRQL 7 5DPDOKR ) $ GRPDLQVSHFLILF ODQJXDJH IRU YHULI\LQJ VRIWZDUH UHTXLUHPHQWFRQVWUDLQWV6FLHQFHRI&RPSXWHU3URJUDPPLQJ   >@*RQoDOYHV($OPHQGUD&$UDXMR-&DVWUR-*RXOmR0$GGUHVVLQJV\PEROUHGXQGDQF\ UHSUHVHQWDWLRQVLQLVWDUH[WHQVLRQV,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH   >@*RQoDOYHV($OPHQGUD&*RXOmR0$UD~MR-&DVWUR-8VLQJHPSLULFDOVWXGLHVWRPLWLJDWH V\PERORYHUORDGLQLVWDUH[WHQVLRQV6RIWZDUHDQG6\VWHPV0RGHOLQJ    ± >@9DQ'HU/LQGHQ'=DPDQVN\$+DGDU,+RZFRJQLWLYHO\HIIHFWLYHLVDYLVXDOQRWDWLRQ"RQ WKHLQKHUHQWGLIILFXOW\RIRSHUDWLRQDOL]LQJWKHSK\VLFVRIQRWDWLRQV9ROXPHRI/HFWXUH1RWHV LQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ± >@0XQHHU681DGHHP0.DVL%@6HOYLDQGUR1.HOO\7+DZNLQV57KHYLVXDOLQKHULWDQFHVWUXFWXUHWRVXSSRUWWKHGHVLJQRI YLVXDOQRWDWLRQV,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH  ± >@$QZHU6(O$WWDU0$QHYDOXDWLRQRIWKHVWDWHFKDUWGLDJUDPVYLVXDOV\QWD[,Q,&,6$ WK,QWHUQDWLRQDO&RQIHUHQFHRQ,QIRUPDWLRQ6FLHQFHDQG$SSOLFDWLRQV   >@&KHUGDQWVHYD<+LOWRQ-5DQD2,YLQV:$PXOWLIDFHWHGHYDOXDWLRQRIWKHUHIHUHQFHPRGHO RILQIRUPDWLRQDVVXUDQFH VHFXULW\&RPSXWHUVDQG6HFXULW\  ± >@'DQJDUVND=)LJO.0HQGOLQJ-$QH[SORUDWLYHDQDO\VLVRIWKHQRWDWLRQDOFKDUDFWHULVWLFVRI WKH GHFLVLRQ PRGHO DQG QRWDWLRQ GPQ  ,Q 3URFHHGLQJV ± ,((( ,QWHUQDWLRQDO (QWHUSULVH 'LVWULEXWHG2EMHFW&RPSXWLQJ:RUNVKRS('2&:9ROXPH6HSWHPEHU  ± >@'LDPDQWRSRXORX 9 0RXUDWLGLV + $SSO\LQJ WKH SK\VLFV RI QRWDWLRQ WR WKH HYDOXDWLRQ RI D VHFXULW\DQGSULYDF\UHTXLUHPHQWVHQJLQHHULQJPHWKRGRORJ\,QIRUPDWLRQDQG&RPSXWHU6HFXULW\     ± >@'LDPDQWRSRXORX 9 3DYOLGLV 0 0RXUDWLGLV + (YDOXDWLRQ RI D VHFXULW\ DQG SULYDF\ UHTXLUHPHQWVPHWKRGRORJ\XVLQJWKHSK\VLFVRIQRWDWLRQ9ROXPH/1&6RI/HFWXUH1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHVLQ%LRLQIRUPDWLFV   ± >@'REHVRYD=8VLQJWKHSK\VLFVRIQRWDWLRQWRDQDO\VHPRGHOEXLOGHUGLDJUDPV,Q,QWHUQDWLRQDO 0XOWLGLVFLSOLQDU\ 6FLHQWLILF *HR&RQIHUHQFH 6XUYH\LQJ *HRORJ\ DQG 0LQLQJ (FRORJ\ 0DQDJHPHQW6*(09ROXPH  ± >@'REHVRYD=(YDOXDWLRQRIHIIHFWLYHFRJQLWLRQIRUWKHTJLVSURFHVVLQJPRGHOHU$SSOLHG6FLHQFHV 6ZLW]HUODQG      >@)LJO.'HUQWO07KHLPSDFWRISHUFHLYHGFRJQLWLYHHIIHFWLYHQHVVRQSHUFHLYHGXVHIXOQHVVRI YLVXDOFRQFHSWXDOPRGHOLQJODQJXDJHV9ROXPH/1&6RI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJVXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   ± >@)LJO.5HFNHU-0HQGOLQJ-$VWXG\RQWKHHIIHFWVRIURXWLQJV\PEROGHVLJQRQSURFHVVPRGHO FRPSUHKHQVLRQ'HFLVLRQ6XSSRUW6\VWHPV    ± >@)LJO.8VHUHYDOXDWLRQRIV\PEROVIRUFRUHEXVLQHVVSURFHVVPRGHOLQJFRQFHSWV,Q3URFHHGLQJV RIWKHWK(XURSHDQ&RQIHUHQFHRQ,QIRUPDWLRQ6\VWHPV(&,6  ± >@/DQWRZ % 'HKQH 0 +RO] ) (YDOXDWLQJ QRWDWLRQV IRU SURGXFWVHUYLFH PRGHOLQJ LQ HP *HQHUDOFRQFHSWPRGHOLQJYVVSHFLILFODQJXDJH,Q&(85:RUNVKRS3URFHHGLQJV9ROXPH  ± >@/LQGHQ'9'=DPDQVN\$+DGDU,$IUDPHZRUNIRULPSURYLQJWKHYHULILDELOLW\RIYLVXDO QRWDWLRQ GHVLJQ JURXQGHG LQ WKH SK\VLFV RI QRWDWLRQV ,Q 3URFHHGLQJV   ,((( WK ,QWHUQDWLRQDO5HTXLUHPHQWV(QJLQHHULQJ&RQIHUHQFH5(  ± >@0RRG\'/+H\PDQV30DWXOHYLFLXV5,PSURYLQJWKHHIIHFWLYHQHVVRIYLVXDOUHSUHVHQWDWLRQV LQ UHTXLUHPHQWV HQJLQHHULQJ $Q HYDOXDWLRQ RI L  YLVXDO V\QWD[ ,Q 3URFHHGLQJV RI WKH ,((( ,QWHUQDWLRQDO&RQIHUHQFHRQ5HTXLUHPHQWV(QJLQHHULQJ  ± >@0RRG\'/+H\PDQV30DWXOHYLþLXV59LVXDOV\QWD[GRHVPDWWHU,PSURYLQJWKHFRJQLWLYH HIIHFWLYHQHVVRIWKHL YLVXDOQRWDWLRQ5HTXLUHPHQWV(QJLQHHULQJ    ± 37 >@5RDVW & 8UXFKXUWX ( 5HIOHFWLQJ RQ WKH SK\VLFV RI QRWDWLRQV DSSOLHG WR D YLVXDOLVDWLRQ FDVH VWXG\ ,Q $&0 ,QWHUQDWLRQDO &RQIHUHQFH 3URFHHGLQJ 6HULHV 9ROXPH 6HSWHPEHU  ± >@6DHHG06DOHK)$O,QVDLI6(O$WWDU0(YDOXDWLQJWKHFRJQLWLYHHIIHFWLYHQHVVRIWKHYLVXDO V\QWD[RIIHDWXUHGLDJUDPV9ROXPH&&,6RI&RPPXQLFDWLRQVLQ&RPSXWHUDQG,QIRUPDWLRQ 6FLHQFH  ± >@6DOHK ) (O$WWDU 0 $ VFLHQWLILF HYDOXDWLRQ RI WKH PLVXVH FDVH GLDJUDPV YLVXDO V\QWD[ ,QIRUPDWLRQDQG6RIWZDUH7HFKQRORJ\  ± >@6W|UUOH+)LVK$7RZDUGVDQRSHUDWLRQDOL]DWLRQRIWKHSK\VLFVRIQRWDWLRQVIRUWKHDQDO\VLV RI YLVXDO ODQJXDJHV 9ROXPH  /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ %LRLQIRUPDWLFV    ± >@'D6LOYD7HL[HLUD0*4XLULQR*.*DLOO\))DOER5$*XL]]DUGL*%DUFHOORV03 3RQV$V\VWHPDWLFDSSURDFKIRUDSSO\LQJWKHSK\VLFVRIQRWDWLRQ SRQ 9ROXPHRI/HFWXUH 1RWHVLQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ± >@=HKQGHU ( 0D\HU 1 *URQLHU * (YDOXDWLRQ RI WKH FRJQLWLYH HIIHFWLYHQHVV RI WKH FRUDV PRGHOOLQJ ODQJXDJH 9ROXPH  /1&6 RI /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH LQFOXGLQJ VXEVHULHV /HFWXUH 1RWHV LQ $UWLILFLDO ,QWHOOLJHQFH DQG /HFWXUH 1RWHV LQ %LRLQIRUPDWLFV    ± >@/DXH58VHRILPDJHGDWDEDVHVWRFUHDWHV\PEROVIRUJUDSKLFDOPRGHOLQJODQJXDJHV,Q/HFWXUH 1RWHVLQ,QIRUPDWLFV /1, 3URFHHGLQJV6HULHVRIWKH*HVHOOVFKDIWIXU,QIRUPDWLN *, 9ROXPH   ±'HVLJQLQJDQG(YDOXDWLQJ9LVXDO1RWDWLRQV >@5RHOHQV%%RUN'$QHYDOXDWLRQRIWKHLQWXLWLYHQHVVRIWKHSJDPRGHOLQJODQJXDJHQRWDWLRQ 9ROXPH/1%,3RI/HFWXUH1RWHVLQ%XVLQHVV,QIRUPDWLRQ3URFHVVLQJ  ± >@6DQWRV 0 *UDOKD & *RXODR 0 $UDXMR - 0RUHLUD $ 2Q WKH LPSDFW RI VHPDQWLF WUDQVSDUHQF\RQXQGHUVWDQGLQJDQGUHYLHZLQJVRFLDOJRDOPRGHOV,Q3URFHHGLQJV,((( WK,QWHUQDWLRQDO5HTXLUHPHQWV(QJLQHHULQJ&RQIHUHQFH5(  ± >@(UGRJDQ*6W¡OHQ.'HVLJQGHFLVLRQVLQWKHGHYHORSPHQWRIDJUDSKLFDOODQJXDJHIRUULVN GULYHQVHFXULW\WHVWLQJ9ROXPH/1&6RI/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH LQFOXGLQJ VXEVHULHV/HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHDQG/HFWXUH1RWHVLQ%LRLQIRUPDWLFV   ±  38