WĂŶĞů ŝƐĐƵƐƐŝŽŶ͗ ,Žǁ ƚŽ ƵŝůĚ Ă WĞƌĨĞĐƚ ŶƚĞƌƉƌŝƐĞ DŽĚĞůŝŶŐ DĞƚŚŽĚ  -ROLWD5DO\Wp1'RPLQLN%RUN20DQIUHG$-HXVIHOG30DULWH.LULNRYD4DQG-DQLV6WLUQD5  1 University of Geneva, CUI, Ballette bât. A, Route de Drize 7, Carouge, 1227, Switzerland 2 TU Wien, Business Informatics Group, Favoritenstrasse 9-11, 1040 Vienna, Austria 3 University of Skövde, Box 408, 54128 Skövde, Sweden 4 Riga Technical University, Kalku 1, Riga, LV-1658, Latvia 5 Stockholm University, Postbox 7003, Kista, SE 16407, Sweden  ďƐƚƌĂĐƚ 7KLV SDSHU UHSRUWV RQ WKH SOHQDU\ SDQHO GLVFXVVLRQ RQ ³+RZ WR %XLOG D 3HUIHFW (QWHUSULVH 0RGHOLQJ0HWKRG´KHOGDWWKH3R(0FRQIHUHQFH7KHSDQHOZDVFKDUJHGZLWKILQGLQJD SDWKZD\ WR WKH SHUIHFW HQWHUSULVH PRGHOLQJ PHWKRG 7KH SDQHOLVWV KDYH D EDFNJURXQG LQ HQWHUSULVHPRGHOLQJDQGPHWKRGHQJLQHHULQJ6RWKHTXHVWLRQLV&DQPHWKRGHQJLQHHULQJKHOS ZLWK GHVLJQLQJ D EHWWHU HQWHUSULVH PRGHOLQJ HQYLURQPHQW" 7KH FRQWULEXWLRQV LQ WKLV SDSHU VKRXOGEHUHJDUGHGDVDVQDSVKRWRIRXUYLHZSRLQWVDWWKHWLPHRIWKHSDQHO  <ĞLJǁŽƌĚƐϭ (QWHUSULVH 0RGHOLQJ 0HWKRG (QJLQHHULQJ 0HWKRG 5HTXLUHPHQWV &RQFHSWXDO 0RGHOLQJ (QWHUSULVH$UFKLWHFWXUH ϭ͘ /ŶƚƌŽĚƵĐƚŝŽŶ (QWHUSULVH0RGHOLQJ (0 LVDZHOONQRZQDSSURDFKWRIRUPDOO\GHVFULELQJDQHQWHUSULVHZLWKDVHW RIPRGHOVUHIOHFWLQJGLIIHUHQWYLHZVRIWKHHQWHUSULVHVXFKDVLWVRUJDQL]DWLRQDOVWUXFWXUHEXVLQHVVJRDOV VHUYLFHVSURGXFWVDQGSURFHVVHVLQIRUPDWLRQV\VWHP ,6 DQGLWVFRPSRQHQWV,7LQIUDVWUXFWXUHVHFXULW\ DVSHFWVHWF7KHPRGHOVDUHDEVWUDFWLRQVRIWKHHQWHUSULVHNQRZOHGJH7KH\SURYLGHDPHGLXPWRVKDUH DFRPPRQXQGHUVWDQGLQJEHWZHHQYDULRXVVWDNHKROGHUVDQGWRFRQGXFWWKHSURJUHVVLRQRIWKHHQWHUSULVH $Q(0PHWKRGLVDFRQFHSWXDOWRROIDFLOLWDWRUDQGJXLGHWKDWKDVYDULRXVDSSOLFDWLRQVLQWKHOLIHRI DQRUJDQL]DWLRQ,WVXSSRUWVWKHLPSOHPHQWDWLRQRILWV(QWHUSULVH$UFKLWHFWXUH>@WKHVWUDWHJLFSODQQLQJ UHRUJDQL]DWLRQDQGGLJLWDOWUDQVIRUPDWLRQ>@WKHGHYHORSPHQWDQGHYROXWLRQRILQIRUPDWLRQV\VWHPV DQG VHUYLFHV LQ FRQFRUGDQFH ZLWK WKH RUJDQL]DWLRQ¶V GHYHORSPHQW VWUDWHJ\ >@ WKH GHVLJQ RI QHZ SURGXFWVDQGVHUYLFHVWREHGHOLYHUHGWRLWVFXVWRPHUV>@WKHGHYHORSPHQWRIGLJLWDOWZLQV>@DQG GHDOLQJZLWKYDULRXVEXVLQHVVFKDOOHQJHV>@ $W\SLFDO(0PHWKRGLQFOXGHVVHYHUDOPRGHOLQJODQJXDJHVRQHSHUGLIIHUHQWPRGHOLQJYLHZDQG SURYLGHVJXLGDQFH DQGVRPHWLPHVDVXSSRUWLQJWRRO WREXLOGWKHPRGHOV,WDLPVWREHJHQHULFLQWKH VHQVHWKDWLWFDQEHDSSOLHGWRDQ\HQWHUSULVH+RZHYHUWKHOLIHRIWRGD\¶VHQWHUSULVHLVQRWDORQJTXLHW ULYHU ,W KDV WR FRSH ZLWK GLYHUVH FKDOOHQJHV RI GLJLWDO WUDQVIRUPDWLRQ EXVLQHVV DJLOLW\ DQG HYHQ WHFKQRORJ\GLVUXSWLRQ7KHQHHGVIRU(0HYROYHDWWKHVDPHSDFHDVRUJDQL]DWLRQDOFRQWH[WVEXVLQHVV UHTXLUHPHQWVDQGWHFKQRORJLHVHYROYH7KHUHIRUHKRZFRXOGRQHPHWKRGVDWLVI\DOORUJDQL]DWLRQVLQDOO VLWXDWLRQV" $ODUJHQXPEHURI(0PHWKRGVDQGODQJXDJHVKDYHEHHQSURSRVHGE\DFDGHPLDDQGLQGXVWU\>@ EXWFKDQJLQJ(0UHTXLUHPHQWVPDNHWKHWDVNRIEXLOGLQJWDLORULQJDQGH[WHQGLQJ(0PHWKRGVPRUH WKDQUHOHYDQWWRGD\  3R(0¶)RUXPWK,),3:*:RUNLQJ&RQIHUHQFHRQWKH3UDFWLFHRI(QWHUSULVH0RGHOOLQJ1RYHPEHU±/DWYLD (0$,/ MROLWDUDO\WH#XQLJHFK - 5DO\Wp  GRPLQLNERUN#WXZLHQDFDW ' %RUN  PDQIUHGMHXVIHOG#KLVVH 0$ -HXVIHOG  0DULWH.LULNRYD#UWXOY 0.LULNRYD MV#GVYVXVH -6WLUQD  25&,' -5DO\Wp  '%RUN  0$-HXVIHOG  0.LULNRYD ; -6WLUQD  ‹&RS\ULJKWIRUWKLVSDSHUE\LWVDXWKRUV  8VHSHUPLWWHGXQGHU&UHDWLYH&RPPRQV/LFHQVH$WWULEXWLRQ,QWHUQDWLRQDO &&%<   &(85:RUNVKRS3URFHHGLQJV &(85:6RUJ   78 7KHDLPRIWKHSDQHOKHOGDWWKH3R(0FRQIHUHQFHZDVWRH[SORUHWKH0HWKRG(QJLQHHULQJ 0( SHUVSHFWLYHRI(QWHUSULVH0RGHOLQJ (0 ±WRHOLFLWWKHUHTXLUHPHQWVDQGKLJKOLJKWWKHFKDOOHQJHV RI0(IRUEXLOGLQJDSHUIHFWO\DGDSWHGDQGHIILFLHQW(0PHWKRG7KHSDQHOLVWVZHUHLQYLWHGWRDQVZHU WKHIROORZLQJWKUHHTXHVWLRQVDQGVXETXHVWLRQV  :KDW DUH WKH UHTXLUHPHQWV IRU D SHUIHFW (0 PHWKRG" 'RHV RQH PHWKRG FDQ ILW DOO RUJDQL]DWLRQV DQG DOO VLWXDWLRQV" 'RHV WKH HQWHUSULVH FRQWH[W PDWWHU ZKHQ EXLOGLQJ DQ (0 PHWKRG"+RZWRPDNHWKH(0HDV\DQGHIILFLHQW"  :KLFK0(DSSURDFKIRUEXLOGLQJDQ(0PHWKRG":KDWZRUNVDQGZKDWGRHVQRW"+RZWR OHDUQIURPSDVWIDLOXUHVDQGRUVXFFHVVHV"6KRXOGZHFROOHFWSDWWHUQVDQGDQWLSDWWHUQVRI0( IRU(0"  :KDWH[SHUWLVHDQGHIIRUWDUHUHTXLUHGWREXLOGXVHDQ(0PHWKRG"+RZWRUHGXFHWKH HIIRUWDQGKRZWRJDLQWKHH[SHUWLVH"  7KH SDQHO LQYROYHG 'RPLQLN %RUN 0DQIUHG -HXVIHOG 0DULWH .LULNRYD DQG -DQLV 6WLUQD DV WKH SDQHOLVWVZKLOH-ROLWD5DO\WpZDVWKHPRGHUDWRURIWKLVVHVVLRQ7KHUHPLQGHURIWKLVSDSHUVXPPDUL]HV WKHGLVFXVVLRQWKHYLHZVRIWKHSDQHOLVWVDQGDQWWKHLQSXWVIURPWKHDXGLHQFHUHJDUGLQJWKHWKUHHPDLQ TXHVWLRQVGHVFULEHGDERYH,QVHFWLRQZHHOLFLWWKHUHTXLUHPHQWVWKDWDQ(0PHWKRGVKRXOGVDWLVI\WR VHHNWKHSHUIHFWLRQ,QVHFWLRQZHGLVFXVVPHWKRGHQJLQHHULQJFKDOOHQJHVZKLOHLQVHFWLRQZHUHIOHFW RQ WKH H[SHUWLVH DQG HIIRUW UHTXLUHG WR FUHDWH (0 PHWKRGV 6HFWLRQ  FRQFOXGHV WKH SDSHU E\ VXPPDUL]LQJWKHRXWFRPHRIWKHSDQHO Ϯ͘ ZĞƋƵŝƌĞŵĞŶƚƐĨŽƌĂƉĞƌĨĞĐƚDŵĞƚŚŽĚ )URPWKH0HWKRG(QJLQHHULQJ 0( SRLQWRIYLHZDQGHVSHFLDOO\IURPWKHVLWXDWLRQDO0(>@SRLQW RIYLHZRQHPHWKRGFDQQRWILWDOOVLWXDWLRQVDQGDOORUJDQL]DWLRQDOFRQWH[WV7KHILUVWVWHSRIEXLOGLQJD QHZPHWKRGFRQVLVWVLQVSHFLI\LQJWKHUHTXLUHPHQWVIRUWKLVPHWKRG>@GHILQLQJLWVVFRSHUHTXLUHG IXQFWLRQDOLWLHVDQGTXDOLW\DVSHFWVLQDFFRUGDQFHZLWKWKHRUJDQL]DWLRQDOFRQWH[WDQGVLWXDWLRQDOIDFWRUV )XQFWLRQDO PHWKRG UHTXLUHPHQWV VSHFLI\ YDULRXV W\SHV RI PRGHOV WR EH SURGXFHG YDOLGDWHG DQG PDQDJHG7KH\DUHQHFHVVDU\EXWQRWVXIILFLHQWWRUHDFKPHWKRGSHUIHFWLRQ3HUIHFWLRQDVDFRQFHSWLV XVXDOO\UHODWHGWRTXDOLW\,QWKHIROORZLQJVXEVHFWLRQVZHPDLQO\GLVFXVVWKHTXDOLW\UHTXLUHPHQWVDQG VLWXDWLRQDODVSHFWV Ϯ͘ϭ͘ YƵĂůŝƚLJƌĞƋƵŝƌĞŵĞŶƚƐĨŽƌĂŶDŵĞƚŚŽĚ $QHQWHUSULVHPRGHOLQJPHWKRGW\SLFDOO\FRYHUVPXOWLSOHSHUVSHFWLYHV GDWDSURFHVVJRDOHYHQW HWF IRUPXOWLSOHOHYHOV EXVLQHVVDSSOLFDWLRQVRIWZDUHQHWZRUNDQGLQIUDVWUXFWXUHHWF 6XFKDPXOWL SHUVSHFWLYHPXOWLOD\HUPRGHOLQJPHWKRGILUVWKDVWRIXOILOOWKHW\SLFDOTXDOLW\UHTXLUHPHQWVIRUPXOWL SHUVSHFWLYHPRGHOLQJPHWKRGV Ɣ Minimal redundancy7KHFRQVWUXFWVXVHGLQWKHGLIIHUHQWSHUVSHFWLYHVOD\HUVVKRXOGKDYHD PLQLPDORYHUODSWRDYRLGUHGXQGDQF\LQWKHPRGHOVFUHDWHGIRUWKHSHUVSHFWLYHOD\HU$FHUWDLQ DPRXQW RI UHGXQGDQF\ LV XQDYRLGDEOH WR EH DEOH WR H[SUHVV FURVVUHIHUHQFHV )XUWKHU VRPH UHGXQGDQF\PD\ EHXVHIXO WR GHWHFW FRQIOLFWV LQYLHZV H[SUHVVHG E\ GLIIHUHQWVWDNHKROGHUV  PRGHOHUV Ɣ Cross-notational constraints:KHQRQHPRGHOLQJODQJXDJHPDNHVUHIHUHQFHV>@WRFRQVWUXFWV XVHGLQDQRWKHUPRGHOLQJODQJXDJH XVHGIRUDQRWKHUSHUVSHFWLYHOD\HU WKHQWKH(0PHWKRG VKRXOGFRQWDLQVXLWDEOHFRQVWUDLQWVIRUXVLQJWKHVHFURVVUHIHUHQFHV Ɣ Consistency&KDQJHVLQRQHPRGHOLQYROYLQJFRQFHSWVWKDWKDYHFURVVQRWDWLRQDOOLQNVWRRWKHU PRGHOVVKRXOGEHWUDQVODWHGLQWRVHPDQWLFDOO\HTXLYDOHQWFKDQJHVWKDWDQ(0PRGHOLQJWRRO VKRXOG DXWRPDWLFDOO\ DSSO\ WR DOO DIIHFWHG PRGHOV LQ RUGHU WR UHWDLQ DQ RYHUDUFKLQJ PRGHO UHSUHVHQWDWLRQRIWKHHQWHUSULVH>@  6SHFLILFDOO\IRU(0ZHLGHQWLI\IXUWKHUUHTXLUHPHQWVIRUWKHSHUIHFW(0PHWKRG Ɣ Ontological grounding / semantics 7KH FRQVWUXFWV VKRXOG EH UHODWHG WR DQ DJUHHGXSRQ RQWRORJ\RIDUWHIDFWVRFFXUULQJLQHQWHUSULVHVVXFKDVUHVRXUFHVSURFHVVHVHYHQWVDQGVRIRUWK 79 )RUH[DPSOHDFRQVWUXFWIRUDWDVNVKRXOGEHGHFODUHGWREHHTXLYDOHQWWRVRPHFRQFHSWLQWKH RQWRORJ\ Ɣ Detection of modeling flaws 7KH SHUIHFW (0 PHWKRG VKRXOG KDYH DGYDQFHG WRROV WR GHWHFW IODZVLQPRGHOVDVZHOODV³XQGHVLUHGPRGHOSDWWHUQV´ Ɣ Extensibility7KHFRUHFRQVWUXFWVRIWKH(0PHWKRGVKRXOGEHH[WHQVLEOHE\GRPDLQVSHFLILF FRQVWUXFWVLGHDOO\GHILQHGDVVSHFLDOL]DWLRQVRIWKHFRUHFRQVWUXFWV7KHQHZFRQVWUXFWVVKDOO QRWYLRODWHWKHVHPDQWLFVRIWKHFRUHFRQVWUXFWVWKDWWKH\DUHVXEFODVVHVRI Ɣ Multi-level abstractions (QWHUSULVH PRGHOV GHVFULEH DUWHIDFWV DW GLIIHUHQW DEVWUDFWLRQ OHYHOV HJ SK\VLFDO LQIUDVWUXFWXUH REMHFWV VXFK DV PDFKLQHV FRPSXWHUV 'DWDEDVHV OLNH SURGXFW FDWDORJVUHIHUWRSURGXFWPRGHOV IXUWKHUJURXSHGLQWRSURGXFWW\SHVDQGFDWHJRULHV 7KHUHPD\ EHEXVLQHVVSURFHVVHVDERXWWKHFUHDWLRQRISURGXFWVHUYLFHLQVWDQFHV2WKHUEXVLQHVVSURFHVVHV DUHDERXWFUHDWLQJSURGXFWVHUYLFHPRGHOV+HQFHWKHSHUIHFW(0PHWKRGVKRXOGEHDEOHWR GHDOZLWKDUWHIDFWVDWDQ\RIWKHVHDEVWUDFWLRQOHYHOV  3HUIHFWLRQ RI DQ (0 PHWKRG FRQVLVWLQJ RI SURFHGXUHV PHWDPRGHOV DQG DFWXDOO\ FRQVWUXFWHG PRGHOVWKXVGHSHQGVRQWKHTXDOLW\RIHQWHUSULVH PHWD PRGHOV.6$QGHUVHQXQGHUVXSHUYLVLRQRI -.URJVWLHKDVDPDOJDPDWHGWKHIROORZLQJV\VWHPVRIFULWHULDIRUHYDOXDWLQJHQWHUSULVHPRGHOTXDOLW\ >@ZKLFKDUHLQKHUHQWO\LPSRUWDQWDOVRIRU(0PHWKRGV Ɣ Principles of modellingIURP>@CompletenessWKHGHJUHHWRZKLFKDOOUHOHYDQWIDFWVIURPWKH GRPDLQDUHLQFOXGHGLQWKHPRGHOCorrectnessKRZZHOOWKHPRGHOFRQIRUPVWRWKHUXOHVRI WKHPRGHOOLQJWHFKQLTXHFlexibilityWKHGHJUHHWRZKLFKWKHPRGHOFDQDGDSWWRFKDQJHVLQWKH PRGHOOLQJ GRPDLQ Integration WR ZKLFK GHJUHH RI FRQVLVWHQF\ EHWZHHQ WKH GLIIHUHQW VXE PRGHOVWKDWFRQVWLWXWHWKHPRGHOSimplicityWKHGHJUHHRIPLQLPDOXVHRIPRGHOOLQJFRQVWUXFWV IRUWKHSUHVHQWLQJNQRZOHGJHLQWKHPRGHOUnderstandabilityWKHH[WHQWWRZKLFKWKHFRQFHSWV DQGVWUXFWXUHVRIWKHPRGHOFDQEHXQGHUVWRRGE\WKHVWDNHKROGHUDQGUsabilityWKHDELOLW\RI WKHPRGHOWREHXVHGIRULWVLQWHQGHGSXUSRVH Ɣ Guidelines of modeling IURP >@ WKDW FRQWDLQ VXFK JHQHUDO SULQFLSOHV DV WKH principle of construction adequacyIRUEHLQJDEOHWRKDYHDFRQVHQVXVWKDWDPRGHOLVFRUUHFWFRPSDUHGWR UHDOLW\the principle of language adequacyIRUDPRGHOLQJFRQWH[WWKHprinciple of economic efficiencyHQVXULQJWKDWWKHFRVWRIFUHDWLQJDQGPDLQWDLQLQJDPRGHOGRHVQRWH[FHHGWKHYDOXH JDLQHG IURP LW WKH principle of clarity GHDOLQJ ZLWK FRPSUHKHQVLELOLW\ DQG H[SOLFLWQHVV RI PRGHOVthe principle of systematic designUHTXLULQJHYHU\YLHZEHFRQQHFWHGWRWKHPRGHODQG QRW FUHDWLQJ GLVDJUHHPHQWV EHWZHHQ RWKHU YLHZV WKH principle of comparability ± PRGHOV VKRXOGEHFRPSDUDEOHERWKRQPRGHODQGPHWDPRGHOOHYHO Ɣ SEQUAL VHPLRWLF TXDOLW\ IUDPHZRUN  >@ ± D V\VWHPV PRGHOOLQJ UHIHUHQFH PRGHO IRU HYDOXDWLQJWKHTXDOLW\RIFRQFHSWXDOPRGHOV  7KHVWULYHIRUSHUIHFWLRQFDQEHDOVRFRQVLGHUHGLQWHUPVRIXVHIXODQGXVHGLQSUDFWLFH7KLVLQWXUQ UHTXLUHV WZR NH\ SRLQWV WR FRQVLGHU   WKH (0 PHWKRG IDFLOLWDWLQJ WKH SURGXFWLRQ RI KLJKTXDOLW\ PRGHOV DQG   VDWLVILHG VWDNHKROGHUV >@ :KLOH WKH IRUPHU LV DGGUHVVHG E\ LQWURGXFLQJ YDULRXV JXLGHOLQHV DQG UHFRPPHQGDWLRQV IRU PRGHOLQJ WKH ODWWHU LV DFKLHYHG E\ UHFRPPHQGDWLRQV DQG JXLGHOLQHVDQGRIWHQHYHQSODLQFRPPRQVHQVHIRURUJDQL]LQJPRGHOLQJVHVVLRQVDQGSURMHFWV+RZWR RUJDQL]H PRGHOLQJ DQG UHTXLUHPHQWV ZRUNVKRSV KDV EHHQ GLVFXVVHG IRU H[DPSOH LQ >@ >@ ,Q DGGLWLRQWRVXFKJXLGHOLQHVWKHUHDUHDOVRDQXPEHURIUHTXLUHPHQWVWRFRQVLGHU 7KH(0PHWKRGLVWREHGHILQHGDQGUHFRJQL]DEOHE\LWVVWDNHKROGHUV7KLVPHDQVWKDWLWLVSRVVLEOH IRULWVXVHUVWRVD\ZKDWWKHPHWKRGLVDQGKRZWRXVHLWLQFOXGLQJKRZWRDFTXLUHDQGLQWURGXFHLWLQDQ RUJDQL]DWLRQ ,Q WKLV UHJDUG WKH PHWKRG VKRXOG VXSSRUW WKHVH DFWLRQV HJ E\ RIIHULQJ SDWKZD\V DQG LQWHJUDWLRQSRLQWVZLWKRWKHUPHWKRGVDQGDSSURDFKHV,QGRLQJVRLWZRXOGUHOLHYHWKHVWDNHKROGHUV IURPWKHEXUGHQWRWKLQNKRZWRGRWKLQJVWKH\DUHDOUHDG\GRLQJDFFRUGLQJWRWKHQHZPHWKRG$WWKH VDPHWLPHWKH(0PHWKRGVKRXOGDOVRUHTXLUHFHUWDLQGLVFLSOLQHDQGULJRURIZRUNLQJ:LWKRXWWKLV WKHUHLVDULVNWKDWRYHUWLPHLWVXVHZLOOGHJHQHUDWHLQWRSXUHO\SHUIRUPDWLYHDFWLRQVZLWKRXWGHHSHU DQDO\WLFDOPHDQLQJ,QVXFKFDVHVRQO\WKHQDPHRIWKHPHWKRGZRXOGEHOHIW6XFKVLWXDWLRQVKDYHEHHQ REVHUYHGLQSUDFWLFHHYHQE\FRPPHUFLDOO\VXFFHVVIXOPHWKRGXVHUV2QHRIWKHUHDVRQVIRUWKLVLVWKH ODFN RI XQGHUVWDQGLQJ RI ZKDW PHWKRGV DUH ZKDW LQ WHUPV RI VNLOOV DQG UHVRXUFHV LV QHHGHG WR XVH PHWKRGVZKDWWKH\FDQDFWXDOO\KHOSWKHRUJDQL]DWLRQWRDFKLHYHDQGZKDWWKH\FDQQRW 80 $FRPPRQUHTXLUHPHQWREVHUYHGLQSUDFWLFHLVWKDWWKH(0PHWKRGVKRXOGEHeasy to useDQGDV IRUPXODWHGE\SRWHQWLDOVWDNHKROGHUV³XQFRPSOLFDWHG´,QWKLVUHJDUGLWLVZRUWKQRWLQJWKDWWKHVHDUH VXEMHFWLYHFULWHULDUHODWHGWRRQHEDFNJURXQGNQRZOHGJHDQGSUHH[LVWLQJVNLOOVHW,WLVRIWHQVRWKDW WKLQJVZHNQRZKRZWRGRVHHPHDV\WRXV+HQFH(0PHWKRGVVKRXOGUHODWHWRRWKHUPHWKRGVDQG PDQDJHPHQWWHFKQLTXHVHYHQRQO\WRSURYLGHUHIHUHQFHSRLQWV0HWKRGHQJLQHHUVVKRXOGDOVRWKLQN DERXWKRZHDV\WKHLUPHWKRGFDQEHFRPPXQLFDWHGWRSRWHQWLDOXVHUVDQGKRZWKH\ZLOOXQGHUVWDQG WKHP (0 PHWKRGV KDYH WR EH customizable 7KH\ VKRXOG RIIHU FXVWRPL]DWLRQ DQG LQWHJUDWLRQ SRVVLELOLWLHVHJLQWKHLUPHWDPRGHOVDQGVXSSRUWLQJWRROV,WVKRXOGDOVRZHOFRPHVXFKFXVWRPL]DWLRQ DQGH[WHQVLRQVIRUH[DPSOHE\SURYLGLQJJXLGHOLQHVDQGFRQVXOWDWLRQVE\PHWKRGGHYHORSHUV$WWKH VDPHWLPHLWVKRXOGDOVREHVWDWHGWKDWQRWHYHU\DVSHFWRIWKHPHWKRGVKRXOGEHRSHQIRUFXVWRPL]DWLRQ DQGQRWHYHU\ERG\VKRXOGEHGRLQJWKDW$ZD\RIGHDOLQJZLWKWKLVDVSHFWLQSUDFWLFHZRXOGEHWRVWULYH IRUDPRUHGHGLFDWHGUROHRIPHWKRGH[SHUWRUPDQDJHURQDQRUJDQL]DWLRQDOOHYHO /DVW EXW QRW OHDVW D SHUIHFW PHWKRG ZRXOG EH VXSSRUWHG ZLWK WKH WRROV WKDW DXWRPDWLFDOO\ FRXOG UHSUHVHQWWKHH[LVWLQJ,7DUFKLWHFWXUHDQGUHXVHNQRZOHGJHUHSUHVHQWHGDQGFDSWXUHGE\,7V\VWHPVRI DQHQWHUSULVH$QRWKHULVVXHLVDYLVLELOLW\RIDYDLODEOHPRGHOVDQGRWKHUIRUPVRIUHSUHVHQWDWLRQ2QH RIWKHLQWHUHVWLQJDSSURDFKHVSURSRVHGLQWKLVUHJDUGLVKDYLQJDFRFNSLWZKHUHWKHGLIIHUHQWYLHZVRQ DQHQWHUSULVHDUHDYDLODEOH>@ Ϯ͘Ϯ͘ dĂŬŝŶŐŝŶƚŽĐŽŶƐŝĚĞƌĂƚŝŽŶƚŚĞŽƌŐĂŶŝnjĂƚŝŽŶĂůĐŽŶƚĞdžƚ 7KH HQWHUSULVH FRQWH[W VKRXOG DOVR EH FRQVLGHUHG ZKHQ FKRRVLQJ DQG XVLQJ (0 PHWKRGV )RU H[DPSOH>@DQG>@GLVFXVVHGYDULRXVDVSHFWVRIVLWXDWLRQDOFRQWLQJHQFLHVQDPHGLQWHQWLRQDODQG VLWXDWLRQDOIDFWRUVLQIOXHQFLQJ(0PHWKRGDQGWRRODGRSWLRQDQGXVH,QVKRUWWKHFKRLFHRI(0PHWKRG DQGWRRODQGWKHLUXVHGHSHQGVRQWKHLQWHQWLRQVWKHFRPSDQ\ZDQWVWRSXUVXHHJGRHVLWZDQWWRXVH WKHPHWKRGZLWKRXWWKHVXSSRUWRIH[WHUQDOH[SHUWVDQGWKHVLWXDWLRQLWLVLQHJKRZPDWXUHLWLVLQ WHUPVRIXVLQJPRGHOLQJPHWKRGVLQJHQHUDO7KHVHZHFDOOLQWHQWLRQDODQGVLWXDWLRQDOIDFWRUV 5HJDUGLQJWKHFRQWH[WRIDQHQWHUSULVHDQGWKHVLWXDWLRQVZHFDQGLVWLQJXLVKEHWZHHQIHDWXUHVWKDW DUHFRQWH[WDQGVLWXDWLRQLQGHSHQGHQWDQGWKHRQHV HJODQJXDJHDGHTXDF\ WKDWPD\EHWDLORUHGWRWKH VL]HRIWKHHQWHUSULVHEXVLQHVVDUHDJHRJUDSKLFDOORFDWLRQFXOWXUDOHQYLURQPHQWSROLWLFDOHQYLURQPHQW DQGRWKHUFRQWH[WXDODQGHQWHUSULVHVSHFLILFIDFWRUV2QHDVSHFWWKDWKDVDJHQHULFLPSRUWDQFHLVWKH FDSDELOLW\ RI DQ (0 PHWKRG WR VXSSRUW FRQWLQXRXV LPSURYHPHQW LQ DQ HQWHUSULVH >@ 7R VXSSRUW FRQWLQXLW\ WKH PHWKRG PXVW EH DSSOLFDEOH LWHUDWLYHO\ DQG WKH UHVXOWV RI LWV DSSOLFDWLRQ VKRXOG EH UHXVDEOHIRUIXUWKHULWHUDWLRQV5HVSHFWLQJFRQWLQXRXVFKDQJHVLQHQWHUSULVHVWKHPHWKRGLWVHOIPD\QHHG WRKDYHFRQWLQXRXVLPSURYHPHQWVWKDWPDNHLWFRQIRUPLQJWRQHZVWUDWHJLFDQGEXVLQHVVQHHGVRIDQ HQWHUSULVH7RKDYHDFRQWLQXRXVHYROXWLRQDQGDSSOLFDWLRQRI(0PHWKRGVDVRSKLVWLFDWHGWRROVXSSRUW LV QHFHVVDU\ IRU FDSWXULQJ WKH PRGHOLQJ UHVXOWV PDLQWDLQLQJ WKHP DQG VLPXOWDQHRXVO\ OHWWLQJ WR LQFRUSRUDWHFKDQJHVLQPHWDPRGHOV ϯ͘ DĞƚŚŽĚŶŐŝŶĞĞƌŝŶŐĨŽƌD 7KHDLPRIPHWKRGHQJLQHHULQJLVWRGHYHORSWKHRULHVDQGIRXQGDWLRQVIRUEXLOGLQJDQGDGDSWLQJQHZ PHWKRGV(0PHWKRGVDUHZLWKLQLWVVFRSH6LWXDWLRQDOPHWKRGHQJLQHHULQJ>@DIILUPVWKDWWKHPHWKRG WREHHIIHFWLYHPXVWSHUIHFWO\DGDSWWRWKHVLWXDWLRQRIWKHRUJDQL]DWLRQRUWKHSURMHFWZKLFKXVHVLW,Q WKLV VHFWLRQ ZH KLJKOLJKW WKH FKDOOHQJHV DQG UHTXLUHPHQWV WKDW PHWKRG HQJLQHHULQJ VKRXOG WDNH LQWR DFFRXQWWRVXSSRUWWKHHQJLQHHULQJRIVLWXDWLRQVSHFLILFDQGDGDSWDEOH(0PHWKRGV 7KHXQGHUO\LQJTXHVWLRQLVZKHWKHUWKHGLYHUVLW\RIHQWHUSULVHVLVVRKLJKWKDWHQWHUSULVHVSHFLILF PHWKRGVVKRXOGEHGHYHORSHGRQWKHIO\,IVRWKHQLWPD\EHKDUGWRFRPSDUHHQWHUSULVHPRGHOVRI GLIIHUHQWHQWHUSULVHV6XFKFRPSDULVRQVDUHDOPRVWLPSRVVLEOHGXHWRWKHFRQILGHQWLDOLW\RIWKHPRGHOV 6WLOOWKHUHVKRXOGEHDFRPPRQFRUHRIFRQVWUXFWVWKDWWKH(0FRPPXQLW\PD\DJUHHXSRQURXJKO\ DORQJWKHOLQHVRI=DFKPDQ)UDPHZRUN>@DQG72*$)>@$SDUWLFXODUFKDOOHQJHIRUDQ(0PHWKRG LVWKHNQRZOHGJHDFTXLVLWLRQ$PHWDPRGHOGHILQLQJWKHFRQVWUXFWVLVQRWVXIILFLHQW2QHDOVRQHHGVWR VSHFLI\ KRZ WR H[WUDFW WKH PRGHOV IURP VRXUFHV VXFK DV LQWHUYLHZV H[LVWLQJ LQIRUPDWLRQ V\VWHPV GRFXPHQWDWLRQDQGVRIRUWK$QRWKHURSHQFKDOOHQJHLVWKHVSHFLILFDWLRQRIDQDO\VLVWRROVIRUHQWHUSULVH 81 PRGHOV HUURU GHWHFWLRQ TXDOLW\ DVVHVVPHQW GHSHQGHQF\ WUDFLQJ VLPXODWLRQV PD\ EH VRPH RI WKH DQDO\VLVVHUYLFHVWREHRIIHUHG:KHQHQWHUSULVHPRGHOVDUHXVHGIRUZKDWLIVFHQDULRVWKHQWKHPHWKRG HQJLQHHULQJDSSURDFKVKRXOGLQFOXGHFRQVWUXFWVRQKRZWRPDSWKHWREHHQWHUSULVHPRGHOEDFNWRWKH HQWHUSULVHV\VWHPVWKDWLPSOHPHQWWKHPRGHOHJWKH(53V\VWHPRIWKHHQWHUSULVH 7RFDWHUIRUWKHGLYHUVLW\RIHQWHUSULVHVRQHPD\DOVRG\QDPLFDOO\H[WHQGDFRUH(0PHWKRGE\QHZ FRQVWUXFWVVSHFLILFIRUWKHHQWHUSULVH7KHZKHHOGRHVQRWKDYHWREHUHLQYHQWHGPDQ\WLPHV$FRUH (0PHWKRGFDQEHUHXVHG7KHPHWKRGHQJLQHHULQJDSSURDFKLVWKHQE\SULQFLSOHLQFUHPHQWDO/LNHIRU VFKHPDHYROXWLRQLQGDWDEDVHVFKDQJHVWRWKH(0PHWKRGPD\UHTXLUHDGDSWLQJWKHPRGHOVFUHDWHG ZLWKWKHROGYHUVLRQRIWKH(0PHWKRG,WZRXOGEHGHVLUDEOHWRDOORZWKHPHWKRGHQJLQHHUWRUHVWULFW FKDQJHVWRWKRVHWKDWZRXOGQRWUHTXLUHH[WHQVLYHFKDQJHVWRH[LVWLQJPRGHOV 2QHDSSURDFKWRDGDSWHQWHUSULVHPRGHOLQJPHWKRGVWRVSHFLILFFRQWH[WVDQGHQWHUSULVHVWKDWZDV DOVRJHQHULFDOO\LPSOHPHQWHGRQDVWDWHRIWKHDUWPHWDPRGHOLQJSODWIRUPKDVEHHQSURSRVHGE\%LGHU HWDO>@ 3DWWHUQVDQGDQWLSDWWHUQVDUHDSURYHQWRROWRLQFRUSRUDWHHPSLULFDONQRZOHGJHLQWRDQHQJLQHHULQJ DFWLYLW\VXFKDVVRIWZDUHHQJLQHHULQJ,QWKHFRQWH[WRIHQWHUSULVHPRGHOLQJVXFKSDWWHUQVFRXOGH[SUHVV IRU H[DPSOH KRZ D VRIWZDUH DUFKLWHFWXUH VXSSRUWV D SURFHVV SDWWHUQ OLNH ³VHSDUDWLRQ RI FRQFHUQV´ 3DWWHUQV DQG DQWLSDWWHUQV FDQ DOVR EH XVHG WR DQDO\]H HQWHUSULVH PRGHOV WKDW DUH PLQHG IURP RWKHU HQWHUSULVHV\VWHPVVXFKDV(53V\VWHPV7KHGRZQVLGHLVWKDWSDWWHUQVDUHRQO\XVHIXOLQDVSHFLILF FRQWH[W HJOHJDOIUDPHZRUNRIDJLYHQFRXQWU\ ,WLVLQKHUHQWO\GLIILFXOWWRH[SOLFLWO\UHSUHVHQWVXFKD FRQWH[W 7KHGHYHORSPHQWRI(0VKRXOGEHEDVHGRQWKHSULQFLSOHVRIPHWKRGHQJLQHHULQJ$NH\DVSHFWRI PHWKRGGHYHORSPHQWLVPRGXODUL]DWLRQWRRIIHUDFRPSRQHQWEDVHGPHWKRGDQGJXLGDQFHRQKRZWR XVHDQGFRPELQHWKHFRPSRQHQWVLQYDULRXVPHWKRGDSSOLFDWLRQFRQWH[WV7KLVDSSURDFKZDVXVHGIRU LQVWDQFHLQWKHGHYHORSPHQWRI(0DQG&''0RUHDERXWWKH&''GHYHORSPHQWDQGWKHFKRLFHV PDGHLQWKLVSURFHVVLVDYDLODEOHLQ>@7KHFRPSRQHQWEDVHGDSSURDFKDOVRRIIHUVWKHSRVVLELOLW\WR GHYHORSPHWKRGH[WHQVLRQVWKDWGRQRWQHHGWREHSODQQHGRUHYHQHQYLVLRQHGLQWKHHDUO\VWDJHVRI PHWKRGGHYHORSPHQW $NH\DVSHFWRIPHWKRGGHYHORSPHQWLVWRROVXSSRUW0HWKRGVZLWKRXWDQ\WRROVXSSRUWDUHKDUGWR LQWURGXFHLQSUDFWLFH+HQFHLQWKLVUHJDUGWKHPHWKRGGHYHORSPHQWWHDPVKRXOGKDYHDQHDUO\VWUDWHJ\ :KLOHLWLVRIFRXUVHSRVVLEOHWRGHYHORSDQHZWRROIURPVFUDWFKWKLVDSSURDFKLVXQGRXEWHGO\FRVWO\ DQGWLPHFRQVXPLQJ,QVWHDGVWUDWHJLHVVXFKDVWKHLPSOHPHQWDWLRQRIPHWKRGVXSSRUWLQDFXVWRPL]DEOH PHWDWRROVKRXOGEHFRQVLGHUHGDVPRUHHIILFLHQWEHFDXVHGHVSLWHWKHLUGUDZEDFNVVXFKDVEHLQJORFNHG LQWRDYHQGRU¶VWRRODQGWKHIXQFWLRQDOLW\RIWKDWWRRO 0HWKRGHQJLQHHULQJIRU(0PHWKRGVVKRXOGIRUHPRVWH[SOLFLWO\VSHFLI\WKHLQWHQGHGVWDNHKROGHUV DQGWKHLUSXUSRVHVRIXVLQJWKHPHWKRGWREHGHYHORSHG7KLVPDNHVVXUHWKDWWKHPHWKRGLVQHLWKHU RYHUHQJLQHHUHGE\IRFXVLQJRQHGJHFDVHVQRUWKDWLWIDLOVLQFRYHULQJWKHGRPDLQDQGVXSSRUWLQJLWV SXUSRVHV DGHTXDWHO\ 0RUHRYHU (0 PHWKRG HQJLQHHULQJ VKRXOG DLP WR IROORZ SURFHGXUHV WKDW DUH IOH[LEOHDQGLWHUDWLYHLQQDWXUH7KHDSSURDFKSURSRVHGE\)UDQN>@DFFRXQWVWRWKHVHUHTXLUHPHQWVWR DJUHDWH[WHQWE\XVLQJVDPSOHPRGHOV RUHYHQLQIRUPDOVNHWFKHV DVHDUO\DVSRVVLEOHLQWKHPHWKRG HQJLQHHULQJ OLIHF\FOH ([SOLFDWLQJ HDUO\ GHVLJQ GHFLVLRQV E\ PHDQV RI H[DPSOHV HQDEOHV WKH PHWKRG HQJLQHHULQJ WHDP WR LQYROYH RWKHU VWDNHKROGHUV DQG WR LQWHJUDWH WKHLU IHHGEDFN DV HDUO\ DV SRVVLEOH (YHQWXDOO\ WKH SURSRVHG (0 PHWKRG QHHGV WR XQGHUJR HPSLULFDO HYDOXDWLRQ LQ RUGHU WR VKRZ LWV XVDELOLW\HDVHRIXVHDQGYDOXHLQWKHLQWHQGHGGRPDLQE\WKHLQWHQGHGVWDNHKROGHUV 7KH PHWKRG HQJLQHHULQJ FRPPXQLW\ VKRXOG WDNH FDUH WKDW WKH PHWKRG FDQ EH VXSSRUWHG E\ D GHGLFDWHGWRRORUDVHWRIWRROV7KHVHWRROVZRXOGEHH[SHFWHGWRFDSWXUHWKHVWDNHKROGHUNQRZOHGJH DQGJHQHUDWHXVHIXOUHSUHVHQWDWLRQVRIWKLVNQRZOHGJH$JRRGH[DPSOHRIVXFKJHQHUDWLRQFDSDELOLWLHV LVWKH&25(WRROIURP9LWHFKFRUSRUDWLRQ>@7KLVWRROIRULQVWDQFHRQWKHEDVLVRIDIXQFWLRQDOEORFN GLDJUDPFDQFUHDWHDQ,')GLDJUDPRUDQDFWLYLW\GLDJUDP7KLVZD\WKHHIIRUWRIPRGHOFUHDWRUVLV VDYHGDQGDGGLWLRQDOPHDQVIRUTXDOLW\FKHFNLQJDUHDYDLODEOH6LPLODUPRGHOJHQHUDWLRQDSSURDFKFRXOG EHDOVRDSSOLHGWRPRGHOVLQFOXGHGLQ(0PHWKRGV 5HVSHFWLQJWKDWWKH(0PHWKRGVDUHDSSOLHGE\VWDNHKROGHUVZKRVHNQRZOHGJHPD\GLIIHUDQGLV HYROYLQJWKHPHWKRGHQJLQHHULQJIRU(0PHWKRGVKDVWRFRQVLGHUDOVRVXSSRUWLQJPRGHOVDQGSURFHVVHV IRUNQRZOHGJHPDQDJHPHQW>@$QRWKHULPSRUWDQWLVVXHLVWKDWWKHHQJLQHHULQJPHWKRGFRQVLGHUVQRW RQO\WKHPHWKRGSHUVHEXWDOVRWKHVRIWZDUHVROXWLRQ V WKDWZLOOVXSSRUWWKHPHWKRG 82 7KHDERYHLVVXHVKDYHEHHQUHODWLYHO\ZHOOXQGHUVWRRGLQWKH(0FRPPXQLW\DVZHOODVWKH\KDYH DWWUDFWHG VRPH DOEHLW LQVXIILFLHQW DWWHQWLRQ LQ SXEOLFDWLRQV :KDW KDV EHHQ GLVFXVVHG DQG UHVHDUFKHG FRQVLGHUDEO\OHVVLVZKDWNLQGRISURMHFWPDQDJHPHQWDQGSURMHFWWHDPDVXFFHVVIXO0(SURMHFWVKRXOG KDYH)RUH[DPSOHPDQ\PHWKRGGHYHORSPHQWVKDYHVRPHRULJLQVLQWKHDFDGHPLFZRUOGZKLOHWRRO GHYHORSPHQW QHHGV FRQVLGHUDEOH LQGXVWULDO EDFNLQJ WKDW FDQQRW EH HDVLO\ HVWDEOLVKHG LQ DFDGHPLF HQYLURQPHQWV0HWKRGVDQGWRROVQHHGWREHDSSOLHGDQGWKHH[SHULHQFHVRIWKHDSSOLFDWLRQVFKDQQHOHG EDFNLQWRWKHGHYHORSPHQW7KLVSXWVIRUZDUGWKHQHHGIRUWKHPHWKRGGHYHORSPHQWWHDPWRFRQVLVWRI UHVHDUFKHUVDQGSUDFWLWLRQHUV$QRWKHULVVXHLVWKDWIRUDVXFFHVVIXOPHWKRGWREHH[LVWLQJDQGKDYLQJ LPSDFWLQWKHSUDFWLFHLWQHHGVWREHXVHGDQGXSGDWHGRYHUDORQJWLPH+HQFHWKHPRUHFRPPRQO\ VHHQFRQVWHOODWLRQVRIWHDPVFHQWHUHGRQDQH[WHUQDOO\IXQGHGUHVHDUFKJUDQWRI\HDUVQHHGWRSODQ KRZWRZRUNDIWHUWKHLQLWLDOSURMHFWHQGV ϰ͘ džƉĞƌƚŝƐĞĂŶĚĞĨĨŽƌƚƌĞƋƵŝƌĞĚƚŽďƵŝůĚͬƵƐĞĂŶDŵĞƚŚŽĚ 7KH NH\ DUHDV RI H[SHUWLVH IRU EXLOGLQJ DQG PDLQWDLQLQJ (0 PHWKRGV SURIHVVLRQDOO\ DUH PHWKRG HQJLQHHULQJDQGFRQFHSWXDOPRGHOLQJDVZHOODVLIZHFRQVLGHUWKDWPRVWPHWKRGVUHTXLUHLWNQRZOHGJH RIPRGHOLQJWRROVDQGPHWKRGLPSOHPHQWDWLRQLQWRROV:LWKRXWFRPSHWHQFHLQWKHVHDUHDVWKHPHWKRG GHYHORSHUVZLOOPRVWOLNHO\HQGXSUHSHDWLQJPDQ\PLVWDNHVRIWKHSDVWDQGPRVWOLNHO\HQGXSRQO\ ZLWKDUHVHDUFKSURWRW\SHPHWKRGWKDWIRFXVHVRQWKHFHQWUDODVSHFWVRIWKHHQYLVLRQHGPHWKRGEXWZLOO ODFN WKH FRPSUHKHQVLYHQHVV DQG GHWDLO QHHGHG IRU D PHWKRG WR EH XVHG LQ SUDFWLFH )RU H[DPSOH GHYHORSLQJDFRUHRIDPRGHOLQJODQJXDJHZLWKPHWDPRGHOLQJFDQEHGRQHUHODWLYHO\TXLFNO\DIWHUWKDW DVLPSOHJUDSKLFDOODQJXDJHFDQEHFRQVWUXFWHGDQGWHVWHGRQDIHZH[DPSOHFDVHV:KLOHLQDUHVHDUFK SURMHFW WKLV ZRXOG FRXQW DV WKH ILUVW VWHS RI YDOLGDWLRQ LW LV VWLOO IDU IURP DQ LQGXVWULDOO\ DSSOLFDEOH PHWKRG7RDFKLHYHWKHODWWHURQHZRXOGQHHGWRDSSO\LWWRDUHDVRQDEOHQXPEHURIUHDOOLIHSURMHFWVRU FDVHV SUREDEO\QROHVVWKDQ DQGGHYHORSDQH[WHQVLYH PHWKRGJXLGHSRSXODWHGZLWKH[DPSOHV H[SHULHQFHEDVHG UHFRPPHQGDWLRQV SDWWHUQV DQG HWF 7KLV WDNHV FRQVLGHUDEOH WLPH DQG HIIRUW DQG PRUHRYHULWFDQQRWEHGRQHZLWKRQO\DIHZSHRSOHLQWKHPHWKRGGHYHORSPHQWWHDP,QDGGLWLRQWKHUH DUHWKHRQJRLQJWDVNVVXFKDVNHHSLQJDZHEVLWHXSWRGDWH (0 PHWKRG GHYHORSPHQW QHHGV WR EH VHHQ DV D ORQJWHUP HQGHDYRU 7ZR PDLQ VWDJHV FDQ EH FRQVLGHUHG±  WKHLQLWLDOGHYHORSPHQWZRUNWRZDUGVFUHDWLQJWKHILUVWUHDVRQDEO\FRPSOHWHDQGXVHIXO PHWKRGDQG  DSSO\LQJWKHPHWKRGDQGDWWKHVDPHWLPHFRQWLQXRXVO\LPSURYLQJLW7KHODWWHUVWDJH DOVRUHTXLUHVWKHPHWKRGGHYHORSHUVWRHQJDJHLQDFWLYLWLHVLQZKLFKRQO\IHZRIWKHPKDYHH[WHQVLYH H[SHUWLVH7KHVHDUHPDUNHWLQJDQGVDOHVRIPHWKRGVWRROVDQGUHODWHGFRQVXOWLQJVHUYLFHV$QDVSHFW WKDWKDVQRWEHHQGLVFXVVHGLQWKLVUHJDUGLVEUDQGLQJ:RXOGLWEHUHOHYDQWWRWKLQNRIPRGHOLQJPHWKRGV DVEUDQGVDQGLIVRZKDWWKHQFDQEHGRQHWRLQFUHDVHEUDQGUHFRJQLWLRQDQGDZDUHQHVV"7KH(0 FRPPXQLW\DVVRFLDWHGZLWKWKH3R(0FRQIHUHQFHPDLQO\UHSUHVHQWVUHVHDUFKHUVZKRZULWHDFDGHPLF SXEOLFDWLRQVDQGERRNV7KHUHDFKRIWKHVHDFWLYLWLHVRXWVLGHWKHFRPPXQLW\KRZHYHUVHHPVOLPLWHG 3RVLWLYH H[DPSOHV RI RWKHU DFWLYLWLHV ZLWK SRWHQWLDOO\ KLJKHU LPSDFW DUH IRU H[DPSOH WKH 1(02 VXPPHUVFKRRO>@ ,QRUGHUIRU(0PHWKRGVWREHXVDEOHDQGDFWXDOO\XVHGLQSUDFWLFHWZRWKLQJVDUHRISDUDPRXQW LPSRUWDQFH2QWKHRQHKDQG(0PHWKRGVQHHGWREHVXSSRUWHGE\DSSURSULDWHPRGHOLQJWRROV2QWKH RWKHUKDQGWKHYDOXHRIHQWHUSULVHPRGHOVQHHGVWREHHTXDORUKLJKHUFRPSDUHGWRWKHHIIRUWVLQYROYHG LQWKHLUSURGXFWLRQ 7RDFFRXQWIRUWKHKHWHURJHQHRXVVWDNHKROGHUVLQYROYHGLQHQWHUSULVHPRGHOLQJFRUUHVSRQGLQJWRROV QHHGWREHPRGHUQHDV\WRGHSOR\DQGHIILFLHQWWRXVH7KHSURYLVLRQRIDSSOLFDWLRQV\VWHPVWKURXJK WKH EURZVHUFORXG LV QRZDGD\V FRQVLGHUHG D FRPPRGLW\ DQG VWDNHKROGHUV LQYROYHG LQ HQWHUSULVH PRGHOLQJSURMHFWVVKRXOGQRWEHH[SHFWHGWRLQVWDOODVRIWZDUHLQDGYDQFHRUWRJHWH[SHULHQFHGZLWK HQWLUHO\QHZVRIWZDUHV\VWHPVDQGXVHULQWHUIDFHV7KHXSWDNHRIZHEWHFKQRORJLHVDQGWKHSURYLVLRQRI PRGHOLQJWRROVWKURXJKWKHZHERUDVH[WHQVLRQVWRZLGHO\DGRSWHGV\VWHPVOLNH96&RGHHQDEOHVJUHDW SRWHQWLDOIRUWKH(0FRPPXQLW\>@ ,QRUGHUWRLQFUHDVHWKHYDOXHRISURGXFLQJHQWHUSULVHPRGHOVWKH(0FRPPXQLW\VKRXOGDOVREH RSHQWRLQFRUSRUDWHPHWKRGVDQGWHFKQLTXHVIURPGDWDVFLHQFHDQGDUWLILFLDOLQWHOOLJHQFH IRUDUHFHQW GLVFXVVLRQDQGVHOHFWHGDGYDQFHVVHH>@>@>@>@ ,QWHUWZLQLQJHQWHUSULVHPRGHOLQJZLWKWKHVH ILHOGVRIUHVHDUFKQRWRQO\JHQHUDWHVPDQLIROGSRWHQWLDOVIRULQWHOOLJHQWRUDVVLVWHGPRGHOLQJ>@>@ 83 LWDOVRHQVXUHVWKDWWKH(0FRPPXQLW\ZRUNVRQWKHELJFKDOOHQJHVDQGUHPDLQVDWWUDFWLYHWRVWXGHQWV DQG\RXQJUHVHDUFKHUV $ SHUIHFW (0 PHWKRG VKRXOG DOVR PLQLPL]H WKH HIIRUW WR FUHDWH DQ XSWRGDWH DQG FRQVLVWHQW HQWHUSULVHPRGHO0DQ\HQWHUSULVHVDOUHDG\KDYHDQXPEHURIVRIWZDUHV\VWHPVLQXVHWKDWPDLQWDLQD SDUWLDOYLHZRIWKHHQWHUSULVHZRUNIORZPDQDJHPHQWV\VWHPVFRQWDLQSURFHVVPRGHOV80/PRGHOLQJ WRROVPD\FRQWDLQGDWDPRGHOVDQGRWKHUPRGHOV(53V\VWHPVFRQWDLQQRWRQO\GDWDEXWDOVRSURFHVV PRGHOV3URFHVVPRGHOVFDQEHPLQHGIURPHYHQWORJILOHV7KHRUJDQL]DWLRQDOVWUXFWXUHRIDQHQWHUSULVH PD\EHVWRUHGLQDQ(53V\VWHPRUVWDWLFGRFXPHQWV6XFKVRXUFHVVKRXOGEHKDUYHVWHGDXWRPDWLFDOO\ WRPLQLPL]HWKHPDQXDOPRGHOLQJHIIRUW:KLOHWKHLQLWLDOLQYHVWPHQWLQWKHQHFHVVDU\LPSRUWILOWHUVLV UDWKHU KLJK WKH DXWRPDWLF H[HFXWLRQ DOORZV WR NHHS WKH HQWHUSULVH PRGHOV XSWRGDWH ZLWK PLQLPDO KXPDQ HIIRUW PXFK OLNH WKH (7/ SURFHVV LQ D GDWD ZDUHKRXVH 7KH SHUIHFW (0 PHWKRG VKRXOG DXWRPDWLFDOO\JHQHUDWHDEVWUDFWLRQVRIWKHKDUYHVWHGPRGHOV $SRVLWLYHH[DPSOHLQWHUPVRI(0PHWKRGDQGWRROXVDJHLV$UFKL0DWHODQJXDJH>@DQG$UFKL WRRO >@ %RWK DUH IOH[LEOH DQG HDV\ WR WHDFK $V D UHVXOW VWXGHQWV ZKR OHDUQ WKHVH PHWKRGV DW XQLYHUVLWLHVDUHIUHHO\XVLQJWKHPDWWKHLUZRUNSODFHV)URPWKLVZHFDQOHDUQWKDWRYHUDOOHGXFDWLRQLQ HQWHUSULVHPRGHOLQJPDWWHUVDVZHOODVDYDLODELOLW\RIIUHHO\DQGRSHQO\DFFHVVLEOHWRROV6LPSOLFLW\LV DQLPSRUWDQWIDFWRULQWKHXVHRIDQ\WRROVKRZHYHUZHFDQQRWDIIRUGWRRYHUVLPSOLI\LQHQWHUSULVH PRGHOLQJ7KHUHIRUHWKHVNLOOVIRUHQWHUSULVHPRGHOLQJZLOOEHSRVVLEOHWRGHYHORSRQO\JUDGXDOO\DQG E\ REWDLQLQJ NQRZOHGJH LQ VHYHUDO DUHDV VXFK DV FRQFHSWXDO PRGHOLQJ WKH XVH RI PRGHOLQJ WRROV IDFLOLWDWLRQVNLOOVHWF ϱ͘ ŽŶĐůƵƐŝŽŶ ³3HUIHFWLVMXVWDYLVLRQ:HZLOOQHYHUUHDFKLWEXWZHFDQZRUNWRZDUGVLW,WNHHSVXVVKDUSDQG FULWLFDODQGORQJLQJIRUPRUHDQGEHWWHU,WDOLJQVJRDOVRISHRSOH7KLVLVDOVRKRZDQRUJDQL]DWLRQDO YLVLRQZRUNV´ *HHUW3RHOVSDQHODWWHQGHH 7KLVTXRWHIURPWKHSDQHOFKDWVXJJHVWVWKDWZKLOHDSHUIHFW (0PHWKRGLVSUREDEO\QRWUHDFKDEOHLWLVVWLOOZRUWKVWULYLQJLQWKDWGLUHFWLRQ 7KH DLP RI WKH SDQHO SUHVHQWHG LQ WKLV SDSHU ZDV WR FKDOOHQJH SDUWLFLSDQWV WR H[SUHVV WKHLU XQGHUVWDQGLQJ RI ZKDW D SHUIHFW (0 PHWKRG VKRXOG EH DQG WR LGHQWLI\ WKH PHWKRG HQJLQHHULQJ FKDOOHQJHVWREXLOGVXFKDPHWKRG%HORZZHVXPPDUL]HWKHPDLQILQGLQJVIURPWKHSDQHOGLVFXVVLRQ 9DOXH SURSRVLWLRQ )LUVW RI DOO WKH PHWKRG HQJLQHHU VKRXOG VWDWH WKH YDOXH SURSRVLWLRQ RI WKH PHWKRG$Q(0PHWKRGVKRXOGEHXVHIXOILWWRWKHSXUSRVHDQGILWWRWKHXVHUDQGKLVKHUFRQFHUQV$V WKHPRGHOLQJWDVNUHTXLUHVWLPHDQGHIIRUWWKHREWDLQHGUHVXOWVVKRXOGEHZRUWKRILW+HQGHULN3URSHU DSDQHODWWHQGHHFDOOVLWD³5HWXUQRQ0RGHOLQJ(IIRUW´,QJHQHUDODQ(0PHWKRGLVH[SHFWHGWRVXSSRUW PXOWLSHUVSHFWLYHDQGPXOWLOD\HUPRGHOLQJ 6WURQJWKHRUHWLFDOIRXQGDWLRQ$Q(0PHWKRGVKRXOGEHWKHRUHWLFDOO\ZHOOIRXQGHGEDVHGRQDQ DJUHHG RQWRORJ\ DQG IRUPDOO\ GHILQHG XVLQJ PHWDPRGHOV DQGRU IRUPDO ODQJXDJHV 7KDW FRQFHUQV DEVWUDFWDQGFRQFUHWHV\QWD[DVZHOODVWKHZD\RIZRUNLQJWRFUHDWHDQGXVHPRGHOV7KLVFDQEHGRQH ZLWKWKHKHOSRIPHWKRGHQJLQHHULQJDSSURDFKHVDQGWRROVDQGTXDOLW\UHIHUHQFHPRGHOV $GDSWDELOLW\7KHFRQWH[WDQGQHHGVRI(0YDU\IURPRQHRUJDQL]DWLRQWRDQRWKHUDQGHYHQHYROYH ZLWKLQDQRUJDQL]DWLRQRYHUWLPH7KHUHIRUHDQ(0PHWKRGVKRXOGEHFXVWRPL]DEOHDQGH[WHQVLEOHE\ FRQWH[WVSHFLILFDQGRUGRPDLQVSHFLILFFRQVWUXFWVDVZHOODVHPSLULFDONQRZOHGJHFDSWXUHGLQSDWWHUQV RUDQWLSDWWHUQV 0HWKRGHQJLQHHULQJ0DQ\PHWKRGHQJLQHHULQJDSSURDFKHVDQGWHFKQLTXHVH[LVW:KLFKRQHWRXVH IRUEXLOGLQJDQ(0PHWKRG".HHSLQJLQPLQGWKDWWKHPHWKRGVKRXOGILWWKHRUJDQL]DWLRQDOFRQWH[WDQG QHHGVZKLFKHYROYHRYHUWLPHZHVHHWZRSRVVLELOLWLHV  EXLOGLQJRQWKHIO\RU  WDLORULQJRIDFRUH (0PHWKRG"%RWKDSSURDFKHVDUHEDVHGRQWKHSULQFLSOHRIPRGXODUL]DWLRQ$PHWKRGLVYLHZHGDVD FRPSRVLWLRQRIPHWKRGFRPSRQHQWVZKLFKFDQGEHDGGHGDQGRUUHPRYHGGHSHQGLQJRQWKHVLWXDWLRQ DQGFXUUHQWQHHGV7KDWVXSSRUWVFRQWLQXRXVPHWKRGLPSURYHPHQW&RPSRQHQWEDVHGDSSURDFKHVDOVR VXSSRUWLQFUHPHQWDOPHWKRGGHYHORSPHQWZKHUHPHWKRGH[WHQVLRQVFDQEHGRQHDWDQ\WLPHWKH\GR QRW QHHG WR EH SODQQHG LQ DGYDQFH 7R EXLOG DQ (0 PHWKRG ERWK PHWKRG HQJLQHHULQJ DQG (0 NQRZOHGJHDQGH[SHUWLVHDUHUHTXLUHG $XWRPDWLRQ$WRROVXSSRUWLVQHFHVVDU\DWERWKOHYHOVPHWKRGHQJLQHHULQJDQGPHWKRGDSSOLFDWLRQ $PHWKRGHQJLQHHULQJSODWIRUPLVH[SHFWHGWRKHOSIRUPDOO\GHILQHPHWKRGVSRWHQWLDOO\E\UHXVLQJDQG 84 DGDSWLQJH[LVWLQJPHWKRGFRPSRQHQWVDQGWRVXSSRUWWKHLUFRQWLQXRXVHYROXWLRQ6LPLODUO\WRPDNH WKHPRGHOLQJWDVNHIILFLHQWDQ(0PHWKRGVKRXOGEHVXSSRUWHGE\DGYDQFHGWRROVHDV\WRGHSOR\DQG WRXVH7KHWRROVPXVWQRWRQO\KHOSWRFUHDWHPRGHOVEXWDOVRYHULI\DQGYDOLGDWHWKHLUFRQVLVWHQF\DQG TXDOLW\DQGHVWDEOLVKFURVVPRGHODQGFURVVOD\HUOLQNVDQGGHSHQGHQFLHV+HQFHWKHHYROXWLRQRIDQ (0PHWKRGLPSOLHVWKHHYROXWLRQRIWKHWRROVWKDWVXSSRUWLW /HDUQLQJ 1R PHWKRG RU WRRO LV JRLQJ WR FRPSOHWHO\ UHSODFH KXPDQ NQRZOHGJH DQG H[SHULHQFH HVSHFLDOO\WKDWRIWKHEXVLQHVVGRPDLQ7UDLQLQJLVHVVHQWLDOWRJDLQH[SHUWLVHDQGHIILFLHQF\LQLQWKH XVHRI(0PHWKRGVDQGWRROV 6XFFHVV)LQDOO\KRZFDQZHPHDVXUHWKHVXFFHVVRIDPHWKRG",VWKHIDFWWKDWWKHPHWKRGLVXVHG LQSUDFWLFHVXIILFLHQWWRVD\WKDWLWLVVXFFHVVIXO"1RWKLVLVRQO\DPLQLPXPFULWHULRQIRUDSSUHFLDWLQJ WKHPHWKRG7RUHDFKWKHVXFFHVVDQ(0PHWKRGVKRXOGGHOLYHUWKHSURPLVHGYDOXHWRWKHVWDNHKROGHUV DQGSRVVHVVPRVWRIWKHTXDOLW\DVSHFWVKLJKOLJKWHGLQWKLVSDSHU ϲ͘ ZĞĨĞƌĞŶĐĞƐ >@ 0 /DQNKRUVW HG  (QWHUSULVH $UFKLWHFWXUH DW :RUN 0RGHOOLQJ&RPPXQLFDWLRQ DQG $QDO\VLV 7KH (QWHUSULVH (QJLQHHULQJ 6HULHV 6SULQJHU %HUOLQ +HLGHOEHUJ  KWWSVGRLRUJ >@ %YDQ*LOV+$3URSHU(QWHUSULVH0RGHOOLQJLQWKH$JHRI'LJLWDO7UDQVIRUPDWLRQ,Q5REHUW %XFKPDQQ $ .DUDJLDQQLV ' .LULNRYD 0 HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0 /1%,3YRO6SULQJHU&KDPSS >@ :2SSUHFKW-5DO\WpDQG0/pRQDUG07RZDUGVD)UDPHZRUNIRU(QWHUSULVH,QIRUPDWLRQ 6\VWHP (YROXWLRQ 6WHHULQJ ,Q )UDQN 8 /RXFRSRXORV 3 3DVWRU 2 3HWURXQLDV , HGV  7KH 3UDFWLFHRI(QWHUSULVH0RGHOLQJ3R(0/1%,3YRO6SULQJHU%HUOLQ+HLGHOEHUJSS  >@ .6DQGNXKO-6WLUQD)+RO]0RGHOLQJ3URGXFWVDQG6HUYLFHVZLWK(QWHUSULVH0RGHOV,Q*UDELV - %RUN ' HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU &KDPSSKWWSVGRLRUJB >@ 895LVV+0DXV6-DYDLG&-LOHN'LJLWDO7ZLQVRIDQ2UJDQL]DWLRQIRU(QWHUSULVH0RGHOLQJ ,Q*UDELV-%RUN' HGV 7KH3UDFWLFHRI(QWHUSULVH0RGHOLQJ3R(0/1%,3YRO 6SULQJHU&KDPSSKWWSVGRLRUJB >@ . 6DQGNXKO - 6WLUQD $ 3HUVVRQ 0 :L‰RW]NL (QWHUSULVH 0RGHOLQJ 7DFNOLQJ %XVLQHVV &KDOOHQJHVZLWKWKH(00HWKRGVWHG7KH(QWHUSULVH(QJLQHHULQJ6HULHV6SULQJHU%HUOLQ +HLGHOEHUJKWWSVGRLRUJ >@ % +HQGHUVRQ6HOOHUV - 5DO\Wp 3 JHUIDON DQG 0 5RVVL 6LWXDWLRQDO 0HWKRG (QJLQHHULQJ 6SULQJHUKWWSVGRLRUJ >@ - 5DO\Wp 5  'HQHFNqUH & 5ROODQG 7RZDUGV D *HQHULF 0RGHO IRU 6LWXDWLRQDO 0HWKRG (QJLQHHULQJ ,Q 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ $GYDQFHG ,QIRUPDWLRQ 6\VWHPV(QJLQHHULQJ&$,6((GHU-DQG0LVVLNRII0 HGV /1&6YRO6SULQJHU 9HUODJSS >@ +: 1LVVHQ 0$ -HXVIHOG 0 -DUNH *9 =HPDQHN + +XEHU 0DQDJLQJ 0XOWLSOH 5HTXLUHPHQWV3HUVSHFWLYHVZLWK0HWDPRGHOV,(((6RIWZDUHSS >@'%RUN5$%XFKPDQQ'.DUDJLDQQLV3UHVHUYLQJ0XOWLYLHZ&RQVLVWHQF\LQ'LDJUDPPDWLF .QRZOHGJH5HSUHVHQWDWLRQ,Q,QWHUQDWLRQDOFRQIHUHQFHRQ.QRZOHGJH6FLHQFH(QJLQHHULQJDQG 0DQDJHPHQW6SULQJHU&KDPSS >@.6$QGHUVHQ([SORULQJ0RGHO4XDOLW\LQ(QWHUSULVH0RGHOLQJ$&DVH6WXG\0DVWHU7KHVLV 1718KWWSVQWQXRSHQQWQXQRQWQX[POXLKDQGOH >@'/0RRG\0HWULFVIRU(YDOXDWLQJWKH4XDOLW\RI(QWLW\5HODWLRQVKLS0RGHOV,Q/LQJ7:5DP 6/L/HH0 HGV &RQFHSWXDO0RGHOLQJ±(5¶(5/1&6YRO6SULQJHU%HUOLQ +HLGHOEHUJKWWSVGRLRUJB >@-.URJVWLH0RGHO%DVHG'HYHORSPHQWDQG(YROXWLRQRI,QIRUPDWLRQ6\VWHPV6SULQJHU/RQGRQ  >@-6WLUQDDQG$3HUVVRQ(QWHUSULVH0RGHOLQJ)DFLOLWDWLQJWKH3URFHVVDQGWKH3HRSOH6SULQJHU &KDP 85 >@$=DYDOD%++DVV7KH$UWDQG3RZHURI)DFLOLWDWLRQ5XQQLQJ3RZHUIXO0HHWLQJV0DQDJH PHQW&RQFHSWV9LHQQD >@'-XJHO0RGHOLQJ,QWHUDFWLYH(QWHUSULVH$UFKLWHFWXUH9LVXDOL]DWLRQV$Q([WHQGHG$UFKLWHFWXUH 'HVFULSWLRQ&RPSOH[6\VWHPV,QIRUPDWLFVDQG0RGHOLQJ4XDUWHUO\&6,04QRSS± KWWSVGRLRUJFVLPT >@$3HUVVRQ(QWHUSULVH0RGHOOLQJ,Q3UDFWLFH6LWXDWLRQDO)DFWRUVDQG7KHLU,QIOXHQFHRQ$GRSWLQJ D3DUWLFLSDWLYH$SSURDFK3K'WKHVLV'HSDUWPHQWRI&RPSXWHUDQG6\VWHPV6FLHQFHV6WRFNKROP 8QLYHUVLW\ >@- 6WLUQD 7KH ,QIOXHQFH RI ,QWHQWLRQDO DQG 6LWXDWLRQDO )DFWRUV RQ (QWHUSULVH 0RGHOOLQJ 7RRO $FTXLVLWLRQLQ2UJDQLVDWLRQV3K'7KHVLV'HSDUWPHQWRI&RPSXWHUDQG6\VWHPV6FLHQFHV5R\DO ,QVWLWXWHRI7HFKQRORJ\6WRFNKROP6ZHGHQ,661 >@$9*XPHURY0.%LNWHPLURYD601XU\\DNKPHWRYD5(0RLVHHY$%1LNRODHYD55 .KDULVRYD935XNRPRLQLNRYD4XDOLW\)XQFWLRQV0RGHOLQJRI,QGXVWULDO(QWHUSULVHV3URGXFWV ,QWHUQDWLRQDO5HYLHZRI0DQDJHPHQWDQG0DUNHWLQJ9RO   >@7KH &RQFLVH 'HILQLWLRQ RI 7KH =DFKPDQ )UDPHZRUN E\ -RKQ $ =DFKPDQ KWWSVZZZ]DFKPDQFRPDERXWWKH]DFKPDQIUDPHZRUN >@7KH72*$)Š6WDQGDUGKWWSVZZZRSHQJURXSRUJWRJDI >@,%LGHU(3HUMRQV'%RUN7RZDUGV2Q7KH)O\&UHDWLRQRI0RGHOLQJ/DQJXDJH-DUJRQV,Q SURFHHGLQJVRIWKHWK,QWHUQDWLRQDO&RQIHUHQFHRQ,&7LQ(GXFDWLRQ5HVHDUFKDQG,QGXVWULDO $SSOLFDWLRQV,QWHJUDWLRQ+DUPRQL]DWLRQDQG.QRZOHGJH7UDQVIHU9ROXPH,0DLQ&RQIHUHQFH 3K' 6\PSRVLXP DQG 3RVWHUV  &(85:6 3URFHHGLQJV 9RO SS   KWWSFHXUZVRUJ9RO >@-6WLUQD-=GUDYNRYLF-*UDELV.6DQGNXKO'HYHORSPHQWRI&DSDELOLW\'ULYHQ'HYHORSPHQW 0HWKRGRORJ\ ([SHULHQFHV DQG 5HFRPPHQGDWLRQV ,Q 3RHOV * *DLOO\ ) 6HUUDO $VHQVLR ( 6QRHFN 0 HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU &KDPKWWSVGRLRUJB >@8)UDQN'RPDLQ6SHFLILF0RGHOLQJ/DQJXDJHV5HTXLUHPHQWV$QDO\VLVDQG'HVLJQ*XLGHOLQHV ,Q 5HLQKDUW]%HUJHU , HW DO HGV  'RPDLQ (QJLQHHULQJ 6SULQJHU %HUOLQ +HLGHOEHUJ  KWWSVGRLRUJB >@9LWHFK FRUSRUDWLRQ &25( $ 3URYHQ /HJDF\ D 3LRQHHU LQ 0%6(  85/ KWWS&25( 6RIWZDUH±9LWHFK YLWHFKFRUSFRP  >@. /DFH 0 .LULNRYD 7KH 0RGHOV IRU .QRZOHGJH $FTXLVLWLRQ LQ 30, 6SHFLILF 5HTXLUHPHQWV (QJLQHHULQJ,Q6HUUDO(6WLUQD-5DO\Wp-*UDELV- HGV 7KH3UDFWLFHRI(QWHUSULVH0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU &KDP  KWWSVGRLRUJ B >@'%RUN5$%XFKPDQQ'.DUDJLDQQLV0/HH(70LURQ$Q2SHQ3ODWIRUPIRU0RGHOLQJ 0HWKRG&RQFHSWXDOL]DWLRQ7KH20L/$%'LJLWDO(FRV\VWHP&RPPXQLFDWLRQVRIWKH$VVRFLDWLRQ IRU,QIRUPDWLRQ6\VWHPV >@3/ *ODVHU ' %RUN 7KH ELJ(5 7RRO  +\EULG 7H[WXDO DQG *UDSKLFDO 0RGHOLQJ RI (QWLW\ 5HODWLRQVKLSV LQ 96 &RGH ,Q WK ,QWHUQDWLRQDO (QWHUSULVH 'LVWULEXWHG 2EMHFW &RPSXWLQJ :RUNVKRS('2&:RUNVKRSSS,(((;SORUH >@16KLORY:2WKPDQ0)HOOPDQQ.6DQGNXKO0DFKLQH/HDUQLQJ%DVHG(QWHUSULVH0RGHOLQJ $VVLVWDQFH$SSURDFKDQG3RWHQWLDOV,Q6HUUDO(6WLUQD-5DO\Wp-*UDELV- HGV 7KH3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU &KDP  KWWSVGRLRUJB >@-&5HFNHU5/XN\DQHQNR0-DEEDUL6DEHJK%6DPXHO$&DVWHOODQRV)URPUHSUHVHQWDWLRQ WRPHGLDWLRQDQHZDJHQGDIRUFRQFHSWXDOPRGHOLQJUHVHDUFKLQDGLJLWDOZRUOG0,64XDUWHUO\ 0DQDJHPHQW,QIRUPDWLRQ6\VWHPV   >@:0DDVV9&6WRUH\5/XN\DQHQNR)URP0HQWDO0RGHOVWR0DFKLQH/HDUQLQJ0RGHOVYLD &RQFHSWXDO 0RGHOV ,Q $XJXVWR $ HW DO HGV  (QWHUSULVH %XVLQHVV3URFHVV DQG ,QIRUPDWLRQ 6\VWHPV0RGHOLQJ/1%,3YROSS6SULQJHU&KDP >@'%RUN$*DUPHQGLD0:LPPHU7RZDUGVD0XOWL2EMHFWLYH0RGXODUL]DWLRQ$SSURDFKIRU (QWLW\5HODWLRQVKLS0RGHOV,QSURFHHGLQJVRI(5)RUXP'HPRDQG3RVWHUV&(85:6 9ROSSKWWSFHXUZVRUJ9RO 86 >@*0XVVEDFKHU%&RPEHPDOH-.LHQ]OH6$EUDKmR+$OL1%HQFRPR0%~U/%XUJXHxR *(QJHOV3-HDQMHDQ-0-p]pTXHO7.KQ60RVVHU+$6DKUDRXL(6\ULDQL'9DUUy 0:H\VVRZ2SSRUWXQLWLHVLQ,QWHOOLJHQW0RGHOLQJ$VVLVWDQFH6RIWZDUHDQG6\VWHPV0RGHOLQJ    >@&)HOWXV40D+$3URSHU3.HOVHQ7RZDUGV$,$VVLVWHG'RPDLQ0RGHOLQJ,QSURFHHGLQJV RIWKH,QWHUQDWLRQDO&RQIHUHQFHRQ&RQFHSWXDO0RGHOLQJ(5/1&6YRO6SULQJHU &KDPSS >@$UFKLPDWH6SHFLILFDWLRQKWWSVZZZRSHQJURXSRUJDUFKLPDWHKRPH >@$UFKL 7KH 2SHQ 6RXUFH PRGHOOLQJ WRRONLW IRU FUHDWLQJ $UFKL0DWH PRGHOV DQG VNHWFKHV KWWSVZZZDUFKLPDWHWRROFRP         87