=Paper=
{{Paper
|id=Vol-3045/paper09
|storemode=property
|title=Panel Discussion: How to Build a Perfect Enterprise Modeling Method
|pdfUrl=https://ceur-ws.org/Vol-3045/paper09.pdf
|volume=Vol-3045
|authors=Jolita Ralyté,Dominik Bork,Manfred A. Jeusfeld,Marite Kirikova,Janis Stirna
|dblpUrl=https://dblp.org/rec/conf/ifip8-1/RalyteBJKS21
}}
==Panel Discussion: How to Build a Perfect Enterprise Modeling Method==
<pdf width="1500px">https://ceur-ws.org/Vol-3045/paper09.pdf</pdf>
<pre>
WĂŶĞů ŝƐĐƵƐƐŝŽŶ͗ ,Žǁ ƚŽ ƵŝůĚ Ă WĞƌĨĞĐƚ ŶƚĞƌƉƌŝƐĞ DŽĚĞůŝŶŐ
DĞƚŚŽĚ

-ROLWD5DO\Wp1'RPLQLN%RUN20DQIUHG$-HXVIHOG30DULWH.LULNRYD4DQG-DQLV6WLUQD5

1
  University of Geneva, CUI, Ballette bât. A, Route de Drize 7, Carouge, 1227, Switzerland
2
  TU Wien, Business Informatics Group, Favoritenstrasse 9-11, 1040 Vienna, Austria
3
  University of Skövde, Box 408, 54128 Skövde, Sweden
4
  Riga Technical University, Kalku 1, Riga, LV-1658, Latvia
5
  Stockholm University, Postbox 7003, Kista, SE 16407, Sweden
    
                   ďƐƚƌĂĐƚ
                   7KLV SDSHU UHSRUWV RQ WKH SOHQDU\ SDQHO GLVFXVVLRQ RQ ³+RZ WR %XLOG D 3HUIHFW (QWHUSULVH
                   0RGHOLQJ0HWKRG´KHOGDWWKH3R(0FRQIHUHQFH7KHSDQHOZDVFKDUJHGZLWKILQGLQJD
                   SDWKZD\ WR WKH SHUIHFW HQWHUSULVH PRGHOLQJ PHWKRG 7KH SDQHOLVWV KDYH D EDFNJURXQG LQ
                   HQWHUSULVHPRGHOLQJDQGPHWKRGHQJLQHHULQJ6RWKHTXHVWLRQLV&DQPHWKRGHQJLQHHULQJKHOS
                   ZLWK GHVLJQLQJ D EHWWHU HQWHUSULVH PRGHOLQJ HQYLURQPHQW" 7KH FRQWULEXWLRQV LQ WKLV SDSHU
                   VKRXOGEHUHJDUGHGDVDVQDSVKRWRIRXUYLHZSRLQWVDWWKHWLPHRIWKHSDQHO
                   
                   <ĞLJǁŽƌĚƐϭ
                   (QWHUSULVH 0RGHOLQJ 0HWKRG (QJLQHHULQJ 0HWKRG 5HTXLUHPHQWV &RQFHSWXDO 0RGHOLQJ
                   (QWHUSULVH$UFKLWHFWXUH

ϭ͘ /ŶƚƌŽĚƵĐƚŝŽŶ

    (QWHUSULVH0RGHOLQJ (0 LVDZHOONQRZQDSSURDFKWRIRUPDOO\GHVFULELQJDQHQWHUSULVHZLWKDVHW
RIPRGHOVUHIOHFWLQJGLIIHUHQWYLHZVRIWKHHQWHUSULVHVXFKDVLWVRUJDQL]DWLRQDOVWUXFWXUHEXVLQHVVJRDOV
VHUYLFHVSURGXFWVDQGSURFHVVHVLQIRUPDWLRQV\VWHP ,6 DQGLWVFRPSRQHQWV,7LQIUDVWUXFWXUHVHFXULW\
DVSHFWVHWF7KHPRGHOVDUHDEVWUDFWLRQVRIWKHHQWHUSULVHNQRZOHGJH7KH\SURYLGHDPHGLXPWRVKDUH
DFRPPRQXQGHUVWDQGLQJEHWZHHQYDULRXVVWDNHKROGHUVDQGWRFRQGXFWWKHSURJUHVVLRQRIWKHHQWHUSULVH
    $Q(0PHWKRGLVDFRQFHSWXDOWRROIDFLOLWDWRUDQGJXLGHWKDWKDVYDULRXVDSSOLFDWLRQVLQWKHOLIHRI
DQRUJDQL]DWLRQ,WVXSSRUWVWKHLPSOHPHQWDWLRQRILWV(QWHUSULVH$UFKLWHFWXUH>@WKHVWUDWHJLFSODQQLQJ
UHRUJDQL]DWLRQDQGGLJLWDOWUDQVIRUPDWLRQ>@WKHGHYHORSPHQWDQGHYROXWLRQRILQIRUPDWLRQV\VWHPV
DQG VHUYLFHV LQ FRQFRUGDQFH ZLWK WKH RUJDQL]DWLRQ¶V GHYHORSPHQW VWUDWHJ\ >@ WKH GHVLJQ RI QHZ
SURGXFWVDQGVHUYLFHVWREHGHOLYHUHGWRLWVFXVWRPHUV>@WKHGHYHORSPHQWRIGLJLWDOWZLQV>@DQG
GHDOLQJZLWKYDULRXVEXVLQHVVFKDOOHQJHV>@
    $W\SLFDO(0PHWKRGLQFOXGHVVHYHUDOPRGHOLQJODQJXDJHVRQHSHUGLIIHUHQWPRGHOLQJYLHZDQG
SURYLGHVJXLGDQFH DQGVRPHWLPHVDVXSSRUWLQJWRRO WREXLOGWKHPRGHOV,WDLPVWREHJHQHULFLQWKH
VHQVHWKDWLWFDQEHDSSOLHGWRDQ\HQWHUSULVH+RZHYHUWKHOLIHRIWRGD\¶VHQWHUSULVHLVQRWDORQJTXLHW
ULYHU ,W KDV WR FRSH ZLWK GLYHUVH FKDOOHQJHV RI GLJLWDO WUDQVIRUPDWLRQ EXVLQHVV DJLOLW\ DQG HYHQ
WHFKQRORJ\GLVUXSWLRQ7KHQHHGVIRU(0HYROYHDWWKHVDPHSDFHDVRUJDQL]DWLRQDOFRQWH[WVEXVLQHVV
UHTXLUHPHQWVDQGWHFKQRORJLHVHYROYH7KHUHIRUHKRZFRXOGRQHPHWKRGVDWLVI\DOORUJDQL]DWLRQVLQDOO
VLWXDWLRQV"
    $ODUJHQXPEHURI(0PHWKRGVDQGODQJXDJHVKDYHEHHQSURSRVHGE\DFDGHPLDDQGLQGXVWU\>@
EXWFKDQJLQJ(0UHTXLUHPHQWVPDNHWKHWDVNRIEXLOGLQJWDLORULQJDQGH[WHQGLQJ(0PHWKRGVPRUH
WKDQUHOHYDQWWRGD\
    
3R(0¶)RUXPWK,),3:*:RUNLQJ&RQIHUHQFHRQWKH3UDFWLFHRI(QWHUSULVH0RGHOOLQJ1RYHPEHU±/DWYLD
(0$,/ MROLWDUDO\WH#XQLJHFK - 5DO\Wp  GRPLQLNERUN#WXZLHQDFDW ' %RUN  PDQIUHGMHXVIHOG#KLVVH 0$ -HXVIHOG 
0DULWH.LULNRYD#UWXOY 0.LULNRYD MV#GVYVXVH -6WLUQD 
25&,' -5DO\Wp  '%RUN  0$-HXVIHOG 
 0.LULNRYD ; -6WLUQD 
                ‹&RS\ULJKWIRUWKLVSDSHUE\LWVDXWKRUV
               8VHSHUPLWWHGXQGHU&UHDWLYH&RPPRQV/LFHQVH$WWULEXWLRQ,QWHUQDWLRQDO &&%< 
               &(85:RUNVKRS3URFHHGLQJV &(85:6RUJ 

                                                                                    78
   7KHDLPRIWKHSDQHOKHOGDWWKH3R(0FRQIHUHQFHZDVWRH[SORUHWKH0HWKRG(QJLQHHULQJ
 0( SHUVSHFWLYHRI(QWHUSULVH0RGHOLQJ (0 ±WRHOLFLWWKHUHTXLUHPHQWVDQGKLJKOLJKWWKHFKDOOHQJHV
RI0(IRUEXLOGLQJDSHUIHFWO\DGDSWHGDQGHIILFLHQW(0PHWKRG7KHSDQHOLVWVZHUHLQYLWHGWRDQVZHU
WKHIROORZLQJWKUHHTXHVWLRQVDQGVXETXHVWLRQV
     :KDW DUH WKH UHTXLUHPHQWV IRU D SHUIHFW (0 PHWKRG" 'RHV RQH PHWKRG FDQ ILW DOO
         RUJDQL]DWLRQV DQG DOO VLWXDWLRQV" 'RHV WKH HQWHUSULVH FRQWH[W PDWWHU ZKHQ EXLOGLQJ DQ (0
         PHWKRG"+RZWRPDNHWKH(0HDV\DQGHIILFLHQW"
     :KLFK0(DSSURDFKIRUEXLOGLQJDQ(0PHWKRG":KDWZRUNVDQGZKDWGRHVQRW"+RZWR
         OHDUQIURPSDVWIDLOXUHVDQGRUVXFFHVVHV"6KRXOGZHFROOHFWSDWWHUQVDQGDQWLSDWWHUQVRI0(
         IRU(0"
     :KDWH[SHUWLVHDQGHIIRUWDUHUHTXLUHGWREXLOGXVHDQ(0PHWKRG"+RZWRUHGXFHWKH
         HIIRUWDQGKRZWRJDLQWKHH[SHUWLVH"

   7KH SDQHO LQYROYHG 'RPLQLN %RUN 0DQIUHG -HXVIHOG 0DULWH .LULNRYD DQG -DQLV 6WLUQD DV WKH
SDQHOLVWVZKLOH-ROLWD5DO\WpZDVWKHPRGHUDWRURIWKLVVHVVLRQ7KHUHPLQGHURIWKLVSDSHUVXPPDUL]HV
WKHGLVFXVVLRQWKHYLHZVRIWKHSDQHOLVWVDQGDQWWKHLQSXWVIURPWKHDXGLHQFHUHJDUGLQJWKHWKUHHPDLQ
TXHVWLRQVGHVFULEHGDERYH,QVHFWLRQZHHOLFLWWKHUHTXLUHPHQWVWKDWDQ(0PHWKRGVKRXOGVDWLVI\WR
VHHNWKHSHUIHFWLRQ,QVHFWLRQZHGLVFXVVPHWKRGHQJLQHHULQJFKDOOHQJHVZKLOHLQVHFWLRQZHUHIOHFW
RQ WKH H[SHUWLVH DQG HIIRUW UHTXLUHG WR FUHDWH (0 PHWKRGV 6HFWLRQ  FRQFOXGHV WKH SDSHU E\
VXPPDUL]LQJWKHRXWFRPHRIWKHSDQHO

Ϯ͘ ZĞƋƵŝƌĞŵĞŶƚƐĨŽƌĂƉĞƌĨĞĐƚDŵĞƚŚŽĚ

    )URPWKH0HWKRG(QJLQHHULQJ 0( SRLQWRIYLHZDQGHVSHFLDOO\IURPWKHVLWXDWLRQDO0(>@SRLQW
RIYLHZRQHPHWKRGFDQQRWILWDOOVLWXDWLRQVDQGDOORUJDQL]DWLRQDOFRQWH[WV7KHILUVWVWHSRIEXLOGLQJD
QHZPHWKRGFRQVLVWVLQVSHFLI\LQJWKHUHTXLUHPHQWVIRUWKLVPHWKRG>@GHILQLQJLWVVFRSHUHTXLUHG
IXQFWLRQDOLWLHVDQGTXDOLW\DVSHFWVLQDFFRUGDQFHZLWKWKHRUJDQL]DWLRQDOFRQWH[WDQGVLWXDWLRQDOIDFWRUV
)XQFWLRQDO PHWKRG UHTXLUHPHQWV VSHFLI\ YDULRXV W\SHV RI PRGHOV WR EH SURGXFHG YDOLGDWHG DQG
PDQDJHG7KH\DUHQHFHVVDU\EXWQRWVXIILFLHQWWRUHDFKPHWKRGSHUIHFWLRQ3HUIHFWLRQDVDFRQFHSWLV
XVXDOO\UHODWHGWRTXDOLW\,QWKHIROORZLQJVXEVHFWLRQVZHPDLQO\GLVFXVVWKHTXDOLW\UHTXLUHPHQWVDQG
VLWXDWLRQDODVSHFWV

Ϯ͘ϭ͘ YƵĂůŝƚLJƌĞƋƵŝƌĞŵĞŶƚƐĨŽƌĂŶDŵĞƚŚŽĚ

    $QHQWHUSULVHPRGHOLQJPHWKRGW\SLFDOO\FRYHUVPXOWLSOHSHUVSHFWLYHV GDWDSURFHVVJRDOHYHQW
HWF IRUPXOWLSOHOHYHOV EXVLQHVVDSSOLFDWLRQVRIWZDUHQHWZRUNDQGLQIUDVWUXFWXUHHWF 6XFKDPXOWL
SHUVSHFWLYHPXOWLOD\HUPRGHOLQJPHWKRGILUVWKDVWRIXOILOOWKHW\SLFDOTXDOLW\UHTXLUHPHQWVIRUPXOWL
SHUVSHFWLYHPRGHOLQJPHWKRGV
      Ɣ Minimal redundancy7KHFRQVWUXFWVXVHGLQWKHGLIIHUHQWSHUVSHFWLYHVOD\HUVVKRXOGKDYHD
          PLQLPDORYHUODSWRDYRLGUHGXQGDQF\LQWKHPRGHOVFUHDWHGIRUWKHSHUVSHFWLYHOD\HU$FHUWDLQ
          DPRXQW RI UHGXQGDQF\ LV XQDYRLGDEOH WR EH DEOH WR H[SUHVV FURVVUHIHUHQFHV )XUWKHU VRPH
          UHGXQGDQF\PD\ EHXVHIXO WR GHWHFW FRQIOLFWV LQYLHZV H[SUHVVHG E\ GLIIHUHQWVWDNHKROGHUV 
          PRGHOHUV
      Ɣ Cross-notational constraints:KHQRQHPRGHOLQJODQJXDJHPDNHVUHIHUHQFHV>@WRFRQVWUXFWV
          XVHGLQDQRWKHUPRGHOLQJODQJXDJH XVHGIRUDQRWKHUSHUVSHFWLYHOD\HU WKHQWKH(0PHWKRG
          VKRXOGFRQWDLQVXLWDEOHFRQVWUDLQWVIRUXVLQJWKHVHFURVVUHIHUHQFHV
      Ɣ Consistency&KDQJHVLQRQHPRGHOLQYROYLQJFRQFHSWVWKDWKDYHFURVVQRWDWLRQDOOLQNVWRRWKHU
          PRGHOVVKRXOGEHWUDQVODWHGLQWRVHPDQWLFDOO\HTXLYDOHQWFKDQJHVWKDWDQ(0PRGHOLQJWRRO
          VKRXOG DXWRPDWLFDOO\ DSSO\ WR DOO DIIHFWHG PRGHOV LQ RUGHU WR UHWDLQ DQ RYHUDUFKLQJ PRGHO
          UHSUHVHQWDWLRQRIWKHHQWHUSULVH>@
    
    6SHFLILFDOO\IRU(0ZHLGHQWLI\IXUWKHUUHTXLUHPHQWVIRUWKHSHUIHFW(0PHWKRG
      Ɣ Ontological grounding / semantics 7KH FRQVWUXFWV VKRXOG EH UHODWHG WR DQ DJUHHGXSRQ
          RQWRORJ\RIDUWHIDFWVRFFXUULQJLQHQWHUSULVHVVXFKDVUHVRXUFHVSURFHVVHVHYHQWVDQGVRIRUWK
                                                        79
       )RUH[DPSOHDFRQVWUXFWIRUDWDVNVKRXOGEHGHFODUHGWREHHTXLYDOHQWWRVRPHFRQFHSWLQWKH
       RQWRORJ\
    Ɣ Detection of modeling flaws 7KH SHUIHFW (0 PHWKRG VKRXOG KDYH DGYDQFHG WRROV WR GHWHFW
       IODZVLQPRGHOVDVZHOODV³XQGHVLUHGPRGHOSDWWHUQV´
    Ɣ Extensibility7KHFRUHFRQVWUXFWVRIWKH(0PHWKRGVKRXOGEHH[WHQVLEOHE\GRPDLQVSHFLILF
       FRQVWUXFWVLGHDOO\GHILQHGDVVSHFLDOL]DWLRQVRIWKHFRUHFRQVWUXFWV7KHQHZFRQVWUXFWVVKDOO
       QRWYLRODWHWKHVHPDQWLFVRIWKHFRUHFRQVWUXFWVWKDWWKH\DUHVXEFODVVHVRI
    Ɣ Multi-level abstractions (QWHUSULVH PRGHOV GHVFULEH DUWHIDFWV DW GLIIHUHQW DEVWUDFWLRQ OHYHOV
       HJ SK\VLFDO LQIUDVWUXFWXUH REMHFWV VXFK DV PDFKLQHV FRPSXWHUV 'DWDEDVHV OLNH SURGXFW
       FDWDORJVUHIHUWRSURGXFWPRGHOV IXUWKHUJURXSHGLQWRSURGXFWW\SHVDQGFDWHJRULHV 7KHUHPD\
       EHEXVLQHVVSURFHVVHVDERXWWKHFUHDWLRQRISURGXFWVHUYLFHLQVWDQFHV2WKHUEXVLQHVVSURFHVVHV
       DUHDERXWFUHDWLQJSURGXFWVHUYLFHPRGHOV+HQFHWKHSHUIHFW(0PHWKRGVKRXOGEHDEOHWR
       GHDOZLWKDUWHIDFWVDWDQ\RIWKHVHDEVWUDFWLRQOHYHOV
    
    3HUIHFWLRQ RI DQ (0 PHWKRG FRQVLVWLQJ RI SURFHGXUHV PHWDPRGHOV DQG DFWXDOO\ FRQVWUXFWHG
PRGHOVWKXVGHSHQGVRQWKHTXDOLW\RIHQWHUSULVH PHWD PRGHOV.6$QGHUVHQXQGHUVXSHUYLVLRQRI
-.URJVWLHKDVDPDOJDPDWHGWKHIROORZLQJV\VWHPVRIFULWHULDIRUHYDOXDWLQJHQWHUSULVHPRGHOTXDOLW\
>@ZKLFKDUHLQKHUHQWO\LPSRUWDQWDOVRIRU(0PHWKRGV
      Ɣ Principles of modellingIURP>@CompletenessWKHGHJUHHWRZKLFKDOOUHOHYDQWIDFWVIURPWKH
          GRPDLQDUHLQFOXGHGLQWKHPRGHOCorrectnessKRZZHOOWKHPRGHOFRQIRUPVWRWKHUXOHVRI
          WKHPRGHOOLQJWHFKQLTXHFlexibilityWKHGHJUHHWRZKLFKWKHPRGHOFDQDGDSWWRFKDQJHVLQWKH
          PRGHOOLQJ GRPDLQ Integration WR ZKLFK GHJUHH RI FRQVLVWHQF\ EHWZHHQ WKH GLIIHUHQW VXE
          PRGHOVWKDWFRQVWLWXWHWKHPRGHOSimplicityWKHGHJUHHRIPLQLPDOXVHRIPRGHOOLQJFRQVWUXFWV
          IRUWKHSUHVHQWLQJNQRZOHGJHLQWKHPRGHOUnderstandabilityWKHH[WHQWWRZKLFKWKHFRQFHSWV
          DQGVWUXFWXUHVRIWKHPRGHOFDQEHXQGHUVWRRGE\WKHVWDNHKROGHUDQGUsabilityWKHDELOLW\RI
          WKHPRGHOWREHXVHGIRULWVLQWHQGHGSXUSRVH
      Ɣ Guidelines of modeling IURP >@ WKDW FRQWDLQ VXFK JHQHUDO SULQFLSOHV DV WKH principle of
          construction adequacyIRUEHLQJDEOHWRKDYHDFRQVHQVXVWKDWDPRGHOLVFRUUHFWFRPSDUHGWR
          UHDOLW\the principle of language adequacyIRUDPRGHOLQJFRQWH[WWKHprinciple of economic
          efficiencyHQVXULQJWKDWWKHFRVWRIFUHDWLQJDQGPDLQWDLQLQJDPRGHOGRHVQRWH[FHHGWKHYDOXH
          JDLQHG IURP LW WKH principle of clarity GHDOLQJ ZLWK FRPSUHKHQVLELOLW\ DQG H[SOLFLWQHVV RI
          PRGHOVthe principle of systematic designUHTXLULQJHYHU\YLHZEHFRQQHFWHGWRWKHPRGHODQG
          QRW FUHDWLQJ GLVDJUHHPHQWV EHWZHHQ RWKHU YLHZV WKH principle of comparability ± PRGHOV
          VKRXOGEHFRPSDUDEOHERWKRQPRGHODQGPHWDPRGHOOHYHO
      Ɣ SEQUAL VHPLRWLF TXDOLW\ IUDPHZRUN  >@ ± D V\VWHPV PRGHOOLQJ UHIHUHQFH PRGHO IRU
          HYDOXDWLQJWKHTXDOLW\RIFRQFHSWXDOPRGHOV

    7KHVWULYHIRUSHUIHFWLRQFDQEHDOVRFRQVLGHUHGLQWHUPVRIXVHIXODQGXVHGLQSUDFWLFH7KLVLQWXUQ
UHTXLUHV WZR NH\ SRLQWV WR FRQVLGHU   WKH (0 PHWKRG IDFLOLWDWLQJ WKH SURGXFWLRQ RI KLJKTXDOLW\
PRGHOV DQG   VDWLVILHG VWDNHKROGHUV >@ :KLOH WKH IRUPHU LV DGGUHVVHG E\ LQWURGXFLQJ YDULRXV
JXLGHOLQHV DQG UHFRPPHQGDWLRQV IRU PRGHOLQJ WKH ODWWHU LV DFKLHYHG E\ UHFRPPHQGDWLRQV DQG
JXLGHOLQHVDQGRIWHQHYHQSODLQFRPPRQVHQVHIRURUJDQL]LQJPRGHOLQJVHVVLRQVDQGSURMHFWV+RZWR
RUJDQL]H PRGHOLQJ DQG UHTXLUHPHQWV ZRUNVKRSV KDV EHHQ GLVFXVVHG IRU H[DPSOH LQ >@ >@ ,Q
DGGLWLRQWRVXFKJXLGHOLQHVWKHUHDUHDOVRDQXPEHURIUHTXLUHPHQWVWRFRQVLGHU
    7KH(0PHWKRGLVWREHGHILQHGDQGUHFRJQL]DEOHE\LWVVWDNHKROGHUV7KLVPHDQVWKDWLWLVSRVVLEOH
IRULWVXVHUVWRVD\ZKDWWKHPHWKRGLVDQGKRZWRXVHLWLQFOXGLQJKRZWRDFTXLUHDQGLQWURGXFHLWLQDQ
RUJDQL]DWLRQ ,Q WKLV UHJDUG WKH PHWKRG VKRXOG VXSSRUW WKHVH DFWLRQV HJ E\ RIIHULQJ SDWKZD\V DQG
LQWHJUDWLRQSRLQWVZLWKRWKHUPHWKRGVDQGDSSURDFKHV,QGRLQJVRLWZRXOGUHOLHYHWKHVWDNHKROGHUV
IURPWKHEXUGHQWRWKLQNKRZWRGRWKLQJVWKH\DUHDOUHDG\GRLQJDFFRUGLQJWRWKHQHZPHWKRG$WWKH
VDPHWLPHWKH(0PHWKRGVKRXOGDOVRUHTXLUHFHUWDLQGLVFLSOLQHDQGULJRURIZRUNLQJ:LWKRXWWKLV
WKHUHLVDULVNWKDWRYHUWLPHLWVXVHZLOOGHJHQHUDWHLQWRSXUHO\SHUIRUPDWLYHDFWLRQVZLWKRXWGHHSHU
DQDO\WLFDOPHDQLQJ,QVXFKFDVHVRQO\WKHQDPHRIWKHPHWKRGZRXOGEHOHIW6XFKVLWXDWLRQVKDYHEHHQ
REVHUYHGLQSUDFWLFHHYHQE\FRPPHUFLDOO\VXFFHVVIXOPHWKRGXVHUV2QHRIWKHUHDVRQVIRUWKLVLVWKH
ODFN RI XQGHUVWDQGLQJ RI ZKDW PHWKRGV DUH ZKDW LQ WHUPV RI VNLOOV DQG UHVRXUFHV LV QHHGHG WR XVH
PHWKRGVZKDWWKH\FDQDFWXDOO\KHOSWKHRUJDQL]DWLRQWRDFKLHYHDQGZKDWWKH\FDQQRW
                                                        80
    $FRPPRQUHTXLUHPHQWREVHUYHGLQSUDFWLFHLVWKDWWKH(0PHWKRGVKRXOGEHeasy to useDQGDV
IRUPXODWHGE\SRWHQWLDOVWDNHKROGHUV³XQFRPSOLFDWHG´,QWKLVUHJDUGLWLVZRUWKQRWLQJWKDWWKHVHDUH
VXEMHFWLYHFULWHULDUHODWHGWRRQHEDFNJURXQGNQRZOHGJHDQGSUHH[LVWLQJVNLOOVHW,WLVRIWHQVRWKDW
WKLQJVZHNQRZKRZWRGRVHHPHDV\WRXV+HQFH(0PHWKRGVVKRXOGUHODWHWRRWKHUPHWKRGVDQG
PDQDJHPHQWWHFKQLTXHVHYHQRQO\WRSURYLGHUHIHUHQFHSRLQWV0HWKRGHQJLQHHUVVKRXOGDOVRWKLQN
DERXWKRZHDV\WKHLUPHWKRGFDQEHFRPPXQLFDWHGWRSRWHQWLDOXVHUVDQGKRZWKH\ZLOOXQGHUVWDQG
WKHP
    (0 PHWKRGV KDYH WR EH customizable 7KH\ VKRXOG RIIHU FXVWRPL]DWLRQ DQG LQWHJUDWLRQ
SRVVLELOLWLHVHJLQWKHLUPHWDPRGHOVDQGVXSSRUWLQJWRROV,WVKRXOGDOVRZHOFRPHVXFKFXVWRPL]DWLRQ
DQGH[WHQVLRQVIRUH[DPSOHE\SURYLGLQJJXLGHOLQHVDQGFRQVXOWDWLRQVE\PHWKRGGHYHORSHUV$WWKH
VDPHWLPHLWVKRXOGDOVREHVWDWHGWKDWQRWHYHU\DVSHFWRIWKHPHWKRGVKRXOGEHRSHQIRUFXVWRPL]DWLRQ
DQGQRWHYHU\ERG\VKRXOGEHGRLQJWKDW$ZD\RIGHDOLQJZLWKWKLVDVSHFWLQSUDFWLFHZRXOGEHWRVWULYH
IRUDPRUHGHGLFDWHGUROHRIPHWKRGH[SHUWRUPDQDJHURQDQRUJDQL]DWLRQDOOHYHO
    /DVW EXW QRW OHDVW D SHUIHFW PHWKRG ZRXOG EH VXSSRUWHG ZLWK WKH WRROV WKDW DXWRPDWLFDOO\ FRXOG
UHSUHVHQWWKHH[LVWLQJ,7DUFKLWHFWXUHDQGUHXVHNQRZOHGJHUHSUHVHQWHGDQGFDSWXUHGE\,7V\VWHPVRI
DQHQWHUSULVH$QRWKHULVVXHLVDYLVLELOLW\RIDYDLODEOHPRGHOVDQGRWKHUIRUPVRIUHSUHVHQWDWLRQ2QH
RIWKHLQWHUHVWLQJDSSURDFKHVSURSRVHGLQWKLVUHJDUGLVKDYLQJDFRFNSLWZKHUHWKHGLIIHUHQWYLHZVRQ
DQHQWHUSULVHDUHDYDLODEOH>@

Ϯ͘Ϯ͘ dĂŬŝŶŐŝŶƚŽĐŽŶƐŝĚĞƌĂƚŝŽŶƚŚĞŽƌŐĂŶŝnjĂƚŝŽŶĂůĐŽŶƚĞdžƚ

    7KH HQWHUSULVH FRQWH[W VKRXOG DOVR EH FRQVLGHUHG ZKHQ FKRRVLQJ DQG XVLQJ (0 PHWKRGV )RU
H[DPSOH>@DQG>@GLVFXVVHGYDULRXVDVSHFWVRIVLWXDWLRQDOFRQWLQJHQFLHVQDPHGLQWHQWLRQDODQG
VLWXDWLRQDOIDFWRUVLQIOXHQFLQJ(0PHWKRGDQGWRRODGRSWLRQDQGXVH,QVKRUWWKHFKRLFHRI(0PHWKRG
DQGWRRODQGWKHLUXVHGHSHQGVRQWKHLQWHQWLRQVWKHFRPSDQ\ZDQWVWRSXUVXHHJGRHVLWZDQWWRXVH
WKHPHWKRGZLWKRXWWKHVXSSRUWRIH[WHUQDOH[SHUWVDQGWKHVLWXDWLRQLWLVLQHJKRZPDWXUHLWLVLQ
WHUPVRIXVLQJPRGHOLQJPHWKRGVLQJHQHUDO7KHVHZHFDOOLQWHQWLRQDODQGVLWXDWLRQDOIDFWRUV
    5HJDUGLQJWKHFRQWH[WRIDQHQWHUSULVHDQGWKHVLWXDWLRQVZHFDQGLVWLQJXLVKEHWZHHQIHDWXUHVWKDW
DUHFRQWH[WDQGVLWXDWLRQLQGHSHQGHQWDQGWKHRQHV HJODQJXDJHDGHTXDF\ WKDWPD\EHWDLORUHGWRWKH
VL]HRIWKHHQWHUSULVHEXVLQHVVDUHDJHRJUDSKLFDOORFDWLRQFXOWXUDOHQYLURQPHQWSROLWLFDOHQYLURQPHQW
DQGRWKHUFRQWH[WXDODQGHQWHUSULVHVSHFLILFIDFWRUV2QHDVSHFWWKDWKDVDJHQHULFLPSRUWDQFHLVWKH
FDSDELOLW\ RI DQ (0 PHWKRG WR VXSSRUW FRQWLQXRXV LPSURYHPHQW LQ DQ HQWHUSULVH >@ 7R VXSSRUW
FRQWLQXLW\ WKH PHWKRG PXVW EH DSSOLFDEOH LWHUDWLYHO\ DQG WKH UHVXOWV RI LWV DSSOLFDWLRQ VKRXOG EH
UHXVDEOHIRUIXUWKHULWHUDWLRQV5HVSHFWLQJFRQWLQXRXVFKDQJHVLQHQWHUSULVHVWKHPHWKRGLWVHOIPD\QHHG
WRKDYHFRQWLQXRXVLPSURYHPHQWVWKDWPDNHLWFRQIRUPLQJWRQHZVWUDWHJLFDQGEXVLQHVVQHHGVRIDQ
HQWHUSULVH7RKDYHDFRQWLQXRXVHYROXWLRQDQGDSSOLFDWLRQRI(0PHWKRGVDVRSKLVWLFDWHGWRROVXSSRUW
LV QHFHVVDU\ IRU FDSWXULQJ WKH PRGHOLQJ UHVXOWV PDLQWDLQLQJ WKHP DQG VLPXOWDQHRXVO\ OHWWLQJ WR
LQFRUSRUDWHFKDQJHVLQPHWDPRGHOV

ϯ͘ DĞƚŚŽĚŶŐŝŶĞĞƌŝŶŐĨŽƌD

    7KHDLPRIPHWKRGHQJLQHHULQJLVWRGHYHORSWKHRULHVDQGIRXQGDWLRQVIRUEXLOGLQJDQGDGDSWLQJQHZ
PHWKRGV(0PHWKRGVDUHZLWKLQLWVVFRSH6LWXDWLRQDOPHWKRGHQJLQHHULQJ>@DIILUPVWKDWWKHPHWKRG
WREHHIIHFWLYHPXVWSHUIHFWO\DGDSWWRWKHVLWXDWLRQRIWKHRUJDQL]DWLRQRUWKHSURMHFWZKLFKXVHVLW,Q
WKLV VHFWLRQ ZH KLJKOLJKW WKH FKDOOHQJHV DQG UHTXLUHPHQWV WKDW PHWKRG HQJLQHHULQJ VKRXOG WDNH LQWR
DFFRXQWWRVXSSRUWWKHHQJLQHHULQJRIVLWXDWLRQVSHFLILFDQGDGDSWDEOH(0PHWKRGV
    7KHXQGHUO\LQJTXHVWLRQLVZKHWKHUWKHGLYHUVLW\RIHQWHUSULVHVLVVRKLJKWKDWHQWHUSULVHVSHFLILF
PHWKRGVVKRXOGEHGHYHORSHGRQWKHIO\,IVRWKHQLWPD\EHKDUGWRFRPSDUHHQWHUSULVHPRGHOVRI
GLIIHUHQWHQWHUSULVHV6XFKFRPSDULVRQVDUHDOPRVWLPSRVVLEOHGXHWRWKHFRQILGHQWLDOLW\RIWKHPRGHOV
6WLOOWKHUHVKRXOGEHDFRPPRQFRUHRIFRQVWUXFWVWKDWWKH(0FRPPXQLW\PD\DJUHHXSRQURXJKO\
DORQJWKHOLQHVRI=DFKPDQ)UDPHZRUN>@DQG72*$)>@$SDUWLFXODUFKDOOHQJHIRUDQ(0PHWKRG
LVWKHNQRZOHGJHDFTXLVLWLRQ$PHWDPRGHOGHILQLQJWKHFRQVWUXFWVLVQRWVXIILFLHQW2QHDOVRQHHGVWR
VSHFLI\ KRZ WR H[WUDFW WKH PRGHOV IURP VRXUFHV VXFK DV LQWHUYLHZV H[LVWLQJ LQIRUPDWLRQ V\VWHPV
GRFXPHQWDWLRQDQGVRIRUWK$QRWKHURSHQFKDOOHQJHLVWKHVSHFLILFDWLRQRIDQDO\VLVWRROVIRUHQWHUSULVH
                                                       81
PRGHOV HUURU GHWHFWLRQ TXDOLW\ DVVHVVPHQW GHSHQGHQF\ WUDFLQJ VLPXODWLRQV PD\ EH VRPH RI WKH
DQDO\VLVVHUYLFHVWREHRIIHUHG:KHQHQWHUSULVHPRGHOVDUHXVHGIRUZKDWLIVFHQDULRVWKHQWKHPHWKRG
HQJLQHHULQJDSSURDFKVKRXOGLQFOXGHFRQVWUXFWVRQKRZWRPDSWKHWREHHQWHUSULVHPRGHOEDFNWRWKH
HQWHUSULVHV\VWHPVWKDWLPSOHPHQWWKHPRGHOHJWKH(53V\VWHPRIWKHHQWHUSULVH
    7RFDWHUIRUWKHGLYHUVLW\RIHQWHUSULVHVRQHPD\DOVRG\QDPLFDOO\H[WHQGDFRUH(0PHWKRGE\QHZ
FRQVWUXFWVVSHFLILFIRUWKHHQWHUSULVH7KHZKHHOGRHVQRWKDYHWREHUHLQYHQWHGPDQ\WLPHV$FRUH
(0PHWKRGFDQEHUHXVHG7KHPHWKRGHQJLQHHULQJDSSURDFKLVWKHQE\SULQFLSOHLQFUHPHQWDO/LNHIRU
VFKHPDHYROXWLRQLQGDWDEDVHVFKDQJHVWRWKH(0PHWKRGPD\UHTXLUHDGDSWLQJWKHPRGHOVFUHDWHG
ZLWKWKHROGYHUVLRQRIWKH(0PHWKRG,WZRXOGEHGHVLUDEOHWRDOORZWKHPHWKRGHQJLQHHUWRUHVWULFW
FKDQJHVWRWKRVHWKDWZRXOGQRWUHTXLUHH[WHQVLYHFKDQJHVWRH[LVWLQJPRGHOV
    2QHDSSURDFKWRDGDSWHQWHUSULVHPRGHOLQJPHWKRGVWRVSHFLILFFRQWH[WVDQGHQWHUSULVHVWKDWZDV
DOVRJHQHULFDOO\LPSOHPHQWHGRQDVWDWHRIWKHDUWPHWDPRGHOLQJSODWIRUPKDVEHHQSURSRVHGE\%LGHU
HWDO>@
    3DWWHUQVDQGDQWLSDWWHUQVDUHDSURYHQWRROWRLQFRUSRUDWHHPSLULFDONQRZOHGJHLQWRDQHQJLQHHULQJ
DFWLYLW\VXFKDVVRIWZDUHHQJLQHHULQJ,QWKHFRQWH[WRIHQWHUSULVHPRGHOLQJVXFKSDWWHUQVFRXOGH[SUHVV
IRU H[DPSOH KRZ D VRIWZDUH DUFKLWHFWXUH VXSSRUWV D SURFHVV SDWWHUQ OLNH ³VHSDUDWLRQ RI FRQFHUQV´
3DWWHUQV DQG DQWLSDWWHUQV FDQ DOVR EH XVHG WR DQDO\]H HQWHUSULVH PRGHOV WKDW DUH PLQHG IURP RWKHU
HQWHUSULVHV\VWHPVVXFKDV(53V\VWHPV7KHGRZQVLGHLVWKDWSDWWHUQVDUHRQO\XVHIXOLQDVSHFLILF
FRQWH[W HJOHJDOIUDPHZRUNRIDJLYHQFRXQWU\ ,WLVLQKHUHQWO\GLIILFXOWWRH[SOLFLWO\UHSUHVHQWVXFKD
FRQWH[W
    7KHGHYHORSPHQWRI(0VKRXOGEHEDVHGRQWKHSULQFLSOHVRIPHWKRGHQJLQHHULQJ$NH\DVSHFWRI
PHWKRGGHYHORSPHQWLVPRGXODUL]DWLRQWRRIIHUDFRPSRQHQWEDVHGPHWKRGDQGJXLGDQFHRQKRZWR
XVHDQGFRPELQHWKHFRPSRQHQWVLQYDULRXVPHWKRGDSSOLFDWLRQFRQWH[WV7KLVDSSURDFKZDVXVHGIRU
LQVWDQFHLQWKHGHYHORSPHQWRI(0DQG&''0RUHDERXWWKH&''GHYHORSPHQWDQGWKHFKRLFHV
PDGHLQWKLVSURFHVVLVDYDLODEOHLQ>@7KHFRPSRQHQWEDVHGDSSURDFKDOVRRIIHUVWKHSRVVLELOLW\WR
GHYHORSPHWKRGH[WHQVLRQVWKDWGRQRWQHHGWREHSODQQHGRUHYHQHQYLVLRQHGLQWKHHDUO\VWDJHVRI
PHWKRGGHYHORSPHQW
    $NH\DVSHFWRIPHWKRGGHYHORSPHQWLVWRROVXSSRUW0HWKRGVZLWKRXWDQ\WRROVXSSRUWDUHKDUGWR
LQWURGXFHLQSUDFWLFH+HQFHLQWKLVUHJDUGWKHPHWKRGGHYHORSPHQWWHDPVKRXOGKDYHDQHDUO\VWUDWHJ\
:KLOHLWLVRIFRXUVHSRVVLEOHWRGHYHORSDQHZWRROIURPVFUDWFKWKLVDSSURDFKLVXQGRXEWHGO\FRVWO\
DQGWLPHFRQVXPLQJ,QVWHDGVWUDWHJLHVVXFKDVWKHLPSOHPHQWDWLRQRIPHWKRGVXSSRUWLQDFXVWRPL]DEOH
PHWDWRROVKRXOGEHFRQVLGHUHGDVPRUHHIILFLHQWEHFDXVHGHVSLWHWKHLUGUDZEDFNVVXFKDVEHLQJORFNHG
LQWRDYHQGRU¶VWRRODQGWKHIXQFWLRQDOLW\RIWKDWWRRO
    0HWKRGHQJLQHHULQJIRU(0PHWKRGVVKRXOGIRUHPRVWH[SOLFLWO\VSHFLI\WKHLQWHQGHGVWDNHKROGHUV
DQGWKHLUSXUSRVHVRIXVLQJWKHPHWKRGWREHGHYHORSHG7KLVPDNHVVXUHWKDWWKHPHWKRGLVQHLWKHU
RYHUHQJLQHHUHGE\IRFXVLQJRQHGJHFDVHVQRUWKDWLWIDLOVLQFRYHULQJWKHGRPDLQDQGVXSSRUWLQJLWV
SXUSRVHV DGHTXDWHO\ 0RUHRYHU (0 PHWKRG HQJLQHHULQJ VKRXOG DLP WR IROORZ SURFHGXUHV WKDW DUH
IOH[LEOHDQGLWHUDWLYHLQQDWXUH7KHDSSURDFKSURSRVHGE\)UDQN>@DFFRXQWVWRWKHVHUHTXLUHPHQWVWR
DJUHDWH[WHQWE\XVLQJVDPSOHPRGHOV RUHYHQLQIRUPDOVNHWFKHV DVHDUO\DVSRVVLEOHLQWKHPHWKRG
HQJLQHHULQJ OLIHF\FOH ([SOLFDWLQJ HDUO\ GHVLJQ GHFLVLRQV E\ PHDQV RI H[DPSOHV HQDEOHV WKH PHWKRG
HQJLQHHULQJ WHDP WR LQYROYH RWKHU VWDNHKROGHUV DQG WR LQWHJUDWH WKHLU IHHGEDFN DV HDUO\ DV SRVVLEOH
(YHQWXDOO\ WKH SURSRVHG (0 PHWKRG QHHGV WR XQGHUJR HPSLULFDO HYDOXDWLRQ LQ RUGHU WR VKRZ LWV
XVDELOLW\HDVHRIXVHDQGYDOXHLQWKHLQWHQGHGGRPDLQE\WKHLQWHQGHGVWDNHKROGHUV
    7KH PHWKRG HQJLQHHULQJ FRPPXQLW\ VKRXOG WDNH FDUH WKDW WKH PHWKRG FDQ EH VXSSRUWHG E\ D
GHGLFDWHGWRRORUDVHWRIWRROV7KHVHWRROVZRXOGEHH[SHFWHGWRFDSWXUHWKHVWDNHKROGHUNQRZOHGJH
DQGJHQHUDWHXVHIXOUHSUHVHQWDWLRQVRIWKLVNQRZOHGJH$JRRGH[DPSOHRIVXFKJHQHUDWLRQFDSDELOLWLHV
LVWKH&25(WRROIURP9LWHFKFRUSRUDWLRQ>@7KLVWRROIRULQVWDQFHRQWKHEDVLVRIDIXQFWLRQDOEORFN
GLDJUDPFDQFUHDWHDQ,')GLDJUDPRUDQDFWLYLW\GLDJUDP7KLVZD\WKHHIIRUWRIPRGHOFUHDWRUVLV
VDYHGDQGDGGLWLRQDOPHDQVIRUTXDOLW\FKHFNLQJDUHDYDLODEOH6LPLODUPRGHOJHQHUDWLRQDSSURDFKFRXOG
EHDOVRDSSOLHGWRPRGHOVLQFOXGHGLQ(0PHWKRGV
    5HVSHFWLQJWKDWWKH(0PHWKRGVDUHDSSOLHGE\VWDNHKROGHUVZKRVHNQRZOHGJHPD\GLIIHUDQGLV
HYROYLQJWKHPHWKRGHQJLQHHULQJIRU(0PHWKRGVKDVWRFRQVLGHUDOVRVXSSRUWLQJPRGHOVDQGSURFHVVHV
IRUNQRZOHGJHPDQDJHPHQW>@$QRWKHULPSRUWDQWLVVXHLVWKDWWKHHQJLQHHULQJPHWKRGFRQVLGHUVQRW
RQO\WKHPHWKRGSHUVHEXWDOVRWKHVRIWZDUHVROXWLRQ V WKDWZLOOVXSSRUWWKHPHWKRG

                                                       82
    7KHDERYHLVVXHVKDYHEHHQUHODWLYHO\ZHOOXQGHUVWRRGLQWKH(0FRPPXQLW\DVZHOODVWKH\KDYH
DWWUDFWHG VRPH DOEHLW LQVXIILFLHQW DWWHQWLRQ LQ SXEOLFDWLRQV :KDW KDV EHHQ GLVFXVVHG DQG UHVHDUFKHG
FRQVLGHUDEO\OHVVLVZKDWNLQGRISURMHFWPDQDJHPHQWDQGSURMHFWWHDPDVXFFHVVIXO0(SURMHFWVKRXOG
KDYH)RUH[DPSOHPDQ\PHWKRGGHYHORSPHQWVKDYHVRPHRULJLQVLQWKHDFDGHPLFZRUOGZKLOHWRRO
GHYHORSPHQW QHHGV FRQVLGHUDEOH LQGXVWULDO EDFNLQJ WKDW FDQQRW EH HDVLO\ HVWDEOLVKHG LQ DFDGHPLF
HQYLURQPHQWV0HWKRGVDQGWRROVQHHGWREHDSSOLHGDQGWKHH[SHULHQFHVRIWKHDSSOLFDWLRQVFKDQQHOHG
EDFNLQWRWKHGHYHORSPHQW7KLVSXWVIRUZDUGWKHQHHGIRUWKHPHWKRGGHYHORSPHQWWHDPWRFRQVLVWRI
UHVHDUFKHUVDQGSUDFWLWLRQHUV$QRWKHULVVXHLVWKDWIRUDVXFFHVVIXOPHWKRGWREHH[LVWLQJDQGKDYLQJ
LPSDFWLQWKHSUDFWLFHLWQHHGVWREHXVHGDQGXSGDWHGRYHUDORQJWLPH+HQFHWKHPRUHFRPPRQO\
VHHQFRQVWHOODWLRQVRIWHDPVFHQWHUHGRQDQH[WHUQDOO\IXQGHGUHVHDUFKJUDQWRI\HDUVQHHGWRSODQ
KRZWRZRUNDIWHUWKHLQLWLDOSURMHFWHQGV

ϰ͘ džƉĞƌƚŝƐĞĂŶĚĞĨĨŽƌƚƌĞƋƵŝƌĞĚƚŽďƵŝůĚͬƵƐĞĂŶDŵĞƚŚŽĚ

    7KH NH\ DUHDV RI H[SHUWLVH IRU EXLOGLQJ DQG PDLQWDLQLQJ (0 PHWKRGV SURIHVVLRQDOO\ DUH PHWKRG
HQJLQHHULQJDQGFRQFHSWXDOPRGHOLQJDVZHOODVLIZHFRQVLGHUWKDWPRVWPHWKRGVUHTXLUHLWNQRZOHGJH
RIPRGHOLQJWRROVDQGPHWKRGLPSOHPHQWDWLRQLQWRROV:LWKRXWFRPSHWHQFHLQWKHVHDUHDVWKHPHWKRG
GHYHORSHUVZLOOPRVWOLNHO\HQGXSUHSHDWLQJPDQ\PLVWDNHVRIWKHSDVWDQGPRVWOLNHO\HQGXSRQO\
ZLWKDUHVHDUFKSURWRW\SHPHWKRGWKDWIRFXVHVRQWKHFHQWUDODVSHFWVRIWKHHQYLVLRQHGPHWKRGEXWZLOO
ODFN WKH FRPSUHKHQVLYHQHVV DQG GHWDLO QHHGHG IRU D PHWKRG WR EH XVHG LQ SUDFWLFH )RU H[DPSOH
GHYHORSLQJDFRUHRIDPRGHOLQJODQJXDJHZLWKPHWDPRGHOLQJFDQEHGRQHUHODWLYHO\TXLFNO\DIWHUWKDW
DVLPSOHJUDSKLFDOODQJXDJHFDQEHFRQVWUXFWHGDQGWHVWHGRQDIHZH[DPSOHFDVHV:KLOHLQDUHVHDUFK
SURMHFW WKLV ZRXOG FRXQW DV WKH ILUVW VWHS RI YDOLGDWLRQ LW LV VWLOO IDU IURP DQ LQGXVWULDOO\ DSSOLFDEOH
PHWKRG7RDFKLHYHWKHODWWHURQHZRXOGQHHGWRDSSO\LWWRDUHDVRQDEOHQXPEHURIUHDOOLIHSURMHFWVRU
FDVHV SUREDEO\QROHVVWKDQ DQGGHYHORSDQH[WHQVLYH PHWKRGJXLGHSRSXODWHGZLWKH[DPSOHV
H[SHULHQFHEDVHG UHFRPPHQGDWLRQV SDWWHUQV DQG HWF 7KLV WDNHV FRQVLGHUDEOH WLPH DQG HIIRUW DQG
PRUHRYHULWFDQQRWEHGRQHZLWKRQO\DIHZSHRSOHLQWKHPHWKRGGHYHORSPHQWWHDP,QDGGLWLRQWKHUH
DUHWKHRQJRLQJWDVNVVXFKDVNHHSLQJDZHEVLWHXSWRGDWH
    (0 PHWKRG GHYHORSPHQW QHHGV WR EH VHHQ DV D ORQJWHUP HQGHDYRU 7ZR PDLQ VWDJHV FDQ EH
FRQVLGHUHG±  WKHLQLWLDOGHYHORSPHQWZRUNWRZDUGVFUHDWLQJWKHILUVWUHDVRQDEO\FRPSOHWHDQGXVHIXO
PHWKRGDQG  DSSO\LQJWKHPHWKRGDQGDWWKHVDPHWLPHFRQWLQXRXVO\LPSURYLQJLW7KHODWWHUVWDJH
DOVRUHTXLUHVWKHPHWKRGGHYHORSHUVWRHQJDJHLQDFWLYLWLHVLQZKLFKRQO\IHZRIWKHPKDYHH[WHQVLYH
H[SHUWLVH7KHVHDUHPDUNHWLQJDQGVDOHVRIPHWKRGVWRROVDQGUHODWHGFRQVXOWLQJVHUYLFHV$QDVSHFW
WKDWKDVQRWEHHQGLVFXVVHGLQWKLVUHJDUGLVEUDQGLQJ:RXOGLWEHUHOHYDQWWRWKLQNRIPRGHOLQJPHWKRGV
DVEUDQGVDQGLIVRZKDWWKHQFDQEHGRQHWRLQFUHDVHEUDQGUHFRJQLWLRQDQGDZDUHQHVV"7KH(0
FRPPXQLW\DVVRFLDWHGZLWKWKH3R(0FRQIHUHQFHPDLQO\UHSUHVHQWVUHVHDUFKHUVZKRZULWHDFDGHPLF
SXEOLFDWLRQVDQGERRNV7KHUHDFKRIWKHVHDFWLYLWLHVRXWVLGHWKHFRPPXQLW\KRZHYHUVHHPVOLPLWHG
3RVLWLYH H[DPSOHV RI RWKHU DFWLYLWLHV ZLWK SRWHQWLDOO\ KLJKHU LPSDFW DUH IRU H[DPSOH WKH 1(02
VXPPHUVFKRRO>@
    ,QRUGHUIRU(0PHWKRGVWREHXVDEOHDQGDFWXDOO\XVHGLQSUDFWLFHWZRWKLQJVDUHRISDUDPRXQW
LPSRUWDQFH2QWKHRQHKDQG(0PHWKRGVQHHGWREHVXSSRUWHGE\DSSURSULDWHPRGHOLQJWRROV2QWKH
RWKHUKDQGWKHYDOXHRIHQWHUSULVHPRGHOVQHHGVWREHHTXDORUKLJKHUFRPSDUHGWRWKHHIIRUWVLQYROYHG
LQWKHLUSURGXFWLRQ
    7RDFFRXQWIRUWKHKHWHURJHQHRXVVWDNHKROGHUVLQYROYHGLQHQWHUSULVHPRGHOLQJFRUUHVSRQGLQJWRROV
QHHGWREHPRGHUQHDV\WRGHSOR\DQGHIILFLHQWWRXVH7KHSURYLVLRQRIDSSOLFDWLRQV\VWHPVWKURXJK
WKH EURZVHUFORXG LV QRZDGD\V FRQVLGHUHG D FRPPRGLW\ DQG VWDNHKROGHUV LQYROYHG LQ HQWHUSULVH
PRGHOLQJSURMHFWVVKRXOGQRWEHH[SHFWHGWRLQVWDOODVRIWZDUHLQDGYDQFHRUWRJHWH[SHULHQFHGZLWK
HQWLUHO\QHZVRIWZDUHV\VWHPVDQGXVHULQWHUIDFHV7KHXSWDNHRIZHEWHFKQRORJLHVDQGWKHSURYLVLRQRI
PRGHOLQJWRROVWKURXJKWKHZHERUDVH[WHQVLRQVWRZLGHO\DGRSWHGV\VWHPVOLNH96&RGHHQDEOHVJUHDW
SRWHQWLDOIRUWKH(0FRPPXQLW\>@
    ,QRUGHUWRLQFUHDVHWKHYDOXHRISURGXFLQJHQWHUSULVHPRGHOVWKH(0FRPPXQLW\VKRXOGDOVREH
RSHQWRLQFRUSRUDWHPHWKRGVDQGWHFKQLTXHVIURPGDWDVFLHQFHDQGDUWLILFLDOLQWHOOLJHQFH IRUDUHFHQW
GLVFXVVLRQDQGVHOHFWHGDGYDQFHVVHH>@>@>@>@ ,QWHUWZLQLQJHQWHUSULVHPRGHOLQJZLWKWKHVH
ILHOGVRIUHVHDUFKQRWRQO\JHQHUDWHVPDQLIROGSRWHQWLDOVIRULQWHOOLJHQWRUDVVLVWHGPRGHOLQJ>@>@
                                                           83
LWDOVRHQVXUHVWKDWWKH(0FRPPXQLW\ZRUNVRQWKHELJFKDOOHQJHVDQGUHPDLQVDWWUDFWLYHWRVWXGHQWV
DQG\RXQJUHVHDUFKHUV
    $ SHUIHFW (0 PHWKRG VKRXOG DOVR PLQLPL]H WKH HIIRUW WR FUHDWH DQ XSWRGDWH DQG FRQVLVWHQW
HQWHUSULVHPRGHO0DQ\HQWHUSULVHVDOUHDG\KDYHDQXPEHURIVRIWZDUHV\VWHPVLQXVHWKDWPDLQWDLQD
SDUWLDOYLHZRIWKHHQWHUSULVHZRUNIORZPDQDJHPHQWV\VWHPVFRQWDLQSURFHVVPRGHOV80/PRGHOLQJ
WRROVPD\FRQWDLQGDWDPRGHOVDQGRWKHUPRGHOV(53V\VWHPVFRQWDLQQRWRQO\GDWDEXWDOVRSURFHVV
PRGHOV3URFHVVPRGHOVFDQEHPLQHGIURPHYHQWORJILOHV7KHRUJDQL]DWLRQDOVWUXFWXUHRIDQHQWHUSULVH
PD\EHVWRUHGLQDQ(53V\VWHPRUVWDWLFGRFXPHQWV6XFKVRXUFHVVKRXOGEHKDUYHVWHGDXWRPDWLFDOO\
WRPLQLPL]HWKHPDQXDOPRGHOLQJHIIRUW:KLOHWKHLQLWLDOLQYHVWPHQWLQWKHQHFHVVDU\LPSRUWILOWHUVLV
UDWKHU KLJK WKH DXWRPDWLF H[HFXWLRQ DOORZV WR NHHS WKH HQWHUSULVH PRGHOV XSWRGDWH ZLWK PLQLPDO
KXPDQ HIIRUW PXFK OLNH WKH (7/ SURFHVV LQ D GDWD ZDUHKRXVH 7KH SHUIHFW (0 PHWKRG VKRXOG
DXWRPDWLFDOO\JHQHUDWHDEVWUDFWLRQVRIWKHKDUYHVWHGPRGHOV
    $SRVLWLYHH[DPSOHLQWHUPVRI(0PHWKRGDQGWRROXVDJHLV$UFKL0DWHODQJXDJH>@DQG$UFKL
WRRO >@ %RWK DUH IOH[LEOH DQG HDV\ WR WHDFK $V D UHVXOW VWXGHQWV ZKR OHDUQ WKHVH PHWKRGV DW
XQLYHUVLWLHVDUHIUHHO\XVLQJWKHPDWWKHLUZRUNSODFHV)URPWKLVZHFDQOHDUQWKDWRYHUDOOHGXFDWLRQLQ
HQWHUSULVHPRGHOLQJPDWWHUVDVZHOODVDYDLODELOLW\RIIUHHO\DQGRSHQO\DFFHVVLEOHWRROV6LPSOLFLW\LV
DQLPSRUWDQWIDFWRULQWKHXVHRIDQ\WRROVKRZHYHUZHFDQQRWDIIRUGWRRYHUVLPSOLI\LQHQWHUSULVH
PRGHOLQJ7KHUHIRUHWKHVNLOOVIRUHQWHUSULVHPRGHOLQJZLOOEHSRVVLEOHWRGHYHORSRQO\JUDGXDOO\DQG
E\ REWDLQLQJ NQRZOHGJH LQ VHYHUDO DUHDV VXFK DV FRQFHSWXDO PRGHOLQJ WKH XVH RI PRGHOLQJ WRROV
IDFLOLWDWLRQVNLOOVHWF

ϱ͘ ŽŶĐůƵƐŝŽŶ

    ³3HUIHFWLVMXVWDYLVLRQ:HZLOOQHYHUUHDFKLWEXWZHFDQZRUNWRZDUGVLW,WNHHSVXVVKDUSDQG
FULWLFDODQGORQJLQJIRUPRUHDQGEHWWHU,WDOLJQVJRDOVRISHRSOH7KLVLVDOVRKRZDQRUJDQL]DWLRQDO
YLVLRQZRUNV´ *HHUW3RHOVSDQHODWWHQGHH 7KLVTXRWHIURPWKHSDQHOFKDWVXJJHVWVWKDWZKLOHDSHUIHFW
(0PHWKRGLVSUREDEO\QRWUHDFKDEOHLWLVVWLOOZRUWKVWULYLQJLQWKDWGLUHFWLRQ
    7KH DLP RI WKH SDQHO SUHVHQWHG LQ WKLV SDSHU ZDV WR FKDOOHQJH SDUWLFLSDQWV WR H[SUHVV WKHLU
XQGHUVWDQGLQJ RI ZKDW D SHUIHFW (0 PHWKRG VKRXOG EH DQG WR LGHQWLI\ WKH PHWKRG HQJLQHHULQJ
FKDOOHQJHVWREXLOGVXFKDPHWKRG%HORZZHVXPPDUL]HWKHPDLQILQGLQJVIURPWKHSDQHOGLVFXVVLRQ
    9DOXH SURSRVLWLRQ )LUVW RI DOO WKH PHWKRG HQJLQHHU VKRXOG VWDWH WKH YDOXH SURSRVLWLRQ RI WKH
PHWKRG$Q(0PHWKRGVKRXOGEHXVHIXOILWWRWKHSXUSRVHDQGILWWRWKHXVHUDQGKLVKHUFRQFHUQV$V
WKHPRGHOLQJWDVNUHTXLUHVWLPHDQGHIIRUWWKHREWDLQHGUHVXOWVVKRXOGEHZRUWKRILW+HQGHULN3URSHU
DSDQHODWWHQGHHFDOOVLWD³5HWXUQRQ0RGHOLQJ(IIRUW´,QJHQHUDODQ(0PHWKRGLVH[SHFWHGWRVXSSRUW
PXOWLSHUVSHFWLYHDQGPXOWLOD\HUPRGHOLQJ
    6WURQJWKHRUHWLFDOIRXQGDWLRQ$Q(0PHWKRGVKRXOGEHWKHRUHWLFDOO\ZHOOIRXQGHGEDVHGRQDQ
DJUHHG RQWRORJ\ DQG IRUPDOO\ GHILQHG XVLQJ PHWDPRGHOV DQGRU IRUPDO ODQJXDJHV 7KDW FRQFHUQV
DEVWUDFWDQGFRQFUHWHV\QWD[DVZHOODVWKHZD\RIZRUNLQJWRFUHDWHDQGXVHPRGHOV7KLVFDQEHGRQH
ZLWKWKHKHOSRIPHWKRGHQJLQHHULQJDSSURDFKHVDQGWRROVDQGTXDOLW\UHIHUHQFHPRGHOV
    $GDSWDELOLW\7KHFRQWH[WDQGQHHGVRI(0YDU\IURPRQHRUJDQL]DWLRQWRDQRWKHUDQGHYHQHYROYH
ZLWKLQDQRUJDQL]DWLRQRYHUWLPH7KHUHIRUHDQ(0PHWKRGVKRXOGEHFXVWRPL]DEOHDQGH[WHQVLEOHE\
FRQWH[WVSHFLILFDQGRUGRPDLQVSHFLILFFRQVWUXFWVDVZHOODVHPSLULFDONQRZOHGJHFDSWXUHGLQSDWWHUQV
RUDQWLSDWWHUQV
    0HWKRGHQJLQHHULQJ0DQ\PHWKRGHQJLQHHULQJDSSURDFKHVDQGWHFKQLTXHVH[LVW:KLFKRQHWRXVH
IRUEXLOGLQJDQ(0PHWKRG".HHSLQJLQPLQGWKDWWKHPHWKRGVKRXOGILWWKHRUJDQL]DWLRQDOFRQWH[WDQG
QHHGVZKLFKHYROYHRYHUWLPHZHVHHWZRSRVVLELOLWLHV  EXLOGLQJRQWKHIO\RU  WDLORULQJRIDFRUH
(0PHWKRG"%RWKDSSURDFKHVDUHEDVHGRQWKHSULQFLSOHRIPRGXODUL]DWLRQ$PHWKRGLVYLHZHGDVD
FRPSRVLWLRQRIPHWKRGFRPSRQHQWVZKLFKFDQGEHDGGHGDQGRUUHPRYHGGHSHQGLQJRQWKHVLWXDWLRQ
DQGFXUUHQWQHHGV7KDWVXSSRUWVFRQWLQXRXVPHWKRGLPSURYHPHQW&RPSRQHQWEDVHGDSSURDFKHVDOVR
VXSSRUWLQFUHPHQWDOPHWKRGGHYHORSPHQWZKHUHPHWKRGH[WHQVLRQVFDQEHGRQHDWDQ\WLPHWKH\GR
QRW QHHG WR EH SODQQHG LQ DGYDQFH 7R EXLOG DQ (0 PHWKRG ERWK PHWKRG HQJLQHHULQJ DQG (0
NQRZOHGJHDQGH[SHUWLVHDUHUHTXLUHG
    $XWRPDWLRQ$WRROVXSSRUWLVQHFHVVDU\DWERWKOHYHOVPHWKRGHQJLQHHULQJDQGPHWKRGDSSOLFDWLRQ
$PHWKRGHQJLQHHULQJSODWIRUPLVH[SHFWHGWRKHOSIRUPDOO\GHILQHPHWKRGVSRWHQWLDOO\E\UHXVLQJDQG
                                                       84
DGDSWLQJH[LVWLQJPHWKRGFRPSRQHQWVDQGWRVXSSRUWWKHLUFRQWLQXRXVHYROXWLRQ6LPLODUO\WRPDNH
WKHPRGHOLQJWDVNHIILFLHQWDQ(0PHWKRGVKRXOGEHVXSSRUWHGE\DGYDQFHGWRROVHDV\WRGHSOR\DQG
WRXVH7KHWRROVPXVWQRWRQO\KHOSWRFUHDWHPRGHOVEXWDOVRYHULI\DQGYDOLGDWHWKHLUFRQVLVWHQF\DQG
TXDOLW\DQGHVWDEOLVKFURVVPRGHODQGFURVVOD\HUOLQNVDQGGHSHQGHQFLHV+HQFHWKHHYROXWLRQRIDQ
(0PHWKRGLPSOLHVWKHHYROXWLRQRIWKHWRROVWKDWVXSSRUWLW
    /HDUQLQJ 1R PHWKRG RU WRRO LV JRLQJ WR FRPSOHWHO\ UHSODFH KXPDQ NQRZOHGJH DQG H[SHULHQFH
HVSHFLDOO\WKDWRIWKHEXVLQHVVGRPDLQ7UDLQLQJLVHVVHQWLDOWRJDLQH[SHUWLVHDQGHIILFLHQF\LQLQWKH
XVHRI(0PHWKRGVDQGWRROV
    6XFFHVV)LQDOO\KRZFDQZHPHDVXUHWKHVXFFHVVRIDPHWKRG",VWKHIDFWWKDWWKHPHWKRGLVXVHG
LQSUDFWLFHVXIILFLHQWWRVD\WKDWLWLVVXFFHVVIXO"1RWKLVLVRQO\DPLQLPXPFULWHULRQIRUDSSUHFLDWLQJ
WKHPHWKRG7RUHDFKWKHVXFFHVVDQ(0PHWKRGVKRXOGGHOLYHUWKHSURPLVHGYDOXHWRWKHVWDNHKROGHUV
DQGSRVVHVVPRVWRIWKHTXDOLW\DVSHFWVKLJKOLJKWHGLQWKLVSDSHU

ϲ͘ ZĞĨĞƌĞŶĐĞƐ

>@ 0 /DQNKRUVW HG  (QWHUSULVH $UFKLWHFWXUH DW :RUN 0RGHOOLQJ&RPPXQLFDWLRQ DQG $QDO\VLV
     7KH      (QWHUSULVH     (QJLQHHULQJ       6HULHV  6SULQJHU    %HUOLQ    +HLGHOEHUJ     
     KWWSVGRLRUJ
>@ %YDQ*LOV+$3URSHU(QWHUSULVH0RGHOOLQJLQWKH$JHRI'LJLWDO7UDQVIRUPDWLRQ,Q5REHUW
     %XFKPDQQ $ .DUDJLDQQLV ' .LULNRYD 0 HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0
     /1%,3YRO6SULQJHU&KDPSS
>@ :2SSUHFKW-5DO\WpDQG0/pRQDUG07RZDUGVD)UDPHZRUNIRU(QWHUSULVH,QIRUPDWLRQ
     6\VWHP (YROXWLRQ 6WHHULQJ ,Q )UDQN 8 /RXFRSRXORV 3 3DVWRU 2 3HWURXQLDV , HGV  7KH
     3UDFWLFHRI(QWHUSULVH0RGHOLQJ3R(0/1%,3YRO6SULQJHU%HUOLQ+HLGHOEHUJSS
     
>@ .6DQGNXKO-6WLUQD)+RO]0RGHOLQJ3URGXFWVDQG6HUYLFHVZLWK(QWHUSULVH0RGHOV,Q*UDELV
     - %RUN ' HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU
     &KDPSSKWWSVGRLRUJB
>@ 895LVV+0DXV6-DYDLG&-LOHN'LJLWDO7ZLQVRIDQ2UJDQL]DWLRQIRU(QWHUSULVH0RGHOLQJ
     ,Q*UDELV-%RUN' HGV 7KH3UDFWLFHRI(QWHUSULVH0RGHOLQJ3R(0/1%,3YRO
     6SULQJHU&KDPSSKWWSVGRLRUJB
>@ . 6DQGNXKO - 6WLUQD $ 3HUVVRQ 0 :L‰RW]NL (QWHUSULVH 0RGHOLQJ 7DFNOLQJ %XVLQHVV
     &KDOOHQJHVZLWKWKH(00HWKRGVWHG7KH(QWHUSULVH(QJLQHHULQJ6HULHV6SULQJHU%HUOLQ
     +HLGHOEHUJKWWSVGRLRUJ
>@ % +HQGHUVRQ6HOOHUV - 5DO\Wp 3 JHUIDON DQG 0 5RVVL 6LWXDWLRQDO 0HWKRG (QJLQHHULQJ
     6SULQJHUKWWSVGRLRUJ
>@ - 5DO\Wp 5  'HQHFNqUH & 5ROODQG 7RZDUGV D *HQHULF 0RGHO IRU 6LWXDWLRQDO 0HWKRG
     (QJLQHHULQJ ,Q 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ $GYDQFHG ,QIRUPDWLRQ
     6\VWHPV(QJLQHHULQJ&$,6((GHU-DQG0LVVLNRII0 HGV /1&6YRO6SULQJHU
     9HUODJSS
>@ +: 1LVVHQ 0$ -HXVIHOG 0 -DUNH *9 =HPDQHN + +XEHU 0DQDJLQJ 0XOWLSOH
     5HTXLUHPHQWV3HUVSHFWLYHVZLWK0HWDPRGHOV,(((6RIWZDUHSS
>@'%RUN5$%XFKPDQQ'.DUDJLDQQLV3UHVHUYLQJ0XOWLYLHZ&RQVLVWHQF\LQ'LDJUDPPDWLF
     .QRZOHGJH5HSUHVHQWDWLRQ,Q,QWHUQDWLRQDOFRQIHUHQFHRQ.QRZOHGJH6FLHQFH(QJLQHHULQJDQG
     0DQDJHPHQW6SULQJHU&KDPSS
>@.6$QGHUVHQ([SORULQJ0RGHO4XDOLW\LQ(QWHUSULVH0RGHOLQJ$&DVH6WXG\0DVWHU7KHVLV
     1718KWWSVQWQXRSHQQWQXQRQWQX[POXLKDQGOH
>@'/0RRG\0HWULFVIRU(YDOXDWLQJWKH4XDOLW\RI(QWLW\5HODWLRQVKLS0RGHOV,Q/LQJ7:5DP
     6/L/HH0 HGV &RQFHSWXDO0RGHOLQJ±(5¶(5/1&6YRO6SULQJHU%HUOLQ
     +HLGHOEHUJKWWSVGRLRUJB
>@-.URJVWLH0RGHO%DVHG'HYHORSPHQWDQG(YROXWLRQRI,QIRUPDWLRQ6\VWHPV6SULQJHU/RQGRQ
     
>@-6WLUQDDQG$3HUVVRQ(QWHUSULVH0RGHOLQJ)DFLOLWDWLQJWKH3URFHVVDQGWKH3HRSOH6SULQJHU
     &KDP
                                                    85
>@$=DYDOD%++DVV7KH$UWDQG3RZHURI)DFLOLWDWLRQ5XQQLQJ3RZHUIXO0HHWLQJV0DQDJH
     PHQW&RQFHSWV9LHQQD
>@'-XJHO0RGHOLQJ,QWHUDFWLYH(QWHUSULVH$UFKLWHFWXUH9LVXDOL]DWLRQV$Q([WHQGHG$UFKLWHFWXUH
     'HVFULSWLRQ&RPSOH[6\VWHPV,QIRUPDWLFVDQG0RGHOLQJ4XDUWHUO\&6,04QRSS±
     KWWSVGRLRUJFVLPT
>@$3HUVVRQ(QWHUSULVH0RGHOOLQJ,Q3UDFWLFH6LWXDWLRQDO)DFWRUVDQG7KHLU,QIOXHQFHRQ$GRSWLQJ
     D3DUWLFLSDWLYH$SSURDFK3K'WKHVLV'HSDUWPHQWRI&RPSXWHUDQG6\VWHPV6FLHQFHV6WRFNKROP
     8QLYHUVLW\
>@- 6WLUQD 7KH ,QIOXHQFH RI ,QWHQWLRQDO DQG 6LWXDWLRQDO )DFWRUV RQ (QWHUSULVH 0RGHOOLQJ 7RRO
     $FTXLVLWLRQLQ2UJDQLVDWLRQV3K'7KHVLV'HSDUWPHQWRI&RPSXWHUDQG6\VWHPV6FLHQFHV5R\DO
     ,QVWLWXWHRI7HFKQRORJ\6WRFNKROP6ZHGHQ,661
>@$9*XPHURY0.%LNWHPLURYD601XU\\DNKPHWRYD5(0RLVHHY$%1LNRODHYD55
     .KDULVRYD935XNRPRLQLNRYD4XDOLW\)XQFWLRQV0RGHOLQJRI,QGXVWULDO(QWHUSULVHV3URGXFWV
     ,QWHUQDWLRQDO5HYLHZRI0DQDJHPHQWDQG0DUNHWLQJ9RO  
>@7KH &RQFLVH 'HILQLWLRQ RI 7KH =DFKPDQ )UDPHZRUN E\ -RKQ $ =DFKPDQ
     KWWSVZZZ]DFKPDQFRPDERXWWKH]DFKPDQIUDPHZRUN
>@7KH72*$)Š6WDQGDUGKWWSVZZZRSHQJURXSRUJWRJDI
>@,%LGHU(3HUMRQV'%RUN7RZDUGV2Q7KH)O\&UHDWLRQRI0RGHOLQJ/DQJXDJH-DUJRQV,Q
     SURFHHGLQJVRIWKHWK,QWHUQDWLRQDO&RQIHUHQFHRQ,&7LQ(GXFDWLRQ5HVHDUFKDQG,QGXVWULDO
     $SSOLFDWLRQV,QWHJUDWLRQ+DUPRQL]DWLRQDQG.QRZOHGJH7UDQVIHU9ROXPH,0DLQ&RQIHUHQFH
     3K' 6\PSRVLXP DQG 3RVWHUV  &(85:6 3URFHHGLQJV 9RO SS  
     KWWSFHXUZVRUJ9RO
>@-6WLUQD-=GUDYNRYLF-*UDELV.6DQGNXKO'HYHORSPHQWRI&DSDELOLW\'ULYHQ'HYHORSPHQW
     0HWKRGRORJ\ ([SHULHQFHV DQG 5HFRPPHQGDWLRQV ,Q 3RHOV * *DLOO\ ) 6HUUDO $VHQVLR (
     6QRHFN 0 HGV  7KH 3UDFWLFH RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU
     &KDPKWWSVGRLRUJB
>@8)UDQN'RPDLQ6SHFLILF0RGHOLQJ/DQJXDJHV5HTXLUHPHQWV$QDO\VLVDQG'HVLJQ*XLGHOLQHV
     ,Q 5HLQKDUW]%HUJHU , HW DO HGV  'RPDLQ (QJLQHHULQJ 6SULQJHU %HUOLQ +HLGHOEHUJ 
     KWWSVGRLRUJB
>@9LWHFK FRUSRUDWLRQ &25( $ 3URYHQ /HJDF\ D 3LRQHHU LQ 0%6(  85/ KWWS&25(
     6RIWZDUH±9LWHFK YLWHFKFRUSFRP 
>@. /DFH 0 .LULNRYD 7KH 0RGHOV IRU .QRZOHGJH $FTXLVLWLRQ LQ 30, 6SHFLILF 5HTXLUHPHQWV
     (QJLQHHULQJ,Q6HUUDO(6WLUQD-5DO\Wp-*UDELV- HGV 7KH3UDFWLFHRI(QWHUSULVH0RGHOLQJ
     3R(0  /1%,3 YRO  6SULQJHU &KDP  KWWSVGRLRUJ
     B
>@'%RUN5$%XFKPDQQ'.DUDJLDQQLV0/HH(70LURQ$Q2SHQ3ODWIRUPIRU0RGHOLQJ
     0HWKRG&RQFHSWXDOL]DWLRQ7KH20L/$%'LJLWDO(FRV\VWHP&RPPXQLFDWLRQVRIWKH$VVRFLDWLRQ
     IRU,QIRUPDWLRQ6\VWHPV
>@3/ *ODVHU ' %RUN 7KH ELJ(5 7RRO  +\EULG 7H[WXDO DQG *UDSKLFDO 0RGHOLQJ RI (QWLW\
     5HODWLRQVKLSV LQ 96 &RGH ,Q WK ,QWHUQDWLRQDO (QWHUSULVH 'LVWULEXWHG 2EMHFW &RPSXWLQJ
     :RUNVKRS('2&:RUNVKRSSS,(((;SORUH
>@16KLORY:2WKPDQ0)HOOPDQQ.6DQGNXKO0DFKLQH/HDUQLQJ%DVHG(QWHUSULVH0RGHOLQJ
     $VVLVWDQFH$SSURDFKDQG3RWHQWLDOV,Q6HUUDO(6WLUQD-5DO\Wp-*UDELV- HGV 7KH3UDFWLFH
     RI (QWHUSULVH 0RGHOLQJ 3R(0  /1%,3 YRO  6SULQJHU &KDP 
     KWWSVGRLRUJB
>@-&5HFNHU5/XN\DQHQNR0-DEEDUL6DEHJK%6DPXHO$&DVWHOODQRV)URPUHSUHVHQWDWLRQ
     WRPHGLDWLRQDQHZDJHQGDIRUFRQFHSWXDOPRGHOLQJUHVHDUFKLQDGLJLWDOZRUOG0,64XDUWHUO\
     0DQDJHPHQW,QIRUPDWLRQ6\VWHPV  
>@:0DDVV9&6WRUH\5/XN\DQHQNR)URP0HQWDO0RGHOVWR0DFKLQH/HDUQLQJ0RGHOVYLD
     &RQFHSWXDO 0RGHOV ,Q $XJXVWR $ HW DO HGV  (QWHUSULVH %XVLQHVV3URFHVV DQG ,QIRUPDWLRQ
     6\VWHPV0RGHOLQJ/1%,3YROSS6SULQJHU&KDP
>@'%RUN$*DUPHQGLD0:LPPHU7RZDUGVD0XOWL2EMHFWLYH0RGXODUL]DWLRQ$SSURDFKIRU
     (QWLW\5HODWLRQVKLS0RGHOV,QSURFHHGLQJVRI(5)RUXP'HPRDQG3RVWHUV&(85:6
     9ROSSKWWSFHXUZVRUJ9RO

                                                     86
>@*0XVVEDFKHU%&RPEHPDOH-.LHQ]OH6$EUDKmR+$OL1%HQFRPR0%~U/%XUJXHxR
     *(QJHOV3-HDQMHDQ-0-p]pTXHO7.KQ60RVVHU+$6DKUDRXL(6\ULDQL'9DUUy
     0:H\VVRZ2SSRUWXQLWLHVLQ,QWHOOLJHQW0RGHOLQJ$VVLVWDQFH6RIWZDUHDQG6\VWHPV0RGHOLQJ
       
>@&)HOWXV40D+$3URSHU3.HOVHQ7RZDUGV$,$VVLVWHG'RPDLQ0RGHOLQJ,QSURFHHGLQJV
     RIWKH,QWHUQDWLRQDO&RQIHUHQFHRQ&RQFHSWXDO0RGHOLQJ(5/1&6YRO6SULQJHU
     &KDPSS
>@$UFKLPDWH6SHFLILFDWLRQKWWSVZZZRSHQJURXSRUJDUFKLPDWHKRPH
>@$UFKL 7KH 2SHQ 6RXUFH PRGHOOLQJ WRRONLW IRU FUHDWLQJ $UFKL0DWH PRGHOV DQG VNHWFKHV
     KWWSVZZZDUFKLPDWHWRROFRP
     
   
   
   
   
   
   
   




                                                 87

</pre>