=Paper= {{Paper |id=Vol-71/paper-9 |storemode=property |title=Human Centred Ontology Management with HCONE |pdfUrl=https://ceur-ws.org/Vol-71/Kotis.pdf |volume=Vol-71 }} ==Human Centred Ontology Management with HCONE== https://ceur-ws.org/Vol-71/Kotis.pdf
                     +XPDQ&HQWHUHG2QWRORJ\0DQDJHPHQWZLWK+&21(

                                  .RQVWDQWLQRV.RWLV*HRUJH$9RXURV
                    'HSDUWPHQWRI,QIRUPDWLRQDQG&RPPXQLFDWLRQV6\VWHPV(QJLQHHULQJ
                                         8QLYHUVLW\RIWKH$HJHDQ
                                     6DPRV.DUORYDVVL*UHHFH
                                        ^NNRWJHRUJHY`#DHJHDQJU
                                                                     
                                                                     
                          $EVWUDFW                                      WKDWDUHUHTXLUHGE\NQRZOHGJHZRUNHUV DQGSURYLGHWKHVH
                                                                         RQWRORJLHV IRU H[SORLWDWLRQ +RZHYHU GXH WR FRQVWDQW
7KH GHYHORSPHQW RI RQWRORJ\ PDQDJHPHQW HQYLURQPHQWV
                                                                         XSGDWLQJFKDQJLQJDQGHYROXWLRQRIRQWRORJLHVWKHUHPXVW
WKDW HPSRZHU FRPPXQLWLHV RI NQRZOHGJH ZRUNHUV WR VKDSH
                                                                         EH D FORVH FROODERUDWLRQ EHWZHHQ NQRZOHGJH HQJLQHHUV DQG
WKHLU LQIRUPDWLRQ VSDFH E\ EHLQJ DFWLYHO\ LQYROYHG LQ WKH
                                                                         ZRUNHUV UHTXLULQJ WKH DFWLYH DQG GHFLVLYH LQYROYHPHQW RI
RQWRORJ\ HQJLQHHULQJ OLIHF\FOH LV HPHUJLQJ 7KLV LV
                                                                         WKH ODWWHU LQ PDQ\ VWDJHV RI WKH RQWRORJ\ PDQDJHPHQW
PRWLYDWHGE\WKHQHHGWRLQFRUSRUDWHRQWRORJ\PDQDJHPHQW
                                                                         SURFHVVHV>6WRMDQRYLF@
WDVNV LQ NQRZOHGJHHPSRZHUHG RUJDQL]DWLRQV DQG WKH QHHG
                                                                            ,Q FRQMXQFWLRQ WR WKH DERYH WKH SUROLIHUDWLRQ RI WKH
WR SRSXODWH WKH VHPDQWLF ZHE ZLWK DJHQWV H[SORLWLQJ
                                                                         VHPDQWLF ZHE DLPV DW H[SOLFDWLQJ WKH PHDQLQJ RI WKH
VHPDQWLFDOO\ DQQRWDWHG LQIRUPDWLRQ LWHPV 7RZDUGV WKLV             ZRUOGZLGH DYDLODEOH LQIRUPDWLRQ 2QWRORJLHV FRQVWLWXWH WKH
WDUJHW ZH DLP DW RQWRORJ\ PDQDJHPHQW HQYLURQPHQWV WKDW           EDFNERQH RI WKLV HIIRUW SURYLGLQJ PDFKLQHH[SORLWDEOH
IRFXV WR WKH ZD\ SHRSOH LQWHUDFW ZLWK WKHLU                      VHPDQWLFLQIRUPDWLRQIRUWKH.QRZOHGJH:HE>)HQVHOHWDO
FRQFHSWXDOLVDWLRQV DQG WR WKH ZD\ FRQFHSWXDOLVDWLRQV DUH          @ %XW KRZ FRXOG ZH SRVVLEO\ SRSXODWH WKH VHPDQWLF
IRUPHG DV SDUW RI WKH GD\WRGD\ DFWLYLWLHV RI NQRZOHGJH        ZHE HQDEOLQJ LQIRUPDWLRQ SURYLGHUV WR DWWDFK VHPDQWLF
ZRUNHUV  7KH SDSHU SRLQWV RQ LPSRUWDQW LVVXHV IRU WKH         LQIRUPDWLRQWRHYHU\SXEOLVKHGLQIRUPDWLRQLWHPVKDSLQJLQ
GHYHORSPHQW RI KXPDQFHQWHUHG HQYLURQPHQWV IRU WKH                 FRQMXQFWLRQ WKHLU FRQVHQVXDO FRQFHSWXDOLVDWLRQV" &XUUHQW
PDQDJHPHQWRIRQWRORJLHVDQGSUHVHQWVDSURWRW\SHV\VWHP               HIIRUWVVXSSRUWWKHVHPLDXWRPDWLFDQGPDQXDOVWUXFWXULQJRI
+&21( +XPDQ &HQWHUHG 2QWRORJ\ 0DQDJHPHQW                            ZHE SDJHV XVLQJ RQWRORJLHV LQ FRQMXQFWLRQ WR RQWRORJ\
(QYLURQPHQW  ZKLFK KDV EHHQ GHVLJQHG ZLWK WKH DLP WR           OHDUQLQJDQGHQULFKPHQW HJ>(UGPDQHWDO0DHGFKH
DGGUHVVWKHVHLVVXHV                                                   HWDO@ ,QFRQMXQFWLRQWRWKHVHWHFKQRORJLHVZHQHHG
                                                                         WRROV WKDW ZRXOG HPSRZHU SHRSOH WR GHYHORS DQG PDQDJH
,QWURGXFWLRQ                                                         RQWRORJLHV LQ D VHDPOHVV DQG WUDQVSDUHQW ZD\ ZLWKRXW
2QWRORJLHV DUH IRUPDO FRQFHSWXDOL]DWLRQV RI GRPDLQV               ERWKHULQJ ZLWK WKH IRUPDOLWLHV DQG V\PEROOHYHO GHWDLOV RI
GHVFULELQJ WKH PHDQLQJ RI DEVWUDFW DQG FRQFUHWH  GRPDLQ          VSHFLILFDWLRQV
DVSHFWV E\ PHDQV RI FRQFHSWV DQG WKHLU LQWHUUHODWLRQV               ,Q WKLV SDSHU ZH FRQMHFWXUH WKDW LQ SDUDOOHO WR UHVHDUFK
>&KDQGUDVHNDUDQHWDO@2QWRORJLHVKDYHEHHQUHDOL]HG             HIIRUWV FRQFHUQLQJ PHWKRGV DQG WHFKQLTXHV IRUHQJLQHHULQJ
DVWKHNH\WHFKQRORJ\WRVKDSLQJDQGH[SORLWLQJLQIRUPDWLRQ             OHDUQLQJ DQG HQULFKLQJ RQWRORJLHV WKH QHHG IRU WRROV WKDW
IRU WKH HIIHFWLYH PDQDJHPHQW RI NQRZOHGJH DQG IRU WKH           ZRXOGHPSRZHUSHRSOHWRPLQLPL]HWKHXSIURQWNQRZOHGJH
HYROXWLRQ RI WKH 6HPDQWLF :HE 2QWRORJLHV HVWDEOLVK D            HQJLQHHULQJHIIRUWDQGDFFHOHUDWHWKHNQRZOHGJHSURFHVVHVLV
FRPPRQ YRFDEXODU\ IRU FRPPXQLW\ PHPEHUV WR LQWHUOLQN             JUHDW 7RZDUGV WKLV DLP ZH DGRSW D KXPDQFHQWHUHG
FRPELQH DQG FRPPXQLFDWH NQRZOHGJH VKDSHG WKURXJK                  DSSURDFK WR GHVLJQLQJ DQG GHYHORSLQJ RQWRORJ\
SUDFWLFH DQG LQWHUDFWLRQ DPRQJ FRPPXQLW\ PHPEHUV                  PDQDJHPHQW HQYLURQPHQWV   6XFK HQYLURQPHQWV PXVW
ELQGLQJ WKH NQRZOHGJH SURFHVVHV RI FUHDWLQJ LPSRUWLQJ           VXSSRUW ³NQRZOHGJH ZRUNHUV´ WR VKDSH WKHLU LQIRUPDWLRQ
FDSWXULQJ UHWULHYLQJ DQG XVLQJ NQRZOHGJH >6WDDE HW DO         VSDFH E\ EHLQJ DFWLYHO\ LQYROYHG LQ RQWRORJ\ PDQDJHPHQW
%HQMDPLQVHWDO@                                          WDVNVWKURXJKRXWWKHRQWRORJ\HQJLQHHULQJOLIHF\FOH
   7KH LQFRUSRUDWLRQ RI RQWRORJ\ PDQDJHPHQW WDVNV LQ
NQRZOHGJHHPSRZHUHG RUJDQL]DWLRQV FDQ SURYH WR EH D
KLQGUDQFHLIQRWGRQHLQDZD\WKDWLVVHDPOHVVWRWKHGD\WR           
GD\ DFWLYLWLHV RI WKH FRPPXQLW\ PHPEHUV  >9RXURV @           $ NQRZOHGJH ZRUNHU LV DQ\ PHPEHU RI DQ LQIRUPDWLRQ
7UDGLWLRQDOO\ NQRZOHGJH HQJLQHHUV GHYHORS WKH RQWRORJLHV          SURGXFWLRQH[SORLWDWLRQ FRPPXQLW\ 6XFK FRPPXQLWLHV PD\
                                                                         LQYROYHZRUNHUVZLWKLQDQRUJDQL]DWLRQRU:RUOG:LGH:HEXVHUV
                                                                         ZLWKFRPPRQLQWHUHVWV
   7RIXUWKHUVXSSRUWRXUFRQMHFWXUHIRUWKHQHHGIRUKXPDQ              2QWRORJ\ PDQDJHPHQW LQ WKH FRQWH[W RI FRPPXQLWLHV RI
FHQWHUHG WRROV OHW XV FRQVLGHU WKH IROORZLQJ RQWRORJ\         NQRZOHGJH ZRUNHUV LQYROYHV WKH GHYHORSPHQW HYDOXDWLRQ
PDQDJHPHQWVFHQDULRVLQDOLYLQJRUJDQL]DWLRQVHWWLQJ                DQGH[SORLWDWLRQRIFRQFHSWXDOL]DWLRQVWKDWHPHUJHDVSDUWRI
   6FHQDULR 1R  ,QYROYHG LQ D NQRZOHGJH UHWULHYDO            NQRZLQJ,QSDUWLFXODULWLQYROYHV
SURFHVV D ZRUNHU LV VHDUFKLQJ IRU D VSHFLILF SLHFH RI       x 7KHGHYHORSPHQWRILQGLYLGXDORQWRORJLHV3HRSOHGHYHORS
LQIRUPDWLRQDERXWEHVWSUDFWLFHVFRQFHUQLQJWKHGHVLJQRID           WKHLU RZQ FRQFHSWXDOL]DWLRQV WKDW PD\ HLWKHU H[SOLFDWH HJ
SURGXFW W\SH 7KH UHWULHYDO WRRO H[SORLWV WKH RQWRORJ\         E\ IRUPDOL]LQJ FRQFHSWV E\ WDNLQJ QRWHV DERXW WKHLU
FRQFHUQLQJSURGXFWGHVLJQVEXWWKHZRUNHUFDQQHLWKHUILQG           PHDQLQJRUMXVWE\QDPLQJWKHP RUQRW E\VWRULQJWKHPLQ
WKHWHUPVWKDWVKHWKLQNVWREHDSSURSULDWHIRUTXHU\LQJWKH          WKH EDFNJURXQG RI WKHLU PLQGV ,QWKHLUGD\WRGD\DFWLYLW\
V\VWHP QRU FDQ VKH JHW WKH QHHGHG LQIRUPDWLRQ E\ DQ\        SHRSOH GHYHORS WKHLU FRQFHSWXDOL]DWLRQV HLWKHU E\
FRPELQDWLRQ RI H[LVWLQJ WHUPV 6KH VRRQ ILQGV RXW WKDW WKH   LPSURYLVLQJ E\ VSHFLDOL]LQJJHQHUDOL]LQJDJJUHJDWLQJ
GHILQLWLRQV RI VRPH WHUPV PXVW EH FKDQJHG WR UHIOHFW WKH     H[LVWLQJ FRQFHSWV EDVHG RQ WKHLU H[SHULHQFHV DQG RQ
LQIRUPDWLRQUHODWHGWRWKHQHZFDVHDWKDQG7KHLQIRUPDWLRQ          LQWHUDFWLRQ ZLWK RWKHU FRPPXQLW\ PHPEHUV RU E\
LVWKHUHEXWFDQQRWEHUHDFKHGVLQFHWKHRQWRORJ\GRHVQRW          V\QWKHVL]LQJH[LVWLQJFRQFHSWXDOL]DWLRQV
UHIOHFW WKH XSWRGDWH SUDFWLFH RI WKH RUJDQL]DWLRQ ,PDJLQH   x 7KH GHYHORSPHQW RI FRPPRQO\ DJUHHG JURXS RQWRORJLHV
QRZWKHVDPHFDVHKDSSHQLQJIRUILYHZRUNHUVSHUGD\LQD             'HYHORSLQJ FRPPRQO\ DJUHHG DQG XQGHUVWDQGDEOH
IDVW FKDQJLQJ GRPDLQ :H VXJJHVW WKDW ZRUNHUV PXVW EH         RQWRORJLHV LV D YHU\ GLIILFXOW DQG UHVRXUFHGHPDQGLQJ WDVN
HPSRZHUHG WR VKDSH WKHLU LQIRUPDWLRQ VSDFH SRVVLEO\            WKDW UHTXLUHV PHPEHUV RI WKH FRPPXQLWLHV WR ZRUN
ZRUNLQJLQFROODERUDWLRQZLWKNQRZOHGJHHQJLQHHUV                   V\QHUJLVWLFDOO\WRZDUGVVKDSLQJWKHLQIRUPDWLRQWKH\H[SORLW
   6FHQDULR 1R  ,Q D NQRZOHGJH XVH SURFHVV D ZRUNHU       :RUNLQJ       V\QHUJLVWLFDOO\      ZRUNHUV     PDS    RWKHUV¶
EURZVHVUHFDOOVH[LVWLQJNQRZOHGJHLWHPVDQGSURFHVVWKHP           FRQFHSWXDOL]DWLRQVWRWKHLURZQDQGSXWWKHPLQWKHFRQWH[W
IRUIXUWKHUXVH'XULQJWKLVSURFHVVWKHZRUNHUPD\SURGXFH           RI WKHLU RZQ H[SHULHQFHV 7KLV OHDGV WR D FRQYHUVDWLRQ
GHULYDWLRQV WKDW VKRXOG EH FDSWXUHG DV QHZ NQRZOHGJH          ZKRVHEDFNDQGIRUWKDVLWLVSRLQWHGLQ>&RRNDQG%URZQ
LQGH[HG E\ QHZ WHUPV RU FRPELQDWLRQV RI H[LVWLQJ WHUPV      @QRWRQO\UHVXOWVLQH[FKDQJLQJNQRZOHGJHEXWDOVRLQ
&DSWXULQJ GHULYHG NQRZOHGJH LV YHU\ LPSRUWDQW                   JHQHUDWLQJQHZNQRZOHGJH
(PSRZHULQJ WKLV ZRUNHU ZLWK WKH SURSHU WRROV IRU               x 7KH HYDOXDWLRQ DQG H[SORLWDWLRQ RI RQWRORJLHV
GHVFULELQJ KHU FRQFHSWLRQV IRUPDOO\ LQFRUSRUDWLQJ WKHP LQ      ([SORLWDWLRQDQGHYDOXDWLRQRIRQWRORJLHVDVSDUWRIWKHGD\
RUJDQL]DWLRQ¶V LQIRUPDWLRQ UHSRVLWRU\ VXEPLWWLQJ DQG             WRGD\ SUDFWLFH RI FRPPXQLWLHV FDQ EH FRQVLGHUHG RQO\ DV
VKDULQJWKLVLQIRUPDWLRQZLWKFRZRUNHUVUHDGLO\DFFHOHUDWHV         SDUWRINQRZLQJ&RQFHSWXDOL]DWLRQVDUHSXWLQSUDFWLFHRULQ
PXFKWKHNQRZOHGJHSURFHVVHV                                         WKH FULWLFLVP RI FRPPXQLW\ PHPEHUV ZKR DV DOUHDG\
   6FHQDULR 1R  ,Q GD\WRGD\ LQIRUPDWLRQ FUHDWLRQ DQG       SRLQWHG KDYH WR FRPSDUH WKHP ZLWK WKHLU RZQ
LPSRUW WDVNV ZRUNHUV DUH GHYLVLQJ EXVLQHVV GRFXPHQWV          FRQFHSWXDOL]DWLRQVDQGSXWWKHPLQWKHFRQWH[WRIWKHLURZQ
SURSRVDOV SURGXFW UHSRUWV EHVW SUDFWLFHV SUREOHPIDXOW        H[SHULHQFHV (YDOXDWLRQ FDQ UHVXOW LQ QHZ PHDQLQJV VLQFH
UHSRUWV HWF ,QGH[LQJ VXFK LQIRUPDWLRQ XVLQJ IRUPDO            FRQFHSWV DUH VHHQ XQGHU WKH OLJKW RQ QHZ H[SHULHQFHV DQG
RQWRORJLFDOFRPPLWPHQWVVKRXOGEHGRQHLQDVHDPOHVVZD\              HYROYLQJFRQWH[WV
E\ NQRZOHGJH ZRUNHUV WKHPVHOYHV GXULQJ DXWKRULQJ                  ,PSHGLPHQWV IRU NQRZOHGJH ZRUNHUV WR SDUWLFLSDWH
DOORZLQJ WKHP WR GHYLVH H[SDQG DQG XSGDWH WKHLU VKDUHG       DFWLYHO\ LQ WKHVH WDVNV LQFOXGH WKHLU XQIDPLOLDULW\ ZLWK
FRQFHSWXDOLVDWLRQVDWWKHVDPHWLPH                                 IRUPDO      ODQJXDJHV       DQG     NQRZOHGJH      HQJLQHHULQJ
   6XPPDUL]LQJ WKH DERYH WKLV SDSHU HPSKDVL]HV RQ              SULQFLSOHVPHWKRGVDVZHOODVZLWKPHWKRGVDQGWHFKQLTXHV
GHYLVLQJHQYLURQPHQWVWKDWIRFXVWRWKHZD\SHRSOHLQWHUDFW           IRU FRQVWUXFWLQJ DQG V\QWKHVL]LQJ RQWRORJLHV 0RVW RI WKH
DQG VKDSH WKHLU FRQFHSWXDOLVDWLRQV DQG WR WKH ZD\              H[LVWLQJ RQWRORJ\ PDQDJHPHQW HQYLURQPHQWV KDYH EHHQ
FRQFHSWXDOLVDWLRQVDUHIRUPHGDVSDUWRINQRZOHGJHZRUNHUV            GHVLJQHG DQG LPSOHPHQWHG IRU WKH NQRZOHGJH HQJLQHHU
FRPPXQLWLHV¶ GD\WRGD\ DFWLYLWLHV >7HQQLVRQ HW DO @      FRQFHQWUDWLQJ PRVWO\ RQ WKH RQWRORJ\ GHYHORSPHQW SURFHVV
7KH SDSHU SUHVHQWV LPSRUWDQW LVVXHV IRU VXFK HQYLURQPHQWV      DW WKH V\PERO OHYHO 7KLV LPSOLHV WKDW WKH GHSOR\PHQW RI
DQGSUHVHQWVWKHRYHUDOODUFKLWHFWXUHDQGIXQFWLRQDOLWLHVRID        WKHVHHQYLURQPHQWVLQRUJDQL]DWLRQVZLWKOLPLWHGH[SHULHQFH
KXPDQFHQWUHG HQYLURQPHQW IRU RQWRORJ\ HQJLQHHULQJ               LQ RQWRORJLHV LV HVVHQWLDOO\ SURKLELWHG OHDGLQJFRPPXQLWLHV
 +&21(  ZKLFK KDV EHHQ GHVLJQHG DQG LPSOHPHQWHG               WRGHYHORSVHPDQWLFDOO\SRRUWKHVDXUXVHVIRUWKHLUGRPDLQV
EDVHGRQWKHVHUHTXLUHPHQWV                                         RU HYHQ DEDQGRQLQJ WKH WULDO IRU VHPDQWLFDOO\ DQQRWDWLQJ
                                                                       WKHLU UHVRXUFHV VLQFH LQ PRVW RI WKH FDVHV WKH\ DUH QRW
0DQDJHPHQWRIRQWRORJLHV                                           ZLOOLQJ WR SD\ WKH FRVWV LPSOLHG E\ HPSOR\LQJ NQRZOHGJH
$V LW LV ZLGHO\ DUJXHG DQG VKRZQ LQ WKH DERYH VFHQDULRV    HQJLQHHULQJUHVRXUFHV
RQWRORJLHV H[SOLFDWH FRQFHSWXDOL]DWLRQV WKDW DUH VKDSHG DQG        /HDGLQJ WRROV IRU RQWRORJ\ HQJLQHHULQJ >2172:(%
H[SORLWHG E\ KXPDQV GXULQJ SUDFWLFH %HLQJ SDUW RI             @ HPSOR\ SRZHUIXO PHWKRGV IRU PDQLSXODWLQJ
NQRZOHGJH WKDW SHRSOH SRVVHVV RQWRORJLHV HYROYH LQ             RQWRORJLHV EXW PRVWO\ DW WKH V\PERO OHYHO 7R HPSRZHU
FRPPXQLWLHVDVSDUWRINQRZLQJ>&RRNDQG%URZQ@               NQRZOHGJH ZRUNHUV WR SDUWLFLSDWH DFWLYHO\ LQ WKH RQWRORJ\
                                                                       HQJLQHHULQJ SURFHVV LQ FROODERUDWLRQ ZLWK NQRZOHGJH
HQJLQHHUV WRROV PXVW HQDEOH SHRSOH WR LPSURYLVH QHZ             DSSURSULDWH FRQWH[WV &RQWH[W LQYROYHV RUJDQL]DWLRQV
RQWRORJLHV V\QWKHVL]H DQG PDS H[LVWLQJ RQWRORJLHV DQG           DFWLYLWLHV SUDFWLFHV QRUPV DQGFRQVWUDLQWVWKDWDUHLQKHUHQW
FROODERUDWLYHO\GHYHORSRQWRORJLHVZLWKWKHLUFRZRUNHUVLQ            LQ WKHVH DFWLYLWLHV SROLFLHV SURFHGXUHV DV ZHOO DV GHYLFHV
ZD\V WKDW DUH QDWXUDO IRU WKHP WR LQWHUDFW ZLWK WKHLU          DQG PHGLD WKDW SHRSOH XVH IRU FRPPXQLFDWLQJ DQG GRLQJ
FRQFHSWXDOL]DWLRQV 7KLV PXVW KDSSHQ LQ WKH EDFNJURXQG RI        WKHLUZRUN
WKHGD\WRGD\NQRZOHGJHLQWHQVLYHDFWLYLWLHVRIZRUNHUVLQ               9LHZLQJ        SHRSOH       DFWLYLWLHV     IRU      PDQDJLQJ
D VHDPOHVV ZD\ WR WKHLU ZRUNLQJ SUDFWLFHV DQG VR WKDW WKH    FRQFHSWXDOL]DWLRQV RI GRPDLQV ZLWKLQ WKH FRQWH[W RI
VHPDQWLFYDOLGLW\RIVSHFLILFDWLRQVLVDVVXUHG7RROVWKDWDUH          HPHUJHQWFRPPXQLWLHVZHVKDOOQRWIRFXVRQREMHFWFHQWHUHG
FORVH WR RXU DLPV DW VXSSRUWLQJ NQRZOHGJH ZRUNHUV WR            UHSUHVHQWDWLRQ IRUPDOLVPV RU RQ RWKHU WHFKQRORJLFDO LVVXHV
GHYHORSPDQDJH RQWRORJLHV SRVVLEO\ LQ WKH DEVHQFH RI             EXWSXWVSHFLDOHPSKDVLVRQWKHSK\VLFDOZD\RILQWHUDFWLQJ
NQRZOHGJH HQJLQHHUV LQFOXGH $3(&.6 >7HQQLVRQ HW DO              ZLWK WKHVH FRQFHSWXDOL]DWLRQV DQG RQ WKH ZD\
@ DQG :HE2'( >$USLUH] HW DO @ $3(&.6                   FRQFHSWXDOL]DWLRQV DUH IRUPHG E\ PHDQV RI SHRSOH
VXSSRUWV ³OLYLQJ´ RQWRORJLHV DOORZLQJ GLVFXVVLRQ DQG              LQWHUDFWLQJDPRQJWKHPVHOYHVDQGSUDFWLFLQJ
HYDOXDWLRQ RI WKH HYROYLQJ GRPDLQ FRQFHSWXDOL]DWLRQV                 7KLV VHFWLRQ SRLQWV RQ LPSRUWDQW LVVXHV IRU WKH
:HE2'( RIIHUV DQ H[WHQVLEOH ZRUNEHQFK WR RQWRORJ\                 GHYHORSPHQW RI KXPDQFHQWHUHG HQYLURQPHQWV IRU WKH
PDQDJHPHQW EDVHG RQ D ZHOOGHILQHG PHWKRGRORJ\ IRU               PDQDJHPHQW RI RQWRORJLHV 7KH OLVW LV E\ QR PHDQV
RQWRORJ\ GHYHORSPHQW +RZHYHU ERWK WRROV ODFN LPSRUWDQW          FRPSOHWH+RZHYHULWSRLQWVRQLVVXHVWKDWZHFRQVLGHUWREH
IDFLOLWLHV IRU PDQDJLQJ WKH HYROXWLRQ RI RQWRORJLHV VXFK DV    WKHPRVWLPSRUWDQW
YHUVLRQPDQDJHPHQWDQGRQWRORJLHVOLEUDULHV                           x 3URYLGH WKH WRROV QHHGHG IRU WKH PDQDJHPHQW RI
   ,Q D JUHDWHU H[WHQG WKDQ H[LVWLQJ WRROV ZH HPSKDVL]H DW    RQWRORJLHVLQDQHFOHFWLFZD\0HPEHUVRIWKHFRPPXQLWLHV
SURYLGLQJJUHDWHU³RSSRUWXQLWLHV´IRUV\VWHPVDQGWRROVWREH           PXVW EH DOORZHG WR IROORZ DQ\ DSSURDFK RUFRPELQDWLRQRI
XVHGE\PHPEHUVRINQRZOHGJHPDQDJHPHQWRUJDQL]DWLRQDO                  DSSURDFKHVIRUWKHGHYHORSPHQWRIRQWRORJLHVZKLFKEHWWHU
XQLWV LQ WKHLU GD\WRGD\ DFWLYLWLHV SURSRVLQJ WKH GHVLJQ RI   ILWVWKHLUSUDFWLFHWKHLUZRUNLQJQRUPVDQGFRQVWUDLQWV7KH\
LQWHJUDWHG RQWRORJ\ PDQDJHPHQW HQYLURQPHQWV XVLQJ                   PD\ LPSURYLVH E\ LQWHJUDWLQJ FRQFHSWV LQ D FRQFHSWXDO
KXPDQFHQWHUHGGHVLJQSULQFLSOHV>+RIIPDQHWDO@                V\VWHPSURYLGHFRQFHSWVZLWKLQIRUPDOGHILQLWLRQVDWWDFKLQJ
   7KH SDSHU SUHVHQWV D KXPDQFHQWHUHG RQWRORJ\                    LQIRUPDWLRQ LWHPV WR WKHP FRPSDUH PHUJH DQG
PDQDJHPHQWHQYLURQPHQW +&21( WKDWSURYLGHVDGYDQFHG                   UHILQHJHQHUDOL]HH[LVWLQJRQWRORJLHV,QWKLVUHVSHFWYHUVLRQ
IXQFWLRQDOLWLHVIRUHGLWLQJYLHZLQJPDQDJLQJWKHHYROXWLRQ           PDQDJHPHQWDQGOLEUDULHVRIRQWRORJLHVPXVWSURYLGHSHRSOH
UHDVRQLQJLQWHJUDWLQJRQWRORJLHVDQGPDSSLQJRQWRORJLHVWR            ZLWK WKH DELOLW\ WR NHHS WUDFN RI FKDQJHV LQ WKHLU
XSSHUOHYHO WRS  RQWRORJLHV DQG OH[LFRQV SXWWLQJ HPSKDVLV        FRQFHSWXDOL]DWLRQV
RQ WKH ZD\ KXPDQV LQWHUDFW ZLWK WKHLU FRQFHSWXDOLVDWLRQV         x 6XSSRUW SHRSOH WR FRPPXQLFDWH WKHLU FRQFHSWXDOL]DWLRQV
DQG RQ WKH ZD\ JURXSV UHDFK WR DQ DJUHHPHQW RQ GRPDLQ         ZLWKRXW GHDOLQJ ZLWK ORZOHYHO LPSOHPHQWDWLRQ GHWDLOV 7KH
FRQFHSWXDOLVDWLRQV 9LHZLQJ RQWRORJ\ PDQDJHPHQW IURP                PDMRU LVVXH IRU KXPDQFHQWHUHG RQWRORJ\ PDQDJHPHQW LV
WKLVSRLQWZHUHYHDO´RSSRUWXQLWLHVIRUXVLQJWKHWHFKQRORJ\           WKDW ORZ OHYHO LPSOHPHQWDWLRQ GHWDLOV PXVW EH KLGGHQ IURP
WKDW ZH QHYHU FRQVLGHUHG´ >&ODQFH\ @ SURYLGLQJ DOVR        SHRSOH ZKR GR QRW XQGHUVWDQG NQRZOHGJH UHSUHVHQWDWLRQ
LQVLJKWV IRU WHFKQRORJLFDO DGYDQFHV LQ PDQDJLQJ DQG               IRUPDOLVPV¶WHUPLQRORJ\3HRSOHPXVWEHJLYHQWKHSRZHUWR
HQJLQHHULQJRQWRORJLHV                                                 H[SUHVV VXEWOH RQWRORJLFDO GLVWLQFWLRQV LQ D ZD\ WKDW LV
                                                                         QDWXUDO WR WKHP EXW VDWLVILHV WKH IRUPDO FRQVWUDLQWV RI WKH
+XPDQFHQWHUHG2QWRORJ\                                              VSHFLILFDWLRQVWRR
0DQDJHPHQW                                                              x 3URYLGH SRZHUIXO UHDVRQLQJ VHUYLFHV IRU FKHFNLQJ
                                                                         VSHFLILFDWLRQV¶FRQVLVWHQF\DQGFRKHUHQF\7KLVLVLPSRUWDQW
+XPDQFHQWHUHGFRPSXWLQJ +&& LVDYLHZSRLQWLQWHQWRQ                 IRU SHRSOH WR GHYHORS ZHOOIRUPHG RQWRORJLHV LH
KHOSLQJ XV DFKLHYH WKH IXOO SRWHQWLDO RI FRPSXWLQJ VR WKDW     RQWRORJLHV ZLWKRXW LQFRQVLVWHQFLHV DPRQJ WKH GHILQHG
PLJKW WR PD[LPL]H WKH YDOXH RI FRPSXWLQJ WR VRFLHW\ LQ D      FRQFHSWV ZLWK FRKHUHQF\ DQG ZHOO RUJDQL]HG  DQG WR
QHZ DJH RI KXPDQ DQG PDFKLQH V\PELRVLV >+RIIPDQ HW DO         FRPSDUHPDS H[LVWLQJ RQWRORJLHV 5HDVRQLQJ VHUYLFHV PXVW
@ -RLQW UHVHDUFK HIIRUWV RQ FRJQLWLRQ HUJRQRPLFV           SHUIRUPLQWKHEDFNJURXQGSURYLGLQJVXIILFLHQWLQIRUPDWLRQ
SV\FKRORJ\ VRFLDO VFLHQFHV DQG LQIRUPDWLRQ WHFKQRORJLHV           WR SHRSOH DERXWWKHZHOOIRUPHGQHVVRIWKHLURQWRORJLHV,W
FRQWULEXWH WR WKH HPHUJHQW RI KXPDQFHQWHUHG V\VWHPV             LV YHU\ LPSRUWDQW WR QRWLFH WKDW WKHVH VHUYLFHV PXVW QRW
OHDGLQJWRDQHZZRUOGRIDSSOLFDWLRQVDQGVHUYLFHV,QWKLV            SURKLELW SHRSOH WR IROORZ DQ\ DSSURDFK WR RQWRORJ\
QHZ HUD V\VWHPV¶ GHVLJQHUV KDYH WR UHDOO\ XQGHUVWDQG WKH       GHYHORSPHQW2QWKHFRQWUDU\IHHGEDFNIURPWKHUHDVRQLQJ
XVH RI V\VWHPV LQ FRQMXQFWLRQ ZLWK WKH FRJQLWLYH DELOLWLHV     VHUYLFHV PXVW EH SURYLGHG LQ WKH IRUP RI KHOS DQG DGYLFH
FRQWH[WXDOFRQVWUDLQWVDQGDFWLYLWLHVRIXVHUV                         DERXW WKH YDOLGLW\ DQG FRQVLVWHQF\ RI VSHFLILFDWLRQV ZLWK
   ,W KDV EHHQ DUJXHG WKDW WKH KXPDQFHQWHUHG GHYHORSPHQW        UHVSHFWWRSHRSOHFRJQLWLYHFDSDFLWLHV
RIV\VWHPVPXVWWDNHWKHWULSOHRISHRSOHPDFKLQHFRQWH[W             x 3URYLGHIDFLOLWLHVIRUH[FKDQJLQJDQGFUHDWLQJRQWRORJLHV
DVWKHXQLWRIDQDO\VLV>+RIIPDQHWDO@7KLVLQYROYHV            FRQYHUVDWLRQDOO\ 7KH DLP LV WR VXSSRUW FRQYHUVDWLRQV
VWXG\LQJ SHRSOH FDSDFLWLHV DQG JRDOV FRPSXWDWLRQDO                EHWZHHQ LQGLYLGXDOV LQ RUGHU WR HQDEOH FULWLFLVP DQG
PHFKDQLVPV DQG LQWHUIDFH FDSDELOLWLHV DOO ZLWKLQ WKHLU
                                                     +&21(
                  3HUVRQDO6SDFH                                                                     3HUVRQDO6SDFH
                                                     


                                                               6KDUHG6SDFH
        +&21(SHUVRQDO                                                                       +&21(SHUVRQDO
                                                                                              
        ,PSURYLVH2QWRORJLHV                                                               ,PSURYLVH2QWRORJLHV
        0HUJH2QWRORJLHV                                                                   0HUJH2QWRORJLHV
        &RQWURO2QWRORJLHV¶                                                                &RQWURO2QWRORJLHV¶
           9HUVLRQV                                         $UJXPHQWDWLRQ                       9HUVLRQV
           /LEUDULHV                                          'LDORJXH                          /LEUDULHV
        0DSWHUPV¶PHDQLQJVWR                                                            0DSWHUPV¶PHDQLQJVWR
           ZRUGVHQVHV                                                                           ZRUGVHQVHV
        &RQVXOW7RS2QWRORJ\                                                               &RQVXOW7RS2QWRORJ\
                                                             $JUHHG6SDFH




                                                         )LJXUH+&21($UFKLWHFWXUH
    
HQFRXUDJH IHHGEDFN DPRQJ FRPPXQLW\ PHPEHUV WR
RQWRORJLFDO VSHFLILFDWLRQV7KHVHIDFLOLWLHVPXVWSURYLGHWKH            +&21(
PHDQV IRU GHWHFWLQJ QHZ RSSRUWXQLWLHV IRU FROODERUDWLRQ DV
                                                                           +&21( +XPDQ&HQWHUHG21WRORJ\(QYLURQPHQW IROORZV
ZHOO DV IRU JHWWLQJ RXW RI GHDGORFNV ZLWKLQ SUREOHPDWLF
                                                                           DGHFHQWUDOL]HGPRGHOWRRQWRORJ\HQJLQHHULQJWKDWLVVKRZQ
VLWXDWLRQVWKDWPD\DULVHGXULQJFROODERUDWLRQ
                                                                           LQ)LJXUH$FFRUGLQJWRWKLVPRGHOSHRSOHFDQFUHDWHWKHLU
x 3URYLGH IDFLOLWLHV IRU EULGJLQJ GLIIHUHQW SHUVSHFWLYHV YLD
                                                                           RZQ RQWRORJLHV VWRUHG LQ D SHUVRQDO VSDFH 2QWRORJLHV FDQ
FRQFHSWV¶PHDQLQJGLVDPELJXDWLRQ7KLVLVLPSRUWDQWIRUWKH
                                                                           EH ODWHU SXEOLFL]HG DQG VKDUHG DPRQJ JURXSV RI ZRUNHUV
GHYHORSPHQW RI FRPPRQO\ DJUHHG FRQFHSWXDOL]DWLRQV
                                                                           WKDW MRLQWO\ FRQWULEXWH WR RQWRORJLHV GHYHORSPHQW ZLWK WKH
HVSHFLDOO\ LQ FRPPXQLWLHV ZKHUH SHRSOH IURP GLIIHUHQW
                                                                           DLPWRUHDFKDQDJUHHPHQWLQFRQFHSWXDOL]LQJWKHLUGRPDLQ
GLVFLSOLQHV PD\ XVH WKH VDPH WHUP ZLWK GLIIHUHQW PHDQLQJV
                                                                           'XULQJ WKLV SURFHVV ZRUNHUV PD\ HYROYH RQWRORJLHV E\
RUXVHGLIIHUHQWWHUPVIRUWKHVDPHFRQFHSW
                                                                           LPSURYLVLQJ LQ WKHLU SHUVRQDO VSDFH PDS DQG V\QWKHVL]H
x 3URYLGH IDFLOLWLHV IRU WKH PDQDJHPHQW RI PXOWLOLQJXDO            WKHLUFRQFHSWXDOL]DWLRQVZLWKWKHFRQFHSWXDOL]DWLRQVRIWKHLU
RQWRORJLHV 0XOWLOLQJXDOLVP LQ WKLV FRQWH[W DLPV WR VXSSRUW        FRZRUNHUV DQG GLVFXVV WKHLU DUJXPHQWV REMHFWLRQV DQG
RQWRORJLFDO VSHFLILFDWLRQV LQ GLIIHUHQW ODQJXDJHV 'RLQJ VR        SRVLWLRQV ZLWKLQ WKH JURXS 'XULQJ FROODERUDWLRQ ZRUNHUV
PHPEHUV RI RUJDQL]DWLRQV PD\ VSHFLI\ DQ RQWRORJ\ XVLQJ             IROORZ D VWUXFWXUHG DUJXPHQWDWLRQ SURFHVV LQ ZKLFK WKH\
WKHLU QDWLYH ODQJXDJH DQG PD\ HYDOXDWH DQG H[SORLW DQ             PD\ UDLVH LVVXHV SURSRVH VROXWLRQV YLD SRVLWLRQV SURYLGH
RQWRORJ\ RULJLQDWHG LQ DQRWKHU ODQJXDJH LQ WKHLU QDWLYH           DUJXPHQWV IRU RU DJDLQVW D SRVLWLRQ HWF $JUHHG RQWRORJLHV
ODQJXDJHWRR                                                             DUH VWRUHG LQ D YLUWXDO VSDFH DQG FDQ EH IXUWKHU VKDUHG
   7KH GHYHORSPHQW RI KXPDQFHQWHUHG RQWRORJ\                         HYROYHGLQZRUNHUV¶SHUVRQDOVSDFHDQGVRRQ
PDQDJHPHQW HQYLURQPHQWV LV FKDOOHQJLQJ 1RW RQO\ GXH WR               +&21( LV D PRGXODU DQG LQWHJUDWHG HQYLURQPHQW
WKH H[SHFWDWLRQV LW FUHDWHV EXW DOVR LQ WKDW LW UHTXLUHV WKH   SURYLGLQJ DFFHVV WR DQ\ LQWHJUDWHG WRRO LQ DQ\ +&21(
V\QHUJLVWLF GHSOR\PHQW RI PDQ\ WHFKQRORJLHV LQWHOOLJHQW             SRLQW 'RLQJ VR ZRUNHUV DUH IUHH WR FRPELQH WKHLU RZQ
DQG FROODERUDWLYH LQWHUIDFHV IRU HGLWLQJ DQG GHSOR\LQJ              PHWKRG IRU XVLQJ WKH HQYLURQPHQW IROORZLQJ DQ HFOHFWLF
NQRZOHGJHEDVHVREMHFWFHQWHUHGNQRZOHGJHUHSUHVHQWDWLRQ                 ZD\ WR RQWRORJ\ HQJLQHHULQJ )RU LQVWDQFH D ZRUNHU PD\
V\VWHPV ZLWK SRZHUIXO UHDVRQLQJ VHUYLFHV ODQJXDJH                   FRQVWUXFWDQRQWRORJ\LQKHUSHUVRQDOVSDFHZKLOHUHFHLYLQJ
HQJLQHHULQJ WHFKQRORJLHV IRU WHUPV¶ GLVDPELJXDWLRQ WR               FRPPHQWV RQ D SUHYLRXV YHUVLRQ RI WKH VDPH RQWRORJ\ WKDW
PHQWLRQ D IHZ +&21( +XPDQ &HQWHUHG 21WRORJ\                        KDV VKDUHG ZLWK FRZRUNHUV ,Q WKH PHDQWLPH VKH LV WU\LQJ
PDQDJHPHQW (QYLURQPHQW  LV D SURWRW\SH HQYLURQPHQW WKDW             WR FRPSO\ ZLWK JHQHULF RQWRORJLFDO FRPPLWPHQWV WKDW WKH
KDV EHHQ GHVLJQHG DQG GHYHORSHG WDNLQJ LQWR DFFRXQW WKH           JURXS KDV DJUHHG WR FRPSO\ ZLWKZKLOHLQDQRWKHUVOLFHRI
DERYHSRLQWHGLVVXHV                                                     KHU ZRUN VKH LV WU\LQJ WR PHUJH KHU RQWRORJ\ ZLWK DQ
RQWRORJ\ LVVXHG E\ D FRZRUNHU 7RZDUGV WKHVH WDUJHWV                                                              FRUUHVSRQGLQJ FRQFHSW +&21( SURYLGHV VHDPOHVV DFFHVV
+&21( SURYLGHV IDFLOLWLHV IRU D  XVHUV WR LPSURYLVH WKHLU                                                          WRUHDVRQLQJVHUYLFHVSURYLGHGE\'HVFULSWLRQ/RJLFV7KHVH
FRQFHSWXDOL]DWLRQV E  FRQVXOW JHQHULF RQWRORJLHV WKDW                                                                VHUYLFHV LQFOXGH DXWRPDWLF FRQFHSWV¶ FODVVLILFDWLRQ
SURYLGH LPSRUWDQW VHPDQWLF GLVWLQFWLRQV F  PDQDJH                                                                    FRQFHSWV¶ GHILQLWLRQV FRQVLVWHQF\ FKHFNV HJ EHWZHHQ D
GLIIHUHQW YHUVLRQV RI WKHLU RQWRORJLHV WUDFNLQJ WKH                                                                 FRQFHSW DQG LWV VXEVXPHUV  DQG GHWHFWLRQ RI FRQFHSWV¶
GLIIHUHQFHV EHWZHHQ WKH YHUVLRQV H  WUDFN WKH                                                                       GHILQLWLRQV GLIIHUHQFHV )HHGEDFN IURP WKHVH UHDVRQLQJ
JHQHUDOL]DWLRQ VSHFLDOL]DWLRQ RI DQ RQWRORJ\ GXULQJ                                                                  VHUYLFHV WR XVHUV LV FRQVWDQWO\ SURYLGHG GXULQJ RQWRORJ\
RQWRORJ\ GHYHORSPHQW G  JHW SURSHU FRQVXOWDWLRQ IURP                                                                GHYHORSPHQW PDQDJHPHQW DQG LV RI KLJK VLJQLILFDQFH )RU
PDFKLQH H[SORLWDEOH UHDGDEOH OH[LFRQV E\ PDSSLQJ                                                                     LQVWDQFH ZKLOH WUDFNLQJ WKH GLIIHUHQFHV EHWZHHQ WZR
FRQFHSWV¶PHDQLQJWRZRUGVHQVHV H PHUJHRQWRORJLHVDQG                                                                 YHUVLRQVRIWKHVDPHRQWRORJ\RUGXULQJPHUJLQJUHDVRQLQJ
IXUWKHUPDQLSXODWHPHUJHGFRQFHSWXDOL]DWLRQVDQG I VKDUH                                                                VHUYLFHV LGHQWLI\ VHPDQWLFDOO\ HTXLYDOHQW GHILQLWLRQV
WKHLU RQWRORJLHV ZLWK JURXSV RI FRZRUNHUV IROORZLQJ D                                                             DOORZLQJ SURSHU KDQGLQJ RI YHUVLRQV DQG GLVDOORZLQJ
VWUXFWXUHG FRQYHUVDWLRQ WRZDUGV DJUHHLQJ LQ GRPDLQ                                                                    VHPDQWLFHUURUV
FRQFHSWXDOL]DWLRQ                                                                                                            &ULWLFDO WR WKH RQWRORJ\ VSHFLILFDWLRQ SURFHVV LV WKH
   +&21( VXSSRUWV SHRSOH WR LQWHUDFW ZLWK WKHLU                                                                      OH[LFRQVFRQVXOWDWLRQSURFHVV7KURXJKOH[LFRQFRQVXOWDWLRQ
FRQFHSWXDOLVDWLRQV KLGLQJ ORZOHYHO LPSOHPHQWDWLRQ GHWDLOV                                                            XVHUV DUH JXLGHG WR WKH FRQVHQVXDO GHILQLWLRQ RI WHUPV
HQDEOLQJ WKHP WR H[SUHVV VXEWOH RQWRORJLFDO GLVWLQFWLRQV                                                            JXLGHGWRIROORZZHOOHVWDEOLVKHGQRUPVDQGSUDFWLFHVLQWKH
FRPSO\LQJ DW WKH VDPH WLPH ZLWK IRUPDO FRQVWUDLQWV RI                                                              FRPPXQLW\ WKH\ DUH H[HUFLVLQJ WKHLU SUDFWLFH HJ E\
VSHFLILFDWLRQV )RUPDO VSHFLILFDWLRQ RI RQWRORJLHV LQ                                                                 FRQVXOWLQJDWHUPLQRORJLFDOOH[LFRQ RULQWKHZLGHUFRQWH[W
+&21(LVGRQHLQWKH1HR&ODVVLF'HVFULSWLRQ/RJLF>3DWHO                                                                    HJ E\ VHOHFWLQJ WKH DSSURSULDWH OH[LFDOL]DWLRQV RI WKHLU



                              
                          ! "#%$'&("*)%+    ,  - %- .  - /  %$'& 0 )  % 132  4 %
                                                                                                                       5 + )%+  
       ) 46$'&(7                  8%      8
                 9:3  <;$  

                                                                                                                   
                       $ (:     
                       4 )'&:  :     

                                              
                 5 13;=: ): 
                  3+ )>: ): 
          ?/3 ,%+ 4 ./ @
                         A        8%      8
        ) 46$'&(7,%+ 4 ./ @
                   9:3    + 

                                                                                
          32  4  A BC 5 5D 9E F
             )32  4  A 5 F 1%GC%H I
           #J ,%+ 4 . J%.
                              ! "#%$'&("*)%+ ,  - %- .  - /  %$'& 0 )  % %  H% $     13;
         ) 46$'&(7,%+ 4 . J%.
                    9:3    +                                                                                                    L M?N O*P?Q O#RSUTM#O?V!QWXZY=[>\]R^_L P?T`]a=XZ^ b ca>R^

                                                                                                                   
          32  4  A 5 F 1%GC%H I                                                                                                                    L P#d de fhg fji!V!V'd e O*`!g k!lnm!\>WWo b p%Xq
              )32  4  A BC 5 5D 9E F                                                                                                              L P?Q o O*P*fjQrZe fhg fji!V!V'd e O*`!g k!lUq
                                                                                                                                                            L P#d de fhg stP?T!i'u P*M?Q i!N O*`!g k!l]vwax(\>ca>R^ \>Xp%Xq

                                                                                                                                            
  K
                                                                                                                                                             L P?Q vyS!fjQrZe fhg stP?T!i'u P*M?Q i!N O*`!g k!lUq
    K
                                                                                                                                                                                                                   
                                                                                                                                                              L P#d d!zP*f%vwp%a(m!\>Xp%vwp x{^%g \Zx(b ^ q q q




                     )LJXUH+&21(FRQFHSWVSHFLILFDWLRQ QDWXUDOODQJXDJH IRUPDO JUDSKLFDOUHSUHVHQWDWLRQ


6FKQHLGHUHWDO@                                                                                                   FRQFHSWLRQV  ,Q +&21( OH[LFRQ FRQVXOWDWLRQ FDQ EH
   ,Q    SDUWLFXODU    ZRUNHUV      FRPPXQLFDWH       WKHLU                                                           VXSSRUWHG LQ DQ\ RI WKH IROORZLQJ WKUHH ZD\V D  E\
FRQFHSWXDOL]DWLRQV XVLQJ WKH IXOO H[SUHVVLYH SRZHU RI                                                                PDSSLQJ FRQFHSWV GHILQLWLRQV WR ZRUG VHQVHV LQ D PDFKLQH
1HR&ODVVLF ZLWKRXW GHDOLQJ ZLWK ORZOHYHO LPSOHPHQWDWLRQ                                                             UHDGDEOHH[SORLWDEOH OH[LFRQ WKURXJK WKH GLVDPELJXDWLRQ
GHWDLOV 7KLV LV DFKLHYHG E\ IROORZLQJ FDQQHG QDWXUDO                                                               SURFHVV E E\IRUPDOO\FRPSO\LQJZLWKJHQHULFRQWRORJLFDO
ODQJXDJHGLDORJXHVEDVHGRQDVOLJKWYDULDWLRQRIWKH:KDW                                                                 FRPPLWPHQWV RI WRS OHYHO RQWRORJLHV RU F  E\ VLPSO\
3RZHU HW DO                                                                       FRQVXOWLQJOH[LFRQVDQGRWKHURQWRORJLHV
@ NQRZOHGJH VSHFLILFDWLRQ SDUDGLJP $V ILJXUH                                                                      +&21( XVHV WKH /DWHQW 6HPDQWLF ,QGH[LQJ /6, 
GHSLFWVZKLOHXVHUVVSHFLI\WKHGHILQLWLRQRIDFRQFHSWWKH\                                                             WHFKQLTXH >'HHUZHVWHU HW DO @ IRU PDSSLQJ WHUPV¶
JHW D IHHGEDFN WH[W WKDW UHIOHFWV WKH GHILQLWLRQ RI WKH                                                           PHDQLQJWRZRUGVHQVHV/6,LVDYHFWRUVSDFHWHFKQLTXHIRU
                                                 )LJXUH+&21(YHUVLRQVPDQDJHPHQW
                                                                      
LQIRUPDWLRQUHWULHYDODQGLQGH[LQJ,WWDNHVDODUJHPDWUL[RI         UHDVRQLQJ SURFHVVHV RI 1HR&ODVVLF $V ILJXUH  VKRZV
WHUPGRFXPHQW DVVRFLDWLRQ GDWD DQG FRQVWUXFWV D VHPDQWLF         +&21(SUHVHQWVWKHVWHSVRIWKHPHUJLQJSURFHVVWRWKHHQG
VSDFH ZKHUHLQ WHUPV DQG GRFXPHQWV WKDW DUH FORVHO\              XVHUDVDIHHGEDFNUHSRUWGHVFULELQJWKHDFWLRQVWKHV\VWHP
DVVRFLDWHG DUH SODFHG QHDU RQH DQRWKHU &XUUHQWO\ +&21(         KDV IROORZHG WR WKH PHUJHG RQWRORJ\ 7KH UHVXOWHG PHUJHG
H[SORLWVWKH:RUG1HW>0LOOHUHWDO@OH[LFDOGDWDEDVHWR          RQWRORJ\ FDQ EH IXUWKHU PDQLSXODWHG DFFRUGLQJ WR XVHUV
PDWFKGHVFULSWLRQVRIWHUPVSURYLGHGE\WKHXVHUZLWKZRUG             SUHIHUHQFHV
VHQVHV LQ :RUG1HW /6, LQ WKLV FDVH FRQVWUXFWV D VHPDQWLF        )XUWKHUPRUH +&21( H[SORLWV WKH DVVRFLDWLRQ RI
VSDFH RI WHUPV DQG ZRUG VHQVHV >$JLUUH DQG 5LJDX @      FRQFHSWVWR:RUG1HWZRUGVHQVHVIRUFRPSXWLQJHTXLYDOHQW
:RUGVHQVHVWKDWFORVHO\PDWFKWKHJLYHQWHUPVDUHSURYLGHG            WHUPVLQRWKHU(XURSHDQODQJXDJHV
WRWKHXVHULQDQRUGHUHGZD\                                           )LQDOO\ D YHU\ LPSRUWDQW EXLOWLQ +&21( IXQFWLRQDOLW\
   2Q WKH RWKHU KDQG NQRZOHGJH ZRUNHUV PD\ IROORZ D           FRQFHUQV VKDULQJ RQWRORJLHV WR JURXS PHPEHUV DQG
GHGXFWLYHDSSURDFKWRWHUPVVSHFLILFDWLRQVE\HODERUDWLQJD            VXSSRUWLQJ JURXS PHPEHUV¶ SDUWLFLSDWLRQ LQ VWUXFWXUHG
JHQHULF WRS RQWRORJ\ ,Q WKLV FDVH FRQFHSWV GHILQLWLRQV FDQ   FRQYHUVDWLRQV DERXW FRQFHSWXDOL]DWLRQV 7KLV LV D EXLOWLQ
EH FKHFNHG IRU WKHLU VHPDQWLF YDOLGLW\ DJDLQVW JHQHULF          UDWKHUWKDQDSDWFKHGRQIDFLOLW\VLQFHLWKDVEHHQGHVLJQHG
FRQFHSWXDOLVDWLRQV E\ PHDQV RI WKH FRQVLVWHQF\ FKHFNLQJ          LQRUGHUWRVXSSRUWSHRSOHWRGLVFXVVRQWRORJLFDODVSHFWVDQG
PHFKDQLVPV SURYLGHG E\ WKH UHSUHVHQWDWLRQ DQG UHDVRQLQJ          LQFRUSRUDWH WKHLU VXJJHVWLRQV  SRVLWLRQV WR VSHFLILFDWLRQV
V\VWHP ,Q GRLQJ VR WKH FRQVWUXFWLRQ RI GRPDLQ VSHFLILF       UDWKHU WKDQ D JHQHULF DUJXPHQWDWLRQ RU GLVFXVVLRQ IDFLOLW\
RQWRORJLHV LV VSHHGXS DQG JXLGHG E\ LPSRUWDQW VHPDQWLF         7KLV IDFLOLW\ HQDEOHV FULWLFLVP LGHQWLI\LQJ SRVVLEOH
GLVWLQFWLRQV VSHFLILHG LQ JHQHULF RQWRORJLHV +&21( LQ LWV     RSSRUWXQLWLHV IRU PHPEHUV¶ FROODERUDWLRQ DV ZHOO DV
FXUUHQWVWDWXVSURYLGHVWKHRSWLRQRILPSRUWLQJDQ\JHQHULF           RYHUFRPLQJ GHDGORFNV ZLWKLQ SUREOHPDWLF VLWXDWLRQV WKDW
RQWRORJ\JLYHQWKDWLWKDVEHHQLPSOHPHQWHGLQ1HR&ODVVLF            DULVHLQRQWRORJLHVVSHFLILFDWLRQ
:HKDYHFRQWDFWHGH[SHULPHQWVZLWKDJHQHULFRQWRORJ\IRU
WHUPLQRORJLFDO UHVRXUFHV ZKLFK LQFRUSRUDWHV (XUR:RUG1HW           &RQFOXGLQJ5HPDUNV
DQG 6,03/( VHPDQWLF FRPPLWPHQWV >9RXURV DQG
                                                                        +&21( SURYLGHV D PRGXODU HQYLURQPHQW VXSSRUWLQJ DQ
(XPHULGRX@
                                                                        HFOHFWLF DSSURDFK WR RQWRORJLHV PDQDJHPHQW DLPLQJ WR
   +DYLQJ PDSSHG WHUPV WR ZRUG VHQVHV FRQFHSWV LQ
                                                                        SURYLGH DQG PXOWLSO\ WKH RSSRUWXQLWLHV RI H[SORLWLQJ
GLIIHUHQW RQWRORJLHV FDQ EH DVVRFLDWHG DPRQJ WKHPVHOYHV
                                                                        RQWRORJ\ PDQDJHPHQW WRROV LQ ZRUNLQJ SODFHV :H
UHVXOWLQJ LQ HIIHFWLYH PHUJLQJ RI RQWRORJLHV 0HUJLQJ
                                                                        FRQMHFWXUH WKDW WKLV WDUJHW FDQ EH DFKLHYHG YLD GHVLJQLQJ
IXQFWLRQDOLW\LQ+&21(LVSHUIRUPHGLQ³EDWFKPRGH´7KH
                                                                        KXPDQFHQWUHGRQWRORJ\PDQDJHPHQWHQYLURQPHQWV
UHVXOWRIWKLVDXWRPDWHGSURFHVVLVDPHUJHGRQWRORJ\ZKRVH
FUHDWLRQLVGULYHQE\KHXULVWLFVDPDSSLQJDOJRULWKPDQGWKH
                                                    )LJXUH+&21(PHUJHSURFHVV
                                                                     
    7KH IDVW HPHUJHQW DUHDV RI WKH VHPDQWLF ZHE DQG           DSSURDFK WR RQWRORJ\ PDQDJHPHQW LQWHJUDWLQJ WHFKQLTXHV
NQRZOHGJH PDQDJHPHQW SXVK UHVHDUFKHUV WR QHZ                     IRURQWRORJ\PDQDJHPHQWLQDWRROVHW
GHYHORSPHQW HIIRUWV EXW WR RXU YLHZ QR VSHFLILF SULQFLSOHV   F  7KH GHYHORSPHQW RI RQWRORJLHV PXVW EH VHHQ DV D
KDYH EHHQ UDLVHG IRU HYDOXDWLQJ WKH LPSDFW RI WRROV RQ       G\QDPLF SURFHVV WKDW LQ PRVW RI WKH FDVHV VWDUWV ZLWK DQ
PDNLQJ WKH IRUHVHHQ WDUJHWV DFKLHYDEOH ,Q WKH ODWHVW (21     LQLWLDO URXJK RQWRORJ\ ZKLFK LV ODWHU UHYLVHG UHILQHG DQG
:RUNVKRS|  DVVHVVPHQWV RI WKH PRVW ZHOO NQRZQ RQWRORJ\        ILOOHG LQ ZLWK WKH GHWDLOV 2QWRORJ\ HYROXWLRQ KDV WR EH
HQJLQHHULQJ HQYLURQPHQW KDYH UHVXOWHG WR VRPH YHU\              VXSSRUWHG WKURXJK WKH HQWLUH OLIHF\FOH UHVXOWLQJ WR D OLYLQJ
LPSRUWDQWFRQFOXVLRQV                                                RQWRORJ\ >6WRMDQRYLF DQG 0RWLN @ +&21(
D RQWRORJ\HQJLQHHULQJHQYLURQPHQWV¶GHYHORSPHQWFULWHULD            LQFRUSRUDWHV IXQFWLRQDOLWLHV LQFOXGLQJ GHYHORSPHQW
FDQQRW EH FRQVLGHUHG LQ LVRODWLRQ IURP VLWXDWLRQV LQ ZKLFK    YHUVLRQLQJ DUJXPHQWDWLRQ PHUJLQJ  IRU VXSSRUWLQJ WKH
WKH RQWRORJ\EDVHG WRROV ZLOO EH XVHG &ULWHULD QHHG WR EH   PDQDJHPHQWRIFRQWLQXRXVO\HYROYLQJRQWRORJLHV
FRQQHFWHG WR VFHQDULRV RI XVH 6XFK VFHQDULRV QHHG WR EH
H[SODLQHG IXUWKHU DQDO\]HG DQG EH FRQQHFWHG WR DFWLYLW\       5HIHUHQFHV
PRGHOV )XUWKHUPRUH WKHUH PXVW EH D EDODQFH EHWZHHQ
                                                                       >$JLUUHDQG5LJDX@($JLUUHDQG*5LJDX:RUG
XVDJH DQG WHFKQRORJ\ DQG EHWZHHQ IRUPDOLW\ DQG
                                                                           VHQVH GLVDPELJXDWLRQ XVLQJ FRQFHSWXDO GHQVLW\ ,Q
LQIRUPDOLW\ >*LERLQ HW DO @ +&21( IROORZLQJ WKH
                                                                           3URFHHGLQJVRI&2/,1*
KXPDQFHQWHUHGGHVLJQDSSURDFKHPSKDVL]HVRQLQWHJUDWLQJ
                                                                       
RQWRORJ\ HQJLQHHULQJ HQYLURQPHQWV ZLWK NQRZOHGJH
                                                                       >$USLUH] HW DO @ -& $USLUH] 2 &RUFKR 0
SURYLGHUVFRQVXPHUV¶ SUDFWLFHV FRQVLGHUDEO\ HQDEOLQJ
                                                                          )HUQDQGH] /RSH] DQG $ *RPH]3HUH] :HE2'( D
NQRZOHGJHZRUNHUVWRLQWHUDFWZLWKWKHLUFRQFHSWXDOL]DWLRQV
                                                                          VFDODEOH ZRUNEHQFK IRU RQWRORJLFDO HQJLQHHULQJ ,Q
DWDKLJKOHYHO
                                                                          3URFHHGLQJV RI WKH )LUVW ,QWHUQDWLRQDO &RQIHUHQFH RQ
E  7KHUH DUH WZR W\SHV RI RQWRORJ\ HQJLQHHULQJ
                                                                          .QRZOHGJH &DSWXUH .&$3  2FW  
HQYLURQPHQWV   (QYLURQPHQWV IRU GHYHORSLQJ RQWRORJLHV
                                                                          9LFWRULD%&&DQDGD
DQG   HQYLURQPHQWV IRU PDSSLQJ DOLJQLQJ RU PHUJLQJ
                                                                       
RQWRORJ\ >1R\ DQG 0XVHQ @ 0DSSLQJ HQYLURQPHQWV
                                                                       >%HFKKRIHU HW DO @ 6 %HFKKRIHU , +RUURFNV &
PD\ LGHQWLI\ SRWHQWLDO FRUUHVSRQGHQFHV EHWZHHQ FRQFHSWV
                                                                          *REOHDQG56WHYHQV2LO(G$UHDVRQDEOHRQWRORJ\
SURYLGH WKH XVHU ZLWK JXLGHOLQHV IRU GHILQLQJ WKHVH
                                                                          HGLWRU IRU WKH VHPDQWLF ZHE ,Q ., $GYDQFHV LQ
FRUUHVSRQGHQFHV RU ERWK +&21( IROORZV DQ HFOHFWLF
                                                                          $UWLILFLDO ,QWHOOLJHQFH /1$,  SDJHV 
                                                                          6SULQJHU
                      
| KWWSNPDLIEXQLNDUOVUXKHGHHRQ
>%HQMDPLQV HW DO @ %HQMDPLQV 5 )HQVHO '            >0LOOHUHWDO@0LOOHU*%HFNZLWK5)HOOEDXP'
  3HUH] $ * .QRZOHGJH PDQDJHPHQW WKURXJK                       *URVV ' 0LOOHU . )LYH SDSHUV RQ :RUG1HW &6/
  RQWRORJLHV ,Q 3URFHHGLQJV RI WKH QG ,QWHUQDWLRQDO           5HSRUW  &RJQLWLYH 6FLHQFH /DERUDWRU\ 3ULQFHWRQ
  &RQIHUHQFH RQ 3UDFWLFDO $VSHFWV RI .QRZOHGJH                   8QLYHUVLW\
  0DQDJHPHQW 3$.0 %DVHO6ZLW]HUODQG2FWREHU                
                                                               >1R\DQG0XVHQ@1DWDO\D)ULGPDQ1R\DQG0DUN
                                                                      $ 0XVHQ (YDOXDWLQJ 2QWRORJ\0DSSLQJ 7RROV
>&KDQGUDVHNDUDQ HW DO @ &KDQGUDVHNDUDQ %                 5HTXLUHPHQWV DQG ([SHULHQFH ,Q 3URFHHGLQJV RI
  -RVHSKVRQ - 5        %HQMDPLQV 9 5               2QWR:HE6,* :RUNVKRS DW WKH WK ,QWHUQDWLRQDO
  -DQXDU\)HEUXDU\  :KDW DUH RQWRORJLHV DQG ZK\ GR ZH        &RQIHUHQFH RQ .QRZOHGJH (QJLQHHULQJ DQG
  QHHGWKHP",(((,QWHOOLJHQW6\VWHPVSS                    .QRZOHGJH 0DQDJHPHQW (.$:  SDJHV 
                                                                      6LJXHQ]D6SDLQWK6HSWHPEHU
>&ODQFH\ @ &ODQFH\ : - $Q ,QWURGXFWLRQ WR            
  +XPDQ&HQWHUHG &RPSXWLQJ 5HSRUW 1$6$$PHV                    >2172:(% @ 2172:(% &RQVRUWLXP IRU
  5HVHDUFK &HQWHU &RPSXWDWLRQDO 6FLHQFHV 'LYLVLRQ               2QWRORJ\EDVHG LQIRUPDWLRQ H[FKDQJH IRU NQRZOHGJH
                                                                 PDQDJHPHQW DQG HOHFWURQLF FRPPHUFH ,67
                                                                      :RUNSDFNDJH'HOLYHUDEOH$VXUYH\RQ
>&RRNDQG%URZQ@&RRN6'1 %URZQ-6                  2QWRORJ\7RROV0D\
  %ULGJLQJ HSLVWHPRORJLHV 7KH JHQHUDWLYH GDQFH                 
  EHWZHHQ RUJDQL]DWLRQDO NQRZOHGJH DQG RUJDQL]DWLRQDO           >3DWHO6FKQHLGHU HW DO @ 3HWHU ) 3DWHO6FKQHLGHU
  NQRZLQJ2UJDQL]DWLRQDO6FLHQFH               0HUU\OO $EUDKDPV /RUL $OSHULQ 5HVQLFN 'HERUDK /
                                                                      0F*XLQQHVV DQG $OH[ %RUJLGD 1HR&ODVVLF 5HIHUHQFH
>'HHUZHVWHU HW DO @ 6FRWW 'HHUZHVWHU 6XVDQ 7            0DQXDO 9HUVLRQ  $UWLILFLDO ,QWHOOLJHQFH3ULQFLSOHV
  'XPDLV *HRUJH : )XUQDV 7KRPDV . /DQGDXHU                 5HVHDUFK'HSDUWPHQW$7 7%HOO/DEV
  5LFKDUG +DUVKPDQ ,QGH[LQJ E\ /DWHQW 6HPDQWLF                
  $QDO\VLV -RXUQDO RI WKH $PHULFDQ 6RFLHW\ RI                >3RZHU HW DO @ 3RZHU 5 6FRWW ' (YDQV 5 :KDW
  ,QIRUPDWLRQ6FLHQFH                                          (UGPDQ HW DO @ (UGPDQ 0 $0DHGFKH                     5HSRUW1R8QLYHUVLW\RI%ULJKWRQ
  +36FKQXUU66WDDE)URP0DQXDOWR6HPLDXWRPDWLF               
  6HPDQWLF $QQRWDWLRQ $ERXW 2QWRORJ\EDVHG 7H[W                >6WDDE HW DO @ 6WDDE 6 6WXGHU56FKQXUU+6XUH
  $QQRWDWLRQ7RROV(7$,-RXUQDO±6HFWLRQRQ6HPDQWLF                < .QRZOHGJH 3URFHVVHV DQG 2QWRORJLHV ,(((
  :HE /LQNRSLQJ (OHFWURQLF $UWLFOHV LQ &RPSXWHU                 ,QWHOOLJHQW 6\VWHPV SDJHV  -DQXDU\)HEUXDU\
  6FLHQFH9RO                                               
                                                                    
>)HQVHO HW DO @ )HQVHO ' +DUPHOHQ )  .OHLQ 0   >6WRMDQRYLF DQG 0RWLN @ /MLOLDQD 6WRMDQRYLF DQG
  $NNHUPDQV + 2Q7R.QRZOHGJH 2QWRORJ\EDVHG                     %RULV 0RWLN 2QWRORJ\ (YROXWLRQ ZLWKLQ 2QWRORJ\
  7RROVIRU.QRZOHGJH0DQDJHPHQW                                    (GLWRUV ,Q 3URFHHGLQJV RI 2QWR:HE6,* :RUNVKRS
                                                                      DW WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ .QRZOHGJH
>*LERLQ HW DO @ $ODLQ *LERLQ )DELHQ *DQGRQ              (QJLQHHULQJ DQG .QRZOHGJH 0DQDJHPHQW (.$:
  2OLYLHU &RUE\ DQG 5RVH 'LHQJ $VVHVVPHQW RI                   SDJHV  6LJXHQ]D 6SDLQ WK 6HSWHPEHU
  2QWRORJ\EDVHG 7RROV 6\VWHPL]LQJ WKH 6FHQDULR                  
  $SSURDFK ,Q  3URFHHGLQJV RI 2QWR:HE6,*                    
  :RUNVKRS DW WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ            >7HQQLVRQ HW DO @ 7HQQLVRQ - 2¶+DUD . 
  .QRZOHGJH (QJLQHHULQJ DQG .QRZOHGJH 0DQDJHPHQW                  6KDGEROW1$3(&.68VLQJDQGHYDOXDWLQJDWRROIRU
  (.$:  SDJHV  6LJXHQ]D 6SDLQ WK                 RQWRORJ\ FRQVWUXFWLRQ ZLWK LQWHUQDO DQG H[WHUQDO .$
  6HSWHPEHU                                                     VXSSRUW ,QWHUQDWLRQDO -RXUQDO RI +XPDQ&RPSXWHU
                                                                      6WXGLHV
>+RIIPDQ HW DO @ +RIIPDQ 5 +D\V 3 DQG )RUG     
  . 0 7KH 7ULSOHV 5XOH ,((( ,QWHOOLJHQW 6\VWHPV          >9RXURV@*HRUJH$9RXURV7HFKQRORJLFDO,VVXHV
  SDJHV0D\-XQH                                        WRZDUGV .QRZOHGJH 3RZHUHG 2UJDQL]DWLRQV
                                                                      .QRZOHGJH0DQDJHPHQW-RXUQDO9RO1R
>0DHGFKH HW DO @ 0DHGFKH $ 66WDDE                  
  'LVFRYHULQJ FRQFHSWXDO UHODWLRQV IURP WH[W ,Q               >9RXURV DQG (XPHULGRX @ *HRUJH $ 9RXURV
  3URFHHGLQJVRI(&$,,263UHVV$PVWHUGDP                     (XJHQLD (XPHULGRX ³6LPSOH DQG (XUR:RUG1HW
                                                                      7RZDUGV WKH 3URPHWKHXV 2QWRORJLFDO )UDPHZRUN´
                                                                       ³7HUPLQRORJ\´  SS