PDF hosted at the Radboud Repository of the Radboud University Nijmegen

Nijmegen

The following full text is a publisher's version.

For additional information about this publication click this link.

https://repository.ubn.ru.nl/handle/2066/233894

Please be advised that this information was generated on 2021-11-24 and may be subject to change.







)RUHQVLFMXGJPHQWV



9DOLGLW\UHOLDELOLW\DQGELDV







































(UZLQ-$70DWWLMVVHQ

 





















)RUHQVLFMXGJPHQWV

9DOLGLW\UHOLDELOLW\DQGELDV



,6%1 

3ULQWLQJ 5LGGHUSULQW

&RYHU 5LGGHUSULQW



7KHUHVHDUFKDQGRUSULQWLQJRIWKLVGLVVHUWDWLRQZDVVXSSRUWHGE\WKH1HWKHUODQGV

)RUHQVLF,QVWLWXWHWKH%HKDYLRXUDO6FLHQFH,QVWLWXWH5DGERXG8QLYHUVLW\1LMPHJHQ

DQGWKH&RYDQ/HGGHQ+XOVHERVFK&HQWHU$PVWHUGDP&HQWHUIRU)RUHQVLF6FLHQFH

DQG0HGLFLQH

  

&RS\ULJKW‹E\(UZLQ-$70DWWLMVVHQ

$OOULJKWVUHVHUYHG1RSDUWRIWKLVWKHVLVPD\EHUHSURGXFHGGLVWULEXWHGVWRUHGLQDUHWULHYDOV\VWHPRUWUDQVPLWWHG

LQDQ\IRUPRUE\DQ\PHDQVZLWKRXWZULWWHQSHUPLVVLRQE\WKHDXWKRU 

)RUHQVLFMXGJPHQWV



9DOLGLW\UHOLDELOLW\DQGELDV















 3URHIVFKULIW





WHUYHUNULMJLQJYDQGHJUDDGYDQGRFWRU

DDQGH5DGERXG8QLYHUVLWHLW1LMPHJHQ

RSJH]DJYDQGHUHFWRUPDJQLILFXVSURIGU-+-0YDQ.ULHNHQ

YROJHQVEHVOXLWYDQKHWFROOHJHYDQGHFDQHQ

LQKHWRSHQEDDUWHYHUGHGLJHQRSGLQVGDJMXQL

RPXXUSUHFLHV



 GRRU





(UZLQ-DFREXV$QWRQLXV7KHRGRUXV0DWWLMVVHQ

JHERUHQRSRNWREHU

WH3ULQVHQEHHN 



3URIGU&/0:LWWHPDQ

3URIGU&(+%HUJHU8QLYHUVLWHLW/HLGHQ



&RSURPRWRU

'U5'6WRHO&HQWUDDO%XUHDXYRRUGH6WDWLVWLHN



0DQXVFULSWFRPPLVVLH

3URIGU%*7LHPHQVYRRU]LWWHU

3URIGU&&KDPSRG8QLYHUVLWpGH/DXVDQQH=ZLWVHUODQG

3URIGU&-GH3RRW9ULMH8QLYHUVLWHLW$PVWHUGDP































&KDSWHU *HQHUDOLQWURGXFWLRQ 

 

&KDSWHU )LUHDUPH[DPLQDWLRQDWVRXUFHOHYHO+RZWRGHILQHWKH

UHOHYDQWSRSXODWLRQDQGKRZWRDSSO\DQXQUHVWULFWLYH

DOWHUQDWLYHSURSRVLWLRQ



 

&KDSWHU 9DOLGLW\DQGUHOLDELOLW\RIIRUHQVLFILUHDUPH[DPLQHUV 

 

&KDSWHU )LUHDUPH[DPLQDWLRQ([DPLQHUMXGJPHQWVDQG

FRPSXWHUEDVHGFRPSDULVRQV



 

&KDSWHU $VVHVVLQJWKHIUHTXHQF\RIJHQHUDOILQJHUSULQWSDWWHUQV

E\ILQJHUSULQWH[DPLQHUVDQGQRYLFHV



 

&KDSWHU &RJQLWLYHELDVHVLQWKHSHHUUHYLHZRIEXOOHWDQG

FDUWULGJHFDVHFRPSDULVRQFDVHZRUN$ILHOGVWXG\



 

&KDSWHU ,PSOHPHQWLQJFRQWH[WLQIRUPDWLRQPDQDJHPHQWLQ

IRUHQVLFFDVHZRUN0LQLPL]LQJFRQWH[WXDOELDVLQ

ILUHDUPVH[DPLQDWLRQ



 

&KDSWHU *HQHUDOGLVFXVVLRQ 

 

&KDSWHU 6XPPDU\ 

 

 1HGHUODQGVHVDPHQYDWWLQJ 

 

 $FNQRZOHGJHPHQWV 

 

 &XUULFXOXPYLWDH 

 

 3XEOLFDWLRQV 



7

 

7

*HQHUDOLQWURGXFWLRQ



General introduction

CHAPTER 1



,1752'8&7,21

)RUHQVLF VFLHQFH LV WKH DSSOLFDWLRQ RI VFLHQFH WR WKH LQYHVWLJDWLRQ RI FULPHV 7KH

IRUHQVLFVFLHQFHVFRYHUDSOHWKRUDRIGLVFLSOLQHVVRPHRIZKLFKFRQFHQWUDWHRQWKH

H[DPLQDWLRQRIWKHFULPHVFHQHLWVHOIZKLOHRWKHUVDUHPRUHODERUDWRU\EDVHGDQG

HYDOXDWHWKHPDWHULDOFROOHFWHGDWFULPHVFHQHV7KURXJKREVHUYDWLRQRIWKHPDWHULDO

DQGLQWHUSUHWDWLRQRIWKHREVHUYHGHYLGHQFHIRUHQVLFH[DPLQHUVSURYLGHHYLGHQFHWR

EHXVHGE\DFRXUWRIODZ>@7KLVHYLGHQFHLVWDNHQLQWRDFFRXQWE\WKHFRXUWWR

GHFLGHDERXWVRPHRQH·VLQQRFHQFHRUJXLOW

)RUHQVLFH[DPLQHUVFDQHYDOXDWHWKHHYLGHQFHDWVRXUFHDFWLYLW\RURIIHQVH

OHYHO>@$WVRXUFHOHYHOTXHVWLRQVDGGUHVVWKHRULJLQRIWKHHYLGHQWLDOPDWHULDOVXFK

DV ´'LG WKH JODVV IUDJPHQWV FRPH IURP WKLV ZLQGRZ RU DQRWKHU EURNHQ JODVV

REMHFW"µ$FWLYLW\OHYHOTXHVWLRQVDGGUHVVDFWLRQVVXFKDV´'LGSHUVRQ$VPDVKWKH

ZLQGRZRUZDVLWVRPHRQHHOVH"µ$WWKHKLJKHVWOHYHORILQWHUSUHWDWLRQRIIHQVHOHYHO

TXHVWLRQVDUHWKRVHWKDWDUHFRQVLGHUHGE\WKHFRXUWLWVHOIVXFKDV´'LGSHUVRQ$

FRPPLWWKHEXUJODU\RUZDVLWVRPHRQHHOVHµ)RUHQVLFH[DPLQHUVQHHGDGGLWLRQDO

LQIRUPDWLRQ VXFK DV LQIRUPDWLRQ DERXW WKH SUREDELOLWLHV RI WUDQVIHU SHUVLVWHQFH

UHFRYHU\DQGEDFNJURXQGOHYHOVRIWUDFHV>@WREHDEOHWRHYDOXDWHWKHHYLGHQFHDW

DFWLYLW\OHYHOLQVWHDGRIDWWKHORZHUVRXUFHOHYHO

)HDWXUHFRPSDULVRQGLVFLSOLQHVVXFKDVILUHDUPDQGILQJHUSULQWH[DPLQDWLRQ

W\SLFDOO\ SURYLGH HYLGHQFH DW VRXUFH OHYHO )RUHQVLF H[DPLQHUV ZRUNLQJ LQ WKHVH

GLVFLSOLQHVSURYLGHMXGJPHQWVDERXWWKHVRXUFHRIWKHPDWHULDOE\H[DPLQLQJIHDWXUHV

VXFKDVGHVLJQFKDUDFWHULVWLFVVWULDWLRQVDQGLPSUHVVLRQVIRUILUHDUPH[DPLQDWLRQ>@

DQGJHQHUDOSDWWHUQVPLQXWLDHRUULGJHGHWDLOIRUILQJHUSULQWH[DPLQDWLRQ>@7KH\

FRPSDUHWKHIHDWXUHVLQDUHFRYHUHGEXOOHWRUILQJHUPDUNIURPDTXHVWLRQHGVRXUFH

ZLWKWKRVHRIDUHIHUHQFHLWHPIURPDNQRZQVRXUFHVXFKDVWHVWVKRWVIURPDILUHDUP

RUUHIHUHQFHSULQWVIURPDQDFFXVHGVSHFLILFVRXUFHFRPSDULVRQVRUEHWZHHQVHYHUDO

UHFRYHUHGEXOOHWVRUILQJHUPDUNVFRPPRQVRXUFHFRPSDULVRQV>@

7KHOLNHOLKRRGUDWLR/5RU´ORJLFDODSSURDFKµLVWKHPHWKRGRIFKRLFHWR

HYDOXDWHWKHUHVXOWVRIVXFKFRPSDULVRQV>@,QWKLVDSSURDFKWKHSUREDELOLW\

RIWKHFRPSDULVRQ UHVXOWV (LV HYDOXDWHGXQGHU DWOHDVW WZRPXWXDOO\H[FOXVLYH

SURSRVLWLRQV>@ZKLFKW\SLFDOO\UHIOHFWWKHSRLQWRIYLHZRIWKHSURVHFXWLRQ+S DQGRIWKHGHIHQVH+G7KHUDWLRRIWKHVHWZRSUREDELOLWLHVZKLOHFRQVLGHULQJWKH

FDVHFLUFXPVWDQFHV,GHILQHVWKHHYLGHQWLDOVWUHQJWKWKHOLNHOLKRRGUDWLR/5>

@

1



ܮܴ ൌ^{௣ሺாȁு}_{௣ሺாȁு}^೛ǡூሻ

೏ǡூሻ         



%\ FRQVLGHULQJ WZR SURSRVLWLRQV WKH OLNHOLKRRG UDWLR DSSURDFK WDNHV LQWR

DFFRXQWWKHSUREDELOLVWLFQDWXUHRIHYLGHQFHDQGGRHVVRLQDEDODQFHGDQGORJLFDOO\

XQIODZHGZD\>@'HVSLWHWKHVHDGYDQWDJHVDGRSWLRQDQGLPSOHPHQWDWLRQRI

WKLV DSSURDFK LQ SUDFWLFH VHHPV WR YDU\ EHWZHHQ FRXQWULHV DQG LQVWLWXWLRQV EXW LV

RIWHQVORZ>@0DQ\H[DPLQHUVVWLOOUHSRUWWKHRXWFRPHRIWKHLUH[DPLQDWLRQDV

DFDWHJRULFDOFRQFOXVLRQVWDWLQJWKDWIRUH[DPSOHDEXOOHWZDVRUZDVQRWILUHGZLWKD

VSHFLILHGILUHDUPRUWKDWWKH\FRXOGQRWHVWDEOLVKWKLV7KHVHFDWHJRULFDOFRQFOXVLRQV

H[DJJHUDWH WKH HYLGHQWLDO VWUHQJWK E\ VXSSUHVVLQJ DQ\ QRWLRQ RI XQFHUWDLQW\ 7KH

ZKROHSRVVLEOHUDQJHRIHYLGHQWLDOVWUHQJWKVLVUHGXFHGWRRQO\WKUHHRSWLRQVLQILQLW\

\HVWKHEXOOHWZDVILUHGZLWKWKHVSHFLILHGILUHDUP]HURQRWKHEXOOHWZDVILUHG

ZLWK DQRWKHU ILUHDUP DQG RQH QR VXSSRUW IRU HLWKHU SURSRVLWLRQ 6FLHQWLILF

FRPPLWWHHVDQGOHDGLQJIRUHQVLFVFLHQWLVWVDUHFULWLFDORIWKHVHFDWHJRULFDOFRQFOXVLRQV

DQG H[SUHVV WKH QHHG WR HYDOXDWH WKH HYLGHQFH PRUH LQ OLQH ZLWK LWV SUREDELOLVWLF

QDWXUHE\DSSO\LQJWKHOLNHOLKRRGUDWLRDSSURDFK>@

,Q &KDSWHU  ZH GLVFXVV WKH VRXUFHOHYHO HYDOXDWLRQ RI ILUHDUP HYLGHQFH

IROORZLQJWKHOLNHOLKRRGUDWLRDSSURDFK



+80$1)$&7256

(YHQWKRXJKWKHFRXUWVRIODZWHQGWRWUHDWWKHWHVWLPRQLHVRIH[DPLQHUVDVLPSDUWLDO

DQG REMHFWLYH > @ WKRVH WHVWLPRQLHV DUH RIWHQ WKH UHVXOW RI REVHUYDWLRQV DQG

HYDOXDWLRQV RI KXPDQ H[DPLQHUV ,Q VRPHIRUHQVLF GLVFLSOLQHV VXFK DV '1$ DQG

GUXJ DQDO\VLV YDULRXV NH\ VWHSV RI WKH H[DPLQDWLRQ DUH QRZ DXWRPDWHG ZKLOH LQ

RWKHUV VXFK DV ILUHDUP DQG ILQJHUSULQW H[DPLQDWLRQ WKH H[DPLQHU LV WKH PDLQ

LQVWUXPHQWRIDQDO\VLVDQGLQWHUSUHWDWLRQ>@7KHH[DPLQHUFRPSDUHVWKH

IHDWXUHVDQGSURYLGHVDMXGJPHQWDERXWWKHVRXUFHRIWKHHYLGHQWLDOPDWHULDOZKLFK

PDNHVWKHVHMXGJPHQWVVXEMHFWLYH>@

&ODLPLQJH[SHUWLVHEDVHGRQWUDLQLQJDQGH[SHULHQFHDQGUHO\LQJRQWKHIDFH

YDOLGLW\RIWKHPHWKRGVDSSOLHGKDVORQJEHHQVXIILFLHQWIRUWKHFRXUWVWRDFFHSWWKH

YDOLGLW\ RI IRUHQVLF MXGJPHQWV %XW WKH H[DPLQHUV· MXGJPHQWV DUH LQFUHDVLQJO\

FKDOOHQJHGEHFDXVHRIDODFNRIVXIILFLHQWHPSLULFDOGDWDVXEVWDQWLDWLQJWKHLUYDOLGLW\



DQG UHOLDELOLW\ >   @ DQG EHFDXVH WKH ULVNV RI FRJQLWLYH ELDVHV DUH

UHFRJQL]HG>@



([SHUWLVH

5HFHQW FKDOOHQJHV RI WKH FODLPHG H[SHUWLVH RI H[DPLQHUV >   @ UDLVH

TXHVWLRQVDERXWZKDWLVH[SHUWLVHLQWKHILUVWSODFHDQGKRZH[DPLQHUVFDQDFKLHYH

WKLV([SHUWLVHKDVEHHQGHILQHGDV´FRQVLVWHQWO\VXSHULRUSHUIRUPDQFHRQDVSHFLILF

VHW RI UHSUHVHQWDWLYH WDVNV IRU D GRPDLQµ > S @ )RU IHDWXUHFRPSDULVRQ

GLVFLSOLQHV WKH FRPSDULVRQ RI IHDWXUHV ZRXOG EH D UHSUHVHQWDWLYH WDVN DQG VR LV

MXGJLQJ LI WKH FRPSDULVRQ UHVXOWV SURYLGH VXSSRUW IRU WKH VDPHVRXUFH RU WKH

GLIIHUHQWVRXUFHSURSRVLWLRQ DQGWRZKLFKGHJUHH7KH SHUIRUPDQFHRIH[DPLQHUV

FDQEHPHDVXUHGE\FDOFXODWLQJKRZRIWHQWKHLUMXGJHGVXSSRUWIRUDSURSRVLWLRQLV

SRLQWLQJ LQ WKH FRUUHFW GLUHFWLRQ DQG IRU WKRVH ZKR DSSO\ WKH OLNHOLKRRG UDWLR

DSSURDFKE\DOVRDVVHVVLQJKRZZHOOFDOLEUDWHGWKHLUMXGJHGGHJUHHVRIVXSSRUWDUH

:KHQSHRSOHVWDUWWRZRUNLQDIRUHQVLFGRPDLQWKH\DUHW\SLFDOO\VXSHUYLVHG

E\ DQ H[SHULHQFHG H[DPLQHU 'XULQJ \HDUV RI WUDLQLQJ WKH\ OHDUQ WR SHUIRUP WKH

QHFHVVDU\ WDVNVDQGDFTXLUHDOHYHORISURILFLHQF\ZKLFK HQDEOHVWKHP WR ZRUNDV

LQGHSHQGHQW H[DPLQHUV :KLOH LW LV RIWHQ DVVXPHG WKDW DGGLWLRQDO H[SHULHQFH ZLOO

LQFUHDVHSHUIRUPDQFHRYHUWLPHUHVHDUFKLQRWKHUGRPDLQVKDVGHPRQVWUDWHGWKDW

WKHFRUUHODWLRQEHWZHHQH[SHULHQFHDQGH[SHUWSHUIRUPDQFHLVORZIRUUHYLHZVVHH

>@0RVWSURIHVVLRQDOVUHDFKDFHUWDLQOHYHORISHUIRUPDQFHDIWHUZKLFKWKHLU

GHYHORSPHQWFRPHVWRDKDOW7KH\PDLQWDLQWKLV´DFFHSWDEOHµOHYHORISHUIRUPDQFH

GXULQJ WKH UHPDLQGHU RI WKHLU FDUHHU 7KHVH SURIHVVLRQDOV ZKR DUH UHJDUGHG DV

H[SHUWVE\ WKH FRXUWPD\ RXWSHUIRUP QRYLFHVEXW ZLOO QRWUHDFKWKHLUPD[LPXP

OHYHO RI SHUIRUPDQFH ,PSURYHPHQW EH\RQG WKLV OHYHO WRZDUGV PD[LPXP H[SHUW

SHUIRUPDQFH FDQ EH DFTXLUHG WKURXJK ´GHOLEHUDWH SUDFWLFHµ >@ :LWK GHOLEHUDWH

SUDFWLFH UHSHDWHG WUDLQLQJ WDVNV ZLWK LPPHGLDWH IHHGEDFN DUH XVHG WR DFWLYHO\

PRQLWRURQH·VSURJUHVVE\FRQFHQWUDWLQJRQWKHFULWLFDODVSHFWVRIWKHWDVNVDQGE\

KRQLQJ RQH·V FDSDFLW\ WR SHUIRUP WKHVH 7KLV DFWLYH DSSURDFK GLIIHUHQWLDWHV WKH

GHYHORSPHQWRIH[SHUWLVHIURPPHUHO\JDLQLQJH[SHULHQFHZKLFKVLPSO\VWUHQJWKHQV

RUDXWRPDWHVSRVVLEO\VXERSWLPDOFRJQLWLYHPHFKDQLVPV>@7KURXJKGHOLEHUDWH

SUDFWLFHH[DPLQHUVPD\EHFRPHPRUHDWWXQHGWRQHZRUPRUHLQIRUPDWLYHIHDWXUHV

DQGRUOHDUQKRZWRXVHWKHVHDSSURSULDWHO\WRLPSURYHSHUIRUPDQFH>@7KLVPD\

HQDEOH H[DPLQHUV WR OHVV RIWHQ SURYLGH VXSSRUW IRU WKH IDOVH SURSRVLWLRQ IRU

LQFUHDVLQJO\GLIILFXOWFRPSDULVRQV

1



,QIRUHQVLFVFLHQFHVXFKDSSURSULDWHDQGLPPHGLDWHIHHGEDFN²DUHTXLUHPHQW

IRUGHOLEHUDWHSUDFWLFH²LVXQFRPPRQ([DPLQHUV·H[SHULHQFHPDLQO\VWHPVIURP

FDVHZRUNFRPSDULVRQVEXWWKHZKROHUHDVRQIRUGRLQJWKHVHFRPSDULVRQVLVWKDWWKH

VRXUFHRIWUDFHVLVXQNQRZQDQGQHHGVWREHHVWDEOLVKHG7KLVPHDQVWKDWFDVHZRUN

FDQQRWSURYLGHWKHQHFHVVDU\IHHGEDFNEHFDXVHWKHH[DPLQHU·VFRQFOXVLRQFDQQRWEH

HYDOXDWHGZLWKRXWNQRZLQJZKLFKSURSRVLWLRQLVWUXH3URILFLHQF\WHVWVLQZKLFKWKH

DFWXDOVRXUFHRIWUDFHVLVNQRZQGRSURYLGHWKHQHFHVVDU\IHHGEDFN>HJ@%XW

LQ SUDFWLFH IHHGEDFN IURP WKHVH WHVWV LV QRW LPPHGLDWH DQG WKH WHVWV DUH VFDUFH

PDNLQJLWLPSRVVLEOHWRVSHQGWKHUHTXLUHGDPRXQWRIWLPH²RIPDQ\KRXUVDGD\

RYHUDSHULRGRIDWOHDVWWHQ\HDUV>@²RQGHOLEHUDWHSUDFWLFHWRUHDFKPD[LPXP

H[SHUWSHUIRUPDQFHLQWHUPVRIGLVFULPLQDWLRQDQGFDOLEUDWLRQRIMXGJPHQWV

7KHVHSUDFWLFDOUHVWULFWLRQVKLQGHULQJWKHDFTXLVLWLRQRIH[SHUWSHUIRUPDQFH

GRQRWPHDQWKDWZHVKRXOGQRWXVHWKHMXGJPHQWVRIIRUHQVLFH[DPLQHUVLQFRXUW

'XHWRWKHLUWUDLQLQJ NQRZOHGJHDQGH[SHULHQFH WKHLU SHUIRUPDQFHZLOO SUREDEO\

VWLOO EH EHWWHU WKDQ WKDW RI QRYLFHV %XW LW GRHV VHHP QHFHVVDU\ WR DVVHVV WKHLU

SHUIRUPDQFHDQGWRFRPSDUHLWWRDVWDQGDUGRI´DFFHSWDEOHSHUIRUPDQFHµDVVHWE\

WKHFRXUW

$QRWKHUUHTXLUHPHQWWREHDEOHWRDFTXLUHH[SHUWSHUIRUPDQFHLVWKHQHHGIRU

DVXIILFLHQWO\SUHGLFWDEOHHQYLURQPHQW>@%HFDXVHWKLVUHTXLUHPHQWVHHPVWREH

IXOILOOHGH[DPLQHUVPD\WRDFHUWDLQH[WHQWVWLOOEHDEOHWROHDUQWKHSDWWHUQVRIWKH

UHFXUULQJIHDWXUHVWKDWWKH\HYDOXDWHLQWKHLUUHOHYDQWSRSXODWLRQ5HVHDUFKKDVVKRZQ

WKDW WKURXJK SHUFHSWXDO OHDUQLQJ SHRSOH EHFRPH PRUH DWWXQHG WR GLVFULPLQDWLQJ

IHDWXUHVDQGVWUXFWXUDOUHODWLRQV7KLVLQFUHDVHVWKHLUVHOHFWLYLW\DQGIOXHQF\RIWKH

H[WUDFWLRQRILQIRUPDWLRQIURPDVWLPXOXVPDNLQJLWHDVLHUWRFODVVLI\WKHVWLPXOXV

>@,WKDVEHHQVKRZQWKDWSHRSOHDUHDEOHWRDXWRPDWLFDOO\DQGXQFRQVFLRXVO\

OHDUQVWDWLVWLFDOUHODWLRQVKLSVRIWKLVLQIRUPDWLRQ²FDOOHGYLVXDOVWDWLVWLFDOOHDUQLQJ²

ZKHQ WKH\ SD\ DWWHQWLRQ WR WKH WDVN >@ $OWKRXJK YLVXDO VWDWLVWLFDO OHDUQLQJ

VWXGLHVKDYHPDLQO\IRFXVHGRQWKHDELOLW\WROHDUQVWDWLVWLFVRIDUWLILFLDOVLQJOHVKDSH

RU KLJKHURUGHU VSDWLDO VWUXFWXUHV > @ D UHFHQW VWXG\ VKRZV WKDW LW DOVR PD\

KDSSHQZLWKIRUHQVLFVWLPXOL>@6XFKXQVWUXFWXUHGDQGXQFRQVFLRXVOHDUQLQJPD\

HYHQXQGHUSLQWKHDVVXPSWLRQWKDWIRUHQVLFH[DPLQHUVDUHDEOHWRSURYLGHDFFXUDWH

GHJUHHRIVXSSRUWMXGJPHQWVRIPRUHDEVWUDFWVWLPXOLVXFKDVGHJUHHVRIVLPLODULW\

RIVWULDWLRQSDWWHUQVDQGPLQXWLDHFRQILJXUDWLRQV>@

$OO LQ DOO D SHUVRQ·V H[SHULHQFH PD\ OHDG WR KLJKHU SHUIRUPDQFH ZKHQ WKH

MXGJPHQWLVPDGHLQDSUHGLFWDEOHHQYLURQPHQWDQGZKHQWKHGHFLVLRQPDNHUKDV



KDGWKHRSSRUWXQLW\WRJHWWRNQRZWKHHQYLURQPHQWDQGWKHSDWWHUQVRIUHFXUULQJ

IHDWXUHVWKHUHLQ%XWH[SHULHQFHDQGFRQILGHQFHKDUGO\VHHPUHOLDEOHLQGLFDWRUVRI

MXGJPHQWDFFXUDF\DQGWKHDEVHQFHRIDSSURSULDWHIHHGEDFNFRXOGHYHQUHVXOWLQWKH

LOOXVLRQRIYDOLGLW\>@OHDGLQJWRRYHUFRQILGHQFH>@$SHUVRQFDQDWWDLQH[SHUW

SHUIRUPDQFHZKHQDSUHGLFWDEOHOHDUQLQJHQYLURQPHQWLVFRXSOHGZLWKIHHGEDFNRQ

MXGJPHQWVLHD´NLQGHQYLURQPHQWµ>@HQDEOLQJWKHPWROHDUQIURPPLVWDNHV

,Q &KDSWHU  DQG  ZH SUHVHQW WZR VWXGLHV DERXW WKH DELOLW\ RI ILUHDUP

H[DPLQHUVWRGLVWLQJXLVKEHWZHHQVDPHVRXUFHDQGGLIIHUHQWVRXUFHFRPSDULVRQV,Q

WKHVHVWXGLHVZHDVNHGWKHH[DPLQHUVWRFRPSDUHVWULDWLRQDQGLPSUHVVLRQSDWWHUQV

DQGWRMXGJHZKHWKHUWKHUHVXOWVSURYLGHVXSSRUWIRUWKHVDPHVRXUFHRUGLIIHUHQW

VRXUFHSURSRVLWLRQDQGWRTXDOLI\WKHGHJUHHRIVXSSRUWIRUWKHSURSRVLWLRQ

,Q &KDSWHU  ZH SUHVHQW D VWXG\ RQ YLVXDO VWDWLVWLFDO OHDUQLQJ LQ ILQJHUSULQW

H[DPLQDWLRQ,QWKLVVWXG\ZHDVNHGH[DPLQHUVDQGQRYLFHVWRMXGJHWKHIUHTXHQF\

RIRFFXUUHQFHRIJHQHUDOILQJHUSULQWSDWWHUQVDQGZHFRPSDUHGWKHLUMXGJPHQWVZLWK

WKHDFWXDOIUHTXHQFLHVRIRFFXUUHQFH



%LDV

:KHQSHRSOHPDNHMXGJPHQWVXQGHUXQFHUWDLQW\WKH\WHQGWRUHO\RQKHXULVWLFVWR

VLPSOLI\VXFKFRPSOH[FRJQLWLYHWDVNV>@:KLOHWKLVW\SLFDOO\OHDGVWRPRUHHIILFLHQW

GHFLVLRQVLWDOVRFRPHVDWWKHFRVWRIHUURUVUHVXOWLQJIURPFRJQLWLYHELDV,QIRUHQVLF

VFLHQFHWKHHIIHFWVRIELDVFDQDSSHDUGXULQJHYHU\VWHSRIWKHH[DPLQDWLRQ,WFDQ

DIIHFWZKLFKHYLGHQWLDOPDWHULDOLVFROOHFWHGDWWKHFULPHVFHQH>@ZKLFKDQDO\VHV

DUHFDUULHGRXW>@WKHREVHUYDWLRQV>@WKHLQWHUSUHWDWLRQRIWKHREVHUYDWLRQV>@

DQGSHHUUHYLHZ>@

6HYHUDOVRXUFHVRIELDVKDYHEHHQUHFRJQL]HG>@VRPHLIZKLFKUHODWHWR

WKHVSHFLILFFDVHELDVLQGXFHGE\WKHWUDFHLWVHOIE\WKHUHIHUHQFHPDWHULDORUE\WKH

FRQWH[WLQIRUPDWLRQZKLOHRWKHUVUHODWHWRWKHSHUVRQGRLQJWKHZRUNRUWRKXPDQ

QDWXUH EDVH UDWH H[SHFWDWLRQV RUJDQL]DWLRQDO IDFWRUV HGXFDWLRQ DQG WUDLQLQJ DQG

SHUVRQDO DQG FRJQLWLYH IDFWRUV &RQILUPDWLRQ DQG FRQWH[WXDO ELDV UHFHLYH PRVW

DWWHQWLRQZLWKLQIRUHQVLFVFLHQFH>HJ@&RQILUPDWLRQELDVLVWKHWHQGHQF\WR

REVHUYHRUHYHQVHHNRXWLQIRUPDWLRQDQGLQWHUSUHWLWLQOLQHZLWKSUHH[LVWLQJEHOLHIV

IRUDUHYLHZVHH>@&RQWH[WXDOELDVLVWKHWHQGHQF\WRKDYHFHUWDLQH[SHFWDWLRQV

DERXW WKH UHVXOWV RI WKH H[DPLQDWLRQ DQG WR REVHUYH DQG LQWHUSUHW WKH HYLGHQWLDO

PDWHULDOZKLOHEHLQJJXLGHGE\WDVNLUUHOHYDQWFRQWH[WLQIRUPDWLRQ>@

1



$OWKRXJKFRJQLWLYHELDVKDVEHHQVKRZQWRDIIHFWIRUHQVLFGHFLVLRQPDNLQJ

IRUDUHYLHZVHH>@PDQ\SHRSOHIDOVHO\EHOLHYHWKDWIRUHQVLFH[DPLQHUVZLOOEH

LPPXQHWRLWVHIIHFWVHYHQWKRXJKWKHLUUHOLDQFHRQSDVWH[SHULHQFHVDQGWKHUHOLDQFH

RQKHXULVWLFVPD\PDNHWKHPPRUHVXVFHSWLEOHWRELDV>@0DQ\IRUHQVLFH[DPLQHUV

HYHQVHHPWRVKRZDELDVEOLQGVSRWDSDUWLFXODULQVWDQFHRIWKH´EHWWHUWKDQDYHUDJH

HIIHFWµ>@ZKHUHRIWKHIRUHQVLFH[DPLQHUVUHFRJQL]HWKDWELDVDIIHFWV

IRUHQVLFGHFLVLRQPDNLQJEXWRQO\EHOLHYHWKDWLWZLOODIIHFWWKHLURZQGHFLVLRQ

PDNLQJ>@

%HFDXVHWKHVHELDVHVDUHQRWWKHUHVXOWRI FRQVFLRXVFRJQLWLYHPHFKDQLVPV

WKH\ FDQQRW EH PLWLJDWHG E\ IRUFH RI ZLOO > @ $ ZD\ WR JXDUG DJDLQVW WKH

XQZDQWHG HIIHFWV RI FRQILUPDWLRQ RU FRQWH[WXDO ELDV LV WR LPSOHPHQW FRQWH[W

LQIRUPDWLRQ PDQDJHPHQW SURFHGXUHV LQ IRUHQVLF FDVHZRUN >  @ 6XFK

SURFHGXUHVFDQLQFOXGHOLQHDUVHTXHQWLDOXQPDVNLQJ>@WKHPDQDJHPHQW

RIFDVHLQIRUPDWLRQ>@DQGEOLQGYHULILFDWLRQRUSHHUUHYLHZ>@

,Q&KDSWHUZHGHVFULEHDVWXG\RIELDVGXULQJSHHUUHYLHZRIWKHMXGJPHQWV

RI ILUHDUP H[DPLQHUV ,Q WKLV VWXG\ ZH FRPSDUH D QRQEOLQG ZKHUH WKH SHHU

UHYLHZLQJH[DPLQHUNQRZVWKHLQWHUSUHWDWLRQRIWKHILUVWH[DPLQHUZLWKDEOLQGSHHU

UHYLHZ SURFHGXUH ZKHUH WKH SHHUUHYLHZLQJ H[DPLQHU SURYLGHV DQ LQGHSHQGHQW

MXGJPHQWZLWKRXWNQRZLQJWKHLQWHUSUHWDWLRQRIWKHILUVWH[DPLQHU

,Q &KDSWHU  ZH GHVFULEH WKH LPSOHPHQWDWLRQ RI D FRQWH[W LQIRUPDWLRQ

PDQDJHPHQWSURFHGXUHLQILUHDUPH[DPLQDWLRQFDVHZRUN7KHSURFHGXUHIRFXVHVRQ

WKHPDQDJHPHQWRILQIRUPDWLRQWRGHFUHDVHWKHSUREDELOLW\WKDWWKHREVHUYDWLRQVDQG

LQWHUSUHWDWLRQVRIWKHILUHDUPH[DPLQHUDUHELDVHGE\FDVHLQIRUPDWLRQ



&20387(5%$6('0(7+2'6

$SDUWIURPHIIRUWVWRHVWDEOLVKWKHYDOLGLW\DQGUHOLDELOLW\RIIRUHQVLFMXGJPHQWVDQG

WRVWUHQJWKHQWKRVHMXGJPHQWVWKURXJKIHHGEDFNDQGE\PLWLJDWLQJELDVH[DPLQHUV

FDQ DOVR REWDLQ VXSSRUW IURP FRPSXWHUEDVHG PHWKRGV >@ ,Q IRUHQVLF SUDFWLFH

VXFKPHWKRGVFDQEHHPSOR\HGWRVHDUFKODUJHUGDWDEDVHVIRUVLPLODUIHDWXUHVEXW

FDQDOVREHXVHGZKHQDVVLJQLQJDQHYLGHQWLDOVWUHQJWKWRWKHUHVXOWVRIDFRPSDULVRQ

6HYHUDOVXFKPHWKRGVIRUFRPSDULVRQDQGHYDOXDWLRQKDYHEHHQGHYHORSHGIRU

ILUHDUPH[DPLQDWLRQ>HJ @DQGILQJHUSULQWH[DPLQDWLRQ>HJ @

7KHVHPHWKRGVW\SLFDOO\UHO\RQPHDVXUHPHQWVRIWKHDYDLODEOHIHDWXUHVZKLFKDUH

FRPSDUHGE\DOJRULWKPVWRDVVHVVDGHJUHHRIVLPLODULW\7KHSUREDELOLW\RIWKLVGHJUHH



RIVLPLODULW\XQGHUWKHVDPHVRXUFH+SRUGLIIHUHQWVRXUFH+GSURSRVLWLRQLVWKHQ

DVVHVVHGE\FRPSDULQJWKHGHJUHHRIVLPLODULW\ZLWKWKRVHRIUHIHUHQFHGDWDEDVHVRI

NQRZQ VDPHVRXUFH ZLWKLQ DQG NQRZQ GLIIHUHQWVRXUFH EHWZHHQ FRPSDULVRQV

7KHUDWLRRIWKHSUREDELOLWLHVRIWKHREVHUYHGGHJUHHRIVLPLODULW\IRUVDPHVRXUFH

DQGGLIIHUHQWVRXUFHFRPSDULVRQVGHILQHVWKHHYLGHQWLDOVWUHQJWKRIWKHFRPSDULVRQ

UHVXOW7KLVFDOFXODWHG´PRUHREMHFWLYHµRU´KDUGµHYLGHQWLDOVWUHQJWKFDQWKHQEH

UHSRUWHGRUEHFRPELQHGZLWKWKHPRUHVXEMHFWLYHMXGJPHQWRIDQH[DPLQHU>

 @&RPELQLQJ WKH RXWFRPHV RIWKHFRPSXWHUEDVHGPHWKRGVZLWK H[DPLQHU

MXGJPHQWV VWLOO VHHPV QHFHVVDU\ IRU PRVW IRUHQVLF GLVFLSOLQHV EHFDXVH WKH FXUUHQW

FRPSXWHUEDVHGPHWKRGVDUHVWLOOOLPLWHGLQWKHW\SHVRIIHDWXUHVIRUZKLFKWKH\FDQ

EHXVHGDQGKDYHOLPLWHGIOH[LELOLW\WRGHDOZLWKYDU\LQJFLUFXPVWDQFHV:KHQDSSOLHG

ZLWKLQWKHERXQGDULHVRILWVLQWHQGHGDQGYDOLGDWHGXVHLWKDVEHHQVXJJHVWHGWKDW

WKH RXWFRPHV RI D FRPSXWHUEDVHG PHWKRG VKRXOG FDUU\ PRUH ZHLJKW WKDQ WKH

MXGJPHQWV RI H[DPLQHUV >@ %XW RXWVLGH WKRVH ERXQGDULHV H[DPLQHUV VKRXOG EH

DOORZHG WR DGDSW WKH RXWFRPHV ZKHQ WKH\ FDQ FRQVLGHU DGGLWLRQDO IHDWXUHV DQG

FLUFXPVWDQFHV

6LPLODU WR KXPDQ MXGJPHQWV FRPSXWHUEDVHG PHWKRGV DOVR UHTXLUH D

SUHGLFWDEOH HQYLURQPHQW LQ RUGHU WR IXQFWLRQ ZHOO >@ DQG WKHLU DFTXLVLWLRQ

SDUDPHWHUV DQG FRPSDULVRQ DOJRULWKPV PXVW EH RSWLPL]HG DQG YDOLGDWHG >@

2YHUDOOFRPSXWHUEDVHGPHWKRGVVHHPWRRXWSHUIRUPKXPDQMXGJPHQWVZKHQWKH

SUHGLFWDELOLW\RIWKHHQYLURQPHQWLVVRORZWKDWSHRSOHKDYHGLIILFXOW\LQGHWHFWLQJ

DQG OHDUQLQJ WKH SDWWHUQV RI UHFXUULQJ IHDWXUHV DQG LQ PDLQWDLQLQJ FRQVLVWHQF\ RI

MXGJPHQWV DQG ZKHQ WKH HQYLURQPHQW LV KLJKO\ SUHGLFWDEOH ZKHUH SHRSOH PD\

GLVSOD\ RFFDVLRQDO ODSVHVRI DWWHQWLRQ )RU LQWHUPHGLDWHSUHGLFWDEOH HQYLURQPHQWV

H[DPLQHUVDUHH[SHFWHGWRRXWSHUIRUPFRPSXWHUEDVHGPHWKRGV>@

$SDUWIURPVWXG\LQJWKHSHUIRUPDQFHRIILUHDUPH[DPLQHUVZHDOVRGHVFULEH

WZRFRPSXWHUEDVHGPHWKRGVDSSOLHGWRILUHDUPH[DPLQDWLRQLQ&KDSWHUDQG:H

FRPSDUHWKHRXWFRPHVRIWKHFRPSXWHUEDVHGPHWKRGVZLWKWKHMXGJPHQWVRIWKH

ILUHDUPH[DPLQHUV

 

1



5()(5(1&(6

>@ &RPPLWWHHRQ,GHQWLI\LQJWKH1HHGVRIWKH)RUHQVLF6FLHQFHV&RPPXQLW\

1DWLRQDO5HVHDUFK&RXQFLO6WUHQJWKHQLQJIRUHQVLFVFLHQFHLQWKHXQLWHG

VWDWHV$SDWKIRUZDUG7KH1DWLRQDO$FDGHPLHV3UHVV

KWWSVGRLRUJ

>@ (XURSHDQ1HWZRUNRI)RUHQVLF6FLHQFH,QVWLWXWHV(QIVLJXLGHOLQHIRU

HYDOXDWLYHUHSRUWLQJLQIRUHQVLFVFLHQFHVWUHQJWKHQLQJWKHHYDOXDWLRQRIIRUHQVLFUHVXOWV

DFURVVHXURSHVWHRIUDH+20(,6(&02

KWWSHQIVLHXZSFRQWHQWXSORDGVPBJXLGHOLQHSGI

>@ &RRN5(YHWW,:-DFNVRQ*-RQHV3- /DPEHUW-$$

KLHUDUFK\RISURSRVLWLRQV'HFLGLQJZKLFKOHYHOWRDGGUHVVLQFDVHZRUN

6FLHQFH -XVWLFHKWWSVGRLRUJ6



>@ $)7(&ULWHULDIRU,GHQWLILFDWLRQ&RPPLWWHH7KHRU\RI

LGHQWLILFDWLRQUDQJHRIVWULDHFRPSDULVRQUHSRUWVDQGPRGLILHGJORVVDU\

GHILQLWLRQVDQDIWHFULWHULDIRULGHQWLILFDWLRQFRPPLWWHHUHSRUW$)7(

-RXUQDO

>@ &KDPSRG& (YHWW,$SUREDELOLVWLFDSSURDFKWRILQJHUSULQW

HYLGHQFH-RXUQDORI)RUHQVLF,GHQWLILFDWLRQ

>@ /DQJHQEXUJ*7KHFRQVLGHUDWLRQRIILQJHUSULQWSUREDELOLWLHVLQWKH

FRXUWURRP$XVWUDOLDQ-RXUQDORI)RUHQVLF6FLHQFHV

KWWSVGRLRUJ

>@ 2PPHQ'0 6DXQGHUV&3%XLOGLQJDXQLILHGVWDWLVWLFDO

IUDPHZRUNIRUWKHIRUHQVLFLGHQWLILFDWLRQRIVRXUFHSUREOHPV/DZ3UREDELOLW\

DQG5LVNKWWSVGRLRUJOSUPJ\

>@ $LWNHQ&**%HUJHU&(+%XFNOHWRQ-6&KDPSRG&&XUUDQ-

'DZLG$3(YHWW,:*LOO3*RQ]DOH]5RGULJXH]--DFNVRQ*

.ORRVWHUPDQ$/RYHORFN7/XF\'0DUJRW30F.HQQD/0HXZO\

'1HXPDQQ&1LF'DHLG11RUGJDDUG$3XFK6ROLV55DVPXVVRQ

%5HGPD\QH05REHUWV35REHUWVRQ%5RX[&6MHUSV0-7DURQL

)7MLQ$7VRL79LJQDX[*$:LOOLV60 =DGRUD*



([SUHVVLQJHYDOXDWLYHRSLQLRQV$SRVLWLRQVWDWHPHQW6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ %XFNOHWRQ-67ULJJV&0 &KDPSRG&$QH[WHQGHG

OLNHOLKRRGUDWLRIUDPHZRUNIRULQWHUSUHWLQJHYLGHQFH6FLHQFH -XVWLFH

KWWSVGRLRUJ6

>@ %LHGHUPDQQ$*DUEROLQR3 7DURQL)7KHVXEMHFWLYLVW

LQWHUSUHWDWLRQRISUREDELOLW\DQGWKHSUREOHPRILQGLYLGXDOLVDWLRQLQIRUHQVLF

VFLHQFH6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ 0DUWLUH.$.HPS5,6D\OH0 1HZHOO%52QWKH

LQWHUSUHWDWLRQRIOLNHOLKRRGUDWLRVLQIRUHQVLFVFLHQFHHYLGHQFH3UHVHQWDWLRQ

IRUPDWVDQGWKHZHDNHYLGHQFHHIIHFW)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ $VVRFLDWLRQRI)RUHQVLF6FLHQFH3URYLGHUV6WDQGDUGVIRUWKH

IRUPXODWLRQRIHYDOXDWLYHIRUHQVLFVFLHQFHH[SHUWRSLQLRQ6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ &RRN5(YHWW,:-DFNVRQ*-RQHV3- /DPEHUW-$$

PRGHOIRUFDVHDVVHVVPHQWDQGLQWHUSUHWDWLRQ6FLHQFH -XVWLFH

KWWSVGRLRUJ6

>@ $LWNHQ&** 7DURQL)6WDWLVWLFVDQGWKHHYDOXDWLRQRIHYLGHQFHIRU

IRUHQVLFVFLHQWLVWVQGHG-RKQ:LOH\DQG6RQV

KWWSVGRLRUJ

>@ &KDPSRG&%DOGZLQ'7DURQL) %XFNOHWRQ-6)LUHDUP

DQGWRROPDUNVLGHQWLILFDWLRQ7KHED\HVLDQDSSURDFK$)7(-RXUQDO



>@ (YHWW,:7RZDUGVDXQLIRUPIUDPHZRUNIRUUHSRUWLQJRSLQLRQVLQ

IRUHQVLFVFLHQFHFDVHZRUN6FLHQFH -XVWLFH

KWWSVGRLRUJ6

>@ 0DUTXLV5%LHGHUPDQQ$&DGROD/&KDPSRG&*XHLVVD]/

0DVVRQQHW*0D]]HOOD:'7DURQL) +LFNV7'LVFXVVLRQ

RQKRZWRLPSOHPHQWDYHUEDOVFDOHLQDIRUHQVLFODERUDWRU\%HQHILWVSLWIDOOV

1



DQGVXJJHVWLRQVWRDYRLGPLVXQGHUVWDQGLQJV6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ %XQFK6 :HYHUV*$SSOLFDWLRQRIOLNHOLKRRGUDWLRVIRUILUHDUP

DQGWRROPDUNDQDO\VLV6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ 0DUWLUH.$.HPS5,:DWNLQV,6D\OH0$ 1HZHOO%5

7KHH[SUHVVLRQDQGLQWHUSUHWDWLRQRIXQFHUWDLQIRUHQVLFVFLHQFHHYLGHQFH

9HUEDOHTXLYDOHQFHHYLGHQFHVWUHQJWKDQGWKHZHDNHYLGHQFHHIIHFW/DZDQG

+XPDQ%HKDYLRUKWWSVGRLRUJOKE

>@ 7KRPSVRQ:&*UDG\5+/DL( 6WHUQ+63HUFHLYHG

VWUHQJWKRIIRUHQVLFVFLHQWLVWV·UHSRUWLQJVWDWHPHQWVDERXWVRXUFH

FRQFOXVLRQV/DZ3UREDELOLW\DQG5LVN

KWWSVGRLRUJOSUPJ\

>@ ([HFXWLYH2IILFHRIWKH3UHVLGHQW·V&RXQFLORI$GYLVRUVRQ6FLHQFHDQG

7HFKQRORJ\)RUHQVLFVFLHQFHLQFULPLQDOFRXUWV(QVXULQJVFLHQWLILFYDOLGLW\RI

IHDWXUHFRPSDULVRQPHWKRGV

KWWSVREDPDZKLWHKRXVHDUFKLYHVJRYVLWHVGHIDXOWILOHVPLFURVLWHVRVWS

3&$67SFDVWBIRUHQVLFBVFLHQFHBUHSRUWBILQDOSGI

>@ $$$6)RUHQVLFVFLHQFHDVVHVVPHQWV$TXDOLW\DQGJDSDQDO\VLVODWHQW

ILQJHUSULQWH[DPLQDWLRQ:&7KRPSVRQ-3%ODFN$.-DLQ -%

.DGDQHKWWSVZZZDDDVRUJVLWHVGHIDXOWILOHVVIV

SXEOLFUHSRUWV/DWHQW)LQJHUSULQW5HSRUW),1$/

BSGI

>@ 6DNV0- .RHKOHU--7KHLQGLYLGXDOL]DWLRQIDOODF\LQIRUHQVLF

VFLHQFHHYLGHQFH9DQGHUELOW/DZ5HYLHZ

>@ (GPRQG*)RXQG%0DUWLUH.%DOODQW\QH.+DPHU'6HDUVWRQ5

O7KRPSVRQ0%&XQOLIIH(.HPS5,6DQ5RTXH07DQJHQ-

0'LRVR9LOOD5/LJHUWZRRG$+LEEHUW':KLWH'5LEHLUR*

3RUWHU*7RZOHU$ 5REHUWV$0RGHOIRUHQVLFVFLHQFH

$XVWUDOLDQ-RXUQDORI)RUHQVLF6FLHQFHV

KWWSVGRLRUJ



>@ .DVVLQ60'URU,( .XNXFND-7KHIRUHQVLFFRQILUPDWLRQ

ELDV3UREOHPVSHUVSHFWLYHVDQGSURSRVHGVROXWLRQV-RXUQDORI$SSOLHG

5HVHDUFKLQ0HPRU\DQG&RJQLWLRQ

KWWSVGRLRUJMMDUPDF

>@ 'URU,(.DVVLQ60 .XNXFND-1HZDSSOLFDWLRQRI

SV\FKRORJ\WRODZ,PSURYLQJIRUHQVLFHYLGHQFHDQGH[SHUWZLWQHVV

FRQWULEXWLRQV-RXUQDORI$SSOLHG5HVHDUFKLQ0HPRU\DQG&RJQLWLRQ

KWWSVGRLRUJMMDUPDF

>@ 'URU,( &ROH6$7KHYLVLRQLQEOLQGMXVWLFH([SHUW

SHUFHSWLRQMXGJPHQWDQGYLVXDOFRJQLWLRQLQIRUHQVLFSDWWHUQUHFRJQLWLRQ

3V\FKRQRPLF%XOOHWLQ 5HYLHZ

KWWSVGRLRUJSEU

>@ 6WRHO5'.HUNKRII:0DWWLMVVHQ(-$7 %HUJHU&(+

%XLOGLQJWKHUHVHDUFKFXOWXUHLQWKHIRUHQVLFVFLHQFHV$QQRXQFHPHQWRID

GRXEOHEOLQGWHVWLQJSURJUDP6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ 'URU,( +DPSLNLDQ*6XEMHFWLYLW\DQGELDVLQIRUHQVLF'1$

PL[WXUHLQWHUSUHWDWLRQ6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ 6DNV0- .LGG5)+XPDQLQIRUPDWLRQSURFHVVLQJDQG

DGMXGLFDWLRQ7ULDOE\KHXULVWLFV/DZ 6RFLHW\5HYLHZ

KWWSVGRLRUJ

>@ 5LVLQJHU'06DNV0-7KRPSVRQ:& 5RVHQWKDO57KH

GDXEHUWNXPKRLPSOLFDWLRQVRIREVHUYHUHIIHFWVLQIRUHQVLFVFLHQFH+LGGHQ

SUREOHPVRIH[SHFWDWLRQDQGVXJJHVWLRQ&DOLIRUQLD/DZ5HYLHZ

KWWSVGRLRUJ

>@ 6DNV0-5LVLQJHU'05RVHQWKDO5 7KRPSVRQ:&

&RQWH[WHIIHFWVLQIRUHQVLFVFLHQFH$UHYLHZDQGDSSOLFDWLRQRIWKHVFLHQFH

RIVFLHQFHWRFULPHODERUDWRU\SUDFWLFHLQWKHXQLWHGVWDWHV6FLHQFH -XVWLFH

KWWSVGRLRUJV[

>@ 0QRRNLQ-/&ROH6$'URU,()LVKHU%$-+RXFN00

,QPDQ..D\H'+.RHKOHU--/DQJHQEXUJ*5LVLQJHU'0

1



5XGLQ16LHJHO- 6WRQH\'$7KHQHHGIRUDUHVHDUFKFXOWXUH

LQWKHIRUHQVLFVFLHQFHV8&/$/DZ5HYLHZ

KWWSVGRLRUJVVUQ

>@ &ROH6$,PSOHPHQWLQJFRXQWHUPHDVXUHVDJDLQVWFRQILUPDWLRQELDV

LQIRUHQVLFVFLHQFH-RXUQDORI$SSOLHG5HVHDUFKLQ0HPRU\DQG&RJQLWLRQ

KWWSVGRLRUJMMDUPDF

>@ 7KRPSVRQ:&3DLQWLQJWKHWDUJHWDURXQGWKHPDWFKLQJSURILOH

7KHWH[DVVKDUSVKRRWHUIDOODF\LQIRUHQVLF'1$LQWHUSUHWDWLRQ/DZ

3UREDELOLW\DQG5LVNKWWSVGRLRUJOSUPJS

>@ 'URU,(3UDFWLFDOVROXWLRQVWRFRJQLWLYHDQGKXPDQIDFWRU

FKDOOHQJHVLQIRUHQVLFVFLHQFH)RUHQVLF6FLHQFH3ROLF\ 0DQDJHPHQW$Q

,QWHUQDWLRQDO-RXUQDO

KWWSVGRLRUJ

>@ &RRSHU*6 0HWHUNR9&RJQLWLYHELDVUHVHDUFKLQIRUHQVLF

VFLHQFH$V\VWHPDWLFUHYLHZ)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ )RUHQVLF6FLHQFH5HJXODWRU&RJQLWLYHELDVHIIHFWVUHOHYDQWWRIRUHQVLFVFLHQFH

H[DPLQDWLRQV)65*

KWWSVZZZJRYXNJRYHUQPHQWSXEOLFDWLRQVFRJQLWLYHELDVHIIHFWV

UHOHYDQWWRIRUHQVLFVFLHQFHH[DPLQDWLRQV

>@ (ULFVVRQ.$ /HKPDQQ$&([SHUWDQGH[FHSWLRQDO

SHUIRUPDQFH(YLGHQFHRIPD[LPDODGDSWDWLRQWRWDVNFRQVWUDLQWV$QQXDO

5HYLHZRI3V\FKRORJ\

KWWSVGRLRUJDQQXUHYSV\FK

>@ (ULFVVRQ.$7KHLQIOXHQFHRIH[SHULHQFHDQGGHOLEHUDWHSUDFWLFH

RQWKHGHYHORSPHQWRIVXSHULRUH[SHUWSHUIRUPDQFH,Q.$(ULFVVRQ1

&KDUQHVV3-)HOWRYLFK 55+RIIPDQ(GV7KHFDPEULGJHKDQGERRNRI

H[SHUWLVHDQGH[SHUWSHUIRUPDQFHSS&DPEULGJH8QLYHUVLW\3UHVV

KWWSVGRLRUJ&%2

>@ (ULFVVRQ.$.UDPSH57 7HVFK5|PHU&7KHUROHRI

GHOLEHUDWHSUDFWLFHLQWKHDFTXLVLWLRQRIH[SHUWSHUIRUPDQFH3V\FKRORJLFDO

5HYLHZKWWSVGRLRUJ;



>@ .HUNKRII:6WRHO5'%HUJHU&(+0DWWLMVVHQ(-$7

+HUPVHQ56PLWV1 +DUG\+-'HVLJQDQGUHVXOWVRIDQ

H[SORUDWRU\GRXEOHEOLQGWHVWLQJSURJUDPLQILUHDUPVH[DPLQDWLRQ6FLHQFH  -XVWLFHKWWSVGRLRUJMVFLMXV

>@ .HLVOHU0$,VRODWHGSDLUVUHVHDUFKVWXG\$)7(-RXUQDO



>@ .DKQHPDQ' .OHLQ*&RQGLWLRQVIRULQWXLWLYHH[SHUWLVH$

IDLOXUHWRGLVDJUHH$PHULFDQ3V\FKRORJLVW

KWWSVGRLRUJD

>@ +RJDUWK50(GXFDWLQJLQWXLWLRQ7KH8QLYHUVLW\2I&KLFDJR3UHVV

>@ +RJDUWK50/HMDUUDJD7 6R\HU(7KHWZRVHWWLQJVRINLQG

DQGZLFNHGOHDUQLQJHQYLURQPHQWV&XUUHQW'LUHFWLRQVLQ3V\FKRORJLFDO6FLHQFH

KWWSVGRLRUJ

>@ 6HLW]$53HUFHSWXDOOHDUQLQJ&XUUHQW%LRORJ\55

KWWSVGRLRUJMFXE

>@ .HOOPDQ3- *DUULJDQ33HUFHSWXDOOHDUQLQJDQGKXPDQ

H[SHUWLVH3K\VLFVRI/LIH5HYLHZV

KWWSVGRLRUJMSOUHY

>@ )LVHU- $VOLQ518QVXSHUYLVHGVWDWLVWLFDOOHDUQLQJRIKLJKHU

RUGHUVSDWLDOVWUXFWXUHVIURPYLVXDOVFHQHV3V\FKRORJLFDO6FLHQFH

KWWSVGRLRUJ

>@ )LVHU- $VOLQ516WDWLVWLFDOOHDUQLQJRIKLJKHURUGHUWHPSRUDO

VWUXFWXUHIURPYLVXDOVKDSHVHTXHQFHV-RXUQDORI([SHULPHQWDO3V\FKRORJ\

/HDUQLQJ0HPRU\DQG&RJQLWLRQ

KWWSG[GRLRUJ

>@ 7XUN%URZQH1%-XQJH- 6FKROO%-7KHDXWRPDWLFLW\RI

YLVXDOVWDWLVWLFDOOHDUQLQJ-RXUQDORI([SHULPHQWDO3V\FKRORJ\*HQHUDO

KWWSVGRLRUJ

1



>@ *URZQV% 0DWWLMVVHQ(-$7'LVWULEXWLRQDOVWDWLVWLFDO

OHDUQLQJ+RZDQGKRZZHOOFDQLWEHPHDVXUHG",Q3URFHHGLQJVRIWKHQG

DQQXDOFRQIHUHQFHRIWKHFRJQLWLYHVFLHQFHVRFLHW\SS

>@ 1RUGJDDUG$$QVHOO5'URW]: -DHJHU/6FDOHRI

FRQFOXVLRQVIRUWKHYDOXHRIHYLGHQFH/DZ3UREDELOLW\DQG5LVN

KWWSVGRLRUJOSUPJU

>@ .DKQHPDQ' 7YHUVN\$2QWKHSV\FKRORJ\RISUHGLFWLRQ

3V\FKRORJLFDO5HYLHZKWWSVGRLRUJK

>@ 7YHUVN\$ .DKQHPDQ'-XGJPHQWXQGHUXQFHUWDLQW\

+HXULVWLFVDQGELDVHV6FLHQFH

KWWSVGRLRUJVFLHQFH

>@ YDQGHQ(HGHQ&$-GH3RRW&- YDQ.RSSHQ3-7KH

IRUHQVLFFRQILUPDWLRQELDV$FRPSDULVRQEHWZHHQH[SHUWVDQGQRYLFHV

-RXUQDORI)RUHQVLF6FLHQFHVKWWSVGRLRUJ



>@ +DPQHWW+- 'URU,(7KHHIIHFWRIFRQWH[WXDOLQIRUPDWLRQ

RQGHFLVLRQPDNLQJLQIRUHQVLFWR[LFRORJ\)RUHQVLF6FLHQFH,QWHUQDWLRQDO6\QHUJ\

KWWSVGRLRUJMIVLV\Q

>@ 'URU,($KLHUDUFK\RIH[SHUWSHUIRUPDQFH-RXUQDORI$SSOLHG

5HVHDUFKLQ0HPRU\DQG&RJQLWLRQ

KWWSVGRLRUJMMDUPDF

>@ 0DWWLMVVHQ(-$7:LWWHPDQ&/0%HUJHU&(+ 6WRHO5'

&RJQLWLYHELDVHVLQWKHSHHUUHYLHZRIEXOOHWDQGFDUWULGJHFDVH

FRPSDULVRQFDVHZRUN$ILHOGVWXG\6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ 6WRHO5'%HUJHU&(+.HUNKRII:0DWWLMVVHQ(-$7 'URU

,(0LQLPL]LQJFRQWH[WXDOELDVLQIRUHQVLFFDVHZRUN,Q.-6WURP

0-+LFNPDQ(GV)RUHQVLFVFLHQFHDQGWKHDGPLQLVWUDWLRQRIMXVWLFH&ULWLFDO

LVVXHVDQGGLUHFWLRQV6$*(3XEOLFDWLRQV,QF

KWWSVGRLRUJQ



>@ 'URU,(&RJQLWLYHDQGKXPDQIDFWRUVLQH[SHUWGHFLVLRQPDNLQJ

6L[IDOODFLHVDQGWKHHLJKWVRXUFHVRIELDV$QDO\WLFDO&KHPLVWU\

KWWSVGRLRUJDFVDQDOFKHPF

>@ 'URU,(&KDUOWRQ' 3HURQ$(&RQWH[WXDOLQIRUPDWLRQ

UHQGHUVH[SHUWVYXOQHUDEOHWRPDNLQJHUURQHRXVLGHQWLILFDWLRQV)RUHQVLF

6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ .OD\PDQ-9DULHWLHVRIFRQILUPDWLRQELDV,Q-%XVHPH\HU5

+DVWLH '/0HGLQ(GV3V\FKRORJ\RIOHDUQLQJDQGPRWLYDWLRQ9ROSS

$FDGHPLF3UHVVKWWSVGRLRUJ6

>@ 3URQLQ(/LQ'< 5RVV/7KHELDVEOLQGVSRW3HUFHSWLRQVRI

ELDVLQVHOIYHUVXVRWKHUV3HUVRQDOLW\DQG6RFLDO3V\FKRORJ\%XOOHWLQ

KWWSVGRLRUJ

>@ 7KRPSVRQ:&:KDWUROHVKRXOGLQYHVWLJDWLYHIDFWVSOD\LQWKH

HYDOXDWLRQRIVFLHQWLILFHYLGHQFH"$XVWUDOLDQ-RXUQDORI)RUHQVLF6FLHQFHV

KWWSVGRLRUJ

>@ .XNXFND-.DVVLQ60=DSI3$ 'URU,(&RJQLWLYHELDV

DQGEOLQGQHVV$JOREDOVXUYH\RIIRUHQVLFVFLHQFHH[DPLQHUV-RXUQDORI

$SSOLHG5HVHDUFKLQ0HPRU\DQG&RJQLWLRQ

KWWSVGRLRUJMMDUPDF

>@ .UDQH'()RUG6*LOGHU-5,QPDQ.-DPLHVRQ$.RSSO5

.RUQILHOG,/5LVLQJHU'05XGLQ17D\ORU06 7KRPSVRQ:

&6HTXHQWLDOXQPDVNLQJ$PHDQVRIPLQLPL]LQJREVHUYHUHIIHFWVLQ

IRUHQVLF'1$LQWHUSUHWDWLRQ-RXUQDORI)RUHQVLF6FLHQFHV

KWWSVGRLRUJM[

>@ 'URU,(7KRPSVRQ:&0HLVVQHU&$.RUQILHOG,/.UDQH'

(6DNV0- 5LVLQJHU'0/HWWHUWRWKHHGLWRUFRQWH[W

PDQDJHPHQWWRROER[$OLQHDUVHTXHQWLDOXQPDVNLQJOVXDSSURDFKIRU

PLQLPL]LQJFRJQLWLYHELDVLQIRUHQVLFGHFLVLRQPDNLQJ-RXUQDORI)RUHQVLF

6FLHQFHVKWWSVGRLRUJ

>@ 0DWWLMVVHQ(-$7.HUNKRII:%HUJHU&(+'URU,( 6WRHO

5',PSOHPHQWLQJFRQWH[WLQIRUPDWLRQPDQDJHPHQWLQIRUHQVLF

1



FDVHZRUN0LQLPL]LQJFRQWH[WXDOELDVLQILUHDUPVH[DPLQDWLRQ6FLHQFH  -XVWLFHKWWSVGRLRUJMVFLMXV

>@ )RXQG% *DQDV-7KHPDQDJHPHQWRIGRPDLQLUUHOHYDQW

FRQWH[WLQIRUPDWLRQLQIRUHQVLFKDQGZULWLQJH[DPLQDWLRQFDVHZRUN6FLHQFH  -XVWLFHKWWSVGRLRUJMVFLMXV

>@ %DOODQW\QH.1(GPRQG* )RXQG%3HHUUHYLHZLQIRUHQVLF

VFLHQFH)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ 5LYD) &KDPSRG&$XWRPDWLFFRPSDULVRQDQGHYDOXDWLRQRI

LPSUHVVLRQVOHIWE\DILUHDUPRQILUHGFDUWULGJHFDVHV-RXUQDORI)RUHQVLF

6FLHQFHVKWWSVGRLRUJ

>@ 6RQJ-3URSRVHG´FRQJUXHQWPDWFKLQJFHOOVFPFµPHWKRGIRU

EDOOLVWLFLGHQWLILFDWLRQDQGHUURUUDWHHVWLPDWLRQ$)7(-RXUQDO



>@ %DLNHU0.HHUHZHHU,3LHWHUPDQ59HUPHLM(YDQGHU:HHUG- 

=RRQ34XDQWLWDWLYHFRPSDULVRQRIVWULDWHGWRROPDUNV)RUHQVLF

6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ 5LYD)0DWWLMVVHQ(-$7+HUPVHQ53LHSHU3.HUNKRII: 

&KDPSRG&&RPSDULVRQDQGLQWHUSUHWDWLRQRILPSUHVVHGPDUNVOHIW

E\DILUHDUPRQFDUWULGJHFDVHV²WRZDUGVDQRSHUDWLRQDOLPSOHPHQWDWLRQRID

OLNHOLKRRGUDWLREDVHGWHFKQLTXH)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ 1HXPDQQ&&KDPSRG&3XFK6ROLV5(JOL1$QWKRQLR]$ 

%URPDJH*ULIILWKV$&RPSXWDWLRQRIOLNHOLKRRGUDWLRVLQ

ILQJHUSULQWLGHQWLILFDWLRQIRUFRQILJXUDWLRQVRIDQ\QXPEHURIPLQXWLDH

-RXUQDORI)RUHQVLF6FLHQFHVKWWSVGRLRUJM

[

>@ (JOL10&KDPSRG& 0DUJRW3(YLGHQFHHYDOXDWLRQLQ

ILQJHUSULQWFRPSDULVRQDQGDXWRPDWHGILQJHUSULQWLGHQWLILFDWLRQV\VWHPV

PRGHOOLQJZLWKLQILQJHUYDULDELOLW\)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW



>@ /HHJZDWHU$-0HXZO\'6MHUSV09HUJHHU3 $OEHULQN,

3HUIRUPDQFHVWXG\RIDVFRUHEDVHGOLNHOLKRRGUDWLRV\VWHPIRUIRUHQVLF

ILQJHUPDUNFRPSDULVRQ-RXUQDORI)RUHQVLF6FLHQFHV

KWWSVGRLRUJ

>@ 6ZRIIRUG+-.RHUWQHU$-=HPS)$XVGHPRUH0/LX$  6DO\DUGV0-$PHWKRGIRUWKHVWDWLVWLFDOLQWHUSUHWDWLRQRIIULFWLRQ

ULGJHVNLQLPSUHVVLRQHYLGHQFH0HWKRGGHYHORSPHQWDQGYDOLGDWLRQ)RUHQVLF

6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW

>@ 0RQWDQL,0DUTXLV5(JOL$QWKRQLR]1 &KDPSRG&

5HVROYLQJGLIIHULQJH[SHUWRSLQLRQV6FLHQFH -XVWLFH

KWWSVGRLRUJMVFLMXV

>@ %LHGHUPDQQ$%R]]D67DURQL) $LWNHQ&**7KH

FRQVHTXHQFHVRIXQGHUVWDQGLQJH[SHUWSUREDELOLW\UHSRUWLQJDVDGHFLVLRQ

6FLHQFH -XVWLFHKWWSVGRLRUJMVFLMXV

>@ 0HXZO\'5DPRV' +DUDNVLP5$JXLGHOLQHIRUWKH

YDOLGDWLRQRIOLNHOLKRRGUDWLRPHWKRGVXVHGIRUIRUHQVLFHYLGHQFHHYDOXDWLRQ

)RUHQVLF6FLHQFH,QWHUQDWLRQDO

KWWSVGRLRUJMIRUVFLLQW



1



7

0DWWLMVVHQ(-$7%HUJHU&(+9HUJHHU3.HUNKRII: 6WRHO5'

)LUHDUPHYDOXDWLRQDWVRXUFHOHYHO+RZWRGHILQHWKHUHOHYDQWSRSXODWLRQ

DQGKRZWRDSSO\DQXQUHVWULFWLYHDOWHUQDWLYHSURSRVLWLRQ0DQXVFULSWLQSUHSDUDWLRQ



 



7

&KDSWHU



)LUHDUPHYDOXDWLRQDWVRXUFHOHYHO

+RZWRGHILQHWKHUHOHYDQWSRSXODWLRQDQGKRZWRDSSO\DQXQUHVWULFWLYHDOWHUQDWLYH

SURSRVLWLRQ

Erwin J.A.T. Mattijssen, Charles E.H. Berger, Peter Vergeer, Wim Kerkhoff & Reinoud D. Stoel

Firearm evaluation at source level: How to define the relevant population and how to apply an

unrestrictive alternative proposition

Manuscript in preparation.

CHAPTER 2



$%675$&7

)RUHQVLFILUHDUPH[DPLQHUVSURYLGHWKHFRXUWZLWKLQIRUPDWLRQDERXWWKHVRXUFHRI

ILUHG FDUWULGJH FDVHV DQG EXOOHWV 7R GR VR WKH\ VKRXOG HYDOXDWH WKH HYLGHQWLDO

VWUHQJWK RI WKH UHVXOWV RIWKHFRPSDULVRQ RI ILUHDUPIHDWXUHVZKLFKLQFOXGHFODVV

FKDUDFWHULVWLFVDQGPLFURVFRSLFIHDWXUHV²LPSUHVVLRQVDQGVWULDWLRQV7KLVLVGRQHE\

DVVHVVLQJWKHSUREDELOLW\RIWKHUHVXOWVXQGHUWZRPXWXDOO\H[FOXVLYHSURSRVLWLRQV

7KHFKRLFHRIWKHVHSURSRVLWLRQVDQGWKHFDVHFLUFXPVWDQFHVDIIHFWZKLFKSRSXODWLRQ

LVFRQVLGHUHGZKHQDVVHVVLQJWKHVHSUREDELOLWLHVDQGWKXVWKHHYLGHQWLDOVWUHQJWK

,QWKLVSDSHUZHGLVFXVVWKDWDQ´XQUHVWULFWLYHµDOWHUQDWLYHSURSRVLWLRQ²ZKLFK

GRHVQRWLQFRUSRUDWHREVHUYDWLRQVRIWKHH[DPLQDWLRQLWVHOI²VKRXOGEHXVHG'RLQJ

VR ZLOO HQDEOH XV WR HYDOXDWH WKH HYLGHQWLDO VWUHQJWK RI WKH FRPSDULVRQ RI WKH

PLFURVFRSLFIHDWXUHVDQGRIWKHFODVVFKDUDFWHULVWLFVWRJHWKHU:HGLVFXVVWKHDVSHFWV

WREH FRQVLGHUHG RULJLQ UHJLRQDQG WLPHZKHQGHILQLQJ WKH UHOHYDQWSRSXODWLRQ

7KHHYLGHQWLDOVWUHQJWKRIREVHUYHGFRUUHVSRQGLQJFODVVFKDUDFWHULVWLFVFDQWKHQEH

EDVHG RQ WKH UHODWLYH IUHTXHQF\ RI RFFXUUHQFH UDULW\ RI WKRVH LQ WKH UHOHYDQW

SRSXODWLRQ:HSURYLGHJXLGHOLQHVIRUKRZWRGRVR

7KHHYLGHQWLDOVWUHQJWKRIWKHPLFURVFRSLFIHDWXUHVGHSHQGVRQWKHZLWKLQ

VRXUFH DQG EHWZHHQVRXUFH YDULDELOLW\ RI WKRVH IHDWXUHV LQ D UHILQHG UHOHYDQW

SRSXODWLRQ 7KLV UHOHYDQW SRSXODWLRQ LV D UHILQHPHQW RI WKH UHOHYDQW SRSXODWLRQ

DERYH7KHUHILQHGSRSXODWLRQLVUHVWULFWHGWRILUHDUPVWKDW\LHOGWKHREVHUYHGFODVV

FKDUDFWHULVWLFV ,Q WKLV ZD\ RQH HQFDSVXODWHV WKH SRVVLEOH FRQGLWLRQDO GHSHQGHQF\

EHWZHHQFODVVFKDUDFWHULVWLFVDQGPLFURVFRSLFIHDWXUHV

7KHHYDOXDWHGHYLGHQWLDOVWUHQJWKVRIWKHFODVVFKDUDFWHULVWLFVDQGPLFURVFRSLF

IHDWXUHVFDQEHPXOWLSOLHGWRJLYHWKHHYLGHQWLDOVWUHQJWKIRUWKHVHIHDWXUHVFRPELQHG

 



,1752'8&7,21

)RUHQVLFILUHDUPH[DPLQDWLRQSURYLGHVHYLGHQFHWRDFRXUWRIODZDERXWWKHVRXUFH

RIILUHGFDUWULGJHFDVHVDQGEXOOHWV>@7RGRVRILUHDUPH[DPLQHUVFRPSDUHFODVV

FKDUDFWHULVWLFV DQG PLFURVFRSLF IHDWXUHV DOVR WHUPHG LQGLYLGXDO FKDUDFWHULVWLFV EHWZHHQFDUWULGJHFDVHVRUEXOOHWVUHFRYHUHGDIWHURQHRUPRUHVKRRWLQJLQFLGHQWVRU

EHWZHHQ WKRVH DQG UHIHUHQFH VKRWV ILUHG ZLWK D VXEPLWWHG ILUHDUP 7KH FODVV

FKDUDFWHULVWLFVDUHWKHUHVXOWRIWKHGHVLJQDQGPDQXIDFWXULQJPHWKRGRIWKHILUHDUP

XVHGWRILUHWKHFDUWULGJHVDQGLQFOXGHHJFDOLEHUJHQHUDOULIOLQJFKDUDFWHULVWLFVWKH

QXPEHUGLUHFWLRQRIWZLVWDQGZLGWKRIWKHODQGVLQWKHEDUUHODQGFKDUDFWHULVWLFV

VXFKDVWKHVKDSHDQGSRVLWLRQRIWKHHMHFWRUWKHVKDSHRIWKHILULQJSLQDSHUWXUHDQG

WKHW\SHRIPDQXIDFWXULQJPDUNVRQWKHEUHHFKIDFH>@7KHPLFURVFRSLFIHDWXUHV²

LPSUHVVLRQV DQG VWULDWLRQV ² RULJLQDWH IURP LPSHUIHFWLRQV RI WKH GLIIHUHQW

FRPSRQHQWVRIWKHILUHDUPXVHGWRILUHWKHFDUWULGJHV>@7KHFODVVFKDUDFWHULVWLFV

DUHRIWHQXVHGDVDILOWHURUVFUHHQLQJGHYLFHWRGHFLGHLIFDUWULGJHFDVHVRUEXOOHWV

FRXOGKDYHEHHQILUHGZLWKWKHVDPHILUHDUPRUZLWKWKHVXEPLWWHGILUHDUP>@

)ROORZLQJ WKLV DSSURDFK WKH H[DPLQHU ZLOO EHJLQ WR H[DPLQH DQG FRPSDUH WKH

PLFURVFRSLFIHDWXUHVRQO\LIWKHFODVVFKDUDFWHULVWLFVDUHMXGJHGWREHFRPSDWLEOHWKH

VDPH 7KH H[DPLQHU ZLOO WKHQ HYDOXDWH ZKHWKHU WKH FRPSDULVRQ RI WKH IHDWXUHV

SURYLGHVVXSSRUWIRUWKHVDPHVRXUFHRUGLIIHUHQWVRXUFHSURSRVLWLRQ

$W SUHVHQW PDQ\H[DPLQHUV UHSRUWWKHRXWFRPHV RIWKHLUH[DPLQDWLRQDVD

FDWHJRULFDOFRQFOXVLRQ7KH\VWDWHWKDWWKHFDUWULGJHFDVHRUEXOOHWZDVRUZDVQRW

ILUHGZLWKWKHVXEPLWWHGILUHDUPRUWKDWWKLVFRXOGQRWEHHVWDEOLVKHGLQWKHIRUPRI

DQ ´LQFRQFOXVLYHµ MXGJPHQW %\ SURIIHULQJ VXFK FDWHJRULFDO FRQFOXVLRQV WKH

H[DPLQHUVLPSOLFLWO\DVVXPHVRPHSULRURGGVDQGVRPHGHFLVLRQWKUHVKROGDQGUHSRUW

WKHRXWFRPHVRIWKHLUH[DPLQDWLRQDVSURRILQVWHDGRIDVHYLGHQFH>@$VDUHVXOW

WKH\H[DJJHUDWHWKHHYLGHQWLDOVWUHQJWKRIDFRPSDULVRQ>@DQGVXSSUHVVDQ\QRWLRQ

RIXQFHUWDLQW\E\WDNLQJDOHDSRIIDLWKWRZDUGVDVDPHVRXUFHRUGLIIHUHQWVRXUFH

GHFLVLRQ>@:KHQSURIIHULQJFDWHJRULFDOFRQFOXVLRQVWKHH[DPLQHUVURXQGXS

DQ\HYLGHQWLDOVWUHQJWKWRLQILQLW\IRUVDPHVRXUFHGHFLVLRQVRUGRZQWR]HURIRU

GLIIHUHQWVRXUFHGHFLVLRQV:KHQSURIIHULQJDQLQFRQFOXVLYHMXGJPHQWH[DPLQHUV

HIIHFWLYHO\UHSRUWDQHYLGHQWLDOVWUHQJWKRIRQHSURYLGLQJQRVXSSRUWIRUHLWKHUWKH

VDPHVRXUFH RU GLIIHUHQWVRXUFH SURSRVLWLRQ :LWK WKHVH LQFRQFOXVLYH MXGJPHQWV

WKH\SURYLGHQRHYLGHQFHDWDOOZKLOHLWKDVEHHQVKRZQWKDWZKHQH[DPLQHUVDUH

IRUFHGWRSURYLGHVRXUFHGHFLVLRQVIRUWKHVHMXGJPHQWVWKH\DUHPRUHRIWHQULJKW

WKDQZURQJ>@%\UHSRUWLQJFDWHJRULFDOFRQFOXVLRQVH[DPLQHUVUHGXFHWKHZKROH

UDQJHRISRVVLEOHHYLGHQWLDOVWUHQJWKVWRRQO\WKUHHRSWLRQVLQILQLW\]HURDQGRQH

2



7RHYDOXDWHWKHHYLGHQFHPRUHLQOLQHZLWKLWVSUREDELOLVWLFQDWXUH>@

DWWHPSWV KDYH EHHQ PDGH WR DWWHQXDWH WKHVH FDWHJRULFDO FRQFOXVLRQV E\ LQFOXGLQJ

SKUDVHVVXFKDV´SUDFWLFDOFHUWDLQW\µRU´WRDUHDVRQDEOHGHJUHHRIVFLHQWLILFFHUWDLQW\µ

>@

,QFRQWUDVWZLWKWKHPRXQWLQJFULWLFLVPRIFDWHJRULFDOFRQFOXVLRQV>

 @ WKH OLNHOLKRRG UDWLR DSSURDFK RU ORJLFDO DSSURDFK LV JDLQLQJ ZLGHVSUHDG

DFFHSWDQFH DV WKH PHWKRG RI FKRLFH WR HYDOXDWH WKH RXWFRPHV RI IRUHQVLF

H[DPLQDWLRQV>@7KLVDSSURDFKWDNHVLQWRDFFRXQWWKHSUREDELOLVWLFQDWXUHRI

WKHHYLGHQFHDQGGRHVVRLQDORJLFDOO\XQIODZHGDQGEDODQFHGZD\>@

'HVSLWH WKHVH DGYDQWDJHV DGRSWLRQ RI WKH OLNHOLKRRG UDWLR DSSURDFK LV VORZ DQG

VHHPVWRYDU\EHWZHHQFRXQWULHVDQGLQVWLWXWLRQV>@

:KHQ DSSO\LQJ WKH OLNHOLKRRG UDWLR DSSURDFK WKH HYLGHQWLDO VWUHQJWK RI D

FRPSDULVRQ LV HYDOXDWHG 7KH SUREDELOLW\ RI WKH FRPSDULVRQ UHVXOWV ( HJ

REVHUYHG GHJUHHV RI VLPLODULW\ DQG GLIIHUHQFH LV HYDOXDWHG XQGHU WZR PXWXDOO\

H[FOXVLYHSURSRVLWLRQV7\SLFDOO\RQHRIWKHVHSURSRVLWLRQVZLOOUHIOHFWWKHSRLQWRI

YLHZ RI WKH SURVHFXWLRQ +^S DQG WKH DOWHUQDWLYH SURSRVLWLRQ WKDW RI WKH GHIHQVH

+G^7KHUDWLRRIWKHVHWZRSUREDELOLWLHVZKLOHFRQVLGHULQJWKHFDVHFLUFXPVWDQFHV

DQGEDFNJURXQGLQIRUPDWLRQ,GHILQHVWKHHYLGHQWLDOVWUHQJWKRIWKHFRPSDULVRQ

UHVXOWVWKHOLNHOLKRRGUDWLR/5>@



ܮܴ ൌ ^{௣ሺாȁு೛ǡூሻ}

௣ሺாȁு_೏ǡூሻ         



6HYHUDOSDSHUVKDYHGLVFXVVHGWKHDSSOLFDWLRQRIWKHOLNHOLKRRGUDWLRDSSURDFK

LQIRUHQVLFILUHDUPH[DPLQDWLRQ>@:KHQWKH\IRFXVRQVRXUFHOHYHO

HYDOXDWLRQ >@ WKH DXWKRUV RI WKHVH SDSHUV VHHP WR DJUHH RQ WKH SURVHFXWLRQ·V

SURSRVLWLRQWREHXVHG)RUWKHDOWHUQDWLYHSURSRVLWLRQVWKHDXWKRUVRIWKHSDSHUV

GLVFXVVWZRW\SHVRISURSRVLWLRQVZKLFKZHZLOOFDOO´UHVWULFWLYHµDQG´XQUHVWULFWLYHµ

,QWKHUHVWULFWLYHDOWHUQDWLYHSURSRVLWLRQWKHREVHUYDWLRQWKDWWKHFODVVFKDUDFWHULVWLFV

RIWKHFDUWULGJHFDVHVRUEXOOHWVFRPPRQVRXUFHFRPSDULVRQRURIWKHFDUWULGJH

FDVH RU EXOOHW DQG WKH ILUHDUP VSHFLILFVRXUFH FRPSDULVRQ DUH FRPSDWLEOH WKH



+SDQG+GFDQDOVREHUHSODFHGE\+DQG+ZKHUH+LVWKHLQFULPLQDWLQJDQG+WKH

H[FXOSDWRU\SURSRVLWLRQ7KHVHPRUHJHQHUDOGHVLJQDWLRQVIRUWKHSURSRVLWLRQVFDQEHXVHG

GXULQJWKHLQYHVWLJDWLYHSKDVHZKHQQRVXVSHFWDQGWKXVQRGHIHQVHLVDYDLODEOH