The adoption and effectiveness of loyalty programs in retailing

Tilburg University

The adoption and effectiveness of loyalty programs in retailing

Leenheer, J.

Publication date:

2004

Document Version

Publisher's PDF, also known as Version of record

Link to publication in Tilburg University Research Portal

Citation for published version (APA):

Leenheer, J. (2004). The adoption and effectiveness of loyalty programs in retailing. CentER, Center for Economic Research.

General rights

Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain

• You may freely distribute the URL identifying the publication in the public portal Take down policy

If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

7KH$GRSWLRQDQG(IIHFWLYHQHVVRI

/R\DOW\3URJUDPVLQ5HWDLOLQJ

3URHIVFKULIW

7HU YHUNULMJLQJ YDQ GH JUDDG YDQ GRFWRU DDQ GH 8QLYHUVLWHLW YDQ 7LOEXUJ RS JH]DJ YDQ GH UHFWRU PDJQLILFXVSURIGU)$YDQGHU'X\Q6FKRXWHQLQKHW RSHQEDDU WH YHUGHGLJHQ WHQ RYHUVWDDQ YDQ HHQ GRRU KHW FROOHJHYRRUSURPRWLHVDDQJHZH]HQFRPPLVVLHLQGHDXOD YDQGH8QLYHUVLWHLWRSZRHQVGDJVHSWHPEHUGRRU

-RUQD/HHQKHHU



&KDSWHU

,QWURGXFWLRQ

/R\DOW\3URJUDPVLQ5HWDLOLQJ

&RQVXPHUV DUH QRZDGD\V OLNHO\ WR EH FRQIURQWHG ZLWK OR\DOW\ SURJUDPV 0DQ\ UHWDLO FRPSDQLHV RIIHU OR\DOW\ FDUGV WR WKHLU FXVWRPHUV &XVWRPHUV FDQ XVH WKHVH OR\DOW\ FDUGV WR REWDLQGLVFRXQWVWRVDYHIRUUHZDUGVWRSDUWLFLSDWHLQORWWHULHV HWF5HWDLOHUVSURYLGHWKHVH EHQHILWV WR VWUHQJWKHQ FXVWRPHUILUP UHODWLRQVKLSV DQG WR PDNH FXVWRPHUV PRUH OR\DO &XVWRPHUV KDYH HQWKXVLDVWLFDOO\ HQWHUHG OR\DOW\ SURJUDPV $OPRVW  RI DOO 'XWFK KRXVHKROGVKDYHDWOHDVWRQHVXSHUPDUNHWOR\DOW\FDUGDQGPDQ\KRXVHKROGVDUHPHPEHUVRI PXOWLSOH OR\DOW\ SURJUDPV VLPXOWDQHRXVO\ *I.  %XW DOWKRXJK OR\DOW\ FDUGV KDYH LQILOWUDWHGFXVWRPHUV¶ZDOOHWVLWLVQRWHYLGHQWZKHWKHUOR\DOW\SURJUDPPHPEHUVKLSVDFWXDOO\ DIIHFWSXUFKDVHEHKDYLRU'RZOLQJDQG8QFOHV



5HFHQWO\ OR\DOW\ SURJUDPV KDYH DSSHDUHG LQ 6RXWK $PHULFD DV ZHOO 7KH\ KDYH SURYHG YHU\ VXFFHVVIXO WKHUH EHFDXVH RI D VWURQJ QHHG IRU UHFRJQLWLRQ FKDUDFWHUL]LQJ WKH 6RXWK$PHULFDQ SRSXODWLRQ $QGUXVV  2XWVLGH UHWDLOLQJ OR\DOW\ SURJUDPV KDYH DSSHDUHGDPRQJDLUOLQHVIUHTXHQWIO\HUSURJUDPVIRUILQDQFLDOSURGXFWVFDUUHQWDOVRQOLQH VWRUHVHWF $FDGHPLFDOO\LWLVUHOHYDQWWRLQYHVWLJDWHKRZOR\DOW\SURJUDPVUHODWHWRDVWUDWHJ\RI FXVWRPHUUHODWLRQVKLSPDQDJHPHQWDQGZKDWWKH\DGGWRH[LVWLQJPDUNHWLQJPL[LQVWUXPHQWV 6HYHUDOUHVHDUFKTXHVWLRQVFDQEHUDLVHGLQWKLVUHVSHFW:KLFKFRPSDQLHVGRDGRSWOR\DOW\ SURJUDPV"$QGZKLFKFXVWRPHUV"$UHOR\DOW\SURJUDPVHIIHFWLYHLQPDNLQJFXVWRPHUVOR\DO DQGGRWKH\VWLPXODWHFXVWRPHUSURILWDELOLW\"+RZGRFRPSHWLWLYHOR\DOW\SURJUDPVDIIHFWD FRPSDQ\":KDWLVWKHEHVWZD\WRGHVLJQDOR\DOW\SURJUDP" 7KLVFKDSWHUSURYLGHVDEURDGGLVFXVVLRQRIOR\DOW\SURJUDPV6HFWLRQVWDUWVZLWKD GLVFXVVLRQ RI FXVWRPHU UHODWLRQVKLS PDQDJHPHQW DQG LWV DSSOLFDWLRQ LQ FRQVXPHU PDUNHWV 6HFWLRQFRQWLQXHVZLWKDGLVFXVVLRQRIUHODWLRQDOPDUNHWLQJLQVWUXPHQWVRIZKLFKOR\DOW\ SURJUDPVDUHDQH[DPSOH6HFWLRQGHILQHVOR\DOW\SURJUDPVGHVFULEHVWKHLUNH\IHDWXUHV DQG SURSRVHV D IUDPHZRUN IRU OR\DOW\ SURJUDP DQDO\VLV ,Q VHFWLRQ  WKH FHQWUDO SUREOHP GHILQLWLRQRIWKLVGLVVHUWDWLRQLVSUHVHQWHG6HFWLRQSURYLGHVDEULHIRYHUYLHZRIH[LVWLQJ UHVHDUFK RQ OR\DOW\ SURJUDPV DQG ILQDOO\ 6HFWLRQ  JLYHV DQ RXWOLQH RI WKH UHVW RI WKLV GLVVHUWDWLRQ

 &XVWRPHU5HODWLRQVKLS0DQDJHPHQW

'HILQLWLRQ

 0DQDJHPHQWLQ-RXUQDORI6HUYLFHV5HVHDUFK,WKDVLQLWLDWHGDVKLIWIURPDWUDQVDFWLRQ RULHQWHGWRZDUGVDUHODWLRQVKLSRULHQWHGPDUNHWLQJDSSURDFK5HODWLRQVKLSPDUNHWLQJFRQWDLQV HVWDEOLVKLQJGHYHORSLQJDQGPDLQWDLQLQJVXFFHVVIXOUHODWLRQDOH[FKDQJHV0RUJDQDQG+XQW  :KHUH FRPSDQLHV WUDGLWLRQDOO\ PD[LPL]HG GLVFUHWH WUDQVDFWLRQV XQGHU D UHODWLRQDO DSSURDFKDFRPSDQ\DLPVWRRSWLPL]HDFRPSOHWHUHODWLRQDOH[FKDQJH$UHODWLRQDOH[FKDQJH WKXV FRQVLVWV RI DQ HQWLUH VSHOO RI FXVWRPHU SXUFKDVHV ZKHUH HDFK GLVFUHWH WUDQVDFWLRQ LV HPEHGGHGLQWUDQVDFWLRQVLQWKHSDVWDQGWKHIXWXUH'Z\HU6FKXUUDQG2K)URPD UHODWLRQDOSHUVSHFWLYHVRPHORZSURILWWUDQVDFWLRQVDUHRSWLPDOQDPHO\LQFDVHWKH\ZLOOEH FRPSHQVDWHG E\ LQFUHPHQWDO SURILWV LQ WKH IXWXUH 7KH PRYH LQ VWUDWHJLF IRFXV IURP WUDQVDFWLRQVWRUHODWLRQVKLSVLPSOLHVWKDWWKHFHQWUDOIRFXVLVQRWRQSURGXFWVRUEUDQGVEXWRQ FXVWRPHUV &RPSDQLHV WKXV RUJDQL]H WKHLU PDUNHWLQJ HIIRUWV DURXQG FXVWRPHUV UDWKHU WKDQ SURGXFW OLQHV %HUJHU HW DO  $V VXFK FXVWRPHUV DUH FRQVLGHUHG WR EH WKH FHQWUDO FRPSDQ\ DVVHW RQ ZKLFK D FRPSDQ\ PXVW DFKLHYH FRPSHWLWLYH DGYDQWDJH 6ULYDVWDYD 6KHUYDQLDQG)DKH\

/R\DOW\



&XVWRPHUHTXLW\

$FRPSDQ\WKDWWDNHVWKHYDOXHRILWVFXVWRPHUEDVHDVWKHFHQWUDOFULWHULRQDLPVWRPD[LPL]H WKHWRWDOYDOXHRILWVFXVWRPHUUHODWLRQVKLSVRULWVFXVWRPHUHTXLW\7KHYDOXHRIDQLQGLYLGXDO FXVWRPHU UHODWLRQVKLS PHDVXUHG DV FXVWRPHU OLIHWLPH YDOXH IXQFWLRQV DV WKH FHQWUDO RSWLPL]DWLRQYDULDEOH&XVWRPHUOLIHWLPHYDOXHLVXVXDOO\RSHUDWLRQDOL]HGDVWKHSUHVHQWYDOXH RIDOOIXWXUHHDUQLQJVPLQXVGLUHFWFXVWRPHUUHODWHGFRVWV-DLQDQG6LQJK&XVWRPHUV DFFRXQWIRUHDUQLQJVWKURXJKWKHWUDQVDFWLRQVWKH\PDNH7KH\FDQDOVRFRQWULEXWHWRHDUQLQJV LQGLUHFWO\E\VSUHDGLQJZRUGRIPRXWKWRRWKHUFRQVXPHUVRUE\JLYLQJIHHGEDFNDQGDGYLFHV WR WKH FRPSDQ\ 7KH HFRQRPLF YDOXH RI WKHVH LQGLUHFW HIIHFWV LV GLIILFXOW WR TXDQWLI\ DQG WKHUHIRUH PRVWO\ LJQRUHG &XVWRPHU OLIHWLPH YDOXH GHSHQGV ERWK RQ WKH OHQJWK RI WKH UHODWLRQVKLSGXUDWLRQWRLWVGHSWKLQWHQVLW\RUXVDJHOHYHODQGWRLWVEUHDGWKFURVVEX\LQJ 9HUKRHI)XUWKHUWUDQVDFWLRQVPDGHQRZDUHSUHIHUUHGRYHUWUDQVDFWLRQVLQWKHIXWXUH

7DNLQJ FXVWRPHUV DV WKH FHQWUDO SURILW GULYHUV LW KDV EHFRPH DSSDUHQW WR PDQ\ FRPSDQLHVWKDWFXVWRPHUVGLIIHUVWURQJO\LQSURILWDELOLW\DQGWKDWWKHFXVWRPHUSURILWDELOLW\ GLVWULEXWLRQ LV KLJKO\ VNHZHG 'RZOLQJ DQG 8QFOHV  ,Q WKLV UHVSHFW WKH  ODZ LV RIWHQPHQWLRQHGZKLFKVWDWHVWKDWW\SLFDOO\SHUFHQWRIVDOHVRUSURILWVFRPHIURPRQO\ SHUFHQW RI FXVWRPHUV 5XVW HW DO  5XVW =HLWKDPO DQG /HPRQ  VSHDN RI D FXVWRPHU S\UDPLG ZLWK IRXU FXVWRPHU WLHUV ODEHOHG DV SODWLQXP JROG LURQ DQG OHDG FXVWRPHUV7KHOHDGWLHUFRQVLVWVFXVWRPHUVZKRDUHXQSURILWDEOHDQGUDWKHUFRVWWKHFRPSDQ\ PRQH\$FXVWRPHUSURILWDELOLW\DQDO\VLVFRXOGWKXVPDNHDFRPSDQ\FRQFOXGHWKDWLWVKRXOG DEDQGRQFHUWDLQFXVWRPHUUHODWLRQVKLSVRUVWRSLQYHVWLQJLQWKHP)XUWKHULWVHHPVWRPDNH VHQVH WR FRQFHQWUDWH PDUNHWLQJ UHVRXUFHV RQ WKH PRVW SURILWDEOH FXVWRPHUV WR JDLQ WKHLU OR\DOW\

&50LQPDVVPDUNHWV

 $QH[WFKDOOHQJHKDVEHHQWRLQWURGXFH &50 LQ FRQVXPHU PDUNHWV 0RVW FRQVXPHU PDUNHWV FKDUDFWHUL]H DV PDVV PDUNHWV ZKLFK KDYH WKH IROORZLQJ FKDUDFWHUL]LQJ IHDWXUHV %KDWWDFKDU\DDQG%ROWRQ

 ,QGLYLGXDOFXVWRPHUVDUHDQRQ\PRXVWRWKHILUP

 /LPLWHGGLUHFWFRQWDFWH[LVWVEHWZHHQFXVWRPHUVDQGWKHILUP

 &XVWRPHUUHODWLRQVKLSVDUHQRQHFRQWUDFWXDODQGVZLWFKLQJFRVWVDUHORZ  /DUJHFXVWRPHUEDVHVZLWKDOLPLWHGSURILWSHUFXVWRPHU

:LWK WKH DEVHQFH RI FXVWRPHUVSHFLILF NQRZOHGJH PDUNHWHUV PXVW DVVHPEOH LQGLYLGXDOOHYHO GDWDEDVHV /RZ VZLWFKLQJ FRVWV HQDEOH FXVWRPHUV WR IUHTXHQW VHYHUDO FRPSHWLWRUV PRUH RU OHVV VLPXOWDQHRXVO\ 7KH FRPELQDWLRQ RI QRQFRQWUDFWXDO FXVWRPHU UHODWLRQVKLSVDQGORZVZLWFKLQJ FRVWVPDNHVLWXQFOHDUIRU FRPSDQLHVZKLFKFRQVXPHUV DUH VWLOO WKHLU FXVWRPHUV %HUJHU HW DO  6FKPLWWOHLQ 0RUULVRQ DQG &RORPER  7KHUHIRUH D VWURQJ QHHG H[LVWV IRU GDWDEDVHV ZLWK LQGXVWU\ZLGH LQIRUPDWLRQ %HOO HW DO )XUWKHUPDUNHWLQJUHVHDUFKLVQHHGHGWRDVVHVVWKHLQIOXHQFHRIPDUNHWLQJDFWLRQVRQ FXVWRPHU OHYHO ,W LV LPSRUWDQW WR IRFXV QRW VROHO\ RQ LQFRPH HIIHFWV EXW WR DFFRXQW IRU DGGLWLRQDOFRVWVPDGHRQDFXVWRPHUDVZHOO%HOOHWDO



5HODWLRQDO0DUNHWLQJ,QVWUXPHQWV

'HILQLWLRQ

5HODWLRQDO PDUNHWLQJ LQVWUXPHQWV DUH VWUXFWXUHG PDUNHWLQJ HIIRUWV WKDW VSHFLILFDOO\ VXSSRUW FXVWRPHUUHODWLRQVKLSV HJ%KDWWDFKDU\DDQG%ROWRQ5DWKHUWKDQGLUHFWO\VWLPXODWLQJ VDOHV WKH\ IRFXV RQ WKH PDLQWHQDQFH DQG GHYHORSPHQW RI FXVWRPHUV %ROWRQ /HPRQ DQG 9HUKRHI.H\WRWKHVHLQVWUXPHQWVLVWKDWWKH\DUHWDUJHWHGWRZDUGVH[LVWLQJFXVWRPHUV RU HYHQ RQO\ WRZDUGV VSHFLILF FXVWRPHU JURXSV IRU ZKLFK D FRPSDQ\ SHUFHLYHV UHODWLRQDO LQYHVWPHQWVIUXLWIXO7KHFRUH JRDORIUHODWLRQDO PDUNHWLQJ LQVWUXPHQWV LV WR LQFUHDVH IXWXUH HDUQLQJV E\ VWLPXODWLQJ FXVWRPHUV¶ SHUFHLYHG IXWXUH YDOXH RI WKH FRPSDQ\¶V RIIHULQJV ,Q HFRQRPLFWHUPLQRORJ\WKH\WU\WRFKDQJHWKHFXVWRPHU¶VFKRLFHSURFHVVIURPRSHUDWLQJLQD VSRW PDUNHW WR RSHUDWLQJ LQ D PXOWLSHULRG FRQWUDFWXDO UHODWLRQVKLS PDUNHW 'RZOLQJ DQG 8QFOHV/HPRQ%DUQHWW:KLWHDQG:LQHU7KLVFRXOGEHGRQHHLWKHUE\JLYLQJ H[SOLFLW HFRQRPLF OR\DOW\ LQFHQWLYHV RU E\ HQKDQFLQJ FRPPLWPHQW WUXVW RU SHUFHLYHG UHODWLRQVKLSTXDOLW\%ROWRQHWDO'H:XOIHWDO

5HODWLRQDOPDUNHWLQJLQVWUXPHQWVFRXOGDSSO\WRDOOS¶VRIWKHPDUNHWLQJPL[DQG DUHRIWHQFRPELQDWLRQVRIWKRVH'LUHFWPDLOVWDUJHWHGSURPRWLRQVDQGOR\DOW\SURJUDPVDUH UHODWLRQDOPDUNHWLQJLQVWUXPHQWVWKDWKDYHUHFHLYHGPRVWDWWHQWLRQLQWKHPDUNHWLQJOLWHUDWXUH 9HUKRHI%XWJLYHQWKHGHILQLWLRQSURSRVHGDERYHZDUUDQWLHVVHUYLFHFDOOFHQWHUVRU HOHFWURQLF FXVWRPHU IRUXPV FDQ DOVR EH FRQVLGHUHG DV UHODWLRQDO PDUNHWLQJ LQVWUXPHQWV %KDWWDFKDU\DDQG %ROWRQ2I FRXUVHRWKHUPDUNHWLQJPL[HOHPHQWV VXFK DV SULFH RU SURGXFWTXDOLW\FRXOGHQKDQFHFXVWRPHUUHODWLRQVKLSVDVZHOO+RZHYHUUHODWLRQDOPDUNHWLQJ LQVWUXPHQWV DUH GLVWLQFWLYH EHFDXVH WKH\ DUH H[SOLFLWO\ VXLWHG WR OHYHUDJH FXVWRPHU UHODWLRQVKLSVLQDGLUHFWDQGWDUJHWHGPDQQHU

&DWHJRUL]DWLRQ

 'H:XOIHWDO7KLVGRHVQRWPHDQWKDWLWLVDOZD\VREYLRXVKRZWRFDWHJRUL]HD PDUNHWLQJLQVWUXPHQW'LUHFWPDLOVDUHFRQVLGHUHGDVVRFLDOLQVWUXPHQWVEHFDXVHWKH\FRQWDLQ FRPPXQLFDWLYH HOHPHQWV 'H:XOI HW DO  EXW WKH FRQWHQW RI WKH PDLOV FRXOG SURYLGH SULFHLQFHQWLYHVDVZHOOHJFRXSRQV6LPLODUO\SUHIHUHQWLDOWUHDWPHQWWKHH[WHQWWRZKLFKD UHWDLOHU WUHDWV DQG VHUYHV LWV UHJXODU FXVWRPHUV EHWWHU WKDQ LWV QRQUHJXODU FXVWRPHUV LV FRQVLGHUHG DV D VRFLDO PDUNHWLQJ WDFWLF 'H:XOI HW DO  EXW SURYLGHV HFRQRPLF YDOXH DOVRLILWVLVJLYHQLQWKHIRUPRISULFHGLIIHUHQFHVRUWDQJLEOHUHZDUGVHJVDYLQJSURJUDPVRU VSHFLDO VKRSSLQJ QLJKWV ZLWK ORZHU SULFHV 7KHUHIRUH ZH SURSRVH WR GLVFULPLQDWH EHWZHHQ PDUNHWLQJLQVWUXPHQWVDFFRUGLQJWRWKHGHJUHHRIHFRQRPLFDQGVRFLDOYDOXHSURYLGHGUDWKHU WKDQWRXVHDGLFKRWRPRXVFDWHJRUL]DWLRQ

5HODWLRQDO PDUNHWLQJ LQVWUXPHQWV FRXOG EH FRQVLGHUHG DV D IRUP RI GHIHQVLYH PDUNHWLQJEHFDXVHWKH\DLPWRHQKDQFHUHODWLRQVKLSVZLWKH[LVWLQJFXVWRPHUVUDWKHUWKDQWR DWWUDFW QHZ FXVWRPHUV IURP WKH FRPSHWLWLRQ 6KDUS DQG 6KDUS  6WURQJHU FXVWRPHU UHODWLRQVKLSVPDNHDFRPSDQ\OHVVYXOQHUDEOHIRUFRPSHWLWLYHDFWLRQVRUQHZHQWUDQFHVLQWKH PDUNHW +RZHYHU UHODWLRQDO LQVWUXPHQWV DUH QRW SXUHO\ GHIHQVLYH LQ PRVW FDVHV EHFDXVH FXVWRPHUVDUHRIWHQQRWH[FOXVLYHOR\DOWRRQHFRPSDQ\EXWWKH\UDWKHUJLYHVHYHUDOVXSSOLHUV DSDUWRIWKHLUWRWDOH[SHQGLWXUHV



/R\DOW\3URJUDPV

'HILQLWLRQ

%DVHG RQ GHVFULSWLRQV RI OR\DOW\ SURJUDPV LQ H[LVWLQJ OLWHUDWXUH %ROWRQ .DQQDQ DQG %UDPOHWW6KDUSDQG6KDUSZHXVHWKHIROORZLQJGHILQLWLRQIRUOR\DOW\SURJUDPV $OR\DOW\SURJUDPLVDQLQWHJUDWHGV\VWHPRI PDUNHWLQJ DFWLRQV WKDW DLPV WR PDNH PHPEHU FXVWRPHUVPRUHSURILWDEOHE\HQKDQFLQJWKHLUOR\DOW\

$OR\DOW\SURJUDPFRQWDLQVWKHIROORZLQJFULWLFDOHOHPHQWV

 &XVWRPHUV PXVW EHFRPH PHPEHUV RI WKH OR\DOW\ SURJUDP LQ RUGHU WR PDNH XVH RI WKH PDUNHWLQJDFWLRQVRIIHUHGWKURXJKLW  $OR\DOW\SURJUDPKDVDQLQILQLWH RUDWOHDVWORQJWHUPGXUDWLRQ:HXVHWKHWHUPµOR\DOW\ DFWLRQ¶IRUSURJUDPVZLWKDOLPLWHGGXUDWLRQHJDWHPSRUDU\VDYLQJSURJUDP  $OR\DOW\SURJUDPUHZDUGV SURJUDPPHPEHUVIRUFHUWDLQEHKDYLRULQDVWUXFWXUDO ZD\DQG JLYHWKXVLQFHQWLYHV WRFXVWRPHUVWRVKRZWKLVEHKDYLRU  $OR\DOW\SURJUDPLVDQHQWLW\XQGHUZKLFKVHYHUDOPDUNHWLQJDFWLRQVFDQEHSXUVXHGHJ WDUJHWHGGLVFRXQWVVSHFLDOVKRSSLQJQLJKWVIRUPHPEHUVPDLOLQJVVDYLQJSURJUDPV 1RZDGD\VPRVWOR\DOW\SURJUDPVUHJLVWHUFXVWRPHUVWKDWKDYHVXEVFULEHGDVOR\DOW\SURJUDP PHPEHUVDQGDVNIRULGHQWLILFDWLRQDWWUDQVDFWLRQVHJ ZLWKOR\DOW\FDUGV7KLVHQDEOHVWKH FRPSDQ\ WR WUDFN WKHLU PHPEHUV¶ SXUFKDVH EHKDYLRU WR GLIIHUHQWLDWH EHWZHHQ PHPEHU DQG QRQPHPEHUV9DQ+HHUGHDQG%LMPROWDQGWRSURYLGHLQGLYLGXDOPHPEHUFXVWRPHUV ZLWKVSHFLDOWUHDWPHQW

5HVHDUFKIUDPHZRUN



)LJXUH)UDPHZRUNIRUOR\DOW\SURJUDPDQDO\VLV

/R\DOW\3URJUDP $GRSWLRQRI 5HWDLOHUV (IIHFWVRI /R\DOW\3URJUDPVRQ &XVWRPHU/R\DOW\ 2YHUDOO 3URILWDELOLW\RI /R\DOW\3URJUDPV /R\DOW\3URJUDP $GRSWLRQRI &XVWRPHUV /R\DOW\3URJUDP 'HVLJQ &RPSHWLWLYH /R\DOW\3URJUDPV 7KHILUVWSURFHVVFRQVLVWVRIWKHVXSSOLHU¶VLQLWLDWLRQWRDGRSWDOR\DOW\SURJUDPDVSDUW RILWVPDUNHWLQJPL[,QUHWDLOSUDFWLFHZHREVHUYHERWKDVXEVWDQWLDOQXPEHURIDGRSWHUVDQG QRQDGRSWHUV RI OR\DOW\ SURJUDPV 8QGHUVWDQGLQJ ZKLFK RUJDQL]DWLRQDO DQG PDUNHW IDFWRUV GULYH OR\DOW\ SURJUDP DGRSWLRQ FRXOG LPSURYH LQVLJKW LQ PDQDJHULDO GHFLVLRQ PDNLQJ LQ UHODWLRQVKLSPDUNHWLQJ,WFRXOGDOVRSURYLGHJXLGDQFHWRFRPSDQLHVLQPDUNHWVDQGDUHDVWR ZKLFKOR\DOW\SURJUDPVKDYHQRWGLVVHPLQDWHGXQWLOQRZ$IWHUDOR\DOW\SURJUDPKDVEHHQ LQWURGXFHGLQGLYLGXDOFXVWRPHUVPXVWGHFLGHZKHWKHURUQRWWKH\ZDQWWREHFRPHPHPEHURI WKH OR\DOW\ SURJUDP 7KH VHFRQG SURFHVV WKXV FRQVLVWV RI WKH OR\DOW\ SURJUDP DGRSWLRQ RI FXVWRPHUV

2QO\ WKH VXEVHW RI FXVWRPHUV WKDW GHFLGH WR EHFRPH OR\DOW\ SURJUDP PHPEHUV DUH H[SRVHG WR WKH OR\DOW\ SURJUDPV¶ PDUNHWLQJ DFWLRQV 7KHVH PDUNHWLQJ DFWLRQV DLP WR DIIHFW PHPEHUFXVWRPHUV¶OR\DOW\7KHVHHIIHFWVRQOR\DOW\FRXOGERWKEHEHKDYLRUDODQGDWWLWXGLQDO LQQDWXUH'LIIHUHQWDVSHFWVRIEHKDYLRUDOOR\DOW\FDQEHWDUJHWHGVXFKDVUHWHQWLRQSXUFKDVH TXDQWLWLHV VKDUHRIZDOOHWV RU QXPEHU RI WUDQVDFWLRQV 7KH TXHVWLRQ ZKHQ KRZ DQG KRZ PXFKLPSDFWWKHPDUNHWLQJDFWLRQVJHQHUDWHLVRIFHQWUDOLPSRUWDQFHWRMXGJHWKHXVHIXOQHVV RIOR\DOW\SURJUDPV



HW DO  7KH RYHUDOO SURILWDELOLW\ RI D OR\DOW\ SURJUDP LV REWDLQHG E\ TXDQWLI\LQJ DQG FRPSDULQJWKHEHQHILWVRIWKHOR\DOW\SURJUDPZLWKWKHUHODWHGFRVWV7KHEHQHILWVRIDOR\DOW\ SURJUDPFRQVLVWILUVWRIDOORIWKHHIIHFWVJHQHUDWHGE\WKHPDUNHWLQJDFWLRQVRQFXVWRPHUV¶ EHKDYLRUDO OR\DOW\ $Q DGGLWLRQDO EHQHILW LV WKDW WKH FRPSDQ\ REWDLQV LQIRUPDWLRQ RQ FXVWRPHUVSHFLILFSXUFKDVHDQGUHVSRQVHEHKDYLRURIOR\DOW\SURJUDPPHPEHUVZKLFKFDQEH XWLOL]HG WR VXSSRUW IXUWKHU PDUNHWLQJ HIIRUWV 0DXUL  7KH FRVWV UHODWHG WR WKH OR\DOW\ SURJUDP FRQVLVW RI IL[HG FRVWV ODXQFK FRVWV RSHUDWLRQ FRVWV DGPLQLVWUDWLYH FRVWV DQG FXVWRPHUVSHFLILF FRVWV UHZDUGLQJ FRVWV FRVWV RI FDUG LVVXDQFH $W FXVWRPHUOHYHO WKH LPSDFWRIDOR\DOW\SURJUDPFDQEHPHDVXUHGE\FDOFXODWLQJWKHHIIHFWVRIGLUHFWEHQHILWVDQG FRVWVRQFXVWRPHUOLIHWLPHYDOXH

 0RVWEDVLFDOO\DOOFXVWRPHUVWKDWDUHSURJUDPPHPEHUVDUHVHOHFWHGIRUDPDUNHWLQJ DFWLRQZKLFKRQO\FUHDWHVGLVFULPLQDWLRQEHWZHHQPHPEHUVDQGQRQPHPEHUV0DQ\OR\DOW\ SURJUDPV SURYLGH UHZDUGV VXFK DV LQIRUPDWLRQDO ZHEVLWHV PHPEHUVKLS PDJD]LQHV DQG VSHFLILFSULFHSURPRWLRQVWRDOOWKHLUPHPEHUV$FRPSDQ\FDQDOVRVHOHFWFHUWDLQFXVWRPHUV IRUDPDUNHWLQJDFWLRQEDVHGRQNQRZQFXVWRPHUFKDUDFWHULVWLFVHJVRFLRGHPRJUDSKLFVRU SURGXFW LQWHUHVWV +RZHYHU ORZ HQWUDQFH EDUULHUV DVN IRU UHILQHG UHZDUGLQJ PHFKDQLVPV WR HQVXUHWKDWOR\DOFXVWRPHUVDUHEHVWUHZDUGHGXQGHUWKHSURJUDP6HOHFWLRQVPDGHRQEDVHRI SXUFKDVHEHKDYLRUEHVWPDNHXVHRISURILWDELOLW\DQGOR\DOW\GLIIHUHQFHVDQGSURYLGHDVVXFK SXUFKDVH LQFHQWLYHV 7KHVH EHKDYLRUDO VHOHFWLRQ UXOHV FDQ EH EDVHG RQ WRWDO VSHQGLQJ LQ D SUHYLRXVSHULRGSURGXFWFDWHJRULHVSXUFKDVHGLQH[LVWHQFHRI DSXUFKDVHHYHQWWUDQVDFWLRQ VL]HVHWF$VDYLQJSURJUDPVHOHFWVFXVWRPHUVEDVHGRQDFFXPXODWHGSXUFKDVHVLQWKHSDVWIRU SURYLGLQJGLVFRXQWVRUSUHVHQWVXVLQJVDYLQJSRLQWVDVWKHPHGLXPWRGLIIHUHQWLDWHEHWZHHQ FXVWRPHUV $ VDYLQJ RI IUHTXHQF\ SURJUDP HQDEOHV DGYDQFHG LQFHQWLYH GHVLJQV WKURXJK XVDJHRIQRQOLQHDUSRLQWVVFKHGXOHVERQXVSRLQWVRQFHUWDLQKLJKPDUJLQSURGXFWVHWF

0RVWILUPVRIIHUDYDULHW\RIPDUNHWLQJDFWLRQVXQGHUWKHFHQWUDOHQWLW\RILWVOR\DOW\ SURJUDP $ ULFK GHVLJQ LPSURYHV WKH RYHUDOO EHQHILWV WR ERWK FXVWRPHUV DQG ILUP DQG LQGLYLGXDODFWLRQVFRXOGHQKDQFHHDFKRWKHU¶VHIIHFWLYHQHVV$QRWKHUSRVVLELOLW\LVWRRSHUDWHD OR\DOW\SURJUDPWRJHWKHUZLWKRWKHUSDUWQHUVDVRFDOOHGPXOWLYHQGRUSURJUDP2%ULHQDQG -RQHV7KH7HVFROR\DOW\SURJUDPPHQWLRQHGEHIRUHLVDQH[DPSOHRIDPXOWLYHQGRU SURJUDP ZLWK DQ DGYDQFHG OR\DOW\ SURJUDP GHVLJQ /R\DOW\ SURJUDP GHVLJQ SRWHQWLDOO\ LQIOXHQFHV OR\DOW\ SURJUDP¶V HIIHFWV RQ FXVWRPHU OR\DOW\ EXW DOVR LWV FRVWV DQG RYHUDOO SURILWDELOLW\RIWKHSURJUDP



3UREOHP'HILQLWLRQ

3UREOHPVWDWHPHQW

,QWKHSUHYLRXVVHFWLRQVZHKDYHGLVFXVVHGWKHUHOHYDQFHRIDFDGHPLFUHVHDUFKLQWKHDUHDRI OR\DOW\SURJUDPV$VVXFKWKHFHQWUDOSUREOHPRIWKLVGLVVHUWDWLRQLVGHILQHGDV :KLFKUROHFDQOR\DOW\SURJUDPVSOD\LQWKHPDUNHWLQJPL[RIUHWDLOHUV" 7KHFHQWUDOSUREOHPVWDWHPHQWZLOOEHDQVZHUHGWKURXJKWKHIROORZLQJUHVHDUFKTXHVWLRQV  :KLFKIDFWRUVGULYHUHWDLOHUVWRDGRSWOR\DOW\SURJUDPV"  :KLFKIDFWRUVGULYHFXVWRPHUVWRDGRSWUHWDLOHUV¶OR\DOW\SURJUDPV"  :KLFKHIIHFWVGROR\DOW\SURJUDPVKDYHRQSXUFKDVHEHKDYLRUDQGSURILWDELOLW\"  +RZGRHVOR\DOW\SURJUDPGHVLJQLQIOXHQFHHIIHFWLYHQHVV"  +RZGRFRPSHWLWRUV¶OR\DOW\SURJUDPVLQIOXHQFHHIIHFWLYHQHVV"

 UHJLVWUDWLRQDOUHDG\RFFXUVDVSDUWRIWKHQRUPDORSHUDWLRQILQDQFLDOVHUYLFHVYLGHRUHQWDOVRU LQ ZKLFK OR\DOW\ SURJUDPV DUH QRW DFFRPSDQLHG ZLWK UHJLVWUDWLRQ SRVVLELOLWLHV SDFNDJHG JRRGV:DQVLQN

0DQDJHULDOUHOHYDQFH

7KLVGLVVHUWDWLRQKDVDFOHDUPDQDJHULDOUHOHYDQFH/R\DOW\SURJUDPVDUHXVHGLQDOPRVWDOO VHFWRUVLQUHWDLOLQJDQGPDQ\RWKHUFRQVXPHUPDUNHWVDVZHOO7KHTXHVWLRQZKHWKHURUQRWWR DGRSWDOR\DOW\SURJUDPLVWKHUHIRUHUHOHYDQWIRUHYHU\UHWDLOHU7KLVGLVVHUWDWLRQFRXOGSURYLGH JXLGDQFHLQPDNLQJWKHULJKWGHFLVLRQ)XUWKHUPDQ\UHWDLOHUVKDYHDGRSWHGOR\DOW\SURJUDPV EXW GR QRW XVH WKHLU SURJUDPV RSWLPDOO\ 7RR PDQ\ UHWDLOHUV KDYH XVHG WKHLU SURJUDPV DV VKRUWWHUP SURPRWLRQDO WRROV UDWKHU WKDQ UHODWLRQDO LQVWUXPHQWV 2%ULHQ DQG -RQHV  0DQ\UHWDLOHUVWKDWKDYHDGRSWHGOR\DOW\SURJUDPVDIHZ\HDUVDJRDUHFXUUHQWO\UHFRQVLGHULQJ WKHLUSURJUDPV2SWLRQVDUHHLWKHUWRRSWLPL]HWKHSURJUDPGHVLJQRUWRDEDQGRQWKHSURJUDP $GIRUPDWLH*LYHQWKHFRPSOH[LW\RIOR\DOW\SURJUDPVLWLVFKDOOHQJLQJWRDVVHVVWKHLU HIIHFWLYHQHVV7KLVGLVVHUWDWLRQSURYLGHVPHDVXUHPHQWWRROVDQGHPSLULFDOLQVLJKWVRQOR\DOW\ SURJUDPVHIIHFWLYHQHVV:HDOVRVWXG\WKHLQIOXHQFHRIGHVLJQHOHPHQWVWKDWDUHFXUUHQWO\XVHG LQSUDFWLFHRQHIIHFWLYHQHVV

([LVWLQJ5HVHDUFKRQ/R\DOW\3URJUDPV

,QWURGXFWLRQ



/R\DOW\SURJUDPDGRSWLRQRIFRPSDQLHVUHWDLOHUV

$W WKLV PRPHQW UHVHDUFK RQ WKH FRPSDQ\¶V GHFLVLRQ ZKHWKHU RU QRW WR DGRSW D OR\DOW\ SURJUDP LV FRPSOHWHO\ ODFNLQJ 2QO\ VRPH OLWHUDWXUH RQ UHODWHG LVVXHV H[LVWV LH RQ WKH DGRSWLRQ RI GDWDEDVH PDUNHWLQJ 9HUKRHI DQG +RHNVWUD  DQG 0DUNHWLQJ 'HFLVLRQ 6XSSRUW 6\VWHPV :LHUHQJD DQG 2XGH 2SKXLV  %RWK H[WHUQDO IDFWRUV VXFK DV KHWHURJHQHRXVDQGG\QDPLFPDUNHWVDQGFRPSHWLWRUV¶DGRSWLRQVDQGLQWHUQDOIDFWRUVVXFKDV RUJDQL]DWLRQDOVWUXFWXUHFXVWRPHURULHQWDWLRQDQGWHFKQRORJLFDOVNLOOVDUHVKRZQWRGULYHWKH DGRSWLRQRIWKHVHV\VWHPV+RZHYHULWLVXQFOHDUWRZKDWH[WHQWWKHVHIDFWRUVDOVRGULYHWKH DGRSWLRQRIOR\DOW\SURJUDPV

/R\DOW\SURJUDPDGRSWLRQRIFXVWRPHUV



/R\DOW\SURJUDPHIIHFWVRQFXVWRPHUOR\DOW\

0RVW UHVHDUFK RQ OR\DOW\ SURJUDPV KDV EHHQ GHGLFDWHG WR HIIHFWLYHQHVV DVVHVVPHQW DV LW LV IXQGDPHQWDO WR SURYH D UHDVRQ RI H[LVWHQFH IRU OR\DOW\ SURJUDPV ([LVWLQJ HPSLULFDO ILHOG VWXGLHVSURYLGHPL[HGHYLGHQFH0lJL ILQGVQRRYHUDOOVLJQLILFDQWHIIHFWRIOR\DOW\FDUG SRVVHVVLRQ LQ WKH SULPDU\ VWRUH RQ HLWKHU VKDUHRIYLVLWV RU VKDUHRIZDOOHW IRU IRXU OR\DOW\ SURJUDPVRSHUDWLQJLQDPLGGOHVL]HGWRZQ+RZHYHUWKHOR\DOW\FDUGHIIHFWLVVLJQLILFDQWIRU WKH WZR ODUJHVW FKDLQV LQ WKH PDUNHW VKH VWXGLHV 6KDUS DQG 6KDUS  DOVR ILQG WKDW D OR\DOW\SURJUDPJHQHUDWHVHIIHFWVRQDYHUDJHSXUFKDVHIUHTXHQFLHVDQGVKDUHRIUHTXLUHPHQWV RQO\ IRU D OLPLWHG QXPEHU RI SURYLGHUV 2Q WKH RWKHU KDQG %ROWRQ %UDPOHWW DQG .DQQDQ  ILQG WKDW OR\DOW\ SURJUDP PHPEHUV WHQG WR RYHUORRN QHJDWLYH HYDOXDWLRQV LQ WKHLU UHWHQWLRQGHFLVLRQDQGXVHWKHLUFUHGLWFDUGDFFRXQWPRUHLQWHQVLYHO\)LQDOO\9HUKRHI ILQGVWKDWOR\DOW\SURJUDPPHPEHUVKLSVHQKDQFHFXVWRPHUVKDUHGHYHORSPHQWV

$Q LPSRUWDQW LVVXH IRU WKH HPSLULFDO DQDO\VLV RI OR\DOW\ SURJUDPV LV WKH WZRVLGHG FDXVDO GLUHFWLRQ RI WKH HIIHFWV HQGRJHQHLW\ SUREOHP $ OR\DOW\ SURJUDP DLPV WR HQKDQFH FXVWRPHUOR\DOW\EXWOR\DOW\SURJUDPHQUROPHQWLVVSHFLILFDOO\DWWUDFWLYHIRUFXVWRPHUVZKR DUHDOUHDG\OR\DO7KHUHIRUHGLIIHUHQFHVEHWZHHQSURJUDPPHPEHUVDQGQRQPHPEHUVFDQQRW EH DWWULEXWHG FRPSOHWHO\ WR WKH OR\DOW\ SURJUDP HIIHFW $XWKRUV RI H[LVWLQJ HIIHFWLYHQHVV VWXGLHVEULQJXSWKHSUREOHPDVDQLVVXHIRUIXUWKHUUHVHDUFK

³7KHSUHYDOHQFHRIPXOWLSOHPHPEHUVKLSV FRQVXPHUV¶ UHDVRQV IRU DFTXLULQJ FDUGV DQG WKH FDXVDOUHODWLRQVKLSEHWZHHQFDUGPHPEHUVKLSDQGFXVWRPHUVKDUHQHHGWREHPRUHWKRURXJKO\ LQYHVWLJDWHG´0lJLS

³7KHSRVLWLYHHIIHFWRIUHZDUGSURJUDPV«LVOLNHO\WREHRYHUHVWLPDWHGLQSULRUUHVHDUFK WKDWGRHVQRWDFFRXQWIRUWKHHQGRJHQRXVQDWXUHRIWKHVHSURJUDPV´%ROWRQHWDOS



VDYLQJSURJUDP6KDUSDQG6KDUS([SHULPHQWDODQGDQDO\WLFDOVWXGLHVKDYHGHDOWZLWK WKH HIIHFWV RI VHYHUDO GHVLJQ HOHPHQWV 'LVWLQFWLRQ FDQ EH PDGH EHWZHHQ GHOD\HG YHUVXV LPPHGLDWHUHZDUGV<LDQG-HRQ=KDQJ.ULVKQDDQG'KDU&XVWRPHUUHZDUGLQJ EDVHG RQ SXUFKDVH VHOHFWLRQ LV LPPHGLDWH LI WKH UHZDUG LV JLYHQ LPPHGLDWH XSRQ SXUFKDVH SULFH GLVFRXQW DQG GHOD\HG ZKHQ D FXVWRPHU LV UHZDUGHG RQ D IXWXUH SXUFKDVH RFFDVLRQ UHTXLULQJ UHWHQWLRQ HJ VDYLQJ SURJUDPV FRXSRQV 8QGHU ORZLQYROYHPHQW FRQGLWLRQV LPPHGLDWH UHZDUGV DUH KLJKHU YDOXHG WKDQ GHOD\HG UHZDUGV EXW DW WKH ULVN RI FUHDWLQJ MXVW SURJUDPOR\DOW\DQGQRWEUDQGRUVWRUHOR\DOW\<LDQG-HRQ$QDGYDQWDJHRIGHOD\HG UHZDUGV LV WKDW WKH\ FUHDWH VZLWFKLQJ FRVWV ZKLFK GHFUHDVH SULFH VHQVLWLYLW\ DQG HQDEOH FRPSDQLHVWRDVNKLJKHUSULFHV.LP6KLDQG6ULQLYDVDQ$PHDQLQJIXOGLVWLQFWLRQRI UHZDUG W\SHV FDQ EH PDGH EHWZHHQ SURGXFWUHODWHG DQG XQUHODWHG UHZDUGV ([SHULPHQWDO UHVHDUFK5RHKP%ROPDQ3XOOLQVDQG5RHKP VKRZVWKDWSURGXFWUHODWHGUHZDUGVDUH EHWWHU DEOH WR VXSSRUW IDYRUDEOH EUDQG DVVRFLDWLRQV DQG WKHUHIRUH SUHIHUUHG RYHU SURGXFW XQUHODWHG UHZDUGV )XUWKHUPRUH SURGXFWUHODWHG DUH W\SLFDOO\ PRUH HIILFLHQW WR RIIHU DQG HVSHFLDOO\FRPSDQLHVZLWKKLJKEUDQGHTXLW\FDQEHQHILWIURPJLYLQJWKHPDVDUHZDUG.LP HW DO  .RSDOOH DQG 1HVOLQ  $QRWKHU SRVVLEOH FDWHJRUL]DWLRQ LV EHWZHHQ KHGRQLF DQG QHFHVVLW\ UHZDUGV .LYHW] DQG 6LPRQVRQ  VKRZ D KLJKHU SUHIHUHQFH IRU OX[XU\ UHZDUGVZKHQUHTXLUHGHIIRUWVLQFUHDVHUHODWLQJWRDUHGXFWLRQLQJXLOWIHHOLQJV

$QDO\VHV RQ VDYLQJ SRLQWV VFKHGXOHV KDYH VKRZQ WKDW FXVWRPHUV VWURQJO\ OHW WKHPVHOYHVOHDGWRWKHSRLQWVWKHPHGLDWRUUDWKHUWKDQWRWKHUHZDUGWREHREWDLQHGLQWKH HQGZKLFKPD\OHDGWRREYLRXVO\LUUDWLRQDOEHKDYLRU+VHHHWDO9DQ2VVHODHU$OED DQG0DQFKDQGD,QVXPH[SHULPHQWDOUHVHDUFKKDVVKRZQWKDWWKHGHVLJQRIDOR\DOW\ SURJUDPFDQLQIOXHQFHLWVHIIHFWLYHQHVVFRQVLGHUDEO\

 2WKHU UHOHYDQW IDFWRUV FDQ EH IRXQG LQ LQGXVWU\ GLIIHUHQFHV 7KH RYHUYLHZ LQ WKH DSSHQGL[VKRZVWKDWWKHOR\DOW\SURJUDPVVWXGLHGGLIIHUZLGHO\LQWKHLQGXVWU\LQZKLFKWKH\ DUH XVHG 6HYHUDO DXWKRUV VXJJHVW WKDW WKH HIIHFWLYHQHVV RI OR\DOW\ SURJUDPV FRXOG YDU\ EHWZHHQ SURGXFW FDWHJRULHV HJ %KDWWDFKDU\D DQG %ROWRQ  9HUKRHI  5HOHYDQW GHWHUPLQDQWVVXJJHVWHGDUHWKHGHJUHHRILQYROYHPHQWLQWKHSURGXFWFDWHJRU\<LDQG-HRQ YDULHW\VHHNLQJWHQGHQFLHV=KDQJHWDODQGULVNDYHUVLRQ%XONOH\6R IDU QR VWXG\ GLUHFWO\ DVVHVVHV WKH HIIHFWV RI LQGXVWU\ GLIIHUHQFHV RQ OR\DOW\ SURJUDP HIIHFWLYHQHVV

/R\DOW\SURJUDPSURILWDELOLW\



2XWOLQHRIWKH'LVVHUWDWLRQ

7KLV GLVVHUWDWLRQ LQYHVWLJDWHV WKH FHQWUDO UHVHDUFK SUREOHP E\ PHDQV RI WKUHH HPSLULFDO VWXGLHV7KHHPSLULFDOVWXGLHVDUHSUHVHQWHGLQUHVSHFWLYHO\&KDSWHUVDQG ,Q&KDSWHUDVXUYH\DPRQJUHWDLOPDQDJHUVLVFRQGXFWHG,WVWXGLHVWKHOR\DOW\ SURJUDPDGRSWLRQRIUHWDLOHUVRXWRIPDUNHWDQGRUJDQL]DWLRQDOFKDUDFWHULVWLFV7KHVWXG\DLPV WRH[SODLQKLJKGLIIHUHQFHVEHWZHHQOR\DOW\SURJUDPDGRSWLRQVEHWZHHQUHWDLOVHFWRUEXWDOVR WKHSKHQRPHQRQWKDWHYHQLQVHFWRUVZLWKPDQ\OR\DOW\SURJUDPVVRPHUHWDLOHUVGHFLGHQRWWR DGRSWDOR\DOW\SURJUDP7KHVXUYH\LVDOVRXVHGWRVWXG\OR\DOW\SURJUDPHIIHFWVRQFXVWRPHU NQRZOHGJHDQGFXVWRPHUOR\DOW\DVSHUFHLYHGE\UHWDLOPDQDJHUVLQFRPELQDWLRQZLWKOR\DOW\ SURJUDPGHVLJQDQGLQGXVWU\GLIIHUHQFHV

&KDSWHU  VWXGLHV OR\DOW\ SURJUDP HIIHFWV RQ EHKDYLRUDO OR\DOW\ XVLQJ PDUNHWZLGH SDQHOGDWDRIKRXVHKROGVRQJURFHU\SXUFKDVLQJDQGOR\DOW\SURJUDPPHPEHUVKLSV7R DFFRXQW IRU WKH WZRVLGHG FDXVDOLW\ EHWZHHQ WKHVH YDULDEOHV ZH VSHFLI\ D PRGHO IRU WKH OR\DOW\ SURJUDP DGRSWLRQ RI FXVWRPHUV DQG XVH LQVWUXPHQWDO YDULDEOHV VXFK DV SULYDF\ FRQFHUQVDQGOR\DOW\SURJUDPHQMR\PHQW7KHVWXG\LVWKHILUVWWRDFFRXQWIRUHQGRJHQHLW\E\ DFFRXQWLQJ IRU WZRVLGHG FDXVDOLW\ EHWZHHQ OR\DOW\ SURJUDP PHPEHUVKLSV DQG SXUFKDVH EHKDYLRUDQGLWLOOXVWUDWHVWRZKDWH[WHQWFRUUHFWLQJIRUHQGRJHQHLW\SUREOHPVLVLPSRUWDQW 7KHVWXG\DOVRDFFRXQWVIRUFRPSHWLWLRQDQGDVVHVVHVWKHHIIHFWVRIOR\DOW\SURJUDPGHVLJQ GLIIHUHQFHV)LQDOO\UHZDUGLQJFRVWVDUHWDNHQLQWRDFFRXQWLQRUGHUWRGUDZFRQFOXVLRQVDERXW HIIHFWVRQQHWUHYHQXHV

7DEOH2YHUYLHZRIH[LVWLQJVWXGLHVRQOR\DOW\SURJUDPV

$XWKRU 5HODWLRQVWXGLHG 5HVHDUFK0HWKRG 3DUWLFXODU'HWDLOV $SSOLFDWLRQ

$OODZD\%HUNRZLW]DQG

'6RX]D &XVWRPHUDGRSWLRQRIOR\DOW\SURJUDP )LHOGVWXG\ 'LIIXVLRQRIOR\DOW\FDUGVDIWHUDOR\DOW\SURJUDPODXQFK 5HWDLOLQJXQVSHFLILHG %HOODQG/DO (IIHFWLYHQHVVRI

OR\DOW\DFWLRQ )LHOGVWXG\DQDO\WLFDOIRXQGDWLRQ (IIHFWVRIDWHPSRUDU\VDYLQJSURJUDPRQFXVWRPHUSXUFKDVHV *URFHU\UHWDLOLQJ %ROWRQ.DQQDQDQG

%UDPOHWW (IIHFWLYHQHVVRIOR\DOW\SURJUDP )LHOGVWXG\3DQHOGDWDTXHVWLRQQDLUH 7KHHIIHFWRIOR\DOW\SURJUDPPHPEHUVKLSRQDFFRXQW UHWHQWLRQDQGXVDJH

&UHGLWFDUG FRPSDQ\

%XONOH\ (IIHFWLYHQHVVRIOR\DOW\

SURJUDP $QDO\WLFDO,2 $VVXPHVXQFHUWDLQW\LQXWLOLW\RIIXWXUHSXUFKDVHVDVUDWLRQDOH IRUOR\DOW\SURJUDPV  'H:XOIHWDO &XVWRPHUDGRSWLRQRI OR\DOW\SURJUDP GHVLJQ &RQMRLQWVWXG\ &RQMRLQWDQDO\VLVRQXWLOLW\RI OR\DOW\SURJUDPGHVLJQV 8QVSHFLILHG 'Uq]HDQG+RFK (IIHFWLYHQHVV3URILWDELOLW\

2YHUYLHZRIH[LVWLQJVWXGLHVRQOR\DOW\SURJUDPV

$XWKRU 5HODWLRQVWXGLHG 5HVHDUFK0HWKRG 3DUWLFXODU'HWDLOV $SSOLFDWLRQ

.LP6KLDQG6ULQDYDVDQ

 (IIHFWLYHQHVVSURILWDELOLW\RIOR\DOW\SURJUDPV GHVLJQ

$QDO\WLFDO*DPH

WKHRU\ 7UDGHRIIEHWZHHQSURGXFWUHODWHGDQG±XQUHODWHGSURGXFWV LQUHODWLRQWRSULFHVHQVLWLYLW\DQG XVDJHLQWHQVLW\



.LYHW]DQG6LPRQVRQ

 3UHIHUHQFHVIRUGHVLJQ ([SHULPHQWDO 7KHHIIHFWRIHIIRUWUHTXLUHPHQWVRQSUHIHUHQFHIRUQHFHVVLW\ YHUVXVOX[XU\UHZDUGV

5HWDLOLQJ FDUUHQWDO HFRPPHUFH .LYHW]DQG6LPRQVRQ

 &XVWRPHUDGRSWLRQRIOR\DOW\SURJUDPV ([SHULPHQWDO 7KHHIIHFWRILGLRV\QFUDWLFILWUHTXLUHGHIIRUWFRPSDUHGWR UHIHUHQFHHIIRUWRQSDUWLFLSDWLRQ 5HVWDXUDQW GHSDUWPHQW VWRUHFUHGLW FDUGV .RSDOOHDQG1HVOLQ

 (IIHFWLYHQHVVSURILWDELOLW\RIOR\DOW\SURJUDPV $QDO\WLFDO*DPHWKHRU\VRPHHPSLULFDO HYLGHQFH 6WXGLHVYLDELOLW\RIOR\DOW\ SURJUDPVLQUHODWLRQWR SUHIHUHQFHVIRUWKHUHZDUGDQG IRUFRPSHWLQJEUDQGVDQGWR FDWHJRU\H[SDQGDELOLW\ $LUOLQHV /LHEHUPDQQ &XVWRPHUDGRSWLRQ HIIHFWLYHQHVVRIOR\DOW\ SURJUDPV 6WUXFWXUHGWHOHSKRQH

2YHUYLHZRIH[LVWLQJVWXGLHVRQOR\DOW\SURJUDPV

$XWKRU 5HODWLRQVWXGLHG 5HVHDUFK0HWKRG 3DUWLFXODU'HWDLOV $SSOLFDWLRQ

0DXUL (IIHFWLYHQHVVRIOR\DOW\

SURJUDPV )LHOGVWXG\3DQHOGDWDTXHVWLRQQDLUH 'HWHUPLQDQWVRIFRQVLVWHQWOR\DOW\FDUGXVDJH *URFHU\UHWDLOLQJ 0lJL (IIHFWLYHQHVVRIOR\DOW\

SURJUDPVFRPSHWLWLRQ )LHOGVWXG\3DQHOGDWDTXHVWLRQQDLUH 6DWLVIDFWLRQDVPRVWLPSRUWDQWFRQWUROYDULDEOH *URFHU\5HWDLOLQJ 1XQHVDQG'Uq]H (IIHFWLYHQHVVRIOR\DOW\

SURJUDPVGHVLJQ ([SHULPHQWV 6WXGLHVWRZKDWH[WHQWZLGHUUHGHHPLQJRSSRUWXQLWLHVFDQ PDNHDVDYLQJSURJUDPPRUH HIIHFWLYH

$LUOLQHV

5RHKP%ROPDQ3XOOLQV

DQG5RHKP /R\DOW\SURJUDPGHVLJQHIIHFWLYHQHVV ([SHULPHQWDO 7KHLQIOXHQFHRIUHZDUGFKDUDFWHULVWLFVRQDWWLWXGLQDO OR\DOW\

3DFNDJHGJRRGV 6RIWGULQNV

6PLWKHWDO (IIHFWLYHQHVVRIOR\DOW\

SURJUDPV 'LDU\VWXG\TXHVWLRQQDLUH 0LUURULQJWHFKQLTXHVPDOOVDPSOHVL]H 5HWDLOLQJXQVSHFLILHG 6KDUSDQG6KDUS (IIHFWLYHQHVVRIOR\DOW\

SURJUDPV )LHOGVWXG\ 2EVHUYDWLRQVKRUWDIWHUODXQFKRIDODUJHPXOWLYHQGRUOR\DOW\ SURJUDP

5HWDLOLQJ 'LYHUVH

9DQ2VVHODHU$OEDDQG

2YHUYLHZRIH[LVWLQJVWXGLHVRQOR\DOW\SURJUDPV

$XWKRU 5HODWLRQVWXGLHG 5HVHDUFK0HWKRG 3DUWLFXODU'HWDLOV $SSOLFDWLRQ

9HUKRHI (IIHFWLYHQHVVRIOR\DOW\

SURJUDPV )LHOGVWXG\3DQHOGDWDTXHVWLRQQDLUH &KDQJHVLQVKDUHRIZDOOHWPHDVXUHGEHWZHHQWZR VXFFHVVLYH\HDUV ,QVXUDQFH SURGXFWV :DQVLQN (IIHFWLYHQHVV3URILWDELOLW\ RIOR\DOW\SURJUDPV GHVLJQ ([SHULPHQWDPRQJ

PDQJHUVDQGFRQVXPHUV 3HUFHLYHGHIIHFWLYHQHVVRIGLIIHUHQWSURJUDPGHVLJQV 3DFNDJHGJRRGV

<LDQG-HRQ /R\DOW\SURJUDPGHVLJQ

HIIHFWLYHQHVV ([SHULPHQWDO (IIHFWVRQSURJUDPOR\DOW\DQGEUDQGOR\DOW\DWWLWXGLQDO )ULHGFKLFNHQVWRUHVEHDXW\ VDORQV

=KDQJ.ULVKQDDQG

'KDU /R\DOW\SURJUDPHIIHFWLYHQHVVDQG SURILWDELOLW\

$QDO\WLFDOVRPH

HPSLULFDOHYLGHQFH 'LIIHUHQFHVEHWZHHQLPPHGLDWHDQGGHOD\HGSURPRWLRQVRQVDOHV DQGSURILWDELOLW\



&KDSWHU

$GRSWLRQDQG(IIHFWLYHQHVVRI/R\DOW\3URJUDPV

7KH5HWDLOHU¶V3HUVSHFWLYH

,QWURGXFWLRQ

$IWHUWXUEXOHQW \HDUVZLWKPDQ\OR\DOW\SURJUDPLQWURGXFWLRQVUHWDLOPDUNHWVKDYHEHFRPH UHODWLYHO\ VWDEOH $ FRQVLGHUDEOH QXPEHU RI UHWDLOHUV FXUUHQWO\ XVH OR\DOW\ SURJUDPV DV D PHDQV WR LQWHQVLI\ UHODWLRQVKLSV ZLWK FXVWRPHUV DQG WR VWLPXODWH FXVWRPHU OR\DOW\ VHH &KDSWHU  2Q WKH RWKHU KDQG PDQ\ RWKHU UHWDLOHUV KDYH GHFLGHG QRW WR DGRSW D OR\DOW\ SURJUDP7KH\FRQVLGHUOR\DOW\SURJUDPVQRWVXLWDEOHIRUWKHLUVSHFLILF FRPSDQ\RUIRUWKH PDUNHWLQZKLFKWKH\DUHRSHUDWLQJ)RRG0DUNHWLQJ,QVWLWXWH UHSRUWVWKDWDERXW RIWKH$PHULFDQUHWDLOHUVGRQRWKDYHOR\DOW\SURJUDPVDQGRIWKHVHQRQDGRSWHUVKDYH QRSODQVWRLQWURGXFHWKHPLQWKHIXWXUH'LVWLQFWLRQFDQWKXVEHPDGHEHWZHHQWZRJURXSVRI UHWDLOHUVWKHDGRSWHUVDQGWKHQRQDGRSWHUVRIOR\DOW\SURJUDPV7KHIDFWRUVWKDWGHWHUPLQH FRPSDQLHV¶DGRSWLRQRIOR\DOW\SURJUDPVDUHXQFOHDU$QGHTXDOO\LQWHUHVWLQJLVVXHLVWRZKDW H[WHQWWKHDGRSWHUVSHUFHLYHWKHLUOR\DOW\SURJUDPDVHIIHFWLYH

([LVWLQJ DFDGHPLF UHVHDUFK GHPRQVWUDWHG WKH WKHRUHWLFDO EDVLV RI OR\DOW\ SURJUDP DGRSWLRQV.LP6KLDQG6ULQLYDVDQ=KDQJ.ULVKQDDQG'KDUDQGKDVSURYLGHG HPSLULFDOHYLGHQFHRIWKHLUHIIHFWLYHQHVV%ROWRQ.DQQDQDQG%UDPOHWW0lJL ([SHULPHQWDO UHVHDUFK KDV IRFXVHG RQ OR\DOW\ SURJUDP GHVLJQ HOHPHQWV VXFK DV WKH VDYLQJ IHDWXUH .LYHW] DQG 6LPRQVRQ D 5RHKP %ROPDQ 3XOOLQV DQG 5RHKP  DQG FRQVXPHU FKDUDFWHULVWLFV .LYHW] DQG 6LPRQVRQ E WR H[SODLQ GLIIHUHQFHV LQ HIIHFWLYHQHVV +RZHYHU PRVW H[LVWLQJ UHVHDUFK KDV IRFXVHG RQ RQH OR\DOW\ SURJUDP RU RQH OR\DOW\SURJUDPFKDUDFWHULVWLFLQLVRODWLRQ)XUWKHULWUHPDLQVXQFOHDUXQGHUZKLFKPDUNHWDQG RUJDQL]DWLRQDOFRQGLWLRQVDOR\DOW\SURJUDPLVDVXLWDEOHPDUNHWLQJLQYHVWPHQW



UHWDLOHUV LQ WKH 1HWKHUODQGV &RQWUDU\ WR H[LVWLQJ OLWHUDWXUH RQ OR\DOW\ SURJUDPV ZKLFK LV EDVHG RQ HLWKHU HPSLULFDO RU H[SHULPHQWDO FRQVXPHU GDWD ZH WDNH D UHWDLOHU¶V SHUVSHFWLYH 5HWDLO PDQDJHUV ZRUN ZLWK OR\DOW\ SURJUDPV RQ D GDLO\ EDVLV DQG FDQ GUDZ IURP ZLGH H[SHULHQFH DQG QXPHURXV SURSULHWDU\ LQIRUPDWLRQ VRXUFHV 6SHFLILFDOO\ RXU VWXG\ FRQWULEXWHVWRWKHOLWHUDWXUHRQOR\DOW\SURJUDPVLQWZRZD\V

)LUVW RXU VXUYH\ DPRQJ UHWDLOHUV RQ WKH DGRSWLRQ RI OR\DOW\ SURJUDPV ZLOO SURYLGH LQVLJKW LQ PDUNHW DQG RUJDQL]DWLRQDO FKDUDFWHULVWLFV HJ FRPSHWLWLYH LQWHQVLW\ DQG WHFKQRORJLFDOVNLOOVWKDWVWLPXODWHRUUHVWUDLQDOR\DOW\SURJUDPDGRSWLRQ7KLVFRQWULEXWLRQ FORVHO\PDWFKHVUHVHDUFKTXHVWLRQSURSRVHGLQ&KDSWHU:KLFKIDFWRUVGULYHUHWDLOHUVWR DGRSW OR\DOW\ SURJUDPV" $OWKRXJK WKH JURZWK LQ UHWDLO OR\DOW\ SURJUDPV LV UHPDUNDEOH OR\DOW\SURJUDPVDUHQRWHTXDOO\ZLGHVSUHDG LQDOOUHWDLOVHFWRUV$QGHYHQLQVHFWRUVZKHUH WKH\ DUH SRSXODU VHYHUDO SOD\HUV VWLOO GR QRW XVH WKHP 7R EURDGHQ DFDGHPLF LQVLJKW LQ PDQDJHULDO GHFLVLRQPDNLQJ DQG WR VXSSRUW IXWXUH UHWDLO GHFLVLRQPDNLQJ LW LV LPSRUWDQW WR XQGHUVWDQG ZK\ VRPH UHWDLOHUV KDYH DGRSWHG FHUWDLQ PDUNHWLQJ VWUDWHJLHV VXFK DV OR\DOW\ SURJUDPVDQGRWKHUVKDYHQRW

 HIIHFWLYHQHVV" DQG UHVHDUFK TXHVWLRQ  +RZ GR FRPSHWLWRUV¶ OR\DOW\ SURJUDPV LQIOXHQFH HIIHFWLYHQHVV"

7KH UHVW RI WKLV FKDSWHU LV VWUXFWXUHG DV IROORZV ,Q WKH QH[W VHFWLRQ ZH GHYHORS D FRQFHSWXDO IUDPHZRUN DQG IRUPXODWH K\SRWKHVHV RQ IDFWRUV LQIOXHQFLQJ OR\DOW\ SURJUDP DGRSWLRQ LQ VHFWLRQ  ZH GR WKH VDPH IRU OR\DOW\ SURJUDP HIIHFWLYHQHVV 6HFWLRQ  GHVFULEHVRXUUHVHDUFKPHWKRGDQGVHFWLRQSUHVHQWVWKHUHVXOWVRIWKHHPSLULFDOVWXG\:H FRQFOXGHLQVHFWLRQDQGGLVFXVVPDQDJHULDOLPSOLFDWLRQVDQGOLPLWDWLRQVRIWKHVWXG\

/R\DOW\3URJUDP$GRSWLRQ

&RQFHSWXDOIUDPHZRUN

5HWDLO FRPSDQLHV KDYH WUDGLWLRQDOO\ EHHQ WUDQVDFWLRQ RULHQWHG UDWKHU WKDQ UHODWLRQ RULHQWHG 0XOKHUQ  6HYHUDO DXWKRUV KDYH SURSRVHG FODVVLILFDWLRQV RU VWDJHV RI UHODWLRQVKLS PDUNHWLQJ &RYLHOOR HW DO  ODEHO WKH ILUVW VWDJH RI UHODWLRQVKLS PDUNHWLQJ DV GDWDEDVH PDUNHWLQJ 7KH\ GHVFULEH LW DV WKH XVH RI WHFKQRORJ\EDVHG WRROV WR WDUJHW DQG UHWDLQ FXVWRPHUV'D\ VSHDNVRIYDOXHDGGLQJH[FKDQJHVWKHIRFXVRIWKH ILUPVKLIWVIURP JHWWLQJFXVWRPHUVWRNHHSLQJFXVWRPHUV7KHILUPSXUVXHVWKLVREMHFWLYHE\GHYHORSLQJDGHHS XQGHUVWDQGLQJRIWKHLUFXVWRPHUV¶QHHGVWKHQWDLORULQJWKHLURIIHULQJWRWKHVHQHHGVDVFORVHO\ DV SRVVLEOH DQG JLYLQJ FRQWLQXLQJ LQFHQWLYHV IRU WKH FXVWRPHU WR FRQFHQWUDWH PRVW RI WKHLU SXUFKDVHV ZLWK WKHP %HUU\  FODVVLILHV LW DV ³OHYHO RQH´ UHODWLRQVKLS PDUNHWLQJ D UHODWLRQDOSHUVSHFWLYHWKDWUHOLHVSULPDULO\RQSULFLQJLQFHQWLYHVWRVHFXUHFXVWRPHUV¶OR\DOW\ 7KHVH GHILQLWLRQV KDYH LQ FRPPRQ WKHLU IRFXV RQ WKH FUHDWLRQ RI FXVWRPHU GDWDEDVHV LQFUHDVLQJFXVWRPHUNQRZOHGJHDQGFXVWRPHUYDOXHDQGHQKDQFHPHQWRIOR\DOW\



LQWHUPVRIWDUJHWLQJ5RVVL0F&XOORFKDQG$OOHQE\ DQGFURVVVHOOLQJ.DPDNXUDHW DO  7KHUHIRUH FXVWRPHU GDWDEDVHV DUH FRQVLGHUHG DQ LPSRUWDQW LQVWUXPHQW WR EXLOG FXVWRPHUUHODWLRQVKLSVLQUHWDLOLQJ*U|QURRV0XOKHUQ6HFRQGUHZDUGVVXFKDV VDYLQJ IHDWXUHV VSHFLDO DFWLRQV DQG GLUHFW PDLOLQJV JLYH OR\DOW\ LQFHQWLYHV WR SURJUDP PHPEHUV DQG FDQ HQKDQFH FXVWRPHU OR\DOW\ /LHEHUPDQQ  &XVWRPHU OR\DOW\ FDQ EH GHVFULEHG DV D GHHSO\ KHOG FRPPLWPHQW WR UHEX\ RU UHSDWURQL]H D SUHIHUUHG SURGXFW FRQVLVWHQWO\LQWKHIXWXUH2OLYHU ,QVXPZHEHOLHYHWKDWOR\DOW\SURJUDPV KDYH WKH SRWHQWLDO WR VXSSRUW UHWDLOHUV¶ PRYH IURP D WUDGLWLRQDO WUDQVDFWLRQDO SHUVSHFWLYH WRZDUGV D UHODWLRQDOSHUVSHFWLYH )LJXUHVKRZVRXUFRQFHSWXDOIUDPHZRUN



)LJXUH&RQFHSWXDOIUDPHZRUN

/R\DOW\3URJUDP5HZDUGV  6DYLQJ)HDWXUH  3ULFH3URPRWLRQV  'LUHFW0DLOLQJV /R\DOW\3URJUDP(IIHFWV 0DUNHW)DFWRUV  %X\LQJ)UHTXHQF\  &RPSHWLWLYH,QWHQVLW\  &RPSHWLWRUV¶/R\DOW\ 3URJUDPV /R\DOW\3URJUDP $GRSWLRQ &XVWRPHU /R\DOW\ &XVWRPHU .QRZOHGJH 2UJDQL]DWLRQDO)DFWRUV  &XVWRPHU2ULHQWDWLRQ  7HFKQRORJLFDO6NLOOV  &HQWUDOL]DWLRQ  &RPSDQ\6L]H 'DWDEDVH&KDUDFWHULVWLFV  0HPEHUVKLS,QIRUPDWLRQ  'DWD$QDO\VLV &XVWRPHU%DVH )DFWRUV  &XVWRPHU'LYHUVLW\

0DUNHWIDFWRUV

3URGXFW0DUNHW7\SH

*U|QURRV  DUJXHV WKDW UHODWLRQVKLS PDUNHWLQJ PDNHV OHVV VHQVH LI FRQVXPHUV EX\ LQIUHTXHQWO\ LQ WKH SURGXFW FDWHJRU\ VXFK DV LQ FDVH RI GXUDEOHV .HHSLQJ WKH UHODWLRQVKLS DOLYH GXULQJ QRQSXUFKDVH SHULRGV LV FRVWO\ ZLWKRXW DQ\ LPPHGLDWH SD\RII IURP LW 8QGHU VXFKFLUFXPVWDQFHVDFRPSDQ\FDQWKXVEHWWHUVWLFNWRWUDQVDFWLRQPDUNHWLQJDQGWU\WRDWWUDFW WKHFRQVXPHURQFHKHPDNHVRQHRIKLVVFDUFHSXUFKDVHV



DXWRPDWLFDOO\FUHDWHGDWDWUDQVDFWLRQZKHQWKHFXVWRPHULVLGHQWLILHGDVDSURJUDPPHPEHU DQG SRVVLEO\ UHFHLYHV SURJUDP UHZDUGV VXFK DV SULFH SURPRWLRQV RU VDYLQJ SRLQWV 7KXV D SURGXFW FDWHJRU\ LQ ZKLFK FXVWRPHUV EX\ ZLWK KLJK IUHTXHQF\ KDV KLJKHU SRWHQWLDO IRU GHYHORSLQJSURJUDPOR\DOW\%KDWWDFKDU\DDQG6HQ<LDQG-HRQ7KHDUJXPHQWV DERYHVXJJHVWWKDWUHODWLRQVKLSPDUNHWLQJDQGOR\DOW\SURJUDPVVSHFLILFDOO\SURYLGHKLJKHVW EHQHILWVLQPDUNHWVZKHUHFRQVXPHUVPDNHSXUFKDVHVZLWKKLJKIUHTXHQF\

2YHUDOOZHK\SRWKHVL]HWKHIROORZLQJ

+ 7KH IUHTXHQF\ ZLWK ZKLFK FXVWRPHUV PDNH SXUFKDVHV ZLWKLQ WKH SURGXFW FDWHJRU\ SRVLWLYHO\LQIOXHQFHVWKHOLNHOLKRRGWKDWDUHWDLOHUDGRSWVDOR\DOW\SURJUDP

&RPSHWLWLYH,QWHQVLW\

&RPSHWLWLRQ LV PRVW LQWHQVH LI FRPSHWLWRUV KDYH D FRPSDUDEOH PDUNHWLQJ PL[ ,Q VXFK PDUNHWV FRPSDQLHV KDUDVV HDFK RWKHU ZLWK SURPRWLRQDO DFWLRQV WR DWWUDFW HDFK RWKHU¶V FXVWRPHUV &XVWRPHUV¶ VZLWFKLQJ PDNH H[SHFWHG FDVKIORZV PRUH YRODWLOH DQG UHTXLUH KLJK UHDFTXLVLWLRQ FRVWV 6ULYDVWDYD 6KHUYDQL DQG )DKH\  $ EHWWHU ORQJUXQ VWUDWHJ\ WR FUHDWH FRPSHWLWLYH DGYDQWDJH LV WR GLIIHUHQWLDWH RQHVHOI IURP WKH FRPSHWLWLRQ WKURXJK LQQRYDWLRQV1LMVHWDO9RVVDQG6HLGHUV$OR\DOW\SURJUDPFUHDWHVFRPSHWLWLYH DGYDQWDJH QRW VR PXFK E\ DWWUDFWLQJ QHZ FXVWRPHUV EXW E\ ORFNLQJ LQ SUHVHQW FXVWRPHUV %HFDXVH LQ D FRPSHWLWLYH PDUNHW WKH WKUHDW RI ORVLQJ FXVWRPHUV LV VXEVWDQWLDO FUHDWLQJ FXVWRPHUOR\DOW\LVEHQHILFLDO$JDLQVWWKLVEDFNJURXQGWKHDGRSWLRQRIUHODWLRQDOLQVWUXPHQWV FDQFUHDWHODUJHUEHQHILWVWKDQXQGHUFLUFXPVWDQFHVRIPRGHVWFRPSHWLWLYHLQWHQVLW\

7KHUHIRUHZHSRVLW

+ $ KLJKHU FRPSHWLWLYH LQWHQVLW\ LQ D PDUNHW LQFUHDVHV WKH OLNHOLKRRG WKDW D UHWDLOHU DGRSWVDOR\DOW\SURJUDP

&RPSHWLWRUV¶/R\DOW\3URJUDPV

 ILUVWGHVFULEHGE\'L0DJJLRDQG3RZHOO WRH[SODLQDWHQGHQF\WRZDUGVKRPRJHQHLW\ ZLWKLQPDUNHWV0LPHWLFLVRPRUSKLVPLVWKXVGULYHQE\ DUHGXFWLRQRIXQFHUWDLQW\ DQG ULVN FRQFHUQLQJWKHIXWXUHSURILWDELOLW\RIDQLQQRYDWLRQZKLFKLQFUHDVHVWKHDWWUDFWLYHQHVVRIDQ LQYHVWPHQW*DWLJQRQDQG5REHUWVRQ6HFRQGFRPSDQLHVPD\DGRSWDOR\DOW\SURJUDP DV D FRXQWHUDFWLRQ WR FRPSHWLWRUV¶ DGRSWLRQ RI D SURJUDP /HHIODQJ DQG :LWWLQN  /R\DOW\ SURJUDPV DUH FDOOHG D GHIHQVLYH VWUDWHJ\ EHFDXVH WKH\ DLP WR NHHS WKH SUHVHQW FXVWRPHUVLQWKHIDFHRIIXWXUHFRPSHWLWLYHRIIHUVUDWKHUWKDQWRJDLQPDUNHWVKDUH6KDUSDQG 6KDUS  +RZHYHU LQ UHWDLOLQJ PRVW FXVWRPHUV EX\ UHJXODUO\ DW GLIIHUHQW FRPSDQLHV ZLWKLQ WKH VDPH VHFWRU VR WKDW FXVWRPHU EDVHV VKRZ FRQVLGHUDEOH RYHUODS 5HLFKKHOG DQG 6DVVHU$FRPSDQ\PD\WKXVORRVHFRPSHWLWLYHDGYDQWDJHWKURXJKFRPSHWLWLYHOR\DOW\ SURJUDPVWKDWSURYLGHFRQVXPHUVZLWKOR\DOW\LQFHQWLYHVDQGUHZDUGV+HQFHDPRWLYDWLRQWR UHDFW RQ FRPSHWLWRUV¶ OR\DOW\ SURJUDPV LV WR SUHYHQW FXVWRPHU GHIHFWLRQ NQRZLQJ WKDW NHHSLQJFXVWRPHUVLVHDVLHUWKDQJHWWLQJWKHPEDFN

%HFDXVH RI PLPHWLF LVRPRUSKLVP DQG FRPSHWLWLYH UHDFWLRQV ZH PDNH WKH IROORZLQJ K\SRWKHVLV

+ $ KLJKHU SHUFHQWDJH RI FRPSHWLWRUV ZLWK D OR\DOW\ SURJUDP LQFUHDVHV WKH OLNHOLKRRG WKDWDUHWDLOHUDGRSWVDOR\DOW\SURJUDP

2UJDQL]DWLRQDOIDFWRUV

)RU D VXFFHVVIXO LPSOHPHQWDWLRQ RI UHODWLRQVKLS PDUNHWLQJ D FRPSDQ\ QHHGV DSSURSULDWH UHVRXUFHVDQGFRPSHWHQFLHV'D\SURSRVHVWKUHHFDWHJRULHVRIUHVRXUFHVWKDWFRPSRVH WKHUHODWLRQDOFDSDELOLW\RULHQWDWLRQNQRZOHGJHDQGVNLOOVDQGLQWHJUDWLRQDQGDOLJQPHQWRI SURFHVVHV $ORQJ WKHVH OLQHV ZH GLVFXVV IRXU RUJDQL]DWLRQDO IDFWRUV WKDW LQIOXHQFH OR\DOW\ SURJUDPDGRSWLRQ

&XVWRPHURULHQWDWLRQ



XQGHUVWDQGLQJDQGWKURXJKGLIIHUHQWLDWHGRIIHUVDOR\DOW\SURJUDPFDQFUHDWHKLJKHUFXVWRPHU YDOXH %HFDXVH WKH EHQHILWV RI D PDUNHWLQJ VWUDWHJ\ GHSHQG RQ LWV FRPSDWLELOLW\ ZLWK WKH FRPSDQ\¶VRYHUDOOVWUDWHJ\'D\DQG9DQGHQ%XOWH1LMVVHQDQG)UDPEDFKZH K\SRWKHVL]H

+ 7KH PRUH FXVWRPHU RULHQWHG D UHWDLO FRPSDQ\ LV WKH KLJKHU WKH OLNHOLKRRG WKDW WKLV UHWDLOHUDGRSWVDOR\DOW\SURJUDP

7HFKQRORJLFDOVNLOOV

5HWDLO FRPSDQLHV PDNH XVH RI YDULRXV WHFKQRORJLHV VXFK DV VFDQQHUV DQG LQYHQWRU\ PDQDJHPHQWV\VWHPVWRRSWLPL]HLQIRUPDWLRQVWUHDPVZLWKLQWKHFRPSDQ\,QJHQHUDOLWKDV EHHQIRXQGWKDWWHFKQRORJLFDOVNLOOVHQKDQFHRUJDQL]DWLRQDOLQQRYDWLRQV'DPDQSRXU %XW PRUH VSHFLILFDOO\ WHFKQRORJLFDO VNLOOV WR DFTXLUH PDQDJH DQG PRGHO FXVWRPHU LQIRUPDWLRQ DUH NH\ WR UHODWLRQVKLS PDUNHWLQJ 'D\  +RJDQ /HPRQ DQG 5XVW  +HQFHLQRXUFRQWH[WWKHVHVNLOOVFRXOGHQKDQFHWKHEHQHILWVRIOR\DOW\SURJUDPGDWDZKLOH UHGXFLQJFRVWVRILPSOHPHQWDWLRQDQGGDWDKDQGOLQJ

:HK\SRWKHVL]H

+ 7KHEHWWHU D UHWDLO FRPSDQ\¶V WHFKQRORJLFDO VNLOOV WKH KLJKHU WKH OLNHOLKRRG WKDW WKH UHWDLOHUDGRSWVDOR\DOW\SURJUDP

&HQWUDOL]DWLRQ

 GLIILFXOWLQDFHQWUDOL]HGRUJDQL]DWLRQWKHH[SHFWHGEHQHILWVRIDOR\DOW\SURJUDPDUHORZHU DQGZHK\SRWKHVL]H + 7KHPRUHFHQWUDOL]HGDUHWDLOFRPSDQ\LVRUJDQL]HGWKHORZHUWKHOLNHOLKRRGWKDWWKH UHWDLOHUDGRSWVDOR\DOW\SURJUDP &RPSDQ\VL]H /DUJHFRPSDQLHVDUHPRUHOLNHO\WRDGRSWQHZV\VWHPVDQGVHUYLFHV)UDPEDFKHWDO :LHUHQJD DQG 2XGH 2SKXLV  7KH\ SRVVHVV PRUH PHDQV WR LQYHVW LQ ODUJHVFDOH LQQRYDWLRQVDQGWKHLULQQRYDWLRQVDUHRIWHQPRUHSURILWDEOHEHFDXVHRIVFDOHDGYDQWDJHV7KH FRVWVRIOR\DOW\SURJUDPDGRSWLRQDUHSDUWO\IL[HGHJLQVHWWLQJXSDFDUGUHJLVWUDWLRQDQG GDWD ZDUHKRXVH V\VWHP ZKLFK IDYRUV DGRSWLRQ LQ ODUJHVFDOH SURJUDPV ,Q DGGLWLRQ WKH EHQHILWVDUHKLJKHUIRUODUJHFRPSDQLHVEHFDXVHDODUJHUFXVWRPHUEDVHFDQEHUHDFKHGZLWK WKHOR\DOW\SURJUDP%HFDXVHRIZLGHUILQDQFLDOIXQGLQJSRVVLELOLWLHVDQGHFRQRPLHVRIVFRSH DQGVFDOHZHK\SRWKHVL]H

+ 7KH ODUJHU D UHWDLO FRPSDQ\ WKH PRUH OLNHO\ LW LV WKDW WKH UHWDLOHU DGRSWV D OR\DOW\ SURJUDP

&XVWRPHUEDVHIDFWRUV

$Q LPSRUWDQW DGYDQWDJH RI UHODWLRQDO PDUNHWLQJ LQVWUXPHQWV RYHU WUDGLWLRQDO PDUNHWLQJ LQVWUXPHQWV LV WKHLU FDSDELOLW\ WR GLIIHUHQWLDWH EHWZHHQ FXVWRPHUV RQ LQGLYLGXDO OHYHO $ OR\DOW\SURJUDP¶VSRWHQWLDORIFXVWRPHUGLIIHUHQWLDWLRQFUHDWHVWKHVWURQJHVWUHODWLYHDGYDQWDJH RYHUPDVVPDUNHWLQJZKHQFXVWRPHUGLYHUVLW\LVKLJK6KHWK6LVLRGLDDQG6KDUPD:H IRFXVRQFXVWRPHUGLYHUVLW\KHUHZKLFKGRHVQRWLPSO\WKDWQRRWKHUFXVWRPHUEDVHIDFWRUV DUHUHOHYDQWIRUDFRPSDQ\¶VDGRSWLRQGHFLVLRQLWLVMXVWWKDWZHZDQWWRIRFXVKHUHRQDIDFWRU WKDWLVGLVWLQFWLYHIRUWKLVVSHFLILFDGRSWLRQGHFLVLRQ



/R\DOW\3URJUDP(IIHFWLYHQHVV

5HOHYDQWIDFWRUV

7KHGULYHUVRIOR\DOW\SURJUDPHIIHFWLYHQHVVDUHRIJUHDWPDQDJHULDOLQWHUHVW7KHGHJUHHWR ZKLFKDPDUNHWLQJVWUDWHJ\LVHIIHFWLYHGHSHQGVRQLWVLPSOHPHQWDWLRQDQGXVDJH$ODYLDQG -RDFKLPVWKDOHU$VVXFKZHH[SHFWWKDWSHUFHLYHGOR\DOW\SURJUDPHIIHFWLYHQHVVUHODWHV WR GDWDEDVH HOHPHQWV DQG OR\DOW\ SURJUDP UHZDUGV DQG SRVVLEO\ PDUNHW DQG RUJDQL]DWLRQDO IDFWRUVVHH)LJXUH 7KHVHODWWHUIDFWRUVVHUYHDVDVHOHFWLRQPHFKDQLVPEDVHGRQH[SHFWHG EHQHILWVDQGFRVWVDQGLIVHOHFWLRQLVDSSURSULDWHWKHVXFFHVVRIWKHSURJUDPPDLQO\GHSHQGV RQLPSOHPHQWDWLRQDQGXVDJHIDFWRUV:LHUHQJDDQG2XGH2SKXLV IRUH[DPSOHIRXQG WKDW PDUNHW DQG RUJDQL]DWLRQDO IDFWRUV GR QRW LQIOXHQFH WKH HIIHFWLYHQHVV RI PDQDJHPHQW GHFLVLRQVXSSRUWV\VWHPVLILPSOHPHQWDWLRQDQGXVDJHIDFWRUVDUHLQFOXGHGDVZHOO)RUOR\DOW\ SURJUDPVWKHVDPHPLJKWKROGWKRXJKZHKDYHQRH[DQWHUHDVRQVWRUXOHRXWDQLQGHSHQGHQW HIIHFWRIPDUNHWDQGRUJDQL]DWLRQDOIDFWRUVRQOR\DOW\SURJUDPHIIHFWLYHQHVV:HQRZGLVFXVV WZRGDWDEDVHHOHPHQWVDQGWKUHHOR\DOW\SURJUDPUHZDUGHOHPHQWVWKDWPD\LQIOXHQFHOR\DOW\ SURJUDP HIIHFWLYHQHVV LQ WHUPV RI D EHWWHU XQGHUVWDQGLQJ RI FXVWRPHUV QHHGV DQG ZLVKHV FXVWRPHU NQRZOHGJH DQG DQ LPSURYHG FXVWRPHU FRPPLWPHQW WR UHSXUFKDVH FXVWRPHU OR\DOW\:HWKHQGLVFXVVWKHLQIOXHQFHRIFXVWRPHUNQRZOHGJHRQFXVWRPHUOR\DOW\

&XVWRPHUGDWDEDVHHOHPHQWV

0HPEHUVKLSLQIRUPDWLRQ

0DQ\FRPSDQLHVUHTXLUHFXVWRPHUVZKREHFRPHPHPEHUVRIWKHLUOR\DOW\SURJUDPWRSURYLGH SHUVRQDO GDWD WKURXJK D VXEVFULSWLRQ IRUP PRVWO\ VRFLRGHPRJUDSKLF LQIRUPDWLRQ DQG VRPHWLPHVGRPDLQVSHFLILFLQWHUHVWVRUDWWLWXGHV7KHDGGLWLRQRISHUVRQDOGDWDWRSXUFKDVH GDWDLPSURYHVWKHTXDOLW\RIWKHFXVWRPHUGDWDEDVH7KH\FDQEHXVHGIRUVHYHUDODSSOLFDWLRQV HJ DGGUHVVHV FDQ EH XVHG WR GHYHORS JHRPDUNHWLQJ SURILOHV KRXVHKROG FRPSRVLWLRQ WR GLVWLQJXLVK VRFLRGHPRJUDSKLF JURXSV 6R PHPEHUVKLS LQIRUPDWLRQ HQDEOHV D FRPSDQ\ WR REWDLQEHWWHUSHUVRQDOL]HGNQRZOHGJHDERXWWKHLUFXVWRPHUV

7KHUHIRUHZHK\SRWKHVL]H



,QWHQVLW\RIGDWDDQDO\VLV

&XVWRPHU GDWDEDVHV RQO\ LPSURYH FXVWRPHU NQRZOHGJH ZKHQ WKH GDWD DUH DQDO\]HG RQ D UHJXODU EDVLV +RZHYHU PDQ\ FRPSDQLHV DUH QRW DEOH WR KDQGOH WKH HQRUPRXV GDWDEDVHV VWDWLVWLFDOO\9HUKRHIHWDO7KHDQDO\VLVRIFXVWRPHUOHYHOSXUFKDVHGDWDSURYLGHVDQ LPSRUWDQW RSSRUWXQLW\ WR EHWWHU XQGHUVWDQG FXVWRPHU EHKDYLRU DQG LQFUHDVH FXVWRPHU NQRZOHGJH5RVVL0F&XOORFKDQG$OOHQE\

7KHUHIRUHZHSURSRVH

+ 7KH LQWHQVLW\ ZLWK ZKLFK OR\DOW\ SURJUDP GDWD DUH DQDO\]HG HQKDQFHV FXVWRPHU NQRZOHGJH

/R\DOW\SURJUDPUHZDUGV

6DYLQJIHDWXUH

6DYLQJIHDWXUHVDUHDIRUPRISRVWSRQHGUHZDUGV&XVWRPHUVKDYHWRVSHQGDVXEVWDQWLDOVXP RIPRQH\ZKLFKW\SLFDOO\UHTXLUHVDORQJVHULHVRISXUFKDVHVLQRUGHUWRREWDLQDUHZDUGLQ WKH HQG $V VXFK D VDYLQJ IHDWXUH LV DQ LQVWUXPHQW WKDW SURYLGHV YHU\ WUDQVSDUHQW OR\DOW\ LQFHQWLYHV 7KH HIIHFWLYHQHVV RI VDYLQJ IHDWXUHV LQ HQKDQFLQJ FXVWRPHU OR\DOW\ KDV EHHQ VKRZQE\H[SHULPHQWDOVWXGLHV1XQHVDQG'Uq]H9DQ2VVHODHU$OEDDQG0DQFKDQGD 

7REHQHILWPD[LPDOO\IURPWKHVDYLQJIHDWXUHDFXVWRPHUPXVWFRQVHTXHQWO\XVHKLVRU KHUOR\DOW\FDUGDWHYHU\SXUFKDVH&XVWRPHUV¶FRQVLVWHQWXVHRIOR\DOW\FDUGVHQKDQFHVWKH TXDOLW\ RI WKH FXVWRPHU GDWDEDVH ZKLFK RSWLPDOO\ VXSSRUWV FXVWRPHU NQRZOHGJH 5HDOL]LQJ FDUG OR\DOW\ LV VRPHWLPHV PHQWLRQHG DV D NH\ PRWLYDWLRQ RI JLYLQJ OR\DOW\ UHZDUGV 0DXUL  ,Q DGGLWLRQ D VDYLQJ IHDWXUH FDSWXUHV LQIRUPDWLRQ DERXW VDYLQJ DQG UHGHHPLQJ EHKDYLRUDQGUHZDUGVFKRLFH.LYHW]DQG6LPRQVRQD$VVXFKLWSURYLGHVDFRPSDQ\ DGGLWLRQDONQRZOHGJHDERXWUHODWLRQVKLSVWDWXVDQGSURGXFWSUHIHUHQFHV

:HK\SRWKHVL]H

+D /R\DOW\ SURJUDPV ZLWK D VDYLQJ IHDWXUH HQKDQFH FXVWRPHU NQRZOHGJH PRUH WKDQ OR\DOW\SURJUDPVZLWKRXWDVDYLQJIHDWXUH

 3URPRWLRQ)HDWXUH

0DQ\ OR\DOW\ SURJUDPV RIIHU SULFH SURPRWLRQV WR WKHLU PHPEHUV RQ SURGXFWV LQ WKH DVVRUWPHQW 7KHVH SULFH SURPRWLRQV DUH RIIHUHG RQO\ WR OR\DOW\ SURJUDP PHPEHUV GLIIHUHQWLDWLQJ EHWZHHQ FXVWRPHU PHPEHUV DQG QRQPHPEHUV &XVWRPHUV PLJKW WKHUHIRUH FRQVLGHU VXFK SULFH SURPRWLRQV DV D UHODWLRQDO LQYHVWPHQW ZKLFK HQKDQFHV WKHLU OR\DOW\ 'H:XOI 2GHNHUNHQ6FKU|GHU DQG ,DFREXFFL  $ FXVWRPHU PLJKW DOVR DWWULEXWH REWDLQLQJDGLVFRXQWWRLWVRZQHIIRUW6FKLQGOHU VKRZHGWKDWWKLVLQGXFHVIHHOLQJVRI SULGH ZKLFK PRWLYDWHV UHSHDW EHKDYLRU DQG HQKDQFHV FXVWRPHU OR\DOW\ )XUWKHU D UHWDLO FRPSDQ\ REWDLQV SHUVRQVSHFLILF UHVSRQVH LQIRUPDWLRQ 7KLV LPSURYHV FXVWRPHU NQRZOHGJH RQ WKH LQGLYLGXDO FXVWRPHU OHYHO LQ WHUPV RI SULFH VHQVLWLYLW\ GHDO SURQHQHVV DQG SURGXFW SUHIHUHQFHV:HH[SHFW

+D /R\DOW\ SURJUDPV WKDW ZLWK D SURPRWLRQ IHDWXUH HQKDQFH FXVWRPHU NQRZOHGJH PRUH WKDQOR\DOW\SURJUDPVZLWKRXWDSURPRWLRQIHDWXUH +E /R\DOW\SURJUDPVWKDWZLWKDSURPRWLRQIHDWXUHHQKDQFHFXVWRPHUOR\DOW\PRUHWKDQ OR\DOW\SURJUDPVZLWKRXWDSURPRWLRQIHDWXUH 'LUHFW0DLOLQJV 'LUHFWPDLOLQJVDUHDQHIIHFWLYHWRROWRGLIIHUHQWLDWHEHWZHHQFXVWRPHUVDQGWRDSSURDFKWKHP LQGLYLGXDOO\%XOWDQG:DQVEHHN'LUHFWPDLOLQJVDUHDIRUPRISHUVRQDOWUHDWPHQWDQG FRXOGWKXVHQKDQFHFXVWRPHUOR\DOW\'H:XOI2GHNHUNHQ6FKU|GHUDQG,DFREXFFL,Q D VLPLODU YHLQ DV IRU SULFH SURPRWLRQV D UHWDLO FRPSDQ\ REWDLQV LQGLYLGXDOOHYHO UHVSRQVH LQIRUPDWLRQRQWKHPDLOLQJRIIHULQJVZKLFKFRXOGLPSURYHWKHLUNQRZOHGJHRQLWVFXVWRPHUV 7KHUHIRUHZHK\SRWKHVL]H

+D $OR\DOW\SURJUDPWKDWXVHVGLUHFWPDLOLQJVHQKDQFHVFXVWRPHUNQRZOHGJHPRUHWKDQD OR\DOW\SURJUDPZLWKRXWGLUHFWPDLOLQJV



&XVWRPHUNQRZOHGJH: &XVWRPHUOR\DOW\

&XVWRPHUNQRZOHGJHKDVEHHQUHFRJQL]HGDVDQLPSRUWDQWWRROWRHQKDQFHFXVWRPHUOR\DOW\LQ PDVVPDUNHWV&RYLHOORHWDO+RJDQ/HPRQDQG5XVW:KHQDUHWDLOHUNQRZV KLVFXVWRPHUVRQVHJPHQWRUHYHQLQGLYLGXDOOHYHOKHFDQSURYLGHEHWWHUVHUYLFHDQGGHYHORS VWURQJHU UHODWLRQV ZLWK WKHP $ FRPSDQ\ FDQ DSSO\ PLFURPDUNHWLQJ RU SURYLGH SHUVRQDO RIIHUV6RFXVWRPHUNQRZOHGJHFDQEHXVHGWRLPSURYHFXVWRPHUYDOXHDQGZHK\SRWKHVL]H + &XVWRPHUNQRZOHGJHHQKDQFHVFXVWRPHUOR\DOW\

5HVHDUFK0HWKRG

3URFHGXUH

7R WHVW RXU K\SRWKHVHV ZH FRQGXFWHG D VXUYH\ DPRQJ PDUNHWLQJ PDQDJHUV RI UHWDLO FRPSDQLHV LQ WKH 1HWKHUODQGV 2XU TXHVWLRQQDLUH ZDV H[WHQVLYHO\ SUHWHVWHG DPRQJ QLQH H[SHUWV7KLVJURXSRIH[SHUWVFRQVLVWHGRIWKUHHDFDGHPLFVWKUHHUHVHDUFKFRQVXOWDQWVDQG WKUHH UHWDLO PDQDJHUV HDFK RI ZKLFK LV VWURQJO\ LQYROYHG LQ UHWDLOLQJ DQG OR\DOW\ SURJUDP SURMHFWV

7KH VDPSOLQJ IUDPH ZDV IRUPHG E\ D FRPPHUFLDO GDWDEDVH WKDW FRQWDLQV DOO UHWDLO FKDLQVZLWKDWOHDVWVHYHQRXWOHWVRUHPSOR\HHVLQWKH1HWKHUODQGV)URPWKLVGDWDEDVHZH H[FOXGHG DOO FRPSDQLHV WKDW DUH SXUH VHUYLFH SURYLGHUV HJ KDLU GUHVVHUV FRPSDQLHV WKDW UHJLVWHUFXVWRPHUVDXWRPDWLFDOO\HJYLGHRUHQWDOVDQGFRPSDQLHVVWURQJO\OLPLWHGLQWKHLU PDUNHWLQJDFWLRQVEHFDXVHRIJRYHUQPHQWUHJXODWLRQHJSKDUPDFLHV$OORWKHUFRPSDQLHV ZHUHFRQWDFWHGE\SKRQHWRREWDLQWKHQDPHDQGHPDLODGGUHVVRIWKHSHUVRQUHVSRQVLEOHIRU WKHFRPSDQ\¶VPDUNHWLQJSROLF\:HZHUHWKXVDOVRDEOHWRUHPRYHFRPSDQLHVWKDWKDGJRQH EDQNUXSW RU WKDW DSSHDUHG QRW WR RSHUDWH LQ D EXVLQHVVWRFRQVXPHU PDUNHW 7KH UHPDLQLQJ VDPSOLQJ IUDPH FRQVLVWHG RI  UHWDLO FRPSDQLHV 7KHVH UHWDLO FRPSDQLHV UHFHLYHG D TXHVWLRQQDLUHLQ0DUFKDQGFRXOGFKRRVHWRFRPSOHWHLWE\UHJXODUPDLORUHPDLO$ UHPLQGHU ZDV LVVXHG LI D UHVSRQGHQW GLG QRW UHSO\ ZLWKLQ WZR ZHHNV $V DQ LQFHQWLYH ZH RIIHUHGDOOUHVSRQGHQWVDUHSRUWZLWKWKHVWXG\ILQGLQJV

 DQLPSRUWDQWWRSLFWRUHWDLOHUV7RWHVWIRUQRQUHVSRQVHELDVZHFRPSDUHGODWHUHVSRQGHQWV ZLWKWKHUHVWRIWKHVDPSOHRQDOOFRQVWUXFWVLQRXUIUDPHZRUN$UPVWURQJDQG2YHUWRQ :H XVHG WZR GHILQLWLRQV IRU ODWH UHVSRQGHQWV QDPHO\ WKH VORZHVW  SHUFHQW DQG WKRVH FRPSDQLHVWKDWUHFHLYHGDUHPLQGHU)RUERWKGHILQLWLRQVQRVLJQLILFDQWGLIIHUHQFHV DSSHDUHG EHWZHHQ ODWH DQG HDUO\ UHVSRQGHQWV IRU DQ\ RI WKH FRQVWUXFWV LQ RXU FRQFHSWXDO IUDPHZRUNDOOSYDOXHV!

0HDVXUHV



VSHFLILF LWHP IRUPXODWLRQ FDQ EH IRXQG LQ $SSHQGL[ $ 7DEOH  SUHVHQWV GHVFULSWLYH VWDWLVWLFVRQWKHPHDVXUHGPDUNHWDQGRUJDQL]DWLRQDOFKDUDFWHULVWLFV

7DEOH'HVFULSWLYHVWDWLVWLFVRIPDUNHWLQJDQGRUJDQL]DWLRQDO

FKDUDFWHULVWLFV

9DULDEOH 0LQLPXP 0D[LPXP 0HDQ 6WG'HYLDWLRQ &XVWRPHU'LYHUVLW\ 3URILWDELOLW\ 3UHIHUHQFHV &RPSHWLWLYH,QWHQVLW\ &RPSHWLWRUV¶/R\DOW\ 3URJUDPV &XVWRPHU2ULHQWDWLRQ 7HFKQRORJLFDO6NLOOV &HQWUDOL]DWLRQ 6L]HRXWOHWV                                

,Q WKH VDPSOH  FRPSDQLHV RSHUDWHG D OR\DOW\ SURJUDP  ZKLFK LV RQO\ PDUJLQDOO\ KLJKHUWKDQLQWKHVDPSOLQJIUDPH)RUSHUFHQWRIWKHFRPSDQLHVWKHFRPPHUFLDO GLUHFWRU FRPSOHWHG WKH TXHVWLRQQDLUH IRU  SHUFHQW WKH PDUNHWLQJ PDQDJHU DQG WKH UHPDLQLQJSHUFHQWFRQVLVWHGRIPDUNHWLQJDQDO\VWVPDUNHWLQJUHVHDUFKHUVDQGHPSOR\HHV ZLWKUHODWHGIXQFWLRQV7KHVDPSOHFRYHUVDZLGHUDQJHRIGLIIHUHQWUHWDLOVHFWRUVDVLVVKRZQ LQ7DEOH

 FXVWRPHUNQRZOHGJHPHDQ VG DQGRQFXVWRPHUOR\DOW\PHDQ VG 

7DEOH'HVLJQRIUHWDLOOR\DOW\SURJUDPVQ 

'HVFULSWLRQ 1XPEHURI/R\DOW\ 3URJUDPV (OHPHQW $EV 3HUF 6DYLQJ)HDWXUH 3URPRWLRQ)HDWXUH 'LUHFW0DLOLQJV &UHGLW&DUGV &RQWHVWV 'HPRQVWUDWLRQV 0XOWLYHQGRU 6DYLQJIRUSRLQWVWRREWDLQUHZDUGLQWKH IXWXUH 'LVFRXQWVRQFHUWDLQLWHPVIRUDOOSURJUDP PHPEHUV 3URJUDPPHPEHUVUHFHLYHGLUHFWPDLOV /R\DOW\FDUGFDQEHXVHGDVDFUHGLWFDUG /RWWHULHVFRPSHWLWLRQV 7UDGHVKRZVSURGXFWLQVWUXFWLRQVZRUNVKRSV /R\DOW\SURJUDPFDQEHXVHGDWGLIIHUHQW FRPSDQLHV              



5HVXOWV

/R\DOW\SURJUDPDGRSWLRQ

7RDVVHVVWKHGULYHUVRIOR\DOW\SURJUDPDGRSWLRQE\UHWDLOHUVZHHVWLPDWHDORJLWPRGHO:H FKHFNHGIRUPXOWLFROOLQHDULW\EHWZHHQWKHLQGHSHQGHQWYDULDEOHVZKLFKWXUQHGRXWWREHORZ IRUDOOPHWULFYDULDEOHVDOOFRUUHODWLRQV7KHORJLWPRGHOKDVDORJOLNHOLKRRGRI± DQGDSVHXGR5_{RI7KHPRGHOSUHGLFWVFRUUHFWO\IRURIWKHFDVHV7KHFRHIILFLHQWV} RIWKHORJLWPRGHODQGWHVWVWDWLVWLFVDUHSUHVHQWHGLQ7DEOH



)LJXUH7KHHIIHFWRIFRPSHWLWLYHSURJUDPVRQOR\DOW\SURJUDPDGRSWLRQ

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0 10 20 30 40 50 60 70 80 90 100

% of Competitors with a Loyalty Program Probability of

Loyalty Program Adoption

/R\DOW\SURJUDPHIIHFWLYHQHVV

1H[W ZH VWXG\ WKH SHUFHLYHG HIIHFWLYHQHVV RI OR\DOW\ SURJUDPV LQ WHUPV RI FXVWRPHU NQRZOHGJH DQG FXVWRPHU OR\DOW\ E\ VHOHFWLQJ RQO\ WKRVH FRPSDQLHV LQ WKH VDPSOH ZLWK D OR\DOW\ SURJUDP  FRPSDQLHV :H SHUIRUP WZR UHJUHVVLRQ DQDO\VHV RQH ZLWK SHUFHLYHG HIIHFWVRQFXVWRPHUNQRZOHGJHDVWKHGHSHQGHQWYDULDEOHDQGRQHZLWKFXVWRPHUOR\DOW\DVWKH GHSHQGHQW YDULDEOH $V LQGHSHQGHQW YDULDEOHV ZH LQFOXGH DOO OR\DOW\ SURJUDP UHZDUG DQG GDWDEDVH IDFWRUV ++ ,Q DGGLWLRQ ZH FKHFN IRU SRVVLEOH HIIHFWV RI PDUNHW DQG RUJDQL]DWLRQDOIDFWRUV*LYHQWKHVPDOOVDPSOHVL]HZHILUVWHQWHUDOOOR\DOW\SURJUDPUHZDUG DQGGDWDEDVHIDFWRUV1H[WZHVHTXHQWLDOO\HQWHUWKHPDUNHWDQGRUJDQL]DWLRQDOIDFWRUVEXW UHPRYHWKHPDJDLQLIWKH\DUHQRQVLJQLILFDQWIRUZDUGYDULDEOHVHOHFWLRQPHWKRG7KHUHVXOWV RIWKHILQDOPRGHOVDUHSUHVHQWHGLQ7DEOH

 WKHRWKHUKDQGPHPEHUVKLSLQIRUPDWLRQGRHVQRWLQIOXHQFHFXVWRPHUNQRZOHGJHVLJQLILFDQWO\ +UHMHFWHGVXJJHVWLQJWKDWUHWDLOHUVGRQRWH[SORLWWKHFXVWRPHULQIRUPDWLRQWKH\ JDWKHU 6DYLQJIHDWXUHVLQIOXHQFHFXVWRPHUNQRZOHGJHSRVLWLYHO\DVZHOO+DFRQILUPHGS  DQG WKH FRHIILFLHQW VL]H LV FRQVLGHUDEOH    :H ILQG QR VLJQLILFDQW LQIOXHQFH RI D SURPRWLRQ IHDWXUH DQG GLUHFW PDLOLQJV RQ WKH OR\DOW\ SURJUDP¶V HQKDQFHPHQW RI FXVWRPHU NQRZOHGJH +D DQG +D UHMHFWHG :KHQ FKHFNLQJ IRU HIIHFWV RI PDUNHW DQG RUJDQL]DWLRQDO IDFWRUV ZH ILQG WKDW EX\LQJ IUHTXHQF\ SRVLWLYHO\ LQIOXHQFHV WKH FXVWRPHU NQRZOHGJHHIIHFWS DVZHOODVFHQWUDOL]DWLRQRIWKHFRPSDQ\S &RPSDUHGWR DUHWDLOHURSHUDWLQJLQDVHFWRULQZKLFKFXVWRPHUVEX\ZLWKORZIUHTXHQF\DPHGLXPEX\LQJ IUHTXHQF\OHDGVWRDQLQFUHDVHRISRLQWVDQGKLJKEX\LQJIUHTXHQF\RISRLQWVRQWKH NQRZOHGJHHIIHFWRISRLQWV

&XVWRPHU OR\DOW\ LV SRVLWLYHO\ LQIOXHQFHG E\ WKH XVDJH RI D VDYLQJ IHDWXUH +E FRQILUPHGS EXWQRWLQIOXHQFHGE\DSURPRWLRQIHDWXUH+EUHMHFWHG7KHVDYLQJ IHDWXUHOHDGVWRDQLQFUHDVHRIWKHFXVWRPHUOR\DOW\HIIHFWRIDOPRVWDKDOISRLQWZKLFKLVD FRQVLGHUDEOHHIIHFWVL]HJLYHQWKDWFXVWRPHUOR\DOW\LVPHDVXUHGRQDSRLQWVFDOH6HQGLQJ GLUHFWPDLOVWROR\DOW\SURJUDPPHPEHUVKDVDOVRDFRQVLGHUDEOHSRVLWLYHEXWQRQVLJQLILFDQW HIIHFWRQFXVWRPHUOR\DOW\+EUHMHFWHG,QOLQHZLWKWKHRUHWLFDOFRQVLGHUDWLRQVFXVWRPHU NQRZOHGJHREWDLQHGIURPWKHOR\DOW\SURJUDPHQKDQFHVWKHHIIHFWRQFXVWRPHUOR\DOW\+ FRQILUPHG S   )RU FXVWRPHU OR\DOW\ LW WXUQV RXW WKDW QRQH RI WKH PDUNHW DQG RUJDQL]DWLRQDOYDULDEOHVLVVLJQLILFDQW



7DEOH'HWHUPLQDQWVRIOR\DOW\SURJUDPHIIHFWLYHQHVV

/R\DOW\3URJUDP(IIHFWV

&XVWRPHU.QRZOHGJH &XVWRPHU/R\DOW\

9DULDEOH +\SRWKHVLVDQG

([SHFWHG6LJQ &RHIILFLHQW WYDOXH SYDOXH

D _{+\SRWKHVLVDQG}



&RQFOXVLRQV

)LQGLQJV

/R\DOW\ SURJUDPV SOD\ DQ LPSRUWDQW UROH LQ UHWDLOLQJ EXW WKH UHWDLOHUV¶ SHUFHSWLRQV RQ WKLV PDUNHWLQJLQVWUXPHQWKDYHUHFHLYHGVFDQWDWWHQWLRQRQWKHOLWHUDWXUH:HSURSRVHDQGWHVWD FRQFHSWXDO IUDPHZRUN RQ WKH UHWDLOHUV¶ OR\DOW\ SURJUDP DGRSWLRQ DQG RQ WKHLU SHUFHSWLRQV UHJDUGLQJOR\DOW\SURJUDPHIIHFWLYHQHVV7RWHVWWKHIRUPXODWHGK\SRWKHVHVZHVXUYH\HG UHWDLOFRPSDQLHVSHUFHQWRIZKLFKKDYHDOR\DOW\SURJUDP2YHUDOOZHILQGWKDWFXVWRPHU PDUNHW DQG RUJDQL]DWLRQDO IDFWRUV GULYH OR\DOW\ SURJUDP DGRSWLRQ UHVHDUFK TXHVWLRQ  &RQWUDU\ WR OR\DOW\ SURJUDP DGRSWLRQ WKH SHUFHLYHG OR\DOW\ SURJUDP HIIHFWV DUH KDUGO\ DIIHFWHG E\ WKHVH IDFWRUV ,QVWHDG WKH SHUFHLYHG HIIHFWLYHQHVV RI D OR\DOW\ SURJUDP PDLQO\ GHSHQGV RQ OR\DOW\ SURJUDP UHZDUGV DQG DQDO\VLV RI FXVWRPHU SXUFKDVH GDWD UHVHDUFK TXHVWLRQV  DQG  7KLV RYHUDOO SDWWHUQ LV LQ OLQH ZLWK HDUOLHU ILQGLQJV LQ WKH OLWHUDWXUH RQ PDQDJHULDOGHFLVLRQPDNLQJHJ$ODYLDQG-RDFKLPVWKDOHU:LHUHQJDDQG2XGH2SKXLV 

/R\DOW\ SURJUDP DGRSWLRQ VHHPV WR EH GULYHQ VWURQJO\ E\ PDUNHW VWDQGDUGV 7KH SHUFHQWDJH RI FRPSHWLWRUV ZLWK D OR\DOW\ SURJUDP LV D VWURQJ GULYHU RI OR\DOW\ SURJUDP DGRSWLRQ 3UHYLRXV UHVHDUFK KDV IRXQG WKDW FRPSDQLHV UHO\ KHDYLO\ RQ FRPSHWLWRUV¶ H[SHULHQFHV ZLWK LQQRYDWLRQV 'L0DJJLR DQG 3RZHOO  DQG WHQG WR RYHUUHDFW RQ FRPSHWLWRUV¶PDUNHWLQJDFWLRQV/HHIODQJDQG:LWWLQN7KLV PD\ OHDG WR VXE RSWLPDO VLWXDWLRQVLQZKLFKWRRPDQ\FRPSDQLHVXVHOR\DOW\SURJUDPV+RZHYHURXUDQDO\VHVUHIXWH WKH DUJXPHQW WKDW OR\DOW\ SURJUDPV DUH LQHIIHFWLYH LI D ODUJH SDUW RI WKH PDUNHW XVHV WKHP 'RZOLQJDQG8QFOHV7KDWLVZHILQGWKDWWKHSHUFHQWDJHRIFRPSHWLWRUVZLWKDOR\DOW\ SURJUDP VWLPXODWHV UHWDLOHUV WR DGRSW D OR\DOW\ SURJUDP DOVR EXW LW GRHV QRW DIIHFW OR\DOW\ SURJUDPHIIHFWLYHQHVV



WRRIDUIRUPRVWUHWDLOHUV/R\DOW\SURJUDPVDOORZFRPSDQLHVWRGLIIHUHQWLDWHEHWZHHQPHPEHU FXVWRPHUVZLWKWDUJHWHGSURPRWLRQVDQGDFWLRQVEXWRQO\DIHZUHWDLOHUVFXUUHQWO\XVHOR\DOW\ SURJUDPV IRU WKDW SXUSRVH +HQFH UHWDLO FRPSDQLHV LJQRUH SDUW RI WKH SRWHQWLDO RI OR\DOW\ SURJUDPVWRVHUYHLQGLYLGXDOFXVWRPHUVEHWWHU

2UJDQL]DWLRQDOIDFWRUVSOD\DVHFRQGDU\UROHLQWKHUHWDLOHUV¶OR\DOW\SURJUDPDGRSWLRQ :H GR QRW ILQG WKDW WHFKQRORJLFDO VNLOOV SOD\ DQ LPSRUWDQW UROH LQ WKH GHFLVLRQ WR DGRSW D OR\DOW\SURJUDP/HVVWHFKQRORJLFDOFRPSDQLHVFDQSUREDEO\DGRSWVLPSOHUV\VWHPV)XUWKHU RXU UHVXOWV VKRZ WKDW FHQWUDOL]HG FRPSDQLHV JDLQ PRVW IURP D OR\DOW\ SURJUDP LQ WHUPV RI EHWWHU FXVWRPHU NQRZOHGJH +RZHYHU ZH GR QRW ILQG WKDW FHQWUDOL]HG FRPSDQLHV DUH PRUH OLNHO\ WR DGRSW D OR\DOW\ SURJUDP ZKLFK VXJJHVWV WKDW WKH\ XQGHUYDOXH WKH EHQHILWV RI REWDLQLQJFXVWRPHUVSHFLILFLQIRUPDWLRQ8QOLNHPXFKLQQRYDWLRQOLWHUDWXUHHJ)UDPEDFKHW DO  ZH GR QRW ILQG D SRVLWLYH UHODWLRQ EHWZHHQ FRPSDQ\ VL]H DQG OR\DOW\ SURJUDP DGRSWLRQ )RU VPDOO FRPSDQLHV OR\DOW\ SURJUDPV DUH SUREDEO\ DQ DWWUDFWLYH DOWHUQDWLYH WR PDVVPDUNHW PDUNHWLQJ VXFK DV QHZVSDSHU DQG WHOHYLVLRQ FRPPHUFLDOV LQ ZKLFK WKH\ IDFH HYHQ ODUJHU VFDOH GLVDGYDQWDJHV )XUWKHU WKH VFDOH DGYDQWDJHV RI D OR\DOW\ SURJUDP PLJKW LQIOXHQFH HVSHFLDOO\ WKH DGRSWLRQ GHFLVLRQ RI YHU\ VPDOO UHWDLO FRPSDQLHV ZKLFK DUH QRW LQFOXGHGLQ RXU VDPSOLQJ IUDPH &XVWRPHU RULHQWDWLRQ LV WKH RQO\ RUJDQL]DWLRQDO IDFWRU WKDW VWURQJO\HQKDQFHVOR\DOW\SURJUDPDGRSWLRQ3UHYLRXVUHVHDUFKDOUHDG\ IRXQGWKDWFXVWRPHU RULHQWDWLRQ HQKDQFHV WKH DGRSWLRQ RI GDWDEDVH PDUNHWLQJ E\ PDQXIDFWXUHUV 9HUKRHI DQG +RHNVWUD  2XU ILQGLQJV FRQILUP WKH SURSRVLWLRQ WKDW FXVWRPHU RULHQWDWLRQ SXW D FRPSDQ\LQDEHWWHUSRVLWLRQWRWDNHDGYDQWDJHRIWKHEHQHILWVRIDOR\DOW\SURJUDP

 'DWDDQDO\VLV LV FUXFLDO LI D ILUP LV WR XQGHUVWDQG LWV FXVWRPHUV )XUWKHU GDWD XVDJH HQDEOHVLPSOHPHQWDWLRQRIWDUJHWHGDFWLRQVWKDWHQKDQFHOR\DOW\VXFKDVGLUHFWPDLOLQJV%XOW DQG :DQVEHHN  :H ILQG WKDW GLUHFW PDLOLQJV LPSURYH FXVWRPHU OR\DOW\ FRQVLGHUDEO\ EXWWKHHIIHFWLVQRWVLJQLILFDQW7KLVVXJJHVWVWKDWVRPHFRPSDQLHVVHQGRXWGLUHFWPDLOLQJV ZLWKRXWFDUHIXOWDUJHWLQJZKLFKUHODWHVDJDLQWRSRRUGDWDDQDO\VLV

0DQDJHULDOLPSOLFDWLRQV

x 'RQRWEOLQGO\FRS\\RXUFRPSHWLWRUV

$ FRPSDQ\ VKRXOG EH FDUHIXO ZLWK FRS\LQJ FRPSHWLWRUV¶ EHKDYLRU 2Q WKH RQH KDQG XVLQJ FRPSHWLWRUV¶H[SHULHQFHVFRXOGJHQHUDWHIUXLWIXOLQIRUPDWLRQDQGLPSURYHWKHOR\DOW\SURJUDP GHFLVLRQ+RZHYHUFRPSDQLHVPLJKWEHFRPHLUUDWLRQDOO\ZRUULHGDERXWVWD\LQJEHKLQGRQWKH FRPSHWLWLRQ2XUDQDO\VHVVKRZWKDWUHWDLOVHFWRUVZKLFKDUHUHODWLYHO\VLPLODUGLIIHUZLGHO\LQ OR\DOW\ SURJUDP DGRSWLRQ UDWHV 7KLV VXJJHVWV WKDW UHWDLOHUV VWURQJO\ IROORZ DGRSWLRQV RI FRPSHWLWRUV

2QWKHRWKHUKDQGRXUUHVXOWVVKRZWKDWWKHHIIHFWLYHQHVVRIDOR\DOW\SURJUDPGRHV QRW GHSHQG RQ FRPSHWLWRUV¶ OR\DOW\ SURJUDP DGRSWLRQV ,Q RWKHU ZRUGV OR\DOW\ SURJUDPV DSSHDUWREHPDLQO\GHIHQVLYHUDWKHUWKDQRIIHQVLYH7KHUHIRUHUHWDLOFRPSDQLHVZLWKOR\DOW\ SURJUDPVVKRXOGQRWZRUU\DERXWFRPSHWLWLYHLPLWDWLRQVWRRPXFK x 5HFRQVLGHUOR\DOW\SURJUDPGHVLJQ &RPSDQLHVWKDWKDYHDGRSWHGDOR\DOW\SURJUDPVKRXOGFDUHIXOO\SODQWKHH[DFWGHVLJQRIWKH OR\DOW\SURJUDP2XUDQDO\VHVVKRZWKDWDSURPRWLRQIHDWXUHXQGHU DOR\DOW\SURJUDPGRHV QRWJHQHUDWHODUJHHIIHFWVRQFXVWRPHUOR\DOW\DQGFXVWRPHUNQRZOHGJH$FRPSDQ\VKRXOG FRQVLGHUDEROLVKLQJSULFHSURPRWLRQVJLYHQXQGHULWVOR\DOW\SURJUDP$OWHUQDWLYHO\DUHWDLOHU FRXOGWDUJHWSULFHSURPRWLRQVWRVSHFLILFFXVWRPHUVHJPHQWVLQWKLVZD\EHWWHUH[SORULQJWKH OR\DOW\ SURJUDP¶V RSSRUWXQLW\ IRU GLIIHUHQWLDWLRQ 6HJPHQWDWLRQ FRXOG EH EDVHG RQ SURILWDELOLW\EXWDOVRFDWHJRU\SHQHWUDWLRQFURVVFDWHJRU\EX\LQJEUDQGFKRLFHVHWF



FRQQHFWHG WR D ILUP¶V RZQ DVVRUWPHQW 5RHKP %ROPDQ 3XOOLQV DQG 5RHKP  VDYLQJ IHDWXUHVFRXOGUHZDUGFXVWRPHUVZLWKIUHHRUGLVFRXQWHGLWHPVIURPWKHSURGXFWDVVRUWPHQW x 8VHOR\DOW\SURJUDPGDWD

0DQ\ FRPSDQLHV LQWURGXFH OR\DOW\ SURJUDPV ZLWK WKH JRDO RI REWDLQLQJ FXVWRPHUVSHFLILF SXUFKDVH GDWD EXW VRPH FRPSDQLHV GR QRW XVH WKLV LQIRUPDWLRQ 2XU VWXG\ VKRZV WKH LPSRUWDQFHRIVWXG\LQJWKLVLQIRUPDWLRQWRLPSURYHNQRZOHGJHRIWKHFXVWRPHUEDVH:HDOVR VKRZWKDWWDUJHWHGDFWLRQVZKLFKUHTXLUHGDWDXVDJHVXFKDVGLUHFWPDLOLQJVFRXOGHQKDQFH FXVWRPHUOR\DOW\7KHUHIRUHFRPSDQLHVDUHDGYLVHGWRH[SORUHDQGH[SORLWGHILQLWHO\PDNHXVH RIWKHLUGDWD

/LPLWDWLRQV

2XU VWXG\ IRFXVHV RQ OR\DOW\ SURJUDPV LQ WKH UHWDLO VHFWRU ZKHUH WKH\ DUH ZLGHO\ XVHG +RZHYHUOR\DOW\SURJUDPVDOVRDSSHDULQRWKHULQGXVWULHVVXFKDVDLUOLQHVORGJLQJ%HOOHW DODQGILQDQFLDOVHUYLFHV9HUKRHI)UDQVHVDQG+RHNVWUD*LYHQGLIIHUHQFHVLQ PDUNHWVWUXFWXUHDQGSURGXFWW\SHWKHGULYHUVDQGHIIHFWLYHQHVVRIOR\DOW\SURJUDPVFRXOGEH GLIIHUHQWLQWKHVHLQGXVWULHV)RU H[DPSOHLQWKHDLUOLQHLQGXVWU\ODUJH FXVWRPHUGLIIHUHQFHV H[LVWLQIO\LQJIUHTXHQF\ZKLFKSDUWO\UHODWHVWRWKHGLVWLQFWLRQEHWZHHQEXVLQHVVDQGSULYDWH FXVWRPHUV.HDUQH\

2QDYHUDJHWKHUHWDLOHUVLQRXUVDPSOHPDNHRQO\OLPLWHGXVHRIWKHRSSRUWXQLWLHVRI OR\DOW\SURJUDPV/R\DOW\SURJUDPVPDLQO\SURYLGHVDYLQJIHDWXUHVSURPRWLRQIHDWXUHVDQG GLUHFWPDLOLQJV7KHOLWHUDWXUHPHQWLRQVVHYHUDORWKHUSRVVLELOLWLHVVXFKDVVLOYHUJROGHQDQG SODWLQXP FXVWRPHU WLHUV 5XVW =HLWKDPO DQG /HPRQ  RU PXOWLSURYLGHU OR\DOW\ SURJUDPV'RZOLQJDQG8QFOHV:HFRXOGQRWWHVWWKHHIIHFWLYHQHVVRIWKHVHSURJUDP GHVLJQV)XWXUHUHVHDUFKFRXOGWU\WRLGHQWLI\FDVHVRIPRUHDGYDQFHGOR\DOW\SURJUDPGHVLJQ RUWRFRQGXFWH[SHULPHQWDOUHVHDUFKWRWHVWWKHLUHIIHFWLYHQHVV



&KDSWHU

'R/R\DOW\3URJUDPV(QKDQFH%HKDYLRUDO/R\DOW\"$

0DUNHW:LGH$QDO\VLV$FFRXQWLQJIRU(QGRJHQHLW\

,QWURGXFWLRQ

7KH HIIHFW RI OR\DOW\ SURJUDPV RQ EHKDYLRUDO OR\DOW\ UHPDLQV WRSLF RI GHEDWH /R\DOW\ SURJUDPVPD\QRWKDYHWKHPLUDFXORXVSRZHUWRWXUQDOOGLVOR\DOFXVWRPHUVLQWROR\DOVRUWR PDNH FXVWRPHUV H[FOXVLYHO\ OR\DO 7KLV GRHV QRW PHDQ WKDW OR\DOW\ SURJUDPV FDQQRW EH D XVHIXOWRRO$VH[SUHVVHGE\.RVORZVN\³:KLOHQRQHRIWKHVHSURJUDPVUHVXOWLQD SHUIHFW ZRUOG HDFK FDQ JHQHUDWH WKDW OLWWOH H[WUD WKDW FDQ SURYLGH WKH UHWDLO PDUNHWHU ZLWK SRWHQWLDOWDFWLFDOZHDSRQV´$VXSHUPDUNHWPDQDJHUGHVFULEHVWKHDGGHGYDOXHRILWVOR\DOW\ SURJUDP DV IROORZV ³<RX GRQ¶W KDYH  SHUFHQW RI D VKDUH RI D FXVWRPHU¶V ZDOOHW &XVWRPHUV VKRS DERXW ILYH WLPHV D PRQWK 0D\EH \RX¶OO JHW WKUHH RI WKRVH WULSV DQG WKH FRPSHWLWLRQJHWVWZR7KHOR\DOW\SURJUDPHOLPLQDWHVDWOHDVWRQHVKRSSLQJWULS\RXZHUHQ¶W JHWWLQJ DQG FUHDWHV DQ DGGLWLRQDO VKRSSLQJ WULS WR \RXU VWRUH´ &LROHWWL  6R LW LV LPSRUWDQWWRFRUUHFWO\TXDQWLI\WKDWµOLWWOHH[WUD¶WKDWDOR\DOW\SURJUDPFDQRIIHUWRDUHWDLOHU

([WDQWHPSLULFDOUHVHDUFKSURYLGHVPL[HGHYLGHQFHRIOR\DOW\SURJUDPHIIHFWLYHQHVV 6RPH SUHYLRXV VWXGLHV IRXQG SRVLWLYH HIIHFWV RI UHWDLO OR\DOW\ SURJUDPV RQ FXVWRPHU SXUFKDVLQJ %ROWRQ .DQQDQ DQG %UDPOHWW  9HUKRHI  ZKHUHDV RWKHUV UHSRUW HIIHFWV ZKLFK DUH OLPLWHG WR DEVHQW 0lJL  6KDUS DQG 6KDUS  7KLV DPELJXLW\ UHODWHV DW OHDVW SDUWO\ WR WKH IDFW WKDW GDWD DQG PHWKRGRORJ\ OLPLWDWLRQV KLQGHU SURSHU DVVHVVPHQWRIWKHHIIHFWVRIOR\DOW\SURJUDPV