• No results found

The evaluation of the equilibrium partitioning method using sensitivity distributions of species in water and soil or sediment | RIVM

N/A
N/A
Protected

Academic year: 2021

Share "The evaluation of the equilibrium partitioning method using sensitivity distributions of species in water and soil or sediment | RIVM"

Copied!
25
0
0

Bezig met laden.... (Bekijk nu de volledige tekst)

Hele tekst

(1)5,90UHSRUW 7KHHYDOXDWLRQRIWKHHTXLOLEULXPSDUWLWLRQLQJPHWKRGXVLQJVHQVLWLYLW\GLVWULEXWLRQVRI VSHFLHVLQZDWHUDQGVRLORUVHGLPHQW 3YDQ%HHOHQ(0-9HUEUXJJHQDQG:-*03HLMQHQEXUJ. 7KLVLQYHVWLJDWLRQKDVEHHQSHUIRUPHGE\RUGHUDQGIRUWKHDFFRXQWRIWKH'LUHFWRUDWH *HQHUDOIRU(QYLURQPHQWDO3URWHFWLRQIRUWKH'LUHFWRUDWHIRU&KHPLFDOV:DVWHDQG 5DGLDWLRQ3URWHFWLRQZLWKLQWKHIUDPHZRUNRI5,90SURMHFWQXPEHUHQWLWOHG5LVN DVVHVVPHQWRIPHWDOVDQGRUJDQLFVXEVWDQFHV 5,90$QWRQLHYDQ/HHXZHQKRHNODDQ0$%LOWKRYHQ7KH1HWKHUODQGVSKRQHID[ HPDLO3YDQ%HHOHQ#5,90QO.

(2) 5,90UHSRUW. SDJHRI. $EVWUDFW 7KHHTXLOLEULXPSDUWLWLRQLQJPHWKRG (T3PHWKRG

(3) FDQEHXVHGWRGHULYHHQYLURQPHQWDO TXDOLW\VWDQGDUGVIRUVRLORUVHGLPHQWIURPDTXDWLFWR[LFLW\GDWDDQGSDUWLWLRQLQJFRHIILFLHQWV 7KHYDOLGLW\RIWKHXVHRIWKH(T3PHWKRGIRUWKLVSXUSRVHZDVVWXGLHGE\WKHFRPSDULVRQRI DTXDWLFZLWKWHUUHVWULDOWR[LFLW\GDWD)RURUJDQLFVXEVWDQFHVDQGIRUPHWDOVVXIILFLHQW GDWDZHUHDYDLODEOHLQWKHOLWHUDWXUHWRPDNHWKLVFRPSDULVRQ)RUFRSSHUFKORUS\ULIRV DWUD]LQHDQGIRUWKHHIIHFWRISHQWDFKORURSKHQRORUFDGPLXPRQVRLOSURFHVVHVWKHWHUUHVWULDO WR[LFLW\GDWDZHUHVLJQLILFDQWO\KLJKHUFRPSDUHGWRWKHDTXDWLFWR[LFLW\GDWDEXWIRU WULFKORURSKHQROWULFKORURHWKHQHFKURPLXP,,,DUVHQLFDQGOHDGWKH\ZHUHORZHU6RPHRI WKHVHVWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHVPLJKWEHDWWULEXWHGWRWKHVHOHFWLRQRIWKHVRUSWLRQ FRQVWDQWVEXWLQWKHFDVHRIFKORUS\ULIRVWULFKORURHWKHQHDQGFKORURIRUPWKLVZDVQRWWKH FDVH)RUWKHVHFRPSRXQGVWKHGLIIHUHQFHVPLJKWEHDWWULEXWHGWRWKHVHOHFWLRQRIVRLORU VHGLPHQWWR[LFLW\WHVWV7KHVHVLJQLILFDQWGLIIHUHQFHVLQGLFDWHWKDWWKH(T3PHWKRGFDQJLYHD VLJQLILFDQWRYHURUXQGHUHVWLPDWLRQ 7KH(T3PHWKRGLVXVHGWRHVWLPDWH+D]DUGRXV&RQFHQWUDWLRQ +&

(4) YDOXHVIRUVRLORU VHGLPHQWXVLQJDTXDWLFWR[LFLW\GDWD7KHVH+&YDOXHVZHUHLQRIWKHFDVHVPRUHWKDQD IDFWRUKLJKHUWKDQWKHFRUUHVSRQGLQJ+&YDOXHVWKDWZHUHGHULYHGGLUHFWO\XVLQJWR[LFLW\ WHVWVZLWKVRLORUJDQLVPVIRUWKHRUJDQLFVXEVWDQFHVDQGPHWDOV 5HFRPPHQGDWLRQVDUHJLYHQIRUWKHXVHRIWKH(T3PHWKRGIRUVHWWLQJVRLOTXDOLW\JXLGHOLQHV ZKHQRQO\DYHU\OLPLWHGQXPEHURIWHUUHVWULDOWR[LFLW\GDWDDUHDYDLODEOH.

(5) 5,90UHSRUW. SDJHRI. 6DPHQYDWWLQJ 'HHYHQZLFKWSDUWLWLHPHWKRGH (T3PHWKRGH

(6) NDQZRUGHQJHEUXLNWRP PLOLHXNZDOLWHLWVQRUPHQ ]RDOVKHW0D[LPDDO7RHODDWEDDU5LVLFRQLYHDXRIGH LQWHUYHQWLHZDDUGH

(7) YRRUERGHPRIVHGLPHQWDIWHOHLGHQXLWDTXDWLVFKHWR[LFLWHLWVJHJHYHQVHQ HHQERGHPZDWHURIVHGLPHQWZDWHUSDUWLWLHFRsIILFLsQW'HYDOLGLWHLWYDQKHWJHEUXLNYDQGH (S3PHWKRGHYRRUGLWGRHONDQEHVWXGHHUGZRUGHQGRRUDTXDWLVFKHWR[LFLWHLWVGDWDWH YHUJHOLMNHQPHWWHUUHVWULVFKH9RRURUJDQLVFKHVWRIIHQHQYRRUPHWDOHQZDUHQYROGRHQGH JHJHYHQVLQGHOLWHUDWXXUEHVFKLNEDDURPGH]HYHUJHOLMNLQJWHPDNHQ'HWR[LFLWHLWVHQ VRUSWLHGDWDYRRUZDWHUHQERGHPZHUGHQJHKDDOGXLWGHUDSSRUWHQGLHZRUGHQJHEUXLNWRP PLOLHXNZDOLWHLWVQRUPHQLQ1HGHUODQGDIWHOHLGHQ0HWEHKXOSYDQJHVHOHFWHHUGHVRUSWLH FRQVWDQWHQ XLWJHGUXNWLQ/NJ

(8) ZHUGHQGH(& (IIHFW&RQFHQWUDWLH

(9) RI1R2EVHUYHG (IIHFW&RQFHQWUDWLRQ 12(&

(10) ZDDUGHQ XLWJHGUXNWLQ—J/

(11) YRRUZDWHURUJDQLVPHQ YHUJHOHNHQPHWGH(&RI12(&ZDDUGHQ XLWJHGUXNWLQPJNJ

(12) YRRUERGHPRUJDQLVPHQRI ERGHPSURFHVVHQ 9RRUNRSHUFKORRUS\ULIRVDWUD]LQHHQYRRUKHWHIIHFWYDQSHQWDFKORRUIHQRORIFDGPLXPRS ERGHPSURFHVVHQZDUHQGHWHUUHVWULVFKHWR[LFLWHLWVJHJHYHQV (&RI12(&

(13) VLJQLILFDQW KRJHUGDQGHDTXDWLVFKHWR[LFLWHLWVJHJHYHQV9RRUWULFKORRUIHQROWULFKORRUHWKHHQ FKURRP,,,DUVHQLFXPHQORRGZDUHQGHDTXDWLVFKHWR[LFLWHLWVJHJHYHQVVLJQLILFDQWKRJHU 6RPPLJHYDQGH]HVWDWLVWLVFKVLJQLILFDQWHYHUVFKLOOHQNXQQHQPLVVFKLHQZRUGHQ WRHJHVFKUHYHQDDQGHVHOHFWLHYDQGHVRUSWLHFRQVWDQWHQPDDUYRRUFKORRUS\ULIRVHQ WULFKORRUHWKHHQZDVGLWQLHWKHWJHYDO'HVLJQLILFDQWODJHUH(&ZDDUGHQYDQFKORURIRUP WULFKORRUPHWKDDQ

(14) YRRUSURFHVVHQLQKHWVHGLPHQWYHUJHOHNHQPHWGLHUVRRUWHQLQZDWHUNRQ RRNQLHWYHUNODDUGZRUGHQGRRUGHVHOHFWLHYDQGHVRUSWLHFRQVWDQWH9RRUFKORRUS\ULIRV WULFKORRUHWKHHQHQFKORURIRUPNXQQHQGH]HVWDWLVWLVFKVLJQLILFDQWHYHUVFKLOOHQPLVVFKLHQ ZRUGHQWRHJHVFKUHYHQDDQGHVHOHFWLHYDQGHERGHPRIVHGLPHQWWR[LFLWHLWVWHVWHQ 'H]HVLJQLILFDQWHYHUVFKLOOHQJHYHQDDQGDWGH(T3PHWKRGHJHHQZHWHQVFKDSSHOLMN JHYDOLGHHUGHPHWKRGHLVRPPLOLHXNZDOLWHLWVQRUPHQDIWHOHLGHQPDDUDOOHHQEHVFKRXZGNDQ ZRUGHQDOVHHQVFKDWWLQJVURXWLQHGLHHHQVLJQLILFDQWHRYHURIRQGHUVFKDWWLQJNDQJHYHQ 'H(T3PHWKRGHZRUGWJHEUXLNWRPGH+D]DUGRXV&RQFHQWUDWLRQ +&

(15) ZDDUGHQYRRU ERGHPRIVHGLPHQWWHVFKDWWHQPHWEHKXOSYDQDTXDWLVFKHWR[LFLWHLWVJHJHYHQV'H]H+& ZDUHQLQYDQGHJHYDOOHQPHHUGDQIDFWRUKRJHUGDQGHRYHUHHQNRPVWLJH+& ZDDUGHQGLHGLUHFWZHUGHQDIJHOHLGPHWEHKXOSYDQWR[LFLWHLWVWHVWHQPHWERGHPRUJDQLVPHQ YRRUGHRUJDQLVFKHVWRIIHQHQPHWDOHQ'H]HIDFWRUJHHIWDDQGDWGH(T3PHWKRGH QLHWJHEUXLNWNDQZRUGHQYRRUHHQDFFXUDWHEHSDOLQJYDQERGHPRIVHGLPHQW+&ZDDUGHQ PDDUDOOHHQJHVFKLNWLVYRRUHHQUXZHVFKDWWLQJ :DQQHHUHHQULVLFREHRRUGHODDUJHFRQIURQWHHUGZRUGWPHWHHQEHSHUNWDDQWDOWHUUHVWULVFKH WR[LFLWHLWVJHJHYHQVHQHHQYHHOJURWHUDDQWDODTXDWLVFKHWR[LFLWHLWVJHJHYHQVVDPHQPHWHHQ EHWURXZEDUHERGHPZDWHUSDUWLWLHFRsIILFLsQW'DQGLHQWHUYRRUHHQUXZHVFKDWWLQJYDQGH ERGHPNZDOLWHLWVQRUPHHQNHX]HJHPDDNWWHZRUGHQWXVVHQKHWJHEUXLNYDQGHWHUUHVWULVFKH GDWDRIKHWJHEUXLNYDQGH(S3PHWKRGH'HDDQEHYHOLQJHQJHYHQJHGHWDLOOHHUGHDGYLH]HQ YRRUGH]HNHX]HWHQHLQGHGHYDDNHUJJURWHRQ]HNHUKHLGLQGHVFKDWWLQJYDQHHQERGHP NZDOLWHLWVQRUPWHPLQLPDOLVHUHQ.

(16) 5,90UHSRUW. SDJHRI. 6XPPDU\ 7KHHTXLOLEULXPSDUWLWLRQLQJPHWKRG (T3PHWKRG

(17) FDQEHXVHGWRGHULYHHQYLURQPHQWDO TXDOLW\VWDQGDUGV OLNHWKH0D[LPXP3HUPLVVLEOH&RQFHQWUDWLRQRUWKHLQWHUYHQWLRQYDOXH

(18) IRU VRLORUVHGLPHQWIURPDTXDWLFWR[LFLW\GDWDDQGDVRLOZDWHURUVHGLPHQWZDWHUSDUWLWLRQLQJ FRHIILFLHQW7KHYDOLGLW\RIWKHXVHRIWKH(T3PHWKRGIRUWKLVSXUSRVHFDQEHVWXGLHGE\WKH FRPSDULVRQRIDTXDWLFZLWKWHUUHVWULDOWR[LFLW\GDWD)RURUJDQLFVXEVWDQFHVDQGIRU PHWDOVVXIILFLHQWGDWDZHUHDYDLODEOHLQWKHOLWHUDWXUHWRPDNHWKLVFRPSDULVRQ7KHWR[LFLW\ DQGVRUSWLRQGDWDIRUZDWHUDQGVRLOZHUHWDNHQIURPWKHUHSRUWVWKDWDUHXVHGWRGHULYH HQYLURQPHQWDOTXDOLW\VWDQGDUGVLQWKH1HWKHUODQGV7KH(& (IIHFW&RQFHQWUDWLRQ

(19) RU 1R2EVHUYHG(IIHFW&RQFHQWUDWLRQ 12(&

(20) YDOXHV H[SUHVVHGLQ—J/

(21) IRUZDWHURUJDQLVPV ZHUHFRPSDUHGZLWKWKH(&RU12(&YDOXHV H[SUHVVHGLQPJNJ

(22) IRUVRLORUJDQLVPVRU VRLOSURFHVVHVXVLQJVHOHFWHGVRUSWLRQFRQVWDQWV H[SUHVVHGLQ/NJ

(23)  )RUFRSSHUFKORUS\ULIRVDWUD]LQHDQGIRUWKHHIIHFWRISHQWDFKORURSKHQRORUFDGPLXPRQVRLO SURFHVVHVWKHWHUUHVWULDOWR[LFLW\GDWD (&RU12(&

(24) ZHUHVLJQLILFDQWO\KLJKHUFRPSDUHGWR WKHDTXDWLFWR[LFLW\GDWD)RUWULFKORURSKHQROWULFKORURHWKHQHFKURPLXP,,,DUVHQLF DQGOHDGWKHDTXDWLFWR[LFLW\GDWDZHUHVLJQLILFDQWO\KLJKHU6RPHRIWKHVHVWDWLVWLFDOO\ VLJQLILFDQWGLIIHUHQFHVPLJKWEHDWWULEXWHGWRWKHVHOHFWLRQRIWKHVRUSWLRQFRQVWDQWVEXWLQWKH FDVHRIFKORUS\ULIRVDQGWULFKORURHWKHQHWKLVZDVQRWWKHFDVH7KHVLJQLILFDQWO\ORZHU(& YDOXHVRIFKORURIRUP WULFKORURPHWKDQH

(25) IRUSURFHVVHVLQVHGLPHQWFRPSDUHGWRDQLPDO VSHFLHVLQZDWHUFRXOGDOVRQRWEHH[SODLQHGE\WKHVHOHFWLRQRIWKHVRUSWLRQFRQVWDQW)RU FKORUS\ULIRVWULFKORURHWKHQHDQGFKORURIRUPWKHVHVLJQLILFDQWGLIIHUHQFHVPLJKWEHDWWULEXWHG WRWKHVHOHFWLRQRIVRLORUVHGLPHQWWR[LFLW\WHVWV7KHVHVLJQLILFDQWGLIIHUHQFHVLQGLFDWHWKDW WKH(T3PHWKRGLVQRWDVFLHQWLILFDOO\YDOLGDWHGPHWKRGWRGHULYHHQYLURQPHQWDOTXDOLW\ VWDQGDUGVEXWFDQRQO\EHUHJDUGHGDVDQHVWLPDWLRQURXWLQHZKLFKFDQJLYHDVLJQLILFDQW RYHURUXQGHUHVWLPDWLRQ 7KH(T3PHWKRGLVXVHGWRHVWLPDWH+D]DUGRXV&RQFHQWUDWLRQ +&

(26) YDOXHVIRUVRLORU VHGLPHQWXVLQJDTXDWLFWR[LFLW\GDWD7KHVH+&YDOXHVZHUHLQRIWKHFDVHVPRUHWKDQD IDFWRUKLJKHUWKDQWKHFRUUHVSRQGLQJ+&YDOXHVWKDWZHUHGHULYHGGLUHFWO\XVLQJWR[LFLW\ WHVWVZLWKVRLORUJDQLVPVIRUWKHRUJDQLFVXEVWDQFHVDQGPHWDOV7KLVIDFWRULQGLFDWHV WKDWWKH(T3PHWKRGFDQQRWEHXVHGIRUDQDFFXUDWHGHWHUPLQDWLRQRIVRLORUVHGLPHQW+& YDOXHVEXWLVRQO\VXLWHGIRUDURXJKHVWLPDWLRQ :KHQDULVNDVVHVVRULVFRQIURQWHGZLWKDOLPLWHGQXPEHURIWHUUHVWULDOWR[LFLW\GDWDDQGD PXFKODUJHUQXPEHURIDTXDWLFWR[LFLW\GDWDWRJHWKHUZLWKDUHOLDEOHVRLOZDWHUSDUWLWLRQLQJ FRHIILFLHQW7KHUHLVDFKRLFHEHWZHHQWKHXVHRIWKHWHUUHVWULDOGDWDRUWKHXVHRIWKH(T3 PHWKRGIRUDURXJKHVWLPDWLRQRIDVRLOTXDOLW\VWDQGDUG7KHUHFRPPHQGDWLRQVJLYHGHWDLOHG DGYLFHIRUWKLVFKRLFHLQRUGHUWRPLQLPL]HWKHRIWHQYHU\ODUJHXQFHUWDLQW\LQWKHHVWLPDWLRQ RIDVRLOTXDOLW\VWDQGDUG .

(27) 5,90UHSRUW. SDJHRI. &RQWHQWV . ,1752'8&7,21   . 7+(&$/&8/$7,212)(19,5210(17$/48$/,7<67$1'$5'6)52072;,&,7<'$7$  7+(86(2)7+((48,/,%5,803$57,7,21,1*0(7+2'72(67,0$7(7+(62,/$1'6(',0(1748$/,7< *8,'(/,1(6)520$48$7,&72;,&,7<'$7$  7+((9$/8$7,212)7+((48,/,%5,803$57,7,21,1*0(7+2'  . 0(7+2'6   . 7+(6(/(&7,212)7+((48,/,%5,803$57,7,21&2()),&,(17.3)2525*$1,&68%67$1&(6  6(/(&7,212)7+((48,/,%5,803$57,7,21&2()),&,(17.3)250(7$/6  7+(&203$5,621%(7:((1$48$7,&72;,&,7<'$7$$1'7(55(675,$/256(',0(1772;,&,7<'$7$ 86,1*7+((430(7+2'   7+(86(2)7+(02',),('(430(7+2')250(7$/6   7+(&203$5,621%(7:((17+($48$7,&+&9$/8($1'7+(7(55(675,$/+&9$/8(86,1*7+( (430(7+2'   67$7,67,&$/$1$/<6,6  . 5(68/76$1'',6&866,21 . '2(67+($33/,&$7,212)7+((430(7+2'21$48$7,&72;,&,7<'$7$*,9(6,*1,),&$17 "   &$17+(',))(5(1&(6%((;3/$,1('%<',))(5(1&(6,17+(5(3257('.39$/8(6"  +2:/$5*($5(7+(',))(5(1&(6%(7:((17+(+&&$/&8/$7(')520$48$7,&72;,&,7<'$7$ $1'7+(+&&$/&8/$7(')52062,/256(',0(1772;,&,7<'$7$"   7+(48$17,),&$7,212)7+((;75$81&(57$,17<&$86('%<7+($33/,&$7,212)7+((430(7+2' ,162,/   +2:&$17+(2%6(59('',))(5(1&(6&$86('%<7+($33/,&$7,212)7+((430(7+2'%( (;3/$,1('$1''27+(<0$7&+:,7+($5/,(5),1',1*6"  +2:0$1<7(55(675,$/72;,&,7<'$7$$5(5(48,5('72(67,0$7($1+&9$/8(7+$7,6025( $&&85$7(7+$17+(21('(5,9(')520$48$7,&72;,&,7<'$7$86,1*7+((430(7+2'" ',))(5(1&(6:,7+7(55(675,$/72;,&,7<'$7$. . 5(&200(1'$7,216 . . &21&/86,216. $&.12:/('*(0(176 5()(5(1&(6 $33(1',;48$17,),&$7,212)81&(57$,17< $33(1',;0$,/,1*/,67 .

(28) 5,90UHSRUW. . SDJHRI. ,QWURGXFWLRQ.  7KHFDOFXODWLRQRIHQYLURQPHQWDOTXDOLW\VWDQGDUGVIURP WR[LFLW\GDWD 7ZRHQYLURQPHQWDOTXDOLW\VWDQGDUGVLQWKH1HWKHUODQGVDUHWKH0D[LPXP3HUPLVVLEOH &RQFHQWUDWLRQ 03&

(29) DQGWKH7DUJHW9DOXH 79

(30) 7KHVWDQGDUGVDUHXVHGWRDVVHVVWKH HQYLURQPHQWDOTXDOLW\RIVXUIDFHZDWHUDLUVRLODQGVHGLPHQW5HVXOWVRIWR[LFLW\WHVWVDUH LPSRUWDQWLQWKHSURFHVVRIGHULYLQJ03&YDOXHVIRUVSHFLILFSROOXWDQWV(DFKGRVHHIIHFW FXUYHRIDWR[LFLW\WHVWFDQEHVXPPDUL]HGE\DGRVHHIIHFWSDUDPHWHUOLNHWKH12(&(& RU(&7KH(&RU(&DUHGHILQHGDVWKHWR[LFDQWFRQFHQWUDWLRQVZKLFKJLYHRU LQKLELWLRQ7KH12(&LVWKHKLJKHVWWHVWHGFRQFHQWUDWLRQWKDWGRHVQRWVKRZD VWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHZLWKWKHFRQWUROWHVWZLWKRXWDGGHGWR[LFDQW7KH12(&LV GHSHQGHQWRQWKHVWDWLVWLFDOSRZHURIWKHWHVWDQGRQWKHH[SHULPHQWDOVHWXS FRQFHQWUDWLRQV WHVWHG

(31) >+RHNVWUDDQG9DQ(ZLMN@ ,QWKH1HWKHUODQGVWKH03&RIRUJDQLFSROOXWDQWVRUPHWDOVLVGHWHUPLQHGIURPWR[LFLW\GDWD XVLQJWKHIROORZLQJSURFHGXUH7KHDTXDWLF03&LVGHULYHGIURPWKH(&RU12(&YDOXHV RIDQXPEHURIFKURQLFDTXDWLFWR[LFLW\WHVWVZLWKDVSHFLILFWR[LFDQW:KHQRUPRUH12(& YDOXHVIURPRUPRUHWD[RQRPLFJURXSVDUHDYDLODEOHDVWDWLVWLFDOSURFHGXUHLVXVHG7KH DYHUDJHWKHVWDQGDUGGHYLDWLRQDQGWKHQXPEHURIWKHORJDULWKPLFDOO\WUDQVIRUPHG12(& YDOXHVDUHXVHGWRFDOFXODWHDWR[LFDQWFRQFHQWUDWLRQ+&  +D]DUGRXV&RQFHQWUDWLRQ 

(32) 7KLVLVWKH SHUFHQWLOHRIWKH12(&GLVWULEXWLRQ%HORZWKLVFRQFHQWUDWLRQDWOHDVW RIWKHVSHFLHVDUHDVVXPHGWREHSURWHFWHG>9DQ6WUDDOHQDQG'HQQHPDQ@7KLV WR[LFDQWFRQFHQWUDWLRQLVWDNHQDVDVWDUWLQJSRLQWIRUVHWWLQJWKH03&:KHQRQO\DVLQJOH (&LVDYDLODEOHWKHQWKH03&LVVHWHTXDOWRWKHORZHVW(&:KHQPRUH(&RU 12(&GDWDDUHDYDLODEOHWKHDVVHVVPHQWIDFWRUFDQEHORZHUHGIURPWRRU GHSHQGLQJRQWKHQXPEHURIGDWDDYDLODEOH7KHVHPHWKRGVWRFDOFXODWHWKH03&ZHUHEDVHG RQWKH(87*'PHWKRG>&URPPHQWXLMQHWDOF@DQGZHUHUHFHQWO\XSGDWHG>7UDDV @6LPLODUPHWKRGVDUHDOVRDYDLODEOHWRGHULYHWHUUHVWULDO03&VIURPVRLOWR[LFLW\WHVWV XVLQJPLFURELDOSURFHVVHVHDUWKZRUPVSODQWVRUDUWKURSRGV>(&.DOIHWDO 7UDDV@ 12(&. WK.  7KHXVHRIWKHHTXLOLEULXPSDUWLWLRQLQJPHWKRGWR HVWLPDWHWKHVRLODQGVHGLPHQWTXDOLW\JXLGHOLQHVIURPDTXDWLF WR[LFLW\GDWD ,QWKH1HWKHUODQGVWKHHQYLURQPHQWDOTXDOLW\VWDQGDUGVIRUZDWHUVRLODQGVHGLPHQWDUH KDUPRQL]HGEHFDXVHLWLVUHFRJQL]HGWKDWSROOXWDQWVGLVWULEXWHEHWZHHQWKHVHHQYLURQPHQWDO FRPSDUWPHQWV)RUH[DPSOHSROOXWHGVRLOVFDQUHVXOWLQJURXQGZDWHUSROOXWLRQRUDLUSROOXWLRQ DQGSROOXWHGZDWHUFDQJLYHULVHWRVHGLPHQWSROOXWLRQDQGYLFHYHUVD7KHSDUWLWLRQLQJRID SROOXWDQWEHWZHHQZDWHUDQGDVROLGSKDVHOLNHVHGLPHQWVRLORUVXVSHQGHGVROLGVFDQEH GHVFULEHGE\DSDUWLWLRQFRHIILFLHQW .S

(33) .SLVGHILQHGDVWKHFRQFHQWUDWLRQUDWLREHWZHHQWKH VROLGDQGWKHDTXHRXVSKDVHDWHTXLOLEULXP.

(34) 5,90UHSRUW. .S &VROLG PJNJ

(35) &ZDWHU PJ/

(36) . SDJHRI. ^`. 7KH.SLVH[SUHVVHGLQ/ZDWHUNJVROLGV7KHVROLGSKDVHFDQEHVHGLPHQWVRLORUVXVSHQGHG PDWWHU7KH.SPDNHVLWSRVVLEOHWRSUHGLFWWKHHTXLOLEULXPVHGLPHQWFRQFHQWUDWLRQZKHQWKH ZDWHUFRQFHQWUDWLRQLVNQRZQ7KLVLVFDOOHGWKHHTXLOLEULXPSDUWLWLRQLQJPHWKRG (T3 PHWKRG

(37) 7KLVPHWKRGFDQEHXVHGWRHVWLPDWHDVRLORUVHGLPHQW03&ZKHQWKHDTXDWLF 03&DQGWKH.SDUHNQRZQDQGLWFDQDOVREHXVHGWRKDUPRQL]HDTXDWLFDQGWHUUHVWULDO03& YDOXHV>.DOIHWDO@:KHQWKH(&RU12(&IURPVRLORUVHGLPHQWDUHXVHGWR FDOFXODWHWKHFRUUHVSRQGLQJZDWHUFRQFHQWUDWLRQVXVLQJHTXDWLRQ^`WKHVHYDOXHVZLOOEH UHIHUUHGWRDV(T3WUDQVIRUPHGYDOXHVWKURXJKRXWWKLVUHSRUW 7KH(T3PHWKRGLVXVHGWRHVWLPDWHWHUUHVWULDODQGVHGLPHQW03&YDOXHVIURPDTXDWLF03& YDOXHVZKHQLQVXIILFLHQWVRLODQGVHGLPHQWWR[LFLW\GDWDDUHDYDLODEOH,QWKH1HWKHUODQGV PRVWVRLODQGVHGLPHQWHQYLURQPHQWDOTXDOLW\VWDQGDUGVDUHGHULYHGIURPWKHHQYLURQPHQWDO TXDOLW\VWDQGDUGVIRUZDWHUXVLQJWKH(T3PHWKRG:LWKLQWKH'XWFKSURMHFW6HWWLQJ ,QWHJUDWHG(QYLURQPHQWDO4XDOLW\6WDQGDUGVIRU6XEVWDQFHV ,16

(38) HQYLURQPHQWDOTXDOLW\ VWDQGDUGVZHUHGHULYHGIRUDERXWVXEVWDQFHV>'H%UXLMQHWDO@5HFHQWO\WKLVGDWD VHWZDVXSGDWHGZLWKPRUHWR[LFLW\GDWD>9HUEUXJJHQHWDO/LM]HQHWDO@DQG PRUHVRUSWLRQGDWD>2WWHHWDO@)RUWKHFDOFXODWLRQRIWKH03&LQZDWHUWKHVWDWLVWLFDO H[WUDSRODWLRQPHWKRGZDVXVHGIRUDSSUR[LPDWHO\RQHWKLUGRIWKHFRPSRXQGVZKLOHLQWKH UHPDLQGHURIWKHFDVHVWKH(87*'PHWKRGZDVXVHG>&URPPHQWXLMQHWDOE &URPPHQWXLMQHWDOF@)RUWKHFDOFXODWLRQRIWKH03&LQVRLOWKHVWDWLVWLFDO H[WUDSRODWLRQPHWKRGZDVXVHGLQDSSUR[LPDWHO\RQHIRXUWKRIWKHFDVHV7KH(87*' PHWKRGZDVXVHGIRURQHILIWKRIWKHFDVHV:KLOHLQWKHUHPDLQGHURIWKHFDVHVWKH(T3 PHWKRGZDVXVHGWRGHULYHWKHVRLO03&IURPWKHZDWHU03&)RUVHGLPHQWWKH(T3PHWKRG ZDVXVHGLQDOOFDVHVEHFDXVHRIDODFNRIHFRWR[LFRORJLFDOGDWD>&URPPHQWXLMQHWDOF 'L7RURHWDO9HUEUXJJHQHWDO@7KLVLOOXVWUDWHVWKDWPRVWRIWKH HFRWR[LFRORJLFDOGDWDUHIHUUHGWRDTXDWLFRUJDQLVPVDPLQRULW\RIWKHGDWDUHIHUUHGWRVRLO RUJDQLVPVZKLOHIRUVHGLPHQWKDUGO\DQ\GDWDZHUHDYDLODEOH. . 7KHHYDOXDWLRQRIWKHHTXLOLEULXPSDUWLWLRQLQJPHWKRG. ,QDQDGYLFHRIWKH7HFKQLFDO&RPPLVVLRQ6RLO3URWHFWLRQ>7&%@LWZDVVWDWHGWKDW WR[LFLW\GDWDIURPWHVWVZLWKVRLODQGVHGLPHQWDUHQHFHVVDU\WRGHWHUPLQHDQ03&IRUVRLO DQGIRUVHGLPHQW:KHQQRGDWDDUHDYDLODEOHLWPLJKWEHSRVVLEOHWRHVWLPDWHWKHVH03& V IURPWKHDTXDWLF03&DQGSDUWLWLRQFRHIILFLHQWVXVLQJWKH(T3PHWKRG7KH'XWFK+HDOWK &RXQFLOVWDWHGWKDWWKH(T3PHWKRGZDVRQO\VXLWHGIRURUJDQLFDSRODUDQGQRWYHU\ K\GURSKRELFVXEVWDQFHVDQGQRWIRUPHWDOVVLQFHWKHXQFHUWDLQW\IDFWRURIWKHSDUWLWLRQ FRHIILFLHQWVIRUPHWDOVLVODUJH,WOLHVLQWKHRUGHURIPDJQLWXGHRIDERXW >*H]RQGKHLGVUDDG@7KHODFNRIVRLODQGVHGLPHQWWR[LFLW\GDWDQRWLFHGLQWKHVHUHSRUWV LQLVVWLOOSUHVHQWQRZDGD\V>9HUEUXJJHQHWDO@7KLVXUJHVOHJLVODWRUVWRXVHWKH (T3PHWKRGWRHVWLPDWHVRLODQGVHGLPHQW03&YDOXHVIURPDTXDWLFWR[LFLW\GDWD7KH FRQWLQXHGXVHRIWKH(T3PHWKRGGHVSLWHRIWKHDERYHFULWLFLVPUDLVHGTXHVWLRQVDERXWWKH YDOLGLW\RIWKHPHWKRGIRUWKLVSXUSRVH,QWKLVUHSRUWWKHRXWFRPHRIWKH(T3PHWKRGLV FRPSDUHGZLWKDFWXDOPHDVXUHPHQWVUHSRUWHGLQWKHOLWHUDWXUH'XULQJWKLVFRPSDULVRQDIHZ TXHVWLRQVDULVH7KHILUVWTXHVWLRQLV'RHVWKHDSSOLFDWLRQRIWKH(T3PHWKRGRQDTXDWLF WR[LFLW\GDWDJLYHDVLJQLILFDQWGLIIHUHQFHZLWKWHUUHVWULDOWR[LFLW\GDWD"7KHVHFRQGTXHVWLRQ LV&DQWKHGLIIHUHQFHVEHH[SODLQHGE\GLIIHUHQFHVLQWKHUHSRUWHG.SYDOXHV"7KHWKLUG TXHVWLRQLV+RZODUJHDUHWKHVHGLIIHUHQFHV"7KHILQDOTXHVWLRQLV+RZGRHVWKLVDIIHFWWKH VHWWLQJRIVRLODQGVHGLPHQWTXDOLW\VWDQGDUGV".

(39) 5,90UHSRUW. . SDJHRI. 0HWKRGV.  7KHVHOHFWLRQRIWKHHTXLOLEULXPSDUWLWLRQFRHIILFLHQW.S IRURUJDQLFVXEVWDQFHV ,QJHQHUDOWKH.SLVGHSHQGHQWRQERWKWKHVROLGSKDVHHJWKHVSHFLILFVRLOVHGLPHQWRU VXVSHQGHGVROLGVWKHZDWHUSKDVH FRQWDLQLQJVDOWVGLVVROYHGRUJDQLFPDWWHUFKHODWRUVDQG RWKHUFRPSRXQGV

(40) DQGWKHUHGR[SRWHQWLDODQGS+RIWKHV\VWHP,QWKHFDVHRIRUJDQLF FRPSRXQGVWKH.SLVRIWHQQRUPDOL]HGIRUWKHFRQFHQWUDWLRQRIRUJDQLFFDUERQLQVRLODQGLV FDOOHGWKH.RF7KH.RFLVH[SUHVVHGLQXQLWVRI/ZDWHUNJRUJDQLFFDUERQ7KHIUDFWLRQRI RUJDQLFFDUERQLVFDOOHGIRFDQGLVH[SUHVVHGDVNJRUJDQLFFDUERQNJVRLO IRF .RF .S. ^`. 7KH.RFFDQEHGHWHUPLQHGH[SHULPHQWDOO\RUFDQEHHVWLPDWHGIURPWKHRFWDQROZDWHU SDUWLWLRQFRHIILFLHQW .RZ

(41) XVLQJD4XDQWLWDWLYH6WUXFWXUH$FWLYLW\5HODWLRQVKLS 46$5

(42) >%RFNWLQJHWDO@7KHVHOHFWLRQRIDVSHFLILF.RFYDOXHIURPWKHVFLHQWLILFOLWHUDWXUHLV QRWDWULYLDORQH7KHYDULDWLRQLQWKHUHSRUWHG.RFYDOXHVRIDVLQJOHFRPSRXQGIRUGLIIHUHQW VRLOVFDQEHVHYHUDORUGHUVRIPDJQLWXGH>0DF.D\HWDOD0DF.D\HWDOE 0DF.D\HWDOF2WWHHWDO@ ,QWKLVUHSRUWWZRVHWVRISDUWLWLRQFRHIILFLHQWVKDYHEHHQXVHG7KHILUVWVHWDUHWKH.SYDOXHV XVHGIRUWKHHYDOXDWLRQRIWKH,QWHUYHQWLRQ9DOXHVIRUWKHILUVWVHULHVRIFRPSRXQGVE\2WWHHW DO 

(43) 7KH\DOVRHYDOXDWHGWKHH[LVWLQJGDWDVHWVIRU.SYDOXHVRIPHWDOVLQVRLO7KH DYDLODEOHGDWDVHWVZHUHUDQNHGDFFRUGLQJWRVHYHUDOFULWHULDLQFOXGLQJWKHTXDOLW\RIWKHGDWD WKHPHWDOFRQFHQWUDWLRQFRPSDWLELOLW\ZLWK'XWFKVRLODQGH[SHULPHQWDOVHWXS7KHVHFRQG GDWDVHWDUHWKH.SYDOXHVIRUPHUO\XVHGZLWKLQWKHIUDPHZRUNRIWKHSURMHFW6HWWLQJ ,QWHJUDWHG(QYLURQPHQWDO4XDOLW\6WDQGDUGV>'H%UXLMQHWDO@WRGHULYHPD[LPXP SHUPLVVLEOHFRQFHQWUDWLRQV 03&V

(44) DQGQHJOLJLEOHFRQFHQWUDWLRQV 1&V

(45)  7KH.SYDOXHVHYDOXDWHGE\2WWHHWDO 

(46) DUHQRUPDOL]HGIRUDVWDQGDUGVRLOFRQWDLQLQJ FOD\RUJDQLFFDUERQDQGS+7KH.SYDOXHVIURP$QQH[LQWKH,16UHSRUW >9520@ZKHUHUHSRUWHGIRUVXVSHQGHGPDWHULDOLQVWDQGDUGVXUIDFHZDWHUZLWK RUJDQLFFDUERQ:KLFKPHDQVWKDWIRFIRUVWDQGDUGVRLOLVWLPHVWKHIRFIRUVWDQGDUG VXVSHQGHGPDWHULDO)RURUJDQLFVXEVWDQFHVLWIROORZVWKDW .SVWDQGDUGVRLO  .SVXVSHQGHGPDWHULDO. ^`. $ORJDULWKPLFWUDQVIRUPDWLRQRIHTXDWLRQ^`ZLWKIRF \LHOGV ORJ.SVWDQGDUGVRLO ORJ.RF. ^`. 7DEOH VHHODVWSDJH

(47) VKRZVWKHVHOHFWHGORJ.SYDOXHVIRUVWDQGDUGVRLOIURP2WWHHWDO 

(48) 2QO\WKH.SYDOXHVIRUFKORUS\ULIRVFKORUGDQHDQGKHSWDFKORUZHUHWDNHQIURP $QQH[LQWKH,16UHSRUW>9520@DQGZKHUHQRUPDOL]HGIRUVWDQGDUGVRLOXVLQJ HTXDWLRQ^`,QJHQHUDOWKHGLIIHUHQFHVLQWKHORJ.SYDOXHVIRUVWDQGDUGVRLOEHWZHHQERWK GDWDVHWVZHUHVPDOOIRURUJDQLFVXEVWDQFHV.

(49) 5,90UHSRUW. SDJHRI.  6HOHFWLRQRIWKHHTXLOLEULXPSDUWLWLRQFRHIILFLHQW.SIRU PHWDOV )RUPHWDOVWKHUHZDVDODUJHGLIIHUHQFHEHWZHHQWKH.SYDOXHVXVHGE\2WWHHWDO 

(50) DQG WKH.SYDOXHVIURP$QQH[LQWKH,16UHSRUW>9520@7DEOHVKRZVWKHGLIIHUHQFH EHWZHHQWKH.SYDOXHVXVHGE\2WWHHWDO 

(51) ZKLFKDUHOLVWHGXQGHUWKHFROXPQPDUNHG ORJ.SDQGWKH.SYDOXHVIRUPHWDOVIURP$QQH[LQWKH,16UHSRUW>9520@ZKLFK DUHOLVWHGXQGHUWKHFROXPQPDUNHGORZ7KHODWWHU.SYDOXHVDUHIURPOLPLWHGVWXGLHVRQ WKHVRUSWLRQWRVXVSHQGHGSDUWLFOHVLQVWHDGRIVHGLPHQW>.DOIHWDO@)RUPRVWPHWDOV WKHVHYDOXHVDUHRUGHUVRIPDJQLWXGHKLJKHUWKDQWKHFRUUHVSRQGLQJ.SYDOXHVLQVRLO %HFDXVHRIWKLVZLGHYDULDELOLW\WKHXVHRI.SYDOXHVIRUWKHSXUSRVHRIHTXLOLEULXP SDUWLWLRQLQJZDVQRWUHFRPPHQGHGIRUWKHGHULYDWLRQRIHFRWR[LFRORJLFDOULVNOLPLWVIRUPHWDOV LQVHGLPHQW>9HUEUXJJHQHWDO@+RZHYHUDPRGLILHGHTXLOLEULXPSDUWLWLRQLQJPHWKRG ZDVXVHG>&URPPHQWXLMQHWDOD&URPPHQWXLMQHWDOE@7KLVPRGLILHGPHWKRG XVHGHPSLULFDOVRUSWLRQFRHIILFLHQWVIURP'XWFKULYHUVDQGFRDVWDO]RQHVZKLFKUHSUHVHQWWKH JHQHULFVLWHVIRUZKLFKHQYLURQPHQWDOTXDOLW\VWDQGDUGVZHUHGHULYHG.  7KHFRPSDULVRQEHWZHHQDTXDWLFWR[LFLW\GDWDDQG WHUUHVWULDORUVHGLPHQWWR[LFLW\GDWDXVLQJWKH(T3PHWKRG 7KH,16GDWDVHW>'H%UXLMQHWDO@DQGWKHXSGDWHGGDWDVHW>9HUEUXJJHQHWDO@ ZHUHVFUHHQHGIRURUJDQLFFRPSRXQGVDQGPHWDOV7KHFKHPLFDOVZHUHVHOHFWHGWKDWKDG VXIILFLHQWGDWDIRUDFRPSDULVRQEHWZHHQDTXDWLFDQGWHUUHVWULDOWR[LFLW\GDWDXVLQJWKH(T3 PHWKRGZLWKWKHVHOHFWHG.SYDOXHV7KUHHVHOHFWLRQFULWHULDZHUHXVHGD

(52) 0RUHWKDQ(& RU/& /HWKDO&RQFHQWUDWLRQ

(53) YDOXHVIURPWHUUHVWULDOWR[LFLW\WHVWVE

(54) 2UPRUHWKDQ FKURQLF12(&YDOXHVIURPFKURQLFWHUUHVWULDOWR[LFLW\WHVWVF

(55) 2UPRUHWKDQ12(&YDOXHV IURPWHVWVXVLQJPLFURELDOSURFHVVHVLQVRLO 7KHWHUUHVWULDO(&YDOXHVZHUHFRPSDUHGZLWKWKH(&YDOXHVIURPVKRUWWHUPDFXWH DTXDWLFWR[LFLW\WHVWVZKHUHDVWKHWHUUHVWULDO12(&YDOXHVZHUHFRPSDUHGZLWKWKH12(& YDOXHVIURPORQJWHUPFKURQLFDTXDWLFWR[LFLW\WHVWV)RUWKHFRPSRXQGVWKDWKDGVXIILFLHQW WHUUHVWULDOWR[LFLW\GDWDWKHUHZHUHDOZD\VVXIILFLHQWDTXDWLFWR[LFLW\GDWDSUHVHQW7KH/& GDWDDUHFRPELQHGZLWKWKH(&GDWDDVLVGRQHLQWKH,16UHSRUW>'H%UXLMQHWDO@ DQGVXPPDUL]HGKHUHDV(&YDOXHV:KHQPRUH(&YDOXHVIRURQHVSHFLHVDUHDYDLODEOH WKHPHDQRIWKHVHORJDULWKPLFDOO\WUDQVIRUPHG(&YDOXHVZDVWDNHQDVLQSXWSDUDPHWHU WKLVLVHTXDOWRWKHORJDULWKPRIWKHJHRPHWULFPHDQRIWKHVHYDOXHV

(56) )RUVRPHDFXWHDTXDWLF WR[LFLW\WHVWVWKHGLIIHUHQFHVLQVHQVLWLYLW\FRXOGEHH[SODLQHGE\GLIIHUHQFHVLQWKHVL]HRIWKH WHVWRUJDQLVPVDQGWKHGXUDWLRQRIWKHWHVW,QWKHVHFDVHVWKHORZHVW(&YDOXHZDVVHOHFWHG IURPDQXPEHURIWHVWVZLWKWKHVDPHVSHFLHV7KHVRLOWR[LFLW\GDWDZHUHQRUPDOL]HGWRD VWDQGDUGVRLOZLWKRUJDQLFPDWWHU RUJDQLFFDUERQ

(57) >9HUEUXJJHQHWDO@ 2QHRIWKHREMHFWLYHVRIWKLVVWXG\LVWRWHVWWKHK\SRWKHVLVWKDWWKHVSHFLHVVHQVLWLYLW\ GLVWULEXWLRQVRIDTXDWLFDQGWHUUHVWULDOVSHFLHVGRQRWGLIIHU$VLPSOHZD\WRFRPSDUHERWK VHQVLWLYLW\GLVWULEXWLRQVLVWRFRPSDUHWKHXQGHUO\LQJGDWD1RUPDOO\WKH(T3PHWKRGLVXVHG WRFDOFXODWHDVRLORUVHGLPHQWFRQFHQWUDWLRQIURPDZDWHUFRQFHQWUDWLRQXVLQJHTXDWLRQ^` )RUSUDFWLFDOUHDVRQVZH(T3WUDQVIRUPHGWKHVRLORUVHGLPHQWFRQFHQWUDWLRQV H[SUHVVHGLQ.

(58) 5,90UHSRUW. SDJHRI. PJNJ

(59) LQWRWKHLUFRUUHVSRQGLQJZDWHUFRQFHQWUDWLRQV H[SUHVVHGLQ—J/

(60) XVLQJHTXDWLRQ^` 7KLVHTXDWLRQFDQEHZULWWHQLQDORJDULWKPLFIRUP ORJ(&ZDWHU ORJ(&VRLOORJ.S. ^`. ZLWKWKH(&ZDWHULQ—J/WKH(&VRLOLQPJNJDQGWKH.SYDOXHIRUVWDQGDUGVRLODV GHVFULEHGLQWKHDERYHSDUDJUDSK7KHFRQVWDQWLVXVHGWRFRQYHUW—JWRPJ$WWKLVVWDJH WKHWHUUHVWULDOWR[LFLW\WHVWVFDQEHFRPSDUHGZLWKWKHDTXDWLFWR[LFLW\WHVWVVLQFHWKHORJ(& RIERWKWHVWVDUHQRZUHSRUWHGLQ—J/7KHGLIIHUHQFHEHWZHHQWKH(T3WUDQVIRUPHG WHUUHVWULDOGDWDDQGWKHDTXDWLFGDWDFDQEHFDOFXODWHGXVLQJHTXDWLRQ^` GHOWD ORJ(&VRLOORJ.SORJ(&ZDWHU. ^`. :KHQHTXDWLRQ^`LVWUXHGHOWD 7KHVDPHSURFHGXUHFDQEHSHUIRUPHGZLWK12(& YDOXHVLQVWHDGRI(&YDOXHV. . 7KHXVHRIWKHPRGLILHG(T3PHWKRGIRUPHWDOV. )RUERWKVHGLPHQWDQGVRLODPRGLILHG(T3PHWKRGFDQEHDSSOLHGWRGHULYH03&VIURP WKRVHIRUZDWHUZKHQVXIILFLHQWWR[LFRORJLFDOGDWDRQVHGLPHQWDQGVRLORUJDQLVPVDUHQRW DYDLODEOH,WPXVWEHQRWHGWKDWRULJLQDOO\WKH(T3PHWKRGQRUPDOL]HVFRQFHQWUDWLRQVRI RUJDQLFVXEVWDQFHVLQWKHVROLGSKDVHWRWKHRUJDQLFFDUERQFRQWHQW)RUPHWDOVDQG PHWDOORLGVWKH(T3PHWKRGZDVPRGLILHGEHFDXVHWKHRUJDQLFFRQWHQWQRUPDOL]DWLRQZDVQRW DSSOLHGDQGHPSLULFDOO\GHULYHGVHGLPHQWZDWHUDQGVRLOZDWHUSDUWLWLRQRUGLVWULEXWLRQ FRHIILFLHQWVZHUHXVHG>&URPPHQWXLMQE@ )RUWKHPHWDOVFDGPLXPFRSSHUOHDGPHUFXU\DQG]LQFWKHUHDUHDODUJHQXPEHURIDTXDWLF DQGWHUUHVWULDOWR[LFLW\GDWDDYDLODEOH>'H%UXLMQHWDO9HUEUXJJHQHWDO@7KH WHUUHVWULDOWR[LFLW\GDWDZHUHQRUPDOL]HGIRUDVWDQGDUGVRLOZLWKFOD\RUJDQLF FDUERQ>'H%UXLMQHWDO9HUEUXJJHQHWDO@7KLVPDNHVLWSRVVLEOHWRFDOFXODWH (T3WUDQVIRUPHGORJ12(&YDOXHVIURPDTXDWLFDQGIURPWHUUHVWULDOWR[LFLW\GDWDIRUWKHVH PHWDOV>2WWHHWDO@7KH12(&YDOXHVIRUVRLOSURFHVVHVRUVRLORUJDQLVPV H[SUHVVHG LQPJNJ

(61) ZHUH(T3WUDQVIRUPHGXVLQJ ORJ12(&ZDWHU ORJ12(&VRLOORJ.S VRLOZDWHU

(62) . ^`. ZLWK12(&ZDWHUH[SUHVVHGLQ—J/12(&VRLOLQPJNJDQGORJ.S VRLOZDWHU

(63) LQ/NJ.  7KHFRPSDULVRQEHWZHHQWKHDTXDWLF+&YDOXHDQGWKH WHUUHVWULDO+&YDOXHXVLQJWKH(T3PHWKRG ,QHTXDWLRQ^`DQGHTXDWLRQ^`WKHWHUUHVWULDODQGDTXDWLFWR[LFLW\GDWDDUHFRPSDUHGZLWK UHVSHFWWRWKHLUDYHUDJH7KLVDYHUDJHLVDOVRFDOOHGWKHORJ+&EHFDXVHEHORZWKLV FRQFHQWUDWLRQRIWKHVSHFLHVDUHSURWHFWHG>9DQ6WUDDOHQDQG'HQQHPDQ@,WLVRI FRXUVHDOVRLQWHUHVWLQJWRFRPSDUHWKHWHUUHVWULDODQGDTXDWLFWR[LFLW\GDWDZLWKUHVSHFWWRWKHLU VWDQGDUGGHYLDWLRQ7KLVFRPSDULVRQLVQRWSHUIRUPHGKHUHEHFDXVHOHJLVODWRUVDUHPRUH LQWHUHVWHGLQWKH+&YDOXHZKLFKLVGHULYHGIURPWKHDYHUDJHDQGWKHVWDQGDUGGHYLDWLRQRI.

(64) 5,90UHSRUW. SDJHRI. WKHWR[LFLW\GDWD7KHVH+&YDOXHVFDQEHXVHGIRUVHWWLQJHQYLURQPHQWDOTXDOLW\VWDQGDUGV VHHLQWURGXFWLRQ

(65) 7KH+& RUWKH+& FDQEHFDOFXODWHGXVLQJWKHIROORZLQJ IRUPXOD>9DQ6WUDDOHQDQG'HQQHPDQ@ 12(&. /RJ+&. 12(&. /RJ+&. (&. (&.  DYHUDJH ORJ12(&

(66) FRQVWDQW 6' ORJ12(&

(67). ^`.  DYHUDJH ORJ(&

(68) FRQVWDQW 6' ORJ(&

(69). ^`. :LWK6' VWDQGDUGGHYLDWLRQDQGWKHFRQVWDQWLVDVWDWLVWLFDOH[WUDSRODWLRQFRQVWDQWZKLFKLV GHSHQGHQWRQWKHQXPEHURIGDWDDQGWKHOHYHORIVWDWLVWLFDOFRQILGHQFHRQHPLJKWZDQWWR DFKLHYH>9DQ6WUDDOHQDQG'HQQHPDQ@ $WWKLVVWDJHWKHLPSDFWRIWKHXVHRIWKH(T3PHWKRGIRUWKHHVWLPDWLRQRIDWHUUHVWULDO+& IURPDQDTXDWLF+&FDQEHHYDOXDWHGXVLQJDORJDULWKPLFWUDQVIRUPDWLRQRIHTXDWLRQ^` ORJ+&ZDWHU ORJ+&VRLOORJ.S. ^`. :LWK+&ZDWHULQ—JOLWHU+&VRLOLQPJNJDQG.SLQOLWHUNJ GHOWD ORJ+&VRLOORJ.SORJ+&ZDWHU. ^`. :KHQGHOWD WKH(T3PHWKRGLVDFFXUDWHZKHQGHOWD WKH(T3PHWKRG XQGHUHVWLPDWHVWKHWHUUHVWULDO+&VRLOIURPWKHDTXDWLF+&ZDWHUZLWKDIDFWRU. . 6WDWLVWLFDODQDO\VLV. 7KHDTXDWLFDQGWHUUHVWULDOORJ(&RU12(&YDOXHVZHUHFRPSDUHGXVLQJDWZRVDPSOH 6WXGHQWVWWHVWDVVXPLQJXQHTXDOYDULDQFHV>$UPLWDJHDQG%HUU\@7KHQXOOK\SRWKHVLV VWDWHVWKDWWKHPHDQVRIWKHDTXDWLFDQGWHUUHVWULDOORJ(&RU12(&YDOXHVGLIIHUE\ORJ.S DVLQHTXDWLRQ^`DQG^`7KHWZRVLGHGSUREDELOLW\LVFDOFXODWHGWRWHVWZKHWKHUWKHQXOO K\SRWKHVLVLVFRUUHFW:KHQWKLVSUREDELOLW\LVEHORZWKHGLIIHUHQFHEHWZHHQWKHPHDQVRI WKHDTXDWLFDQGWHUUHVWULDOORJ(&RU12(&YDOXHVLVVWDWLVWLFDOO\VLJQLILFDQW)RUWKH FRPSDULVRQRIWKH+&VRLOZLWKWKH+&ZDWHUXVLQJHTXDWLRQ^`FRQILGHQFHOHYHOV ZHUHFDOFXODWHGXVLQJHTXDWLRQV^`DQG^`ZLWKWKHH[WUDSRODWLRQFRQVWDQWVIURP$OGHQEHUJ DQG-DZRUVND 

(70) :KHQWKHFRQILGHQFHOHYHOVRIWKH(T3WUDQVIRUPHG+&VRLOGLGQRW RYHUODSZLWKWKHFRQILGHQFHOHYHOVRIWKH+&ZDWHUWKHVWDWLVWLFDOSUREDELOLW\LVOHVVWKDQ :KHQWKH+&VRLOIHOORXWVLGHRIWKHFRQILGHQFHUDQJHRIWKH+&ZDWHUWKHVWDWLVWLFDO SUREDELOLW\LVOHVVWKDQ7KHFDOFXODWLRQVZHUHSHUIRUPHGXVLQJ0LFURVRIW([FHO7KH PHDQDQGVWDQGDUGGHYLDWLRQ Q

(71) RIWKHGLVWULEXWLRQVDUHUHSRUWHG.

(72) 5,90UHSRUW. . SDJHRI. 5HVXOWVDQG'LVFXVVLRQ.  'RHVWKHDSSOLFDWLRQRIWKH(T3PHWKRGRQDTXDWLF WR[LFLW\GDWDJLYHVLJQLILFDQWGLIIHUHQFHVZLWKWHUUHVWULDO WR[LFLW\GDWD" 7DEOH VHHODVWSDJH

(73) VKRZVWKHDYHUDJH DYUJ

(74) WKHVWDQGDUGGHYLDWLRQ 6'

(75) DQGWKHQXPEHU RIVSHFLHV 1

(76) IURPWKHWHUUHVWULDO6SHFLHV6HQVLWLYLW\'LVWULEXWLRQ 66'

(77) DQGWKHDTXDWLF 66'7KHRUJDQLFVXEVWDQFHVDQGPHWDOVZHUHVHOHFWHGIURPWKHXSGDWHG,16GDWDVHW >9HUEUXJJHQHWDO@H[FHSWIRUFKORUS\ULIRVFKORUGDQHDQGKHSWDFKORUZKLFKZHUHRQO\ SUHVHQWLQWKHRULJLQDO,16GDWDVHW>'H%UXLMQHWDO@,QWKHXSGDWHG,16GDWDVHW >9HUEUXJJHQHWDO@WKHWR[LFLW\GDWDRQDOGULQDQGGLHOGULQZHUHSRROHG)RUVHGLPHQWV QRGDWDZHUHSUHVHQWLQWKH,16GDWDVHWVDQGWKHUHIRUHLQIRUPDWLRQRQGLFKORURHWKDQHDQG WULFKORURPHWKDQHZHUHWDNHQIURPWKHOLWHUDWXUH>9DQ%HHOHQDQG9DQ9ODDUGLQJHQ 9DQ%HHOHQHWDO9DQ9ODDUGLQJHQDQG9DQ%HHOHQ9DQ9ODDUGLQJHQDQG9DQ %HHOHQ@7KLVLVXVHGDVDQH[DPSOHVLQFHQRV\VWHPDWLFOLWHUDWXUHVHDUFKZDV SHUIRUPHGRQVHGLPHQWWR[LFLW\GDWD)RUGLFKORURHWKDQHDQGWULFKORURPHWKDQHWKH VHQVLWLYLW\GLVWULEXWLRQRIPLFURELDOUHDFWLRQVLQVHGLPHQWZDVFRPSDUHGZLWKWKHDTXDWLF 66')RUDWUD]LQHSHQWDFKORURSKHQROFKORUGDQHFRSSHUFDGPLXP]LQFDQGOHDGWZR GLIIHUHQWFRPSDULVRQVZHUHPDGHRQHEDVHGRQWKHFRPSDULVRQEHWZHHQVRLOSURFHVVHVDQG DTXDWLFWR[LFLW\WHVWVDQRWKHURQHEDVHGRQWKHFRPSDULVRQEHWZHHQWHUUHVWULDODQGDTXDWLF WR[LFLW\WHVWV 7KHGDWDLQWDEOHDUHVRUWHGDFFRUGLQJWRGHOWDVKRZQLQWKHEHIRUHODVWFROXPQEXWWKHVRLO VHGLPHQWDQGPHWDOWHVWVZHUHNHSWVHSDUDWH7KHGLIIHUHQFHVGHOWDUDQJHIURPIRU FKORUS\ULIRVGRZQWRIRUWULFKORURHWKHQH DQGHYHQGRZQWRIRUWULFKORURPHWKDQH LQVHGLPHQW

(78) 7KHGLIIHUHQFHEHWZHHQWZRORJDULWKPVFDQDOVREHH[SUHVVHGDVDUDWLR7KLV LQGLFDWHVWKDWIRUFKORUS\ULIRVWKHDTXDWLFWR[LFLW\WHVWVZHUH  WLPHVPRUHVHQVLWLYH WKDQWKHWHUUHVWULDOWR[LFLW\WHVWVZKHUHDVIRUWULFKORURHWKHQHWKHDTXDWLFWR[LFLW\WHVWVZHUH   WLPHVOHVVVHQVLWLYHWKDQWKHWHUUHVWULDOWR[LFLW\WHVWV)RUFKORUS\ULIRVDQG DWUD]LQHWKH(T3WUDQVIRUPHGWHUUHVWULDOWR[LFLW\GDWDZHUHKLJKHUWKDQWKHDTXDWLFWR[LFLW\ GDWDZKHUHDVLWZDVWKHRWKHUZD\DURXQGIRUWULFKORURSKHQRODQGWULFKORURHWKHQH,Q RWKHUZRUGVWKHDSSOLFDWLRQRIWKH(T3PHWKRGJDYHULVHWRVLJQLILFDQWGLIIHUHQFHVIRURI WKHRUJDQLFVXEVWDQFHV)RUWKHPHWDOVKDOIRIWKHFRPSDULVRQVVKRZDVLJQLILFDQW GLIIHUHQFHGHOWDEHWZHHQWKH(T3WUDQVIRUPHGWHUUHVWULDOGDWDDQGWKHDTXDWLFGDWD)RU FRSSHUDQGFDGPLXPWKHDTXDWLFWR[LFLW\WHVWVZHUHPRUHVHQVLWLYHZKHUHDVIRUFKURPLXP DUVHQLFDQGOHDGWKHWHUUHVWULDOWR[LFLW\WHVWVZHUHPRUHVHQVLWLYH )RUGLFKORURHWKDQHDQGWULFKORURPHWKDQHVHGLPHQWWR[LFLW\GDWDZHUHDYDLODEOHXVLQJ PLFURELDOSURFHVVHVLQDQDHURELFVHGLPHQW>9DQ%HHOHQDQG9DQ9ODDUGLQJHQ@7KH SURFHVVHVLQYROYHGZHUHWKHPLQHUDOL]DWLRQRIDFHWDWH>9DQ9ODDUGLQJHQDQG9DQ%HHOHQ @EHQ]RDWH>9DQ%HHOHQDQG9DQ9ODDUGLQJHQ@FKORURSKHQRO>9DQ%HHOHQDQG 9DQ9ODDUGLQJHQ@FKORURIRUP>9DQ%HHOHQHWDO@DQGPHWKDQRJHQHVLV>9DQ 9ODDUGLQJHQDQG9DQ%HHOHQ@7KHVHSURFHVVHVZHUHSHUIRUPHGLQVHGLPHQWZLWK DQGFDUERQUHVSHFWLYHO\7KHVHVHGLPHQWGDWDDUHRQO\SUHVHQWHGDV LOOXVWUDWLRQEHFDXVHVHGLPHQWGDWDZHUHQRWSUHVHQWLQWKHRULJLQDOQRULQWKHXSGDWHG,16GDWD VHWV>'H%UXLMQHWDO9HUEUXJJHQHWDO@7KHVHUHVXOWVVXJJHVWWKDWWKH DSSOLFDWLRQRIWKH(T3PHWKRGFDQDOVRJLYHDVLJQLILFDQW PRUHWKDQKXQGUHGIROG

(79) XQGHUHVWLPDWLRQRIWKHVHQVLWLYLW\RIPLFURELDOSURFHVVHVLQVHGLPHQWEXWWKHGDWDDUHPXFK WRRVFDUFHWRGUDZILUPFRQFOXVLRQV . .

(80) 5,90UHSRUW. SDJHRI. ,QVXPPDU\WDEOHVKRZVWKDWWKHDSSOLFDWLRQRIWKH(T3PHWKRGRQDTXDWLFWR[LFLW\GDWD FDQJLYHVLJQLILFDQWGLIIHUHQFHVZLWKWHUUHVWULDOWR[LFLW\GDWDIRUDSSUR[LPDWHO\KDOIRIWKH FRPSRXQGV7KHVHGLIIHUHQFHVGRQRWLQGLFDWHDV\VWHPDWLFRYHURUXQGHUHVWLPDWLRQEXW UDWKHUDQDGGHGXQFHUWDLQW\FDXVHGE\WKHDSSOLFDWLRQRIWKH(T3PHWKRG.  &DQWKHGLIIHUHQFHVEHH[SODLQHGE\GLIIHUHQFHVLQWKH UHSRUWHG.SYDOXHV" 1RZWKDWLWKDVEHHQVKRZQWKDWWKH(T3PHWKRGGHYLDWHVVLJQLILFDQWO\IRUDSSUR[LPDWHO\KDOI RIWKHWHVWHGFRPSRXQGVWKHTXHVWLRQDULVHVZKHWKHUWKLVPLJKWEHDWWULEXWHGWRWKHVHOHFWLRQ RIWKH.SYDOXHV:KHQWKHDYHUDJHORJ(&VRLODQGWKHDYHUDJHORJ(&ZDWHUDUHNQRZQ RQHFDQFDOFXODWHWKHRSWLPL]HG.SYDOXH .S

(81) XVLQJDORJDULWKPLFWUDQVIRUPDWLRQRI HTXDWLRQ^` ORJ(&VRLOORJ(&ZDWHU ORJ.S . ^`. 7KLVORJ.S YDOXHZLOOEHUHIHUUHGWRDVWKHRSWLPL]HGORJ.S YDOXHIRUWKH(T3PHWKRG )RUWKLV.S YDOXHWKHGLIIHUHQFHEHWZHHQWKHDYHUDJH(T3WUDQVIRUPHGWHUUHVWULDOORJ(& YDOXHDQGWKHDYHUDJHDTXDWLFORJ(&YDOXHLV]HUR7DEOHVKRZVWKLVRSWLPL]HGORJ.S. YDOXHLQWKHWKLUGFROXPQIURPWKHULJKWZKLFKFDQEHFRPSDUHGZLWK.RFYDOXHVIURPWKH OLWHUDWXUH>0DF.D\HWDOD0DF.D\HWDOE0DF.D\HWDOF@7KHVH.RF YDOXHVZHUHFRQYHUWHGWR.SYDOXHVIRUDVWDQGDUGVRLOXVLQJHTXDWLRQ^`7KHORZHVWYDOXHV DUHOLVWHGLQWKHFROXPQPDUNHGORZZKHUHDVWKHKLJKHVWYDOXHVDUHOLVWHGLQWKHFROXPQ PDUNHGKLJK7KHFRPSDULVRQVKRZVWKDWWKHORJ.S YDOXHIDOOVRQHORJXQLW DIDFWRU

(82) RXWVLGHWKHUDQJHRIWKHH[SHULPHQWDOORJ.SYDOXHVIRUFKORUS\ULIRVWULFKORURHWKHQHDQG WULFKORURPHWKDQH7KHUHIRUHWKH(T3PHWKRGLVQRWYDOLGIRUWKHGDWDVHWRIWKHVHRUJDQLF FRPSRXQGV1HLWKHUWKHVWDWLVWLFDOXQFHUWDLQW\LQWKHDTXDWLFDQGWHUUHVWULDOWR[LFLW\YDOXHVQRU WKHVWDWLVWLFDOXQFHUWDLQW\LQWKH.SYDOXHVLVVXIILFLHQWWRH[SODLQWKHGLIIHUHQFHEHWZHHQWKH (T3WUDQVIRUPHGWHUUHVWULDOGDWDDQGWKHDTXDWLFGDWDIRUWKHVHRUJDQLFFRPSRXQGV7KH GLIIHUHQFHPLJKWEHDWWULEXWHGWRWKHFKRLFHRIWHVWVSHFLHV)RUWULFKORURHWKHQHDQG WULFKORURPHWKDQHVHQVLWLYHPLFURELDOSURFHVVHVZHUHFRPSDUHGZLWKDTXDWLFWR[LFLW\WHVWV)RU FKORUS\ULIRVLQVHQVLWLYHWHVWVZLWKHDUWKZRUPVFRQWULEXWHGIRURIWKHWHUUHVWULDOGDWD7KH RQHWHVWZLWKDVSULQJWDLOZDVPRUHWKDQDIDFWRUPRUHVHQVLWLYH,WPLJKWEHSRVVLEOHWKDW FKORUS\ULIRVZDVOHVVELRDYDLODEOHLQWKHZRUPWHVWV )RUPHWDOVDGLIIHUHQWFRPSDULVRQLVPDGHEHFDXVHWKHUDQJHRI.SYDOXHVIRUPHWDOVLQ GLIIHUHQWVRLOVLVYHU\ODUJHDQGFDQQRWHDVLO\EHVWDQGDUGL]HG>2WWHHWDO@7KHIRXUWK FROXPQIURPWKHOHIWVKRZVWKHORJ.SYDOXHVZKLFKZHUHXVHGSUHYLRXVO\IRUWKH GHWHUPLQDWLRQRIVHGLPHQWTXDOLW\VWDQGDUGV>9520@,WLVFOHDUWKDWWKHVHYDOXHVDUH RIWHQRQHXQLWORZHUWKDQWKHORJ.SYDOXHVZKLFKDUHFXUUHQWO\XVHG>2WWHHWDO@)RU PHWDOVGHOWDOLHVZLWKLQWKHUDQJHRIIRUFRSSHUDQGIRUOHDG7KHVHGLIIHUHQFHV PLJKWEHFDXVHGE\WKHVHOHFWLRQRIWKH.SYDOXHVIURPWKHOLWHUDWXUH ,QVXPPDU\WKHGLIIHUHQFHVEHWZHHQWKH(T3WUDQVIRUPHGWHUUHVWULDOWR[LFLW\GDWDDQGWKH DTXDWLFWR[LFLW\GDWDPLJKWEHH[SODLQHGE\GLIIHUHQFHVLQWKHUHSRUWHG.SYDOXHVIRUPRVWRI WKHFRPSRXQGVEXWQRWIRUFKORUS\ULIRVWULFKORURHWKHQHDQGWULFKORURPHWKDQH)RUWKHODWWHU FRPSRXQGVWKHGLIIHUHQFHVPLJKWEHDWWULEXWHGWRWKHVHOHFWLRQRIWHVWVSHFLHV.

(83) 5,90UHSRUW. SDJHRI.  +RZODUJHDUHWKHGLIIHUHQFHVEHWZHHQWKH+& FDOFXODWHGIURPDTXDWLFWR[LFLW\GDWDDQGWKH+&FDOFXODWHG IURPVRLORUVHGLPHQWWR[LFLW\GDWD" 7KH(T3PHWKRGLVRIWHQXVHGIRUVHWWLQJVRLOTXDOLW\VWDQGDUGVWRFDOFXODWHDVRLO+&YDOXH LQPJNJIURPDZDWHU+&YDOXHLQ—JOLWHU7KH+&YDOXHLVGHSHQGHQWRQWKHDYHUDJHDQG WKHVWDQGDUGGHYLDWLRQRIWKH66'DQGFDQEHFDOFXODWHGXVLQJHTXDWLRQ^`RU^`7KH GLIIHUHQFHEHWZHHQWKH(T3WUDQVIRUPHGWHUUHVWULDORUVHGLPHQWORJ+&YDOXHDQGWKHDTXDWLF ORJ+&YDOXHLVFDOOHGGHOWD7KLVGLIIHUHQFHFDQEHFDOFXODWHGXVLQJHTXDWLRQ^`DQGLV OLVWHGLQWKHODVWFROXPQRIWDEOH7KLVGLIIHUHQFHTXDQWLILHVWKHDGGLWLRQDOXQFHUWDLQW\ FDXVHGE\WKHDSSOLFDWLRQRIWKH(T3PHWKRG'HOWDFDQDOVREHYLHZHGDVWKHORJDULWKPRI WKHUDWLREHWZHHQWKH(T3WUDQVIRUPHGWHUUHVWULDO+&DQGWKHDTXDWLF+&:KHQWKH(T3 PHWKRGSHUIRUPVSHUIHFWO\ERWK+&YDOXHVDUHHTXDODQGWKHUHIRUHGHOWD ORJ :KHQ WKH(T3PHWKRGLVSHUIRUPHGWRHVWLPDWHWKHWHUUHVWULDO+&IURPWKHDTXDWLFWR[LFLW\GDWD XVLQJWKHDTXDWLF66'YDOXHVLQWDEOHWKHWHUUHVWULDO+&ZRXOGEHRYHUHVWLPDWHG7KH RYHUHVWLPDWLRQIDFWRULV IRUWULFKORURHWKHQH IRUFKURPLXPPRUHWKDQ IRUFKORUGDQHFDUERIXUDQFKORUS\ULIRVFRSSHUFDGPLXPDQGFREDOWXSWR IRU DWUD]LQH)RUWKHRWKHUFRPSRXQGVWKHXQGHURURYHUHVWLPDWLRQZRXOGEHOHVVWKDQDIDFWRU  7KHHVWLPDWLRQRIDVHGLPHQW+&IURPDTXDWLFWR[LFLW\GDWDDOVRVHHPVWREHVXEMHFWHGWR ODUJHXQFHUWDLQWLHV)RUWULFKORURPHWKDQHWKHVHGLPHQW+&ZRXOGKDYHEHHQXQGHUHVWLPDWHG ZLWKDIDFWRU 7KLVODUJHUDWLRPLJKWEHDWWULEXWHGWRWKHODUJHGLIIHUHQFHVLQ VHQVLWLYLW\IRUWULFKORURPHWKDQHEHWZHHQWKHDQDHURELFSURFHVVHVLQVHGLPHQWDQGDTXDWLF WR[LFLW\WHVWV>9DQ%HHOHQDQG9DQ9ODDUGLQJHQ@ ,QVXPPDU\7KHXVHRIWKH(T3PHWKRGWRHVWLPDWHWHUUHVWULDO+&YDOXHVIURPDTXDWLF+& YDOXHVFDQOHDGWRERWKRYHUDQGXQGHUHVWLPDWLRQVZKLFKFDQRFFDVLRQDOO\EHRQHRUHYHQ WZRRUGHUVRIPDJQLWXGH . . . .  7KHTXDQWLILFDWLRQRIWKHH[WUDXQFHUWDLQW\FDXVHGE\WKH DSSOLFDWLRQRIWKH(T3PHWKRGLQVRLO 7KHSUHFHGLQJSDUDJUDSKVKDYHVKRZQWKDWWKHDSSOLFDWLRQRIWKH(T3PHWKRGGLGQRWOHDGWR DV\VWHPDWLFRYHURUXQGHUHVWLPDWLRQRIWKHWHUUHVWULDO+&IRUWKHVHOHFWHGRUJDQLF FRPSRXQGVDQGPHWDOV)RUDVSHFLILFFRPSRXQGKRZHYHUDVHULRXVRYHURUXQGHUHVWLPDWLRQ RIWKHWHUUHVWULDO+&E\WKHDSSOLFDWLRQRIWKH(T3PHWKRGFDQRFFXU3URYLGHGWKDWWKH WHUUHVWULDOGDWDDUHRIWKHVDPHTXDOLW\DVWKHDTXDWLFGDWDWKHWHUUHVWULDO+&ZKLFKLV GHULYHGXVLQJWKH(T3PHWKRGLVOHVVUHOLDEOHWKDQDWHUUHVWULDO+&ZKLFKLVGHULYHGIURP VRLOWR[LFLW\WHVWV7KLVH[WUDXQFHUWDLQW\FDXVHGE\WKHXVHRIWKH(T3PHWKRGFDQEH TXDQWLILHGXVLQJWKHGLIIHUHQFHEHWZHHQWKHWHUUHVWULDOORJ+&DQGWKHDTXDWLFORJ+& VKRZQDVGHOWDLQWKHODVWFROXPQRIWDEOH)RURUJDQLFFRPSRXQGVGHOWDUDQJHGEHWZHHQ DQG:KHQWKHVHGLPHQWGDWDDUHOHIWRXWGHOWDYDOXHVUHPDLQZKLFKFDQEH GHVFULEHGE\DGLVWULEXWLRQZLWKDQDYHUDJHRIDQGDVWDQGDUGGHYLDWLRQRI7KH ORZHUGRWWHGOLQHLQILJXUHVKRZVWKLVGLVWULEXWLRQ7KHGHOWDYDOXHVIRURUJDQLFFRPSRXQGV DUHVKRZQDVVTXDUHVDQGDUHGLVWULEXWHGHYHQO\RQWKHYHUWLFDOVFDOHVWDUWLQJZLWKWKHORZHVW YDOXHWRJHWDFXPXODWLYHGLVWULEXWLRQ>$OGHQEHUJDQG-DZRUVND@2QDYHUDJHWKH(T3 PHWKRGSHUIRUPVZHOOIRUWKHRUJDQLFFRPSRXQGVLQVRLOVLQFHWKHDYHUDJHRIWKHGLVWULEXWLRQ 

(84) LVFORVHWR:KHQRQHLVLQWHUHVWHGLQDVSHFLILF+&IRUDVSHFLILFFRPSRXQGWKH.

(85) 5,90UHSRUW. SDJHRI. EURDGQHVVRIWKHGLVWULEXWLRQFDQSRVHDSUREOHPEHFDXVHWKHGLIIHUHQFHFDXVHGE\WKH DSSOLFDWLRQRIWKH(T3PHWKRGFDQEHWZRRUGHUVRIPDJQLWXGH VHHILJXUH

(86) 7KHORZHU FRQILGHQFHLQWHUYDORIWKLVGLVWULEXWLRQLVLPSRUWDQWEHFDXVHLWFDQEHXVHGWRTXDQWLI\WKH H[WUDXQFHUWDLQW\FDXVHGE\WKH(T3PHWKRG7KLVFRQILGHQFHLQWHUYDOFDQEHFDOFXODWHGIURP WKHDYHUDJH 

(87) WKHVWDQGDUGGHYLDWLRQ 

(88) DQGWKHQXPEHURIGDWD 

(89) IURPWKLV GLVWULEXWLRQ7KHVWDWLVWLFDOPHWKRGRI$OGHQEHUJDQG-DZRUVND>@ ZKLFKJLYHVDQ H[WUDSRODWLRQIDFWRURI

(90) \LHOGV  7KLVLQGLFDWHVWKDWWKH HVWLPDWLRQRIWKHVRLO+&IURPWKHDTXDWLF+&XVLQJWKH(T3PHWKRGLVOHVVWKDQDIDFWRU   WRRODUJHLQRIWKHFDVHV7KHXSSHUFRQILGHQFHLQWHUYDOFDQEHFDOFXODWHG DFFRUGLQJO\JLYLQJ  7KLVLQGLFDWHVWKDWWKHHVWLPDWLRQRIWKH VRLO+&IURPWKHDTXDWLF+&XVLQJWKH(T3PHWKRGLVOHVVWKDQDIDFWRUWRRVPDOOLQ RIWKHFDVHV . 7KHDSSOLFDWLRQRIWKH(T3PHWKRGIRUVHGLPHQWVFDQJLYHULVHWRHYHQODUJHUXQFHUWDLQWLHV ZDWHUDQGWKH+& VHGLPHQWFDQEH )RURUJDQLFFRPSRXQGVWKHUDWLREHWZHHQWKH+& DVODUJHDV   LVWKHOHIWPRVWSRLQWLQILJXUHIRUWULFKORURPHWKDQHLQ VHGLPHQW

(91) %XWPRUHGDWDDUHQHHGHGWRHVWLPDWHDUHOLDEOHVDIHW\IDFWRU (&. . (&. . )RUPHWDOVWKHORJWUDQVIRUPHGUDWLREHWZHHQWKHDTXDWLF+&DQGWKHWHUUHVWULDO+&UDQJHG EHWZHHQDQG VHHWDEOH

(92) $QXPEHURIUDWLRVDUHXVHGZKLFKFDQEHGHVFULEHG E\DGLVWULEXWLRQZLWKDQDYHUDJHRIDQGDVWDQGDUGGHYLDWLRQRI7KHXSSHUGRWWHG OLQHLQILJXUHVKRZVWKLVGLVWULEXWLRQZKLOHWKHLQGLYLGXDOUDWLRVDUHPDUNHGDVWULDQJOHV $JDLQDFRQILGHQFHLQWHUYDOFDQEHFDOFXODWHGXVLQJWKHPHWKRGRI$OGHQEHUJDQG -DZRUVND 

(93) IRUWKLVGLVWULEXWLRQZLWKDVOLJKWO\GLIIHUHQWH[WUDSRODWLRQIDFWRURI IRUGDWD7KLVJLYHV  7KLVLQGLFDWHVWKDWWKHHVWLPDWLRQRIWKH VRLO+&IURPWKHDTXDWLF+&XVLQJWKH(T3PHWKRGLVOHVVWKDQDIDFWRUWRRODUJHLQ RIWKHFRPSDULVRQVZLWKPHWDOV7KHXSSHUFRQILGHQFHLQWHUYDOFDQEHFDOFXODWHG DFFRUGLQJO\JLYLQJ  7KLVLQGLFDWHVWKDWWKHHVWLPDWLRQRIWKHVRLO +&IURPWKHDTXDWLF+&XVLQJWKH(T3PHWKRGLVOHVVWKDQDIDFWRUWRRVPDOOLQRI WKHFDVHV :KHQDOOWKHGDWDIRUWKHORJWUDQVIRUPHGUDWLREHWZHHQWKHDTXDWLF+&DQGWKHWHUUHVWULDORU VHGLPHQW+&DUHMRLQHGWRJHWKHU2QHJHWVDGLVWULEXWLRQZLWKGHOWDYDOXHVZLWKDQ DYHUDJHRIDQGDVWDQGDUGGHYLDWLRQRI)RUGDWDWKH$OGHQEHUJDQG-DZRUVND PHWKRG 

(94) JLYHVDQH[WUDSRODWLRQIDFWRURI7KLVZRXOG\LHOGDIDFWRURI   $ORJWUDQVIRUPDWLRQZRXOGJLYHDQXQGHUHVWLPDWLRQIDFWRURI 7KHFRUUHVSRQGLQJRYHUHVWLPDWLRQIDFWRUFDQEHFDOFXODWHGXVLQJ  :KLFKPHDQVWKDWWKHRYHUHVWLPDWLRQIDFWRULV7KLVIDFWRULVORZHUWKDQWKH RYHUHVWLPDWLRQIDFWRURIIRUWKHRUJDQLFFRPSRXQGVEXWKLJKHUWKDQWKHRYHUHVWLPDWLRQ IDFWRURIIRUWKHPHWDOV7KLVLQGLFDWHVWKDWWKHXVHRIWKH(T3PHWKRGWRGHULYHVRLO+& YDOXHVIURPDTXDWLFWR[LFLW\GDWDPLJKWOHDGWR+&YDOXHVZKLFKDUHWZRRUGHUVRI PDJQLWXGHWRRORZDQGDUHWKHUHIRUHRYHUSURWHFWLYH 7KHXQGHUHVWLPDWLRQIDFWRUVRQWKHRWKHUKDQGUDQJHIURPIRUWKHWRWDOGDWDVHWWRIRU RUJDQLFFRPSRXQGVRUIRUPHWDOV7KHYDOXHRILVFDXVHGE\WKHFRPSDULVRQEHWZHHQ VHGLPHQWSURFHVVHVDQGDTXDWLFRUJDQLVPVZKLFKDUHWD[RQRPLFDOO\XQUHODWHG7KHUHIRUHRQO\ WKHYDOXHVRIDQGDUHVHOHFWHG7KHVHYDOXHVDUHRQO\DQRUGHURIPDJQLWXGHHVWLPDWLRQ DQGGHSHQGRQWKHVHOHFWHGWR[LFLW\GDWDDQG.SYDOXHV5RXQGLQJRIIWRWKHQHDUHVWIDFWRURI WHQJLYHV7KLVLQGLFDWHVWKDWWKHXVHRIWKH(T3PHWKRGWRGHULYHVRLO+&YDOXHVIURP DTXDWLFWR[LFLW\GDWDFDQOHDGWR+&YDOXHVZKLFKDUHIRURIWKHFRPSRXQGVPRUHWKDQD IDFWRURIWRRKLJKDQGDUHWKHUHIRUHXQGHUSURWHFWLYH.

(95) 5,90UHSRUW.                     . SDJHRI. WRWDO RUJDQLF RUJDQLF PHWDO PHWDO. . . . . . . . ORJ+&VRLOZDWHU. )LJXUH. 7KHGLIIHUHQFHEHWZHHQPRGHODQGREVHUYDWLRQV. 7KHGLIIHUHQFHEHWZHHQPRGHODQGREVHUYDWLRQVLVH[SUHVVHGDVWKHFXPXODWLYHGLVWULEXWLRQRI WKHORJWUDQVIRUPHGUDWLRVEHWZHHQWKH(T3WUDQVIRUPHGWHUUHVWULDO+&DQGWKHDTXDWLF+& GHOWD

(96) IRUHDFKRIWKHFRPSRXQGVOLVWHGLQWDEOH7KHFRPSRXQGVRQWKHOHIWKDQGVLGHRI WKHILJXUH WKHQHJDWLYHYDOXHV

(97) ZRXOGEHXQGHUSURWHFWHGZKHQWKH(T3PHWKRGZDVXVHGWR GHULYHDWHUUHVWULDO+&IURPDTXDWLFWR[LFLW\GDWD)RUWKHFRPSRXQGVOHIWRIWKH WHUUHVWULDO+&ZDVPRUHWKDQDIDFWRUVPDOOHUWKDQWKHWHUUHVWULDO+&GHULYHGIURP DTXDWLFGDWD)RUWKHFRPSRXQGVWRWKHULJKWRILWZDVWKHRWKHUZD\DURXQG.  +RZFDQWKHREVHUYHGGLIIHUHQFHVFDXVHGE\WKH DSSOLFDWLRQRIWKH(T3PHWKRGEHH[SODLQHGDQGGRWKH\ PDWFKZLWKHDUOLHUILQGLQJV" ,QWKHDERYHSDUDJUDSKVLWZDVVKRZQWKDWWKH(T3PHWKRGGHYLDWHGVLJQLILFDQWO\IRUDOPRVW KDOIRIWKHWHVWHGFRPSRXQGVIURPWKHXSGDWHG,16GDWDVHW7KHIROORZLQJIDFWRUV FRQWULEXWHGWRWKLVGHYLDWLRQ 'LIIHUHQFHVEHWZHHQVSHFLHVVHQVLWLYLW\GLVWULEXWLRQVLQZDWHUDQGHLWKHUVHGLPHQWRUVRLO 'LIIHUHQFHVLQH[SRVXUHFRQGLWLRQVGXULQJWKHWR[LFLW\WHVWVLQZDWHUVRLOVDQGVHGLPHQWV 'LIIHUHQFHVLQVHQVLWLYLW\RIWHVWVSHFLHVZLWKLQWKHXSGDWHG,16GDWDVHW 6HOHFWLRQRIWKH.SYDOXHIURPWKHOLWHUDWXUH %RWKWKH7HFKQLFDO&RPPLVVLRQ6RLO3URWHFWLRQ>7&%@DQGWKH'XWFK+HDOWK&RXQFLO >*H]RQGKHLGVUDDG@KDYHVWDWHGWKDWWKH(T3PHWKRGLVQRWUHFRPPHQGHGIRU FRPSRXQGVOLNHPHWDOVDQGSHVWLFLGHV7KHGDWDDQDO\VLVLQWKLVUHSRUWFRQILUPVWKDWWR[LFLW\ WHVWVZLWKVRLODQGVHGLPHQWDUHQHFHVVDU\IRUDUHOLDEOHDQGDFFXUDWHGHWHUPLQDWLRQRIVRLODQG VHGLPHQW03&YDOXHV7KLVVXSSRUWVWKHVWDQGLQJSUDFWLFHLQWKH1HWKHUODQGVZKHUHWKH(T3 PHWKRGLVRQO\XVHGZKHQLQVXIILFLHQWVRLORUVHGLPHQWWR[LFLW\GDWDDUHDYDLODEOH$WWKLV VWDJHWKHTXHVWLRQDERXWKRZPDQ\GDWDVKRXOGEHUHJDUGHGDVLQVXIILFLHQWFDQQRZEH.

(98) 5,90UHSRUW. SDJHRI. DQVZHUHGLQPRUHGHWDLO2QHPXVWEHDULQPLQGWKDWWKHUHFRPPHQGDWLRQVLQWKHQH[W SDUDJUDSKDUHRQO\VXLWHGIRUYHU\FUXGHHVWLPDWLRQV7KHXVHRIDOLPLWHGDPRXQWRI WHUUHVWULDOWR[LFLW\GDWDFDQOHDGWRDQXQFHUWDLQW\LQWKHHVWLPDWLRQRIWKHWHUUHVWULDO+& ZKLFKLVPXFKPRUHWKDQWKHIDFWRUDWWULEXWHGWRWKHXVHRIWKH(T3PHWKRG.  +RZPDQ\WHUUHVWULDOWR[LFLW\GDWDDUHUHTXLUHGWR HVWLPDWHDQ+&YDOXHWKDWLVPRUHDFFXUDWHWKDQWKHRQH GHULYHGIURPDTXDWLFWR[LFLW\GDWDXVLQJWKH(T3PHWKRG" ,QDSSHQGL[LWLVVKRZQWKDWWKHODUJHXQFHUWDLQW\FDXVHGE\WKHXVHRIDOLPLWHGDPRXQWRI WHUUHVWULDOWR[LFLW\GDWDFDQEHTXDQWLILHG7KLVXQFHUWDLQW\IDFWRUFDQEHFRPSDUHGZLWKWKH XQFHUWDLQW\IDFWRUFDXVHGE\WKHXVHRIWKH(T3PHWKRG SURYLGHGWKDWVXIILFLHQWDTXDWLF WR[LFLW\GDWDDQGVRUSWLRQGDWDDUHDYDLODEOH

(99) 7KHILUVWUHFRPPHQGDWLRQVVKRZWKHRXWFRPH RIWKLVFRPSDULVRQ.

(100) 5,90UHSRUW. . SDJHRI. 5HFRPPHQGDWLRQV.  :KHQOHVVWKDQWHUUHVWULDOWR[LFLW\GDWDDUHDYDLODEOHWKHXVHRIWKH(T3PHWKRGFDQ EHDGYRFDWHGEHFDXVHWKHXQFHUWDLQW\LQWKHHVWLPDWLRQRIWKH+&LVPXFKODUJHUWKDQD IDFWRU  :KHQWHUUHVWULDOWR[LFLW\GDWDDUHDYDLODEOHIRUDQDUFRWLFWR[LFDQWWKHXVHRIWKH WHUUHVWULDOGDWDLVSUHIHUUHG:KHQWKHWHUUHVWULDOGDWDKDYHDODUJHVWDQGDUGGHYLDWLRQDQGWKHUH LVVXIILFLHQWLQIRUPDWLRQDERXWWKHVRUSWLRQEHKDYLRUDQGWKHDTXDWLFWR[LFLW\WKHXVHRIWKH (T3PHWKRGFDQDOVREHDGYRFDWHG  :KHQPRUHWKDQWHUUHVWULDOWR[LFLW\GDWDDUHDYDLODEOHLWLVJHQHUDOO\EHWWHUWRXVHWKHVH GDWDLQVWHDGRIXVLQJWKH(T3PHWKRGWRGHULYHD+&YDOXHIURPDTXDWLFGDWD  ,QVSHFLDOFDVHVIRUDFRPSRXQGZKLFKKDVDODUJHVWDQGDUGGHYLDWLRQRILWVDTXDWLF 6SHFLHV6HQVLWLYLW\'LVWULEXWLRQDQGZKLFKKDVDQDFFXUDWH.SYDOXHDQGDORWRIUHOLDEOH DTXDWLFWR[LFLW\GDWDFRYHULQJDODUJHWD[RQRPLFGLYHUVLW\LWPLJKWEHEHWWHUWRXVHWKH(T3 PHWKRGHYHQZKHQRUWHUUHVWULDOWR[LFLW\GDWDDUHDYDLODEOH7KHXQFHUWDLQW\LQWKH+& IURPGDWDZLWKDVWDQGDUGGHYLDWLRQRILVDIDFWRU VKRZQLQWDEOH

(101) ZKLFKLVPXFK ODUJHUWKDQDIDFWRU  7KH+&YDOXHVZKLFKDUHEDVHGRQOHVVWKDQILYHWR[LFLW\GDWDRUZKLFKDUHGHULYHG XVLQJWKH PRGLILHG

(102) (T3PHWKRGVKRXOGEHUHJDUGHGDVSUHOLPLQDU\+&YDOXHV7KHVH SUHOLPLQDU\+&YDOXHVFDQEHXVHGLQFRPSDULVRQZLWKHQYLURQPHQWDOFRQFHQWUDWLRQVLQ RUGHUWRGHFLGHZKHWKHUPRUHUHVHDUFKLVQHHGHGIRUWKHULVNHYDOXDWLRQRIDVSHFLILFSROOXWDQW  0RUHVHGLPHQWWR[LFLW\GDWDVKRXOGEHDFTXLUHGWRGHWHUPLQHUHOLDEOHVHGLPHQW03&V.

(103) 5,90UHSRUW. . SDJHRI. &RQFOXVLRQV. 7KHXVHRIWKH(T3PHWKRGWRGHULYHDWHUUHVWULDO+&IURPVRUSWLRQGDWDDQGDTXDWLFWR[LFLW\ GDWDJDYHDQDSSUR[LPDWHO\HTXDOFKDQFHRIXQGHUHVWLPDWLRQRURYHUHVWLPDWLRQ7KH(T3 PHWKRGGHYLDWHGVLJQLILFDQWO\IRUDSSUR[LPDWHO\KDOIRIWKHWHVWHGFRPSRXQGVIURPWKH XSGDWHG,16GDWDVHW,QRIWKHWHVWHGFRPSRXQGVWKHRYHUHVWLPDWLRQRIWKHWHUUHVWULDO +&GHULYHGIURPDTXDWLFGDWDZDVPRUHWKDQDIDFWRU. $FNQRZOHGJHPHQWV 7KHDXWKRUVWKDQN'U'6LMPDQG'U'9DQGH0HHQWIRUVWLPXODWLQJGLVFXVVLRQVRQWKH VFRSHRIWKHSURMHFWDQGIRUYDOXDEOHKHOSLQWKHSUHSDUDWLRQRIWKHPDQXVFULSW:HDOVRWKDQN 'U0(-9DQGHU:HLGHQ'UV737UDDVDQG'U-9DQ:HQVHPIRUFULWLFDOUHDGLQJRI WKHPDQXVFULSW.

(104) 5,90UHSRUW. SDJHRI. 5HIHUHQFHV $OGHQEHUJ7-DZRUVND-68QFHUWDLQW\RIWKHKD]DUGRXVFRQFHQWUDWLRQDQGIUDFWLRQDIIHFWHG IRUQRUPDOVSHFLHVVHQVLWLYLW\GLVWULEXWLRQV(FRWR[LFRO(QYLURQ6DI $UPLWDJH3%HUU\*6WDWLVWLFDOPHWKRGVLQPHGLFDOUHVHDUFK&DPEULGJH8QLWHG.LQJGRP %ODFNZHOO6FLHQFH %RFNWLQJ*-09DQ'H3ODVVFKH(-6WUXLMV-&DQWRQ-+6RLOZDWHUSDUWLWLRQFRHIILFLHQWV IRURUJDQLFFRPSRXQGV%LOWKRYHQWKH1HWKHUODQGV1DWLRQDO,QVWLWXWHRI3XEOLF+HDOWKDQG (QYLURQPHQWDO3URWHFWLRQ 5,90

(105) 5HSRUW1R &URPPHQWXLMQ73ROGHU06LMP''H%UXLMQ-9DQ'H3ODVVFKH(D(YDOXDWLRQRIWKH 'XWFKHQYLURQPHQWDOULVNOLPLWVIRUPHWDOVE\DSSOLFDWLRQRIWKHDGGHGULVNDSSURDFK(QYLURQ 7R[LFRO&KHP &URPPHQWXLMQ76LMP''H%UXLMQ-9DQ'HQ+RRS09DQ/HHXZHQ.9DQ'H3ODVVFKH( E0D[LPXPSHUPLVVLEOHDQGQHJOLJLEOHFRQFHQWUDWLRQVIRUPHWDOVDQGPHWDOORLGVLQWKH 1HWKHUODQGVWDNLQJLQWRDFFRXQWEDFNJURXQGFRQFHQWUDWLRQV-RXUQDORI(QYLURQPHQWDO 0DQDJHPHQW &URPPHQWXLMQ76LMP''H%UXLMQ-9DQ/HHXZHQ.9DQ'H3ODVVFKH(F0D[LPXP SHUPLVVLEOHDQGQHJOLJLEOHFRQFHQWUDWLRQVIRUVRPHRUJDQLFVXEVWDQFHVDQGSHVWLFLGHV-RXUQDORI (QYLURQPHQWDO0DQDJHPHQW 'H%UXLMQ-&URPPHQWXLMQ79DQ/HHXZHQ.9DQ'H3ODVVFKH(6LMP'9DQ'HU:HLGHQ0 (QYLURQPHQWDO5LVN/LPLWVLQ7KH1HWKHUODQGV%LOWKRYHQWKH1HWKHUODQGV1DWLRQDO ,QVWLWXWHRI3XEOLF+HDOWKDQG(QYLURQPHQWDO3URWHFWLRQ 5,90

(106) 5HSRUW1R 'L7RUR'0=DUED&6+DQVHQ'-%HUU\:-6ZDUW]5&&RZDQ&(3DYORX63$OOHQ +(7KRPD1$3DTXLQ357HFKQLFDOEDVLVIRUHVWDEOLVKLQJVHGLPHQWTXDOLW\FULWHULDIRU QRQLRQLFRUJDQLFFKHPLFDOVXVLQJHTXLOLEULXPSDUWLWLRQLQJ(QYLURQ7R[LFRO&KHP  (&7HFKQLFDO*XLGDQFH'RFXPHQWVLQVXSSRUWRI'LUHFWLYH((&RQULVNDVVHVVPHQWRI QHZQRWLILHGVXEVWDQFHVDQG5HJXODWLRQ (&

(107) 1RRQULVNDVVHVVPHQWRIQHZQRWLILHG VXEVWDQFHV 3DUWV,,,,,,DQG,9

(108) 5HSRUW1R(&FDWDORJXHQXPEHUV&5 (1&UXH0HUFLHU//X[HPERXUJ2IILFHIRU2IILFLDO3XEOLFDWLRQVRIWKH(XURSHDQ &RPPXQLW\ *H]RQGKHLGVUDDG+HWSURMHFWLQWHJUDOHQRUPVWHOOLQJVWRIIHQ5HSRUW1R'HQ+DDJ +RHNVWUD-$9DQ(ZLMN3+$OWHUQDWLYHVIRUWKHQRREVHUYHGHIIHFWOHYHO(QYLURQ7R[LFRO &KHP .DOI')0HQVLQN%-:*0RQWIRUWV0+003URWRFROIRUWKHGHULYDWLRQRI+DUPRQLVHG 0D[LPXP3HUPLVVLEOH&RQFHQWUDWLRQV 075V

(109) %LOWKRYHQWKH1HWKHUODQGV1DWLRQDO,QVWLWXWHRI 3XEOLF+HDOWKDQG(QYLURQPHQWDO3URWHFWLRQ 5,90

(110) 5HSRUW1R /LM]HQ-3$%DDUV$-2WWH3)5LNNHQ06ZDUWMHV)$9HUEUXJJHQ(0-9DQ:H]HO$3 7HFKQLFDOHYDOXDWLRQRIWKH,QWHUYHQWLRQ9DOXHVIRU6RLOVHGLPHQWDQG*URXQGZDWHU+XPDQ DQGHFRWR[LFRORJLFDOULVNDVVHVVPHQWDQGGHULYDWLRQRIULVNOLPLWVIRUVRLODTXDWLFVHGLPHQWDQG JURXQGZDWHU%LOWKRYHQWKH1HWKHUODQGV1DWLRQDO,QVWLWXWHRI3XEOLF+HDOWKDQG(QYLURQPHQWDO 3URWHFWLRQ 5,90

(111) 5HSRUW1R.

(112) 5,90UHSRUW. SDJHRI. 0DF.D\'6KLX0DD0RQRDURPDWLF+\GURFDUERQV&KORUREHQ]HQHVDQG3&%V,OOXVWUDWHG KDQGERRNRISK\VLFDOFKHPLFDOSURSHUWLHVDQGHQYLURQPHQWDOIDWHIRURUJDQLFFKHPLFDOV9RO

(113)  %RFD5DWRQ)ORULGD/HZLV3XEOLVKHUV 0DF.D\'6KLX0DE3HVWLFLGHFKHPLFDOV,OOXVWUDWHGKDQGERRNRISK\VLFDOFKHPLFDO SURSHUWLHVDQGHQYLURQPHQWDOIDWHIRURUJDQLFFKHPLFDOV9RO

(114) %RFD5DWRQ)ORULGD/HZLV 3XEOLVKHUV 0DF.D\'6KLX0DF9RODWLOH2UJDQLF&KHPLFDOV,OOXVWUDWHGKDQGERRNRISK\VLFDOFKHPLFDO SURSHUWLHVDQGHQYLURQPHQWDOIDWHIRURUJDQLFFKHPLFDOV9RO

(115) %RFD5DWRQ)ORULGD/HZLV 3XEOLVKHUV 2WWH3)/LM]HQ-3$2WWH-*6ZDUWMHV)$9HUVOXLMV&:(YDOXDWLRQDQGUHYLVLRQRIWKH &62,/SDUDPHWHUVHW3URSRVHGSDUDPHWHUVHWIRUKXPDQH[SRVXUHPRGHOOLQJDQGGHULYLQJ ,QWHUYHQWLRQ9DOXHVIRUWKHILUVWVHULHVRIFRPSRXQGV%LOWKRYHQWKH1HWKHUODQGV1DWLRQDO ,QVWLWXWHRI3XEOLF+HDOWKDQG(QYLURQPHQWDO3URWHFWLRQ 5,90

(116) 5HSRUW1R 7&%$GYLHVSURMHFW,QWHJUDOH1RUPVWHOOLQJ6WRIIHQGHHOE5HSRUW1R$R/HLGVFKHQGDP 7UDDV73*XLGDQFHGRFXPHQWRQGHULYLQJHQYLURQPHQWDOULVNOLPLWV%LOWKRYHQWKH 1HWKHUODQGV1DWLRQDO,QVWLWXWHRI3XEOLF+HDOWKDQG(QYLURQPHQWDO3URWHFWLRQ 5,90

(117) 5HSRUW 1R 9DDO0$9DQ/HHXZHQ&-+RHNVWUD-$+HUPHQV-/09DULDWLRQLQVHQVLWLYLW\RI DTXDWLFVSHFLHVWRWR[LFDQWVSUDFWLFDOFRQVHTXHQFHVIRUHIIHFWDVVHVVPHQWRIFKHPLFDOVXEVWDQFHV (QYLURQ0DQDJ 9DQ%HHOHQ39DQ9ODDUGLQJHQ3/$7R[LFHIIHFWVRISROOXWDQWVRQWKHPLQHUDOL]DWLRQRI FKORURSKHQRODQGEHQ]RDWHLQPHWKDQRJHQLFULYHUVHGLPHQW(QYLURQ7R[LFRO&KHP  9DQ%HHOHQ39DQ9ODDUGLQJHQ3/$)OHXUHQ.HPLOl$.7R[LFHIIHFWVRISROOXWDQWVRQWKH PLQHUDOL]DWLRQRIFKORURIRUPLQULYHUVHGLPHQWV(FRWR[LFRO(QYLURQ6DI 9DQ6WUDDOHQ10'HQQHPDQ&$-(FRWR[LFRORJLFDOHYDOXDWLRQRIVRLOTXDOLW\FULWHULD (FRWR[LFRO(QYLURQ6DI 9DQ9ODDUGLQJHQ3/$9DQ%HHOHQ37R[LFHIIHFWVRISROOXWDQWVRQPHWKDQHSURGXFWLRQLQ VHGLPHQWVRIWKHULYHU5KLQH%XOO(QYLURQ&RQWDP7R[LFRO 9DQ9ODDUGLQJHQ3/$9DQ%HHOHQ37R[LFHIIHFWVRISROOXWDQWVRQWKHPLQHUDOL]DWLRQRI DFHWDWHLQPHWKDQRJHQLFULYHUVHGLPHQW%XOO(QYLURQ&RQWDP7R[LFRO 9HUEUXJJHQ(0-3RVWKXPXV59DQ:H]HO$3(FRWR[LFRORJLFDO6HULRXV5LVN &RQFHQWUDWLRQVIRUVRLOVHGLPHQWDQG JURXQG

(118) ZDWHUXSGDWHGSURSRVDOVIRUILUVWVHULHVRI FRPSRXQGV%LOWKRYHQWKH1HWKHUODQGV1DWLRQDO,QVWLWXWHRI3XEOLF+HDOWKDQG(QYLURQPHQWDO 3URWHFWLRQ 5,90

(119) 5HSRUW1R 9520,QWHJUDOHQRUPVWHOOLQJVWRIIHQPLOLHXNZDOLWHLWVQRUPHQERGHPZDWHUOXFKW JHDFWXDOLVHHUGHYHUVLH,16QRWLWLH5HSRUW'HQ+DDJ0LQLVWHULHYDQ9RONVKXLVYHVWLQJ 5XLPWHOLMNH2UGHQLQJHQ0LOLHXEHKHHU.

(120) 5,90UHSRUW. SDJHRI. $SSHQGL[ 4XDQWLILFDWLRQRIXQFHUWDLQW\ 7KHTXDQWLILFDWLRQRIWKHXQFHUWDLQW\FDXVHGE\WKHDSSOLFDWLRQWKHVWDWLVWLFDOH[WUDSRODWLRQ PHWKRGRQDOLPLWHGQXPEHURIWR[LFLW\GDWD 7KHUDWLRRIWKHPHGLDQ+&DQGWKHORZHUFRQILGHQFHOHYHORIWKH+&FDQTXDQWLI\WKH XQFHUWDLQW\LQWKH+&YDOXH 8)

(121) 7KHPHGLDQ+&FDQEHFDOFXODWHGDFFRUGLQJWRHTXDWLRQ ^`XVLQJWKHPHGLDQH[WUDSRODWLRQFRQVWDQW PF

(122) ZKLOHWKHORZHU+&FDQEHFDOFXODWHGLQ WKHVDPHZD\XVLQJWKHORZHUH[WUDSRODWLRQFRQVWDQW OF

(123)  ORJ8) /RJ +&PHGLDQ+&ORZHU

(124)  ORJ+&PHGLDQORJ+&ORZHU. ^`. 8VLQJHTXDWLRQ^`\LHOGV ORJ8) DYHUDJH ORJ12(&

(125) PF 6' ORJ12(&

(126) DYHUDJH ORJ12(&

(127) OF 6' ORJ12(&

(128) ORJ8) OFPF

(129) 6' ORJ12(&

(130). ^`. 7KHXQFHUWDLQW\IDFWRU8)LVGHSHQGHQWRQWKHVWDQGDUGGHYLDWLRQRIWKHWR[LFLW\GDWDDQGRQ WKHH[WUDSRODWLRQFRQVWDQWVZKLFKDUHGHSHQGHQWRQWKHQXPEHURIVSHFLHVWHVWHG7DEOH VKRZVWKDW8)GHFUHDVHVVWURQJO\DWLQFUHDVLQJQXPEHURIWHVWVSHFLHVDQGWKDWWKH8) LQFUHDVHVIRUFRPSRXQGVZLWKDKLJKHUVWDQGDUGGHYLDWLRQ1DUFRWLFFRPSRXQGVQRUPDOO\ KDYHDVWDQGDUGGHYLDWLRQEHORZ>9DDOHWDO@ZKHUHDVWDEOHVKRZVWKDWWKH VWDQGDUGGHYLDWLRQRIPRVWSHVWLFLGHVDQGPHWDOVDUHLQWKHUDQJHRIWR:KHQ8)LV DERYHZHDVVXPHWKDWWKHFRUUHVSRQGLQJ+&YDOXHLVWRRXQFHUWDLQWREHRIPXFKXVH DQGLWLVWKHUHIRUHEHWWHUWRXVHWKH(T3PHWKRGLQVWHDGRIDQLQVXIILFLHQWQXPEHURIWHUUHVWULDO WR[LFLW\GDWD2QWKHRWKHUKDQGZKHQ8)LVEHORZLWFDQEHDVVXPHGWKDWWKHXQFHUWDLQW\ FDXVHGE\WKHORZQXPEHURIWHVWVSHFLHVLVVPDOOHUWKDQWKHXQFHUWDLQW\FDXVHGE\WKH DSSOLFDWLRQRIWKH(T3PHWKRG7DEOHVKRZVWKDWIRUQ WKH8)LVDERYHIRUDOOWKH WDEXODWHGVWDQGDUGGHYLDWLRQV,QRWKHUZRUGVZKHQOHVVWKDQWHUUHVWULDOWR[LFLW\GDWDDUH DYDLODEOHLWLVPRUHDFFXUDWHWRXVHWKH(T3PHWKRGWKDQWRUHO\RQRQO\DYHU\OLPLWHG DPRXQWRIWHUUHVWULDOWR[LFLW\GDWD 7KHULJKWFROXPQLQWDEOHVKRZVWKHXQFHUWDLQW\IDFWRU8)IRUFRPSRXQGVZLWKDYHU\ VSHFLILFPRGHRIDFWLRQOLNHFHUWDLQDQWLELRWLFVLQVHFWLFLGHVRUKHUELFLGHVWKDWKDYHD66' ZLWKDODUJHVWDQGDUGGHYLDWLRQ)RUWKHVHFRPSRXQGVLWLVRIWKHXWPRVWLPSRUWDQFHWKDWD ODUJHQXPEHURIGLIIHUHQWVSHFLHVDUHWHVWHGVLQFHWKHUHLVDULVNWKDWRQHPLJKWPLVVWKHPRVW VHQVLWLYHWD[RQRPLFJURXS(YHQZKHQWHUUHVWULDOVSHFLHVDUHWHVWHGWKHXQFHUWDLQW\IDFWRU 8)LVZKLFKLQGLFDWHVWKDWWKHXQFHUWDLQW\GXHWRWKHOLPLWHGQXPEHURIWHUUHVWULDOVSHFLHV LVVWLOOPXFKODUJHUWKDQWKHIDFWRUZKLFKLVFDXVHGE\WKHDSSOLFDWLRQRIWKH(T3PHWKRG ,QSUDFWLFHLWLVRIWHQNQRZQZKLFKWD[RQRPLFJURXSLVPRUHDWULVNDQGWKHUHIRUHWKH XQFHUWDLQW\GXHWRWKHOLPLWHGQXPEHURIWHUUHVWULDOVSHFLHVFDQEHVPDOOHUEHFDXVHWKHVSHFLHV DUHQRWVHOHFWHGUDQGRP.

(131) 5,90UHSRUW. SDJHRI. 7DEOH 7KHUHODWLRQEHWZHHQWKHQXPEHURIWHVWVSHFLHVDQGWKHVWDQGDUGGHYLDWLRQRI WKHVHQVLWLYLW\GLVWULEXWLRQRQWKHUDWLREHWZHHQWKHPHGLDQDQGWKHORZHUHVWLPDWHRIWKH+& 1RVSHFLHV 6'  6'  6'  6'  6'   ( ( ( ( (    ( ( (     ( (      (                                                            .

(132) 5,90UHSRUW. SDJHRI. $SSHQGL[ 0DLOLQJOLVW  'LUHFWRUDDW*HQHUDDO0LOLHXEHKHHU'LUHFWLH6WRIIHQ$IYDOVWRIIHQ6WUDOLQJ  'U0YDQGHU:HLGHQ'LUHFWRUDDW*HQHUDDO0LOLHXEHKHHU'LUHFWLH6WRIIHQ$IYDOVWRIIHQ6WUDOLQJ  'U':*-XQJ'LUHFWRUDDW*HQHUDDO0LOLHXEHKHHU'LUHFWLH6WRIIHQ$IYDOVWRIIHQ6WUDOLQJ  'U7&URPPHQWXLMQ'LUHFWRUDDW*HQHUDDO0LOLHXEHKHHU'LUHFWLH%RGHP:DWHU/DQGHOLMN*HELHG  'UV'-RQNHUV'LUHFWRUDDW*HQHUDDO0LOLHXEHKHHU'LUHFWLH%RGHP:DWHU/DQGHOLMN*HELHG  -$SSHOPDQ&7%:DJHQLQJHQ  'U)YDQ$VVFKH,/=52%UXVVHO  'UV7%DNNHU5,=$/HO\VWDG  'UV0%HHN5,=$/HO\VWDG  'U:)WHQ%HUJH'60+HHUOHQ  'U3-GHQ%HVWHQ5,=$:6&/HO\VWDG  'UV-%ULOV712'HQ+HOGHU  'U7%URFN$OWHUUD:DJHQLQJHQ  'U-'HQHHU$OWHUUD:DJHQLQJHQ  'UV6'RJJHU*H]RQGKHLGVUDDG'HQ+DDJ  'U-+)DEHU$OWHUUD:DJHQLQJHQ  'U,U&$0YDQ*HVWHO9ULMH8QLYHUVLWHLW$PVWHUGDP  'U.+GHQ+DDQ6KHOO$PVWHUGDP  'UV-+DUPVHQ$OWHUUD:DJHQLQJHQ  'U,U$-+HQGULNV5,=$:6&/HO\VWDG  'UV'(0WHQ+XOVFKHU5,=$:6&/HO\VWDG  'U,U*(.DPHUOLQJ$.:$:$88WUHFKW  'UV0.RHQH6WLFKWLQJ1DWXXUHQ0LOLHX8WUHFKW  'U./HJLHUVH5,.=.DPSHUODQG  'U3&0YDQ1RRUW5,=$:6&/HO\VWDG  $0&03LMQHQEXUJ5,.='HQ+DDJ  'U(6QHOOHU5,=$/HO\VWDG  'U:-0YDQ7LOERUJ97%95R]HQGDDO  'U:9HHUNDPS6KHOO$PVWHUGDP  'U,U-309LQN5,=$:6&/HO\VWDG  'U+:DHWHUVFKRRW8QLRQ0XQLqUH%UXVVHO  'U-YDQ:HQVHP7&%'HQ+DDJ  'U'YDQ:LMN$N]R1REHO$UQKHP  'HSRW1HGHUODQGVH3XEOLFDWLHVHQ1HGHUODQGVH%LEOLRJUDILH  'LUHFWLH5,90  'LUHFWHXUVHFWRU'U,U*GH0LN  +RRIG/DERUDWRULXP(&2'UV-+&DQWRQ  'U-+0GH%UXLMQ5,90&65  'U&:0%RGDU5,90&65  3URIGU&-YDQ/HHXZHQ5,90&65  ,U-/LM]HQ5,90/%*  'ULU'YDQGH0HHQW5,90(&2  'U/3RVWKXPD5,90(&2  'U05XWJHUV5,90(&2  'U:6ORRII5,90&65  'U'6LMP5,90&65  'U-6WUXLMV5,90(&2  'UV77UDDV5,90&65  'U(0-9HUEUXJJHQ5,90&65  'UV7*9HUPHLUH5,90&65  'U$YDQ:H]HO5,90&65  6%'9RRUOLFKWLQJ 3XEOLF5HODWLRQV  %XUHDX5DSSRUWHQUHJLVWUDWLH  %LEOLRWKHHN5,90  $XWHXUV %XUHDX5DSSRUWHQEHKHHU 5HVHUYHH[HPSODUHQ.

(133) 6RLO 3DUDPHWHU ORJ(& ORJ12(& ORJ(& ORJ12(& 3

(134) ORJ12(& 3

(135) ORJ12(& 3

(136) ORJ12(& ORJ(& ORJ(& ORJ(& ORJ(& ORJ(& ORJ12(& 3

(137) ORJ(& 6

(138) ORJ(& 6

(139) ORJ12(& ORJ12(& 3

(140) ORJ12(& 3

(141) ORJ12(& ORJ12(& 3

(142) ORJ12(& 3

(143) ORJ12(& 3

(144) ORJ12(& ORJ12(& 3

(145) ORJ12(& 3

(146) ORJ12(& 3

(147) ORJ12(&. :DWHU 3DUDPHWHU ORJ(& ORJ12(& ORJ(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ(& ORJ(& ORJ(& ORJ(& ORJ(& ORJ12(& ORJ(& ORJ(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(& ORJ12(&. SDJHRI. &RPSDULVRQV 6XEVWDQFH $YU 6' 1 +& DYUJ 6' 1 +& GHOWD GHOWD &KORUS\ULIRV           $WUD]LQH           &DUERIXUDQ           3HQWDFKORURSKHQRO           &KORUGDQH           $WUD]LQH           3HQWDFKORURSKHQRO           &KORUGDQH           $OGULQGLHOGULQ           7ULFKORUREHQ]HQH           +HSWDFKORU           7ULFKORURSKHQRO           7ULFKORURHWKHQH           'LFKORURHWKDQH           7ULFKORURPHWKDQH           &RSSHU           &DGPLXP           &REDOW           =LQF           &RSSHU           =LQF           0HUFXU\           &DGPLXP           &KURPLXP,,,           $UVHQLF           /HDG           /HDG           2UJDQLFVXEVWDQFHV   0HWDOV   7RWDO   7KHGLIIHUHQFHEHWZHHQWKHORJDULWKPLFDOO\WUDQVIRUPHGWHUUHVWULDOWR[LFLW\GDWD H[SUHVVHGLQPJNJ

(148) DQGWKHORJDULWKPLFDOO\WUDQVIRUPHGDTXDWLFWR[LFLW\ GDWD LQ—JOLWHU

(149) LVFDOOHGGHOWDDQGLVFDOFXODWHGDFFRUGLQJWRHTXDWLRQ^`7KHGLIIHUHQFHEHWZHHQWKHDTXDWLFORJ+&DQGWKHWHUUHVWULDOORJ+&LV FDOOHGGHOWDDQGLVFDOFXODWHGXVLQJHTXDWLRQ^`6LJQLILFDQWGLIIHUHQFHVEHORZSUREDELOLW\DUHSULQWHGEROGDQGWKHVLJQLILFDQWGLIIHUHQFHVEHORZ DUHSULQWHGLQLWDOLFV. 3DUWLWLRQLQJFRHIILFLHQWV ORJ.S ORZ KLJK ORJ.S.                                                                                                . 7DEOH &RPSDULVRQEHWZHHQWKH6SHFLHV6HQVLWLYLW\'LVWULEXWLRQVIURPORJ(&RUORJ12(&YDOXHVIURPDTXDWLFDQG WHUUHVWULDOWR[LFLW\WHVWVXVLQJWKH(T3PHWKRG. 5,90UHSRUW.

(150)

Referenties

GERELATEERDE DOCUMENTEN

system suffered of a high plasma background radiation signal caused by strong AI and All lines that reached the output slit of the monochromator by multiple

Suid-Afrikaners kan dit nie bekostig om in hulle afson- derlike groepe van mekaar te isoleer nie, hulle moet die toekoms sáám tegemoet gaan, het hy onder luide toe- juiging

Therefore, it cannot be concluded that a firm’s degree of internationalization or higher global focus increase foreign equity commitment of Brazilian companies with foreign

Increased institutional autonomy, the increase in the number of higher education institutions and the changes in the funding system contributed to this development. In 1997

De eerste is dat mensen die georienteerd zijn op Riga ontevreden kunnen zijn over de bereikbaarheid van deze voorzieningen en het woord nabijheid in de.. vraagstelling hebben

Methodology was discussed in chapter four whereby the study applied the Johansen procedure with agricultural productivity as the dependent variable and agricultural

Op basis van de Leidraad Toetsen zullen de grasbekledingen hiervoor (bij een bedekking van &gt; 70%) ongeacht de score van de doorworteling, de score matig voor de

Despite the limitations of the model, it supports the simple mechanism we propose for the particle assembly at the monolayer: particles are swept by the droplet’s surface