Application of STPA on small drone operations: a benchmarking approach

(1)

Application of STPA on small drone operations

a benchmarking approach

Chatzimichailidou, Maria Mikela; Karanikas, Nektarios; Plioutsias, Anastasios DOI

10.1016/j.proeng.2017.03.091 Publication date

2017

Document Version Final published version Published in

Proceedings of the 4th European STAMP Workshop 2016 License

CC BY-NC-ND Link to publication

Citation for published version (APA):

Chatzimichailidou, M. M., Karanikas, N., & Plioutsias, A. (2017). Application of STPA on small drone operations: a benchmarking approach. In M. Rejzek (Ed.), Proceedings of the 4th European STAMP Workshop 2016 (Vol. 179, pp. 13-22). Procedia Engineering.

https://doi.org/10.1016/j.proeng.2017.03.091

General rights

It is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), other than for strictly personal, individual use, unless the work is under an open content license (like Creative Commons).

Disclaimer/Complaints regulations

If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please contact the library:

https://www.amsterdamuas.com/library/contact/questions, or send a letter to: University Library (Library of the University of Amsterdam and Amsterdam University of Applied Sciences), Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.

(2)

Procedia Engineering 179 ( 2017 ) 13 – 22 Available online at www.sciencedirect.com

Peer-review under responsibility of the scientific committee of the 4th European STAMP Workshop 2016 doi: 10.1016/j.proeng.2017.03.091

ScienceDirect

WK(XURSHDQ67$03:RUNVKRS

$SSOLFDWLRQRI673$RQ6PDOO'URQH2SHUDWLRQV$%HQFKPDUNLQJ

$SSURDFK

0DULD0LNHOD&KDW]LPLFKDLOLGRX

^D

1HNWDULRV.DUDQLNDV

^E

$QDVWDVLRV3OLRXWVLDV

^F

aImperial College London, Department of Civil & Environmental Engineering, South Kensington Campus, SW7 2AZ, London, UK

bAmsterdam University of Applied Sciences, Faculty of Technology, Weesperzijde 190, Amsterdam, 1097 DZ, the Netherlands

cNational Technical University of Athens, School of Mechanical Engineering, Heroon Polytechniou 9, 15780 Zografou, Athens, Greece

$EVWUDFW

7KHUHPDUNDEOHDQGFRQWLQXRXVJURZWKRIWKHXQPDQQHGDLUFUDIWPDUNHWKDVEURXJKWQHZVDIHW\UHODWHGFKDOOHQJHVDVWKRVHDUH

UHFRUGHG LQ YDULRXV DFFLGHQW DQG LQFLGHQW UHSRUWV $OWKRXJK GURQHV ZLWK DQ RSHUDWLQJ ZHLJKW KLJKHU WKDQ .JV DUH

WHFKQRORJLFDOO\DGYDQFHGDQGRIWHQVXEMHFWWRVWDQGDUGVHJWHFKQLFDOUHOLDELOLW\DLUVSDFHPDQDJHPHQWOLFHQVLQJFHUWLILFDWLRQ

WKHUHJXODWRU\IUDPHZRUNIRUXOWUDOLJKWGURQHVIRFXVHVDOPRVWH[FOXVLYHO\RQWKHOLPLWDWLRQVWKDWWKHRSHUDWRUQHHGVWRFRQVLGHU

7KXV WKH SURWHFWLRQ IURP DFFLGHQWV VHHPV WR UHO\ PRVWO\ RQ WKH FRPSHWHQF\ RI WKH RSHUDWRU WR IO\ D GURQH VDIHO\ DQG KLVKHU

REVHUYDQFHRIWKHUXOHVSXEOLVKHGE\WKHUHVSHFWLYHDXWKRULWLHV,QDGGLWLRQWKHKD]DUGVO\LQJLQWKHLQWHUDFWLRQEHWZHHQDQRSHUDWRU

DQGDVPDOOGURQHKDYHQRWEHHQV\VWHPDWLFDOO\VWXGLHG,QWKLVSDSHUZHSUHVHQWWKHILUVWUHVXOWVIURPD6\VWHP7KHRUHWLF

3URFHVV$QDO\VLV673$EDVHGDSSURDFKWRWKHLGHQWLILFDWLRQRIKD]DUGVDQGVDIHW\UHTXLUHPHQWVLQVPDOOGURQHRSHUDWLRQVDQG

DQ DGDSWDWLRQ RI WKH 5LVN 6LWXDWLRQ $ZDUHQHVV 3URYLVLRQ &DSDELOLW\ 5LVN62$3 PHWKRGRORJ\ LQ RUGHU WR TXDQWLI\ WKH

GLIIHUHQFHVDPRQJVWGURQHPRGHOVUHJDUGLQJWKHH[WHQWWRZKLFKWKH\IXOILOOWKHVDIHW\UHTXLUHPHQWVLGHQWLILHGWKURXJK673$

7KH UHVXOWV VKRZHGWKDW WKH GURQHV VWXGLHG VDWLVI\ WKH VDIHW\ UHTXLUHPHQWV DW ORZ DQG PRGHUDWH OHYHOV DQG WKH\ SUHVHQW KLJK

GLVVLPLODULWLHVEHWZHHQWKHPUHJDUGLQJWKHH[WHQWWRZKLFKWKH\PHHWWKHVDPHVDIHW\UHTXLUHPHQWV)XWXUHZRUNZLOOLQFOXGHD FRPSDULVRQRIDODUJHUVDPSOHRIVPDOOGURQHVDJDLQVWWKHVDIHW\UHTXLUHPHQWVDVZHOODVSDLUZLVHDQGEDVVHVVPHQWRIWKHGHJUHH

WR ZKLFK YDULRXV UHJXODWRU\ IUDPHZRUNV ZRUOGZLGH DGGUHVV WKH VDIHW\ UHTXLUHPHQWV JHQHUDWHG ZLWK 673$ DQG DVVLJQHG WR WKH

DXWKRULW\OHYHO

7KH$XWKRUV3XEOLVKHGE\(OVHYLHU/WG

3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIWKHSURJUDPFRPPLWWHHRI(6:

&RUUHVSRQGLQJDXWKRU7HOID[

(PDLODGGUHVVPFKDW]LPLFKDLOLGRX#LPSHULDODFXN

Peer-review under responsibility of the scientific committee of the 4th European STAMP Workshop 2016

(3)

Keywords:%HQFKPDUNLQJ'LVVLPLODULW\PHDVXUHV'URQHV5LVN62$3PHWKRGRORJ\6DIHW\5HTXLUHPHQWV673$

,QWURGXFWLRQ

7KHFRQWLQXRXVLQFUHDVHRIGURQHV¶SRSXODWLRQ>@KDVEURXJKWQHZVDIHW\FKDOOHQJHV7KHQXPEHUVRIUHVSHFWLYH

UHSRUWVLQFUHDVHVKDUSO\>@DVGURQHVPLJKWIO\QHDUDLUSODQHVDQGKHOLFRSWHUVRUEHRSHUDWHGZLWKRXWSHUPLVVLRQ

FORVHWRDLUSRUWV>@($6$>@KDVGHYHORSHGDGDWDEDVHLQFOXGLQJDFFLGHQWVDQGVHULRXVLQFLGHQWVUHSRUWHGE\DFFLGHQW

LQYHVWLJDWLRQDXWKRULWLHVLQ(XURSH$FFRUGLQJWRWKH53$65HPRWHO\3LORWHG$LUFUDIW6\VWHPVGDWDEDVH>@S

)LJXUHRFFXUUHQFHVZHUHUHSRUWHGLQWKLVQXPEHULQFUHDVHGWRLQZKLOHLQWKHQXPEHURI

RFFXUUHQFHVZDVWKXVDOPRVWWLPHVKLJKHUWKDQWKHSUHYLRXV\HDU

'HVSLWHWKHHVFDODWLRQRIQXPEHUVRIVDIHW\HYHQWVZLWKGURQHVDFOHDUDQGXQLYHUVDOO\DFFHSWHG8QPDQQHG$LUFUDIW

6\VWHPV8$6UHJXODWRU\IUDPHZRUNLVQRW\HWLQSODFHDQGGURQHV\VWHPVDUHFXUUHQWO\PDQDJHGXQGHUGLIIHUHQW

UHJXODWLRQVGHSHQGLQJRQWKHFRXQWU\WKH\DUHIORZQ,Q)HEUXDU\WKH)HGHUDO$YLDWLRQ$GPLQLVWUDWLRQ)$$ SURSRVHGWKH2SHUDWLRQDQG&HUWLILFDWLRQRI6PDOO8$6>@ZKHUHDUHJXODWRU\VWUXFWXUHVLPLODUWRWKHRQHRIPDQQHG

DLUFUDIW ZDV XWLOL]HG LQFOXGLQJ DLUPDQ FHUWLILFDWLRQ UHTXLUHPHQWV ,Q 0DUFK WKH (XURSHDQ $YLDWLRQ 6DIHW\

$JHQF\($6$SXEOLVKHGD7HFKQLFDO2SLQLRQ>@WKDWLQFOXGHVVXJJHVWLRQVIRUORZULVNRSHUDWLRQVRIXQPDQQHG

DLUFUDIWLUUHVSHFWLYHO\RIWKHLUPD[LPXPFHUWLILHGWDNHRIIPDVV7KHSXUSRVHRIWKH7HFKQLFDO2SLQLRQLVWRVHUYHDV

JXLGDQFH IRU (XURSHDQ 8QLRQ (8 0HPEHU 6WDWHV WKDW DUH H[SHFWHG WR GHYHORS RU PRGLI\ WKHLU 8$6 UHODWHG

UHJXODWLRQV+HQFHLWVHHPVWKDWWKHUHJXODWRU\IUDPHZRUNLQWKH(8PLJKWEHFRPHTXLWHGLYHUVHGXHWRWKHIDFWWKDW

WKH LQGLYLGXDO (8 6WDWHV DUH UHVSRQVLEOH IRU WKHLU RZQ DLUVSDFH WKXV WKH HVWDEOLVKPHQW RI D &URVV(XURSHDQ

VWDQGDUGL]DWLRQVHHPVUHPRWHLQWLPH

'DODPDJNLGLVet al.>@XVHGDUHOLDELOLW\DVVHVVPHQWEDVHGRQ)DLOXUH0RGHDQG(IIHFWV$QDO\VLV)0($DQG

)DXOW 7UHH $QDO\VLV )7$ IRU SDUWLFXODU 8$6 PRGHOV DQG WKH\ DFNQRZOHGJHG WKH H[LVWHQFH RI D JDS LQ GDWD

DYDLODELOLW\ZKHQQHZHUV\VWHPVVXFKDVGURQHVPD\KDYHQRWH[KLELWHGIDLOXUHVOHDGLQJWRDFFLGHQWV,QWKHZRUNRI

&ORWKLHUet al.>@DULVNPDQDJHPHQWIUDPHZRUNIRU8$6ZDVSUHVHQWHGIRXQGHGRQWKHQRWLRQWKDWKD]DUGVDQG

FDXVDOIDFWRUVFDQEHGHULYHGIURPPHWKRGVVXFKDV)XQFWLRQDO+D]DUG$QDO\VLV+D]DUGDQG2SHUDELOLW\$QDO\VLV

+$=23 DQG )0($ %\ XVLQJ )7$ DQG '\QDPLF 6LPXODWLRQ .XFKDU >@ SURSRVHG QHZ PHWKRGV IRU HQVXULQJ

FROOLVLRQDYRLGDQFHEHWZHHQ8$6V/HHet al.>@ZHUHDOVRFRQFHUQHGZLWKWKHSUREDELOLVWLFVDIHW\DVVHVVPHQWRI

8$6RSHUDWLRQVE\FDOFXODWLQJFROOLVLRQUDWHVLQKLJKWUDIILFDFWLYLW\,QRUGHUWRLGHQWLI\YDULRXVZD\VLQZKLFKKXPDQ

IDFWRUVFRQWULEXWHGWRWKHORVVRIDKHDY\8$6IORZQIRUPLOLWDU\SXUSRVHV-RKQVRQ>@XVHGWKH(YHQWVDQG&DXVDO

)DFWRUVDFFLGHQWDQDO\VLVWHFKQLTXHDQG/RKet al.>@SRLQWHGRXWWKHQHHGIRU8$6GHYHORSHUVWRFRQVLGHUWKHVDIHW\

FHUWLILFDWLRQIRURSHUDWLRQVLQWKH86QDWLRQDODLUVSDFH

7DNLQJLQWRDFFRXQWWKHLQGLFDWLYHUHIHUHQFHVDERYHWKHDYLDWLRQFRPPXQLW\IDFHVWZRFKDOOHQJHVDFRPPRQ

UHJXODWRU\ IUDPHZRUN IRU 8$6 HVSHFLDOO\ IRU OLJKW GURQHV LV PLVVLQJ DQG OLQHDU DSSURDFKHV JURXQGHG RQ

UHGXFWLRQLVP VHHP WR SUHYDLO ZLWKRXW DGHTXDWHO\ DGGUHVVLQJ WKH FRPSOH[LW\ RI GURQH IOLJKWV $Q RSHUDWRU FHQWULF

DSSURDFK KDV UHVXOWHG WR WKH SXEOLFDWLRQ RI GLUHFWLYHV DQG UHJXODWLRQV WKDW IRFXV KHDYLO\ RQ WKH GURQH RSHUDWRU

RWKHUZLVHFDOOHGDV³HQGXVHU´ZLWKRXWVHYHUDODXWKRULWLHVKDYLQJ\HWFRPSOHWHO\DGGUHVVHGUHTXLUHPHQWVIRUVPDOO

GURQHV¶GHVLJQDQGFHUWLILFDWLRQRUWKHLURZQUHVSRQVLELOLWLHV>HJ@

$LPLQJWRDGGUHVVWKHWZRDERYHPHQWLRQHGFKDOOHQJHVDORQJZLWKWKHFRQWLQXRXVDGYDQFHPHQWVLQVPDOOGURQH

WHFKQRORJ\DQGFDSDELOLWLHVWKHDXWKRUVKDYHEHHQGHYHORSLQJDQ673$EDVHGDSSURDFKWRLGHQWLI\KD]DUGVDQGVDIHW\

UHTXLUHPHQWV 65V IRU VPDOOGURQH RSHUDWLRQV $Q DQDO\VLV RI D W\SLFDO GURQH ± RSHUDWRU V\VWHP ZLWK 673$ >@

SURYLGHGDOLVWRIKD]DUGVDQGFDXVDOIDFWRUVWKDWPLJKWOHDGWRXQZDQWHGHYHQWV7KH65VSURGXFHGZLWK673$ZHUH

IXUWKHUDVVLJQHGWRWKHDXWKRULW\PDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQOHYHOV$OVRWKHDXWKRUVFRPSDUHGKLJKO\

PDUNHWHGPRGHOVDJDLQVWWKH65VJHQHUDWHGZLWK673$E\DGDSWLQJWKH5LVN62$3PHWKRGRORJ\>@5LVN62$3ZDV

FRQVLGHUHG DV WKH SURSHU PHWKRGRORJ\ EHFDXVH LW LV DQ 673$EDVHG PHWKRGRORJ\ DQG SURYLGHV D PHDQV RI

TXDQWLILFDWLRQZLWKWKHXVHRI5RJHUV7DQLPRWRGLVVLPLODULW\PHDVXUH>@7KHPRGHOVZHUHDOVRFRPSDUHGWRHDFK

RWKHU

(4)

15 Maria Mikela Chatzimichailidou et al. / Procedia Engineering 179 ( 2017 ) 13 – 22

0HWKRGRORJ\

7KHIROORZLQJDVVXPSWLRQVZHUHPDGHDVDPHDQVWRGHILQHWKHV\VWHPXQGHUH[DPLQDWLRQDQGWKHUHVHDUFKVFRSH

x 7KHGURQHV\VWHPLVQRWVXEMHFWWRFLYLODYLDWLRQUHTXLUHPHQWVLHGURQHRSHUDWLQJZHLJKWOHVVWKDQ.JIRUWKH

86DQG.JIRUWKH(8DFFRUGLQJWRFXUUHQWUHJXODWLRQVDQGRUOHJLVODWLRQ

x 7KH JHQHULF GURQH V\VWHPFRQVLVWV RI D UHPRWH FRQWUROOHU WKH GURQH DQG D GLVSOD\ 7KH GLVSOD\ LV XVHG IRU

PRQLWRULQJ WHOHPHWU\ GDWD DQG PLJKW RU QRW EH SDUW RI WKH UHPRWH FRQWUROOHU HJ VRIWZDUH DSSOLFDWLRQ LQ D

VPDUWSKRQH

x 7KHGURQHLVDURWDU\DLUFUDIWWKXVLVQRWVXEMHFWWRDHURG\QDPLFOLPLWDWLRQV

x 0LVVLRQORVVHVGXHWRIDFWRUVRWKHUWKDQGHJUDGHGVDIHW\ZHUHQRWDGGUHVVHG

x &ROOLVLRQVZLWKIO\LQJIDXQDZHUHQRWFRQVLGHUHG

x 7KHGURQHV\VWHPZDVDQDO\]HGGRZQWRWKHOHYHORILQWHUDFWLRQEHWZHHQWKHRSHUDWRUDQGWKHGURQHVHH)LJ

+RZHYHUVRPHLPSOLFDWLRQVIRUWKHKLJKHUKLHUDUFKLFDOOHYHOVVHH)LJZHUHDOVRGUDZQ)XUWKHUGHFRPSRVLWLRQ

HJDUFKLWHFWXUHDQGOLQNVRIVRIWZDUHDQGKDUGZDUHVXEV\VWHPVZDVRXWRIWKHVFRSHRIWKLVVWXG\

7KHKHUHLQSURSRVHGDSSURDFKLVEDVHGRQDQDGDSWDWLRQRIWKH5LVN62$3PHWKRGRORJ\>@^ÁFRQVLVWVRINH\

VWDJHVDQGVWHSVDVVKRZQLQ7DEOHDQGH[SODLQHGIXUWKHULQWKLVVHFWLRQ

GHILQHWKHEHQFKPDUNLQJV\VWHPE\XWLOL]LQJ673$,QWKLVVWXG\WKHEHQFKPDUNLQJUHIHUHQFHLVWKHOLVWRIWKH

UHTXLUHPHQWVGHULYHGWKURXJK673$IRUDJHQHULFOLJKWZHLJKWGURQHV\VWHP

PDSWKHRULJLQDOHOHPHQWVLH65VPHWE\HDFKGURQHWRWKHEHQFKPDUNLQJV\VWHP

HPSOR\ WKH 5RJHUV7DQLPRWR GLVVLPLODULW\ PHDVXUH IRU ELQDU\ GDWD RU RWKHU FRPSDUDWLYH WRROV LQ RUGHU WR

GHSLFWWKHGLVWDQFHEHWZHHQWKH³LGHDO´LH673$EDVHGDQG³UHDO´V\VWHPVLHGURQHVXQGHUVWXG\

XVHWKHDIRUHPHQWLRQHGGLVVLPLODULW\PHDVXUHWRFDOFXODWHWKHGLIIHUHQFHVDPRQJVWWKHGURQHVSDLUZLVH

7DEOH7KH5LVN62$3EDVHGEHQFKPDUNLQJDSSURDFK

7KHVWHSVRIWKHPHWKRGRORJ\

$SSO\WKH673$KD]DUGDQDO\VLVWRDJHQHULFVPDOOGURQHV\VWHP

&RQWHPSODWHWKH673$GHULYHGVDIHW\UHTXLUHPHQWVDVWKHEHQFKPDUNLQJUHIHUHQFH

3HUIRUPDJDSDQDO\VLVEHWZHHQWKHEHQFKPDUNLQJ³LGHDO´V\VWHPDQGWKH³UHDO´GURQHPRGHOVVHOHFWHG

$VVLJQ³´RU³´YDOXHVGHSHQGLQJRQZKHWKHUDVDIHW\UHTXLUHPHQWLVPHWE\WKHGURQHPRGHOVRUQRWFRUUHVSRQGLQJO\

&DOFXODWHWKHYDOXHRIWKH5RJHUV7DQLPRWRGLVVLPLODULW\PHDVXUHIRUWKHEHQFKPDUNLQJUHIHUHQFHZLWKHDFKGURQHPRGHOIRUWKH

PDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQOHYHOV Æ&DVH$

&DOFXODWHWKHYDOXHRIWKH5RJHUV7DQLPRWRGLVVLPLODULW\PHDVXUHIRUGURQHSDLUVHJ0RGHO±0RGHOHWF Æ&DVH%

,QWHUSUHWWKHUHVXOWVRI6WHSVDQG

6WHS

$OWKRXJKWKHDQDO\VLVZDVGRQHIRUWKHWZRORZHUOHYHOVRIWKHKLHUDUFKLFDOFRQWUROVWUXFWXUHRIDJHQHULFGURQH

V\VWHPVHH)LJV\VWHPPDUNHGZLWKUHGGDVKHGOLQH673$DOVROHGWRWKHIRUPXODWLRQRI65VIRURWKHUV\VWHP

FRQWUROOHUVLHDXWKRULW\DQGPDQXIDFWXUHU,QUHIHUHQFHWR)LJWKHGDVKHGDUURZVLQGLFDWHWKDWWKHRSHUDWRULVQRW

DOZD\VRUQHFHVVDULO\VXSSRUWHGE\DXWRPDWHGIXQFWLRQV7KHDXWKRUV]RRPHGLQWRWKHKLHUDUFKLFDOFRQWUROVWUXFWXUH

RI)LJDQGSHUIRUPHGWKH673$DQDO\VLVIRUWKHVDIHW\FRQWUROVWUXFWXUHRI)LJ7KHSUHOLPLQDU\VWHSVRI673$

DUHJLYHQLQ7DEOH

'URQHPRGHOVPD\GLIIHULQWKHLUGHVLJQDQGIXQFWLRQDOXQLWV

Á'XHWRWKHVFRSHRIWKLVZRUNWKHUHLVRQH5LVN62$3VWHSPLVVLQJIURP7DEOHVHH&RQFOXVLRQ$OOVHYHQVWHSVOLVWHGLQ

7DEOHDUHVWHSVRIWKH5LVN62$3PHWKRGRORJ\

(5)

1H[W WKH DXWKRUV LGHQWLILHG WKH8QVDIH &RQWURO $FWLRQV 8&$V LH 673$ 6WHS DQG WKH FDXVDOIDFWRUV LH

673$6WHSDVZHOODVWKH65V%RWK673$VWHSVZHUHSHUIRUPHGLWHUDWLYHO\DQGSHHUUHYLHZHGE\WKHUHVHDUFKHUV

LQGHSHQGHQWO\ LQ RUGHU WR HQVXUH WKH TXDOLW\ DQG UREXVWQHVV RI WKH UHVXOWV E\ HIIHFWLYHO\ FRPELQLQJ WHFKQLFDO

NQRZOHGJHLQDYLDWLRQDQGH[SHULHQFHLQWKHDSSOLFDWLRQRIWKHPHWKRG

$OWKRXJK673$6WHSLVW\SLFDOO\IROORZHGE\WKHGHYHORSPHQWRIVFHQDULRVWKDWLQFOXGHFRPELQDWLRQVRIPXOWLSOH

FRQGLWLRQVZKHUHFRQWURODFWLRQVPLJKWEHSURYHQKD]DUGRXVRULQHIIHFWLYHLWZDVQRWLQWKHVFRSHRIWKLVVWXG\WR

SHUIRUPWKLVVXEVWHSZKLFKLVUHTXLUHGGXULQJWKHFHUWLILFDWLRQRIV\VWHPV

)LJ+LJKOHYHOKLHUDUFKLFDOFRQWUROVWUXFWXUH

7DEOH3UHOLPLQDU\VWHSVRI673$

$FFLGHQW,QMXULHVRUSURSHUW\GDPDJHUHVXOWLQJIURPWKHRSHUDWLRQRIGURQH

+LJKOHYHOKD]DUGV +LJKV\VWHPOHYHOVDIHW\

UHTXLUHPHQWV

>+@8QVDIHVHSDUDWLRQIURPWHUUDLQREMHFWVRQJURXQGGXULQJFRQWUROOHGIOLJKW >65@'URQHVKRXOGPDLQWDLQD

VDIHVHSDUDWLRQIURP

WHUUDLQREMHFWVRQJURXQG

>+@8QFRQWUROOHGIOLJKWRYHUFRQJHVWHGDUHD >65@'URQHVKRXOGEHXQGHU

FRQWUROOHGIOLJKW

>+@8QVDIHVHSDUDWLRQIURPRWKHUIO\LQJREMHFWVGXULQJFRQWUROOHGIOLJKW >65@'URQHVKRXOGPDLQWDLQD

VDIHVHSDUDWLRQIURPRWKHU

SRZHUHGIO\LQJREMHFWV

(6)

)LJ6DIHW\FRQWUROVWUXFWXUHIRUDJHQHULFVPDOOGURQHV\VWHP

6WHS

7KHDQDO\VLVRIWKHGURQH±RSHUDWRUV\VWHPOHGWRUHTXLUHPHQWVDFURVVDOOPDLQV\VWHPFRQWUROOHUVWKXVWKH673$

65VZHUHJURXSHGLQWRIRXUFDWHJRULHVHDFKRQHFRUUHVSRQGLQJWRHDFKRIWKHFRQWUROOHUVRIWKHODUJHUV\VWHPXQGHU

VWXG\DXWKRULW\PDQXIDFWXUHURSHUDWRUDQGGURQHDXWRPDWLRQ

6WHS

)RXU GURQH PRGHOV ZHUH VHOHFWHG EDVHG RQ WKH DYDLODELOLW\ RI GHWDLOHG PDQXDOV RQ WKH LQWHUQHW DQG WKHLU VDOH

YROXPHV$JDSDQDO\VLVEHWZHHQWKHOLVWRIWKH65VGHULYHGZLWK673$DQGWKHVSHFLILFDWLRQVRIWKHVPDOOGURQH

PRGHOVZDVSHUIRUPHGIRUWKHPDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQ7KHFRQVLGHUDWLRQRIWKHDXWKRULW\OHYHOZDV

RXWRIWKHVFRSHRIWKLVVWXG\

6WHS

$ELQDU\UHSUHVHQWDWLRQLHRIWKHUHTXLUHPHQWVWKDWWKHVPDOOGURQHVPHWRUQRWVHUYHGDVDILUVWLQGLFDWLRQ

RIWKHH[WHQWWRZKLFKWKRVHGURQHVHPEHGGHGVDIHW\³E\GHVLJQ´7RWUDQVODWHWKH65VIURPWH[WXDOWHUPVLQWRELQDU\

GDWDDVLPSOHUXOHZDVXVHGWKH³´YDOXHH[SUHVVHGWKHDEVHQFHDQGWKH³´YDOXHWKHSUHVHQFHRIDQ65)LJLVD

VFUHHQVKRW RI WKH ELQDU\ GDWD FUHDWHG IRU DOO GURQH PRGHOV DQG WKH EHQFKPDUNLQJ EDVLV ³>0@´ LQGLFDWHV WKH

PDQXIDFWXUHU ³>2@´ WKH RSHUDWRU ³>$@´ WKH DXWRPDWLRQ ³>0@´ ³>0@´ ³>0@´ ³>0@´ DUH WKH VHOHFWHG DQG

FRPSDUHGPRGHOV

(7)

)LJ6FUHHQVKRWRIWKHELQDU\GDWDUHSUHVHQWLQJSUHVHQWDEVHQWVDIHW\UHTXLUHPHQWV

6WHS&DVH$

'LVVLPLODULW\PHDVXUHPHQWVZHUHFRQGXFWHGDPRQJVWWKHEHQFKPDUNLQJPRGHOGHILQHGZLWK673$DQGWKHGURQHV

DFURVVWKHPDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQOHYHOV7KHFRPSDULVRQVZHUHPDGHSDLUZLVHE\XVLQJWKHELQDU\

GDWDRI6WHSDERYHWKDWLV%HQFKPDUN>0@%HQFKPDUN>0@HWF7KHDLPZDVWRUHYHDOWKHH[WHQWWRZKLFK

WKHGURQHVPHWWKH65VDFFRUGLQJWRWKH673$EHQFKPDUNLQJEDVLV7KHFRPSDULVRQZDVSHUIRUPHGE\XVLQJWKH

5RJHUV7DQLPRWRGLVVLPLODULW\PHDVXUHZKLFKZDVWKHSUHIHUUHGELQDU\GLVVLPLODULW\PHDVXUHPDLQO\EHFDXVHLWJLYHV

ZHLJKWWRWKHGLVVLPLODULWLHVEHWZHHQWKHFRPSDUHGYHFWRUVLHLGHDODQGUHDOV\VWHPVE\PXOWLSO\LQJWKHPE\WZR

,WLVDQRUPDOL]HGGLVVLPLODULW\PHDVXUHZLWKDPLQLPXPGLVVLPLODULW\RI³´LHH[DFWO\VLPLODUV\VWHPVDQGD

PD[LPXPGLVVLPLODULW\RI³´LHWKHYHFWRUVDUHFRPSOHWHO\GLVVLPLODU7KHHTXDWLRQLVJLYHQEHORZ

S S S S

S r S

i

RTd

7KHWHUPV³ܵͲͲ´³ܵͲͳ´³ܵͳͲ´DQG³ܵͳͳ´RI(TGHQRWHWKHWRWDOQXPEHURIWKHFRUUHVSRQGLQJ

DQGSDLUVRIELQDU\LQWHJHUVRIWKHWZRFRPSDUHGHDFKWLPHYHFWRUV7KHYHFWRUVXQGHUFRPSDULVRQVKDOO

KDYHWKHVDPHQXPEHURIURZVEHFDXVHWKHUHLVDRQHWRRQHUHODWLRQVKLSEHWZHHQWKHELQDU\LQWHJHUV

6WHS&DVH%

'LVVLPLODULW\ PHDVXUHPHQWV ZHUH DOVR FRQGXFWHG DPRQJVW WKH GURQHV IRU DOO WKUHH V\VWHP FRQWUROOHUV LH

PDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQ7KHDLPZDVWRUHYHDOWKHH[WHQWWRZKLFKWKRVHGURQHPRGHOVIXOILOOHGWKH

VDPH65V

(8)

5HVXOWV

7KHDSSOLFDWLRQRI673$6WHSUHVXOWHGWR8&$VDQGFDXVDOIDFWRUVZHUHLGHQWLILHGWKURXJK673$6WHS

,QWRWDO65VZHUHREWDLQHGE\673$RQHRIZKLFKZDVDVVLJQHGH[FOXVLYHO\WRWKHDXWKRULW\OHYHODQGZDVQRW

FRQVLGHUHGLQWKHGLVVLPLODULW\FDOFXODWLRQV7KHOLVWVRI8&$VFDXVDOIDFWRUVDQG65VVHHURZVLQ)LJDUHQRW

UHSRUWHGLQWKLVSDSHUGXHWRVSDFHOLPLWDWLRQVEXWDUHDYDLODEOHWRWKHUHDGHUXSRQUHTXHVWWRWKHFRUUHVSRQGLQJDXWKRU

WKRVHOLVWVZLOOEHLQFOXGHGLQDMRXUQDOSDSHUZKLFKLVDOUHDG\XQGHUUHYLHZ7KH65VZHUHWUDQVODWHGLQWRELQDU\

GDWDDQGWKHQDJDSDQDO\VLVZDVSHUIRUPHG7KHELQDU\OLNHUHVXOWVDUHGHSLFWHGLQ7DEOH7KHWHUPV³ܵͲͲ´³ܵͲͳ´

DUHQRWVKRZQLQ7DEOHEHFDXVHWKHEHQFKPDUNLQJV\VWHPIXOILOVDOOUHTXLUHPHQWVE\GHIDXOW%DVHGRQWKHYDOXHVRI

7DEOH WKH YDOXHV RI WKH 5RJHUV7DQLPRWR GLVVLPLODULW\ PHWULF ZHUH FDOFXODWHG 7DEOH 7KRVH UHIHU WR WKH

EHQFKPDUNLQJPRGHOVFRPSDULVRQ&DVH$$FFRUGLQJWRWKHUHVXOWV

x )URPERWK7DEOHVHH³'LVVLPLODULWLHV´DQG^VWURZRI7DEOHLWLVDSSDUHQWWKDWDWDOOOHYHOVRIFRQWUROOHUV>0@

IXOILOVWKHOHDVWRIWKH673$65VLQFRPSDULVRQZLWKWKHUHVWPRGHOV

x 7DEOHLQGLFDWHVWKDWDWDPDQXIDFWXUHUDQGDXWRPDWLRQOHYHO>0@DQG>0@SHUIRUPWKHVDPHDQG\LHOGWKHEHVW

FRUUHVSRQGLQJYDOXHV

x 7KHPDQXIDFWXUHUDQGDXWRPDWLRQOHYHOVFRQFHUQHG>0@VFRUHVORZHUWKDQ>0@DQG>0@EXWEHWWHUWKDQ>0@

x >0@VDWLVILHVPRVWRIWKHUHTXLUHPHQWVIRUWKHRSHUDWRUIROORZHGE\PRGHOV>0@>0@DQG>0@LQDVFHQGLQJ

RUGHURIGLVVLPLODULWLHV

7DEOH7KHYDOXHVRIWKH5RJHUV7DQLPRWRWHUPVSHUGURQHPRGHOSHUFRQWUROOHU

'URQHPRGHOV 5RJHUV7DQLPRWRWHUPV 0DQXIDFWXUHU 2SHUDWRU $XWRPDWLRQ

>0@ 6LPLODULWLHV6

'LVVLPLODULWLHV6

>0@ 6LPLODULWLHV6

'LVVLPLODULWLHV6

>0@ 6LPLODULWLHV6

'LVVLPLODULWLHV6

>0@ 6LPLODULWLHV6

'LVVLPLODULWLHV6

7RWDOVDIHW\UHTXLUHPHQWVSHUFRQWUROOHU

7DEOH7RWDOUHVXOWV&DVH$GLVVLPLODULWLHVEHWZHHQEHQFKPDUNLQJV\VWHPDQGGURQHPRGHOV

'URQHPRGHOV 0DQXIDFWXUHU 2SHUDWRU $XWRPDWLRQ

>0@

7DEOHSUHVHQWVWKHGLVVLPLODULWLHVEHWZHHQWKHGURQHPRGHOVZLWKRXWWDNLQJLQWRDFFRXQWWKHEHQFKPDUNLQJ

V\VWHP7KRVHGLVVLPLODULWLHVDUHFDWHJRUL]HGRQWKHEDVLVRIV\VWHPFRQWUROOHUVLHD0DQXIDFWXUHUE2SHUDWRU

F$XWRPDWLRQ,Q&DVH%WKHUHZDVQRLQWHUPHGLDWHXQLWIRUFRPSDULVRQLHEHQFKPDUNLQJUHIHUHQFHEXWWKH

GURQHPRGHOVDUHFRPSDUHGWRHDFKRWKHUGLUHFWO\$FFRUGLQJWR7DEOHWKHUHVXOWVVKRZHGWKDW

(9)

x 7KH KLJKHVW GLVVLPLODULWLHV DUH REVHUYHG EHWZHHQ >0@ >0@ DQG >0@ >0@ DW WKH OHYHO RI DXWRPDWLRQ

3UDFWLFDOO\WKLVPHDQVWKDWRQHGURQHPRGHOVXSSRUWVWKHPDLQWHQDQFHRIVDIHW\FRQWUROVWKURXJKDXWRPDWLRQUDWKHU

WKDQUHO\LQJYDVWO\RQWKHKXPDQRSHUDWRU

x $KLJKGLVVLPLODULW\LVDOVRDSSDUHQWEHWZHHQ>0@DQG>0@DWWKHPDQXIDFWXUHUDQGRSHUDWRUOHYHOV

x 0RGHOV>0@DQG>0@EHDUJUHDWUHVHPEODQFHWRHDFKRWKHUDFURVVDOOOHYHOVRIFRQWUROOHUV7KH\DUHDOVRSURGXFHG

E\WKHVDPHPDQXIDFWXUHUZKLFKFDQH[SODLQWKHLULQEHWZHHQORZGLVVLPLODULW\

x 2YHUDOO>0@KDVWKHKLJKHVWGLVVLPLODULWLHVWRWKHRWKHUPRGHOVZKLFKLQGLFDWHVWKDW>0@QRWRQO\PHHWVWKHOHDVW

65VLH&DVH$DERYHEXWWKRVHDUHKLJKO\GLIIHUHQWFRPSDUHGWRWKHRWKHUGURQHPRGHOV

7DEOH7RWDOUHVXOWV&DVH%SDLUZLVHGLVVLPLODULWLHVEHWZHHQDOOGURQHPRGHOVIRUDWKHPDQXIDFWXUHUEWKHRSHUDWRUDQGWKHF DXWRPDWLRQ

&RQWUROOHU

'URQHPRGHOV

D0DQXIDFWXUHU E2SHUDWRU F$XWRPDWLRQ

>0@ >0@ >0@ >0@ >0@ >0@ >0@ >0@ >0@ >0@ >0@ >0@

>0@       

>0@

'LVFXVVLRQ

7KH673$KD]DUGDQDO\VLVIROORZHGLQWKLVZRUNOHGV\VWHPDWLFDOO\WRWKHLGHQWLILFDWLRQRIKD]DUGRXVVWDWHVDQG

FDXVDOIDFWRUVDVVRFLDWHGZLWKKLJKOHYHOVDIHW\KD]DUGVLQWKHRSHUDWLRQRIDW\SLFDOVPDOOGURQHV\VWHPDQG

GURYH WKH JHQHUDWLRQ RI 65V 7KRVH UHTXLUHPHQWV ZHUH DVVLJQHG WR WKH PDLQ V\VWHP FRQWUROOHUV LH DXWKRULW\

PDQXIDFWXUHURSHUDWRUDQGGURQHDXWRPDWLRQDQGZHUHXVHGDVDEHQFKPDUNLQJEDVLVWRDVVHVVWKHVDIHW\³HPEHGGHG´

LQVPDOOGURQHPRGHOVRIWKHFXUUHQWPDUNHW7KHUHTXLUHPHQWVSURSRVHGLQWKLVVWXG\FRYHUDUDQJHRIKD]DUGVDQG

FDXVDOIDFWRUVQRW\HWH[SOLFLWO\QRUKROLVWLFDOO\DGGUHVVHGLQSXEOLVKHGULVNDQDO\VHVDQGUHJXODWLRQV

7KH SURSRVHG EHQFKPDUNLQJ DSSURDFK ZDV DQ DGDSWDWLRQ RI WKH 5LVN62$3 PHWKRGRORJ\ >@ ZKLFK RIIHUV D

TXDQWLILFDWLRQ RI WKH GHJUHH WR ZKLFK WKH GURQH V\VWHP PHHWV WKH 65V GHULYHG IURP 673$ 7KH DYDLODEOH

GRFXPHQWDWLRQIRUGURQHPRGHOVDOORZHGIRUWKHDVVHVVPHQWRIDOOWKH673$GHULYHG65VDQGWKHDQDO\VLVIROORZHG

ZDVVXIILFLHQWO\FRPSUHKHQVLYHWRPHDVXUHGLVVLPLODULWLHV7KHRQO\SUHUHTXLVLWHRIWKLVPHWKRGLVWRKDYHWZRV\VWHPV

VRDVWRFRPSDUHWKHPZLWKHDFKRWKHU,Q&DVH$WKHRQHXQLWXQGHUFRPSDULVRQLVDOZD\VWKHEHQFKPDUNLQJV\VWHP

GHWHUPLQHGE\WKH673$KD]DUGDQDO\VLVDQGGHSLFWLQJWKH³LGHDO´V\VWHPZKLOHWKHRWKHULVDQH[LVWLQJGURQHV\VWHP

,Q&DVH%ERWKXQLWVUHSUHVHQWUHDOGURQHV\VWHPVZLWKLGHQWLILHGJDSVUHJDUGLQJWKH65VWKH\LQFRUSRUDWHEDVHGRQ

WKHVSHFLILFDWLRQVGRFXPHQWHGLQWKHLUSXEOLVKHGPDQXDOV$OVRLWLVXVHIXOWREHPHQWLRQHGWKDWLQVWHDGRIWKH5RJHUV

7DQLPRWRPHDVXUHWKHDQDO\VWPD\FKRRVHDQRWKHUGLVVLPLODULW\PHDVXUHGHSHQGLQJRQWKHH[DPLQHGFDVHWKDWLV

V\VWHPSDUWLFXODULWLHVEHKDYLRUDQGDWWULEXWHVSUREOHPVWDWHPHQWDQGIRFXVRILQWHUHVW

,QWKLVZRUNWKHDXWKRUVFKRVHGURQHPRGHOVLQRUGHUWRGHPRQVWUDWHKRZDEHQFKPDUNLQJDSSURDFKPLJKWZRUN

DQGZKDWFRQFOXVLRQVFDQEHGUDZQIURPWKHDGRSWLRQRIGLVVLPLODULW\PHDVXUHVLQWHUPVRIGURQHVDIHW\%DVHGRQ

WKHFDVHV$ %WKHDQDO\VLVRIWKHVPDOOGURQHVGLGQRWRQO\VKRZWKDWWKH\FRYHUWKH673$65VDWORZWRPRGHUDWH

OHYHO EXW DOVR LQGLFDWHG KLJK GLVVLPLODULWLHV UHJDUGLQJ WKH H[WHQW WR ZKLFK WKRVH GURQHV PHW WKH VDPH 65V DW WKH

PDQXIDFWXUHURSHUDWRUDQGDXWRPDWLRQOHYHOV

,WLVDOVRQRWHGWKDWWKHDSSURDFKSURSRVHGLQWKLVSDSHUGLIIHUVIURPWKH6\VWHPV7KHRUHWLF(DUO\&RQFHSW$QDO\VLV

67(&$>@ZKLFKLVDFRQFHSWDQDO\VLVEHLQJSHUIRUPHGLQWKHLQWHUYDOEHWZHHQWKHFRQFHSWXDOL]DWLRQDQGWKH

UHTXLUHPHQWV RI D V\VWHP 7KH FKDOOHQJHV WKDW 67(&$ GHDOV ZLWK DUH OLPLWHG GHVLJQ LQIRUPDWLRQ DEVHQFH RI

VSHFLILFDWLRQVLQIRUPDOGRFXPHQWDWLRQDQGFRQFHSWRIRSHUDWLRQV>@3UDFWLFDOO\ZKHQDSSO\LQJ67(&$WKHDQDO\VW

LVEDVHGRQDQDUUDWLYHRUWH[WXDOGHVFULSWLRQRIWKHV\VWHPXQGHUGHYHORSPHQW1HYHUWKHOHVVRXUDSSURDFKLVORFDOL]HG

(10)

ODWHULQWKHOLIHF\FOHZKHQWKHV\VWHPLVDOUHDG\GHVLJQHGDQGRSHUDWHGVWLOOEHLQJVXEMHFWWRPRGLILFDWLRQVWKRXJK

,QWKLVSKDVHXVHULHRSHUDWRUPDQXDOVDQGGHVLJQVSHFLILFDWLRQVDUHDOUHDG\DYDLODEOH7KHUHIRUHWKHSURSRVHG

EHQFKPDUNLQJDSSURDFKUHJDUGVV\VWHPVWKDWDOUHDG\H[LVWWKHFRQWUROOHUVWKHDFWXDWRUVDQGWKHVHQVRUVDUHNQRZQ

DFWRUVDQGWKHLUUHVSRQVLELOLWLHVDUHDOUHDG\GHILQHGRUDWOHDVWWRDQH[WHQW7KHGURQHPRGHOVIRULQVWDQFHDUH

DOUHDG\EXLOWDQGWKHVDIHW\FRQWUROVWUXFWXUHIRUDJHQHULFVPDOOGURQHV\VWHPZDVGHULYHGDIWHUUHDGLQJVHYHUDOXVHU

PDQXDOVH[SODLQLQJKRZWKRVHV\VWHPVDFWXDOO\ZRUN

&RQFOXVLRQ

7KHH[LVWLQJRUVWLOOXQGHUILQDOL]DWLRQUHJXODWRU\IUDPHZRUNIRUVPDOOGURQHVLVTXLWHGLYHUVHDQGIRFXVHVDOPRVW

H[FOXVLYHO\RQWKHOLPLWDWLRQVWKDWWKHRSHUDWRUQHHGVWRFRQVLGHU7RGDWHSXEOLVKHGULVNDVVHVVPHQWVIRU8$6DUH

EDVHGPDLQO\RQGDWDFROOHFWHGIURPPDQQHGDLUFUDIWDQGQRWRQDV\VWHPDWLFKD]DUGDQDO\VHVIRUVPDOOGURQHVRSHUDWHG

LQXQFRQWUROOHGDLUVSDFHV$OWKRXJKWKHUHLVVRPHUHVHDUFKRQ8$6VDIHW\WKLVLVPDLQO\EDVHGRQVWDWLVWLFDODQDO\VLV

DQGVSHFLILFDFFLGHQWVFHQDULRVRU8$6PRGHOVZKLOHDWWKHVDPHWLPHLWLVQRWFOHDUZKHWKHUWKHUHLVDVWUXFWXUHG

KD]DUG DQDO\VLV EHKLQG WKRVH VWXGLHV 7KHUHIRUH D UHJXODWRU\ IUDPHZRUN ZKLFK LV JURXQGHG RQ D V\VWHPDWLF DQG

V\VWHPZLGHULVNDQDO\VLVLV\HWPLVVLQJ

,QWKLVVWXG\ZHVKRZHGWKDWWKH673$DQDO\VLVSURYLGHVWKHDQDO\VWWKHDELOLW\WRUHDFKWRFRQFUHWHUHVXOWVLQD

VWUXFWXUHGDQGV\VWHPDWLFPDQQHU,WLVH[SHFWHGWKDWWKHUHVXOWVRIWKH673$DQDO\VLVZKLFKZDVQRWIXOO\SUHVHQWHG

KHUH GXH WR VSDFH UHVWULFWLRQV FDQ FRPSULVH D VWDUWLQJ SRLQW WR PRYH WRZDUGV WKH GHYHORSPHQW RI D KROLVWLF DQG

PHWKRGRORJLFDOO\ MXVWLILHG VWDQGDUGL]DWLRQ VFKHPH IRU VPDOOGURQH IOLJKWV 2Q RQH KDQG WKH GLVVLPLODULW\ DQDO\VLV

SHUIRUPHGKHUHLQEHWZHHQWKHEHQFKPDUNLQJUHIHUHQFHDQGWKHGURQHPRGHOVPLJKWIXQFWLRQDVDPHWKRGWRHYDOXDWH

³HPEHGGHG´VDIHW\DQGLPSURYHWKHODWWHULQH[LVWLQJGURQHV\VWHPVRYHUWLPH7KHFRPSDULVRQEHWZHHQWKHPRGHOV

RQWKHRWKHUKDQGFDQEHXVHGDVDSUDFWLFDOLQGLFDWRUIRUPHDVXULQJWKHH[WHQWWRZKLFKGURQHPRGHOVRIIHUWKHVDPH

FRQWUROVRYHUVDIHW\FRQVWUDLQWV

$IXWXUHUHVHDUFKVWHSPLJKWEHWKHDSSOLFDWLRQRIWKHFRPSOHWH5LVN62$3PHWKRGRORJ\WKDWLVHPSOR\PHQWRI

WKH (:D6$3 >@ HDUO\ ZDUQLQJ VLJQ LGHQWLILFDWLRQ DSSURDFK ,Q WKLV ZD\ WKH DQDO\VW ZLOO GHILQH WKH VHQVRU

FKDUDFWHULVWLFVDQGLQWXUQHPEHGWKHDSSURSULDWHVHQVRUVWKDWHQKDQFHWKHDZDUHQHVVRIWKHUHJXODWRU±RSHUDWRU±

GURQH V\VWHP RYHU WKH WKUHDWV DQG YXOQHUDELOLWLHV WKDW VXUURXQG WKHP DQG PD\ SXW WKH RYHUDOO V\VWHP XQGHU ULVN

)XUWKHUPRUHIXWXUHLPSURYHPHQWVLQVHQVRUWHFKQRORJ\PD\DOORZWKHLULQWHJUDWLRQLQWRGURQHVZLWKRXWLQFUHDVLQJ

WKHLU ZHLJKW VLJQLILFDQWO\ RU JHQHUDWLQJ PDMRU VDIHW\ LVVXHV WKDW FDOO IRU IXUWKHU H[DPLQDWLRQ HJ WKH SRWHQWLDO

RYHUZKHOPLQJ RI WKH RSHUDWRU ZLWK QXPHURXV IHHGEDFNV IURP WKH V\VWHP DQG KLVKHU FRQIXVLRQ LQ SULRULWL]LQJ WKH

PDLQWHQDQFHRIVDIHW\FRQWUROVZKHQPXOWLSOHVDIHW\FRQVWUDLQWVDUHYLRODWHGDWWKHVDPHWLPH>@

,QLWVFXUUHQWIRUP5LVN62$3LVELQDU\EDVHGDOWKRXJK65VFDQEHIXOILOOHGWRVRPHGHJUHHWKDWLVYDULDEOHVPD\

KDYHDYDOXHEHWZHHQ³´DQG³´)RUWKDWUHDVRQIXWXUHZRUNLVLQWHQGHGWRLQYROYHIX]]\ORJLFWRFRSHZLWKFULVS

YDULDEOHVDQGDGRSWFRQWLQXRXVYDULDEOHVLQVWHDG7KHDVVLJQPHQWRIZHLJKWVWR65VPD\DOVREHFRQVLGHUHGEDVHGRQ

WKHFULWLFDOLW\RIWKHV\VWHPIXQFWLRQVWKH\DGGUHVV

6RIDUWKHDXWKRUVKDYHEHHQH[WHQGLQJWKHLUDQDO\VLVWRDVDPSOHRIGURQHPRGHOVDLPLQJWRSURYLGHEURDGHU

UHVXOWVIURPWKHFRPSDUDWLYHDQDO\VLVDQGVXSSRUWWKHFDOOIRUHVWDEOLVKLQJDFRPPRQDQGKROLVWLFULVNPDQDJHPHQW

IUDPHZRUN IRU VPDOO GURQHV ,Q DGGLWLRQ WKH DXWKRUV KDYH EHHQ DQDO\]LQJ WKH UHJXODWLRQV SXEOLVKHG E\ VHYHUDO

DXWKRULWLHVLQRUGHUWRSHUIRUPDGLVVLPLODULW\DQDO\VLVDPRQJVWWKHPDQGVKRZWKHH[WHQWRIGLYHUVLW\RIWKHFXUUHQW

UXOHVDQGVWDQGDUGVDERXWVPDOOGURQHIOLJKWV:HFODLPWKDWWKHDIRUHPHQWLRQHGUHVHDUFKZLOOFROOHFWLYHO\GHPRQVWUDWH

WKHQHHGWRFRSHWLPHO\ZLWKWKHVDIHW\FKDOOHQJHVDQGWRFRQWUROWKHSRVVLEOHKD]DUGVRIH[LVWLQJGURQHV\VWHPVEHIRUH

QHJDWLYHHYHQWVKDSSHQ

$FNQRZOHGJHPHQWV

7KHDXWKRUVZRXOGOLNHWRWKDQN'U,RDQQLV'RNDVIRUKLVLGHDWRDSSO\DQDGDSWDWLRQRI5LVN62$3LQRUGHUWR

LQGLFDWHWKHGLIIHUHQFHVDPRQJVWWKHFRPSDUHGGURQHPRGHOVLQDTXDQWLWDWLYHPDQQHU7KHDXWKRUVDUHDOVRJUDWHIXO

WRWKHWZRSHHUUHYLHZHUVIRUWKHLUYDOXDEOHFRPPHQWVDQGVXJJHVWLRQVWKDWKHOSHGLPSURYHWKHPDQXVFULSW

(11)

5HIHUHQFHV

>@ 5DGLDQW ,QVLJKWV , &RPPHUFLDO GURQHV Highways in the sky, commercial unmanned aerial systems(UAS), market shares, strategies, and forecasts, worldwide, 2015-2021 KWWSZZZUDGLDQWLQVLJKWVFRPUHVHDUFKFRPPHUFLDOGURQHVKLJKZD\VLQWKHVN\FRPPHUFLDOXQPDQQHG

DHULDOV\VWHPVXDVPDUNHW3XEOLVKHG-DQXDU\$FFHVVHG-XO\

>@9DQLDQ-More drones are flying too close to comfort to airplanes and airports7HFKKWWSIRUWXQHFRPGURQHVIO\LQJWRRFORVH

DLUSODQHVDLUSRUWV3XEOLVKHG0DUFK$FFHVVHG$SULO

>@($6$Annual Safety Report 2016%UXVVHOV(XURSHDQ$YLDWLRQ6DIHW\$JHQF\

>@ &DPSLRQ6PLWK % 2WWDZD %XUHDX Drone close calls near airports spur proposed regulations, Toronto star &DQDGD

KWWSVZZZWKHVWDUFRPQHZVFDQDGDGURQHFORVHFDOOVQHDUDLUSRUWVVSXUSURSRVHGUHJXODWLRQVKWPO 3XEOLVKHG -XQH

$FFHVVHG-XO\

>@ (XURSHDQ $YLDWLRQ 6DIHW\ $JHQF\ Anual safety review 2016 SXEOLFDWLRQ GDWH RQOLQH

KWWSVZZZHDVDHXURSDHXV\VWHPILOHVGIXB($6$B$65B0$,1B5(3257SGI

>@)$$Operation and Certification of Small Unmanned Aircraft Systems:DVKLQJWRQ'&)HGHUDO$YLDWLRQ$GPLQLVWUDWLRQ

>@($6$Introduction of a regulatory framework for the operation of unmanned aircraft.&RORJQH(XURSHDQ$YLDWLRQ6DIHW\$JHQF\

>@'DODPDJNLGLV.9DODYDQLV.3 3LHJO/$On integrating unmanned aircraft systems into the national airspace system: issues, challenges, operational restrictions, certification, and recommendations.6SULQJHU6FLHQFH %XVLQHVV0HGLD

>@&ORWKLHU5$*UHHU'$*UHHU'* 0HKWD$05LVNSHUFHSWLRQDQGWKHSXEOLFDFFHSWDQFHRIGURQHVRisk analysisQR

>@ .XFKDU -. Safety analysis methodology for unmanned aerial vehicle (UAV) collision avoidance systems. ,Q 86$(XURSH $LU 7UDIILF

0DQDJHPHQW5 '6HPLQDUVYRO

>@/HH+70H\Q/$ .LP6<3UREDELOLVWLFVDIHW\DVVHVVPHQWRIXQPDQQHGDHULDOV\VWHPRSHUDWLRQVJournal of Guidance, Control, and DynamicsQR

>@ -RKQVRQ &: 7KH +LGGHQ +XPDQ )DFWRUV LQ 8QPDQQHG $HULDO 9HKLFOHV Proceedings of the 25th International Systems Safety Society Conference$XJ%DOWLPRUH0'

>@/RK5%LDQ< 5RH78$9VLQFLYLODLUVSDFH6DIHW\UHTXLUHPHQWVIEEE Aerospace and Electronic Systems MagazineQR

>@&LYLO$YLDWLRQ$XWKRULW\Requirements for operating in airspaceRQOLQHKWWSZZZFDDFRXN&RPPHUFLDOLQGXVWU\$LUFUDIW8QPDQQHG

DLUFUDIW8QPDQQHG$LUFUDIW

>@)HGHUDO$YLDWLRQ$GPLQLVWUDWLRQUnmanned Aircraft Systems; Fly for FunRQOLQHKWWSZZZIDDJRYXDVJHWWLQJBVWDUWHGIO\BIRUBIXQ

>@ 86 'HSDUWPHQW RI 7UDQVSRUWDWLRQ Advisory Circular, Small Unmanned Aircraft Systems SXEOLFDWLRQ GDWH RQOLQH

KWWSZZZIDDJRYXDVPHGLD$&BB$)6B6LJQHGSGI

>@ $XVWUDOLDQ *RYHUQPHQW Federal Register of Legislation, Civil Aviation Safety Regulations 1998 SXEOLFDWLRQ GDWH RQOLQH

KWWSVZZZOHJLVODWLRQJRYDX'HWDLOV)&+WPO9ROXPHB

>@/HYHVRQ1Engineering a safer world: Systems thinking applied to safety0LW3UHVV

>@&KDW]LPLFKDLOLGRX00 'RNDV,05LVN62$3LQWURGXFLQJDQGDSSO\LQJDPHWKRGRORJ\RIULVNVHOIDZDUHQHVVLQURDGWXQQHOVDIHW\

Accident Analysis & Prevention

>@=KDQJ% 6ULKDUL613URSHUWLHVRIELQDU\YHFWRUGLVVLPLODULW\PHDVXUHV,QProc. JCIS Int’l Conf. Computer Vision, Pattern Recognition, and Image ProcessingYRO

>@&KDW]LPLFKDLOLGRX00 'RNDV,0,QWURGXFLQJ5LVN62$3WRFRPPXQLFDWHWKHGLVWULEXWHGVLWXDWLRQDZDUHQHVVRIDV\VWHPDERXWVDIHW\

LVVXHVDQDSSOLFDWLRQWRDURERWLFV\VWHPErgonomics

>@)OHPLQJ&+ /HYHVRQ1,QWHJUDWLQJ6\VWHPV6DIHW\LQWR6\VWHPV(QJLQHHULQJGXULQJ&RQFHSW'HYHORSPHQW,QINCOSE International SymposiumYROQRSS

>@'RNDV,0)HHKDQ- ,PUDQ6(:D6$3$QHDUO\ZDUQLQJVLJQLGHQWLILFDWLRQDSSURDFKEDVHGRQDV\VWHPLFKD]DUGDQDO\VLVSafety science

>@3OLRXWVLDV$ .DUDQLNDV18VLQJ673$LQWKH(YDOXDWLRQRI)LJKWHU3LORWV7UDLQLQJ3URJUDPV3URFHHGLQJVRIWKHUG(XURSHDQ67$03

:RUNVKRS67$03(82FWREHU$PVWHUGDP7KH1HWKHUODQGVProcedia EngineeringSS

Application of STPA on small drone operations: a benchmarking approach