Consistency of impact assessment protocols for non-native species

Detalhes bibliográficos
Autor(a) principal: González-Moreno, Pablo
Data de Publicação: 2019
Outros Autores: Lazzaro, Lorenzo, Vilà, Montserrat, Preda, Cristina, Adriaens, Tim, Bacher, Sven, Brundu, Giuseppe, Copp, Gordon H., Essl, Franz, García-Berthou, Emili, Katsanevakis, Stelios, Moen, Toril Loennechen, Lucy, Frances E., Nentwig, Wolfgang, Roy, Helen E., Srėbalienė, Greta, Talgø , Venche, Vanderhoeven, Sonia, Andjelković, Ana, Arbačiauskas, Kęstutis, Auger-Rozenberg, Marie-Anne, Bae, Mi-Jung, Bariche, Michel, Boets, Pieter, Boieiro, Mário, Borges, Paulo Alexandre, Clode, João Lemos Gomes Clanning, Cardigos, Federico, Chartosia, Niki, Cottier-Cook, Elizabeth Joanne, Crocetta, Fabio, D'hondt, Bram, Foggi, Bruno, Follak, Swen, Gallardo, Belinda, Gammelmo, Øivind, Giakoumi, Sylvaine, Giuliani, Claudia, Guillaume, Fried, Jelaska, Lucija Šerić, Jeschke, Jonathan M., Jover, Miquel, Juárez-Escario, Alejandro, Kalogirou, Stefanos, Kočić, Aleksandra, Kytinou, Eleni, Laverty, Ciaran, Lozano, Vanessa, Maceda-Veiga, Alberto, Marchante, Elizabete, Marchante, Hélia, Martinou, Angeliki F., Meyer, Sandro, Minchin, Dan, Montero-Castaño, Ana, Morais, Maria Cristina, Morales-Rodriguez, Carmen, Muhthassim, Naida, Nagy, Zoltán Á., Ogris, Nikica, Onen, Huseyin, Pergl, Jan, Puntila, Riikka, Rabitsch, Wolfgang, Ramburn, Triya Tessa, Rêgo, Carla, Reichenbach, Fabian, Romeralo, Carmen, Saul, Wolf-Christian, Schrader, Gritta, Sheehan, Rory, Simonović, Predrag, Skolka, Marius, Soares, António Onofre, Sundheim, Leif, Tarkan, Ali Serhan, Tomov, Rumen, Tricarico, Elena, Tsiamis, Konstantinos, Uludağ, Ahmet, van Valkenburg, Johan, Verreycken, Hugo, Vettraino, Anna Maria, Vilar, Lluís, Wiig, Øystein, Witzell, Johanna, Zanetta, Andrea, Kenis, Marc
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Texto Completo: https://hdl.handle.net/10316/107188
https://doi.org/10.3897/neobiota.44.31650
Resumo: Standardized tools are needed to identify and prioritize the most harmful non-native species (NNS). A plethora of assessment protocols have been developed to evaluate the current and potential impacts of non-native species, but consistency among them has received limited attention. To estimate the consistency across impact assessment protocols, 89 specialists in biological invasions used 11 protocols to screen 57 NNS (2614 assessments). We tested if the consistency in the impact scoring across assessors, quantified as the coefficient of variation (CV), was dependent on the characteristics of the protocol, the taxonomic group and the expertise of the assessor. Mean CV across assessors was 40%, with a maximum of 223%. CV was lower for protocols with a low number of score levels, which demanded high levels of expertise, and when the assessors had greater expertise on the assessed species. The similarity among protocols with respect to the final scores was higher when the protocols considered the same impact types. We conclude that all protocols led to considerable inconsistency among assessors. In order to improve consistency, we highlight the importance of selecting assessors with high expertise, providing clear guidelines and adequate training but also deriving final decisions collaboratively by consensus.
id RCAP_657202d51ed7501babdf01bdf93971b3
oai_identifier_str oai:estudogeral.uc.pt:10316/107188
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Consistency of impact assessment protocols for non-native speciesEnvironmental impactexpert judgementinvasive alien species policymanagement prioritizationrisk assessmentsocio-economic impactStandardized tools are needed to identify and prioritize the most harmful non-native species (NNS). A plethora of assessment protocols have been developed to evaluate the current and potential impacts of non-native species, but consistency among them has received limited attention. To estimate the consistency across impact assessment protocols, 89 specialists in biological invasions used 11 protocols to screen 57 NNS (2614 assessments). We tested if the consistency in the impact scoring across assessors, quantified as the coefficient of variation (CV), was dependent on the characteristics of the protocol, the taxonomic group and the expertise of the assessor. Mean CV across assessors was 40%, with a maximum of 223%. CV was lower for protocols with a low number of score levels, which demanded high levels of expertise, and when the assessors had greater expertise on the assessed species. The similarity among protocols with respect to the final scores was higher when the protocols considered the same impact types. We conclude that all protocols led to considerable inconsistency among assessors. In order to improve consistency, we highlight the importance of selecting assessors with high expertise, providing clear guidelines and adequate training but also deriving final decisions collaboratively by consensus.This article is based upon work from the COST Action TD1209: Alien Challenge. COST (European Cooperation in Science and Technology) is a pan-European intergovernmental framework. The mission of COST is to enable scientific and technological developments leading to new concepts and products and thereby contribute to strengthening Europe’s research and innovation capacities. PGM was supported by the CABI Development Fund (with contributions from ACIAR (Australia) and Dfid (UK) and by Darwin plus, DPLUS074 ‘Improving biosecurity in the SAUKOTs through Pest Risk Assessments’. MV by Belmont Forum-Biodiversa project InvasiBES (PCI2018-092939). CP by Sciex-NMSch 12.108. JMJ and WCS by BiodivERsA (FFII project; DFG grant JE 288/7-1). JMJ by DFG project JE 288/9-1,9-2. CR and MB by Fundação para a Ciência e a Tecnologia grants SFRH/BPD/91357/2012 and SFRH/ BPD/86215/2012, respectively. PS by MESTD of Serbia, grant #173025. JP by RVO 67985939 and 17-19025S. JCC was supported by a starting grant in the framework of the 2014 FCT Investigator Programme (IF/01606/2014/CP1230/CT0001).Pensoft Publishers2019info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttps://hdl.handle.net/10316/107188https://hdl.handle.net/10316/107188https://doi.org/10.3897/neobiota.44.31650eng1314-24881619-0033González-Moreno, PabloLazzaro, LorenzoVilà, MontserratPreda, CristinaAdriaens, TimBacher, SvenBrundu, GiuseppeCopp, Gordon H.Essl, FranzGarcía-Berthou, EmiliKatsanevakis, SteliosMoen, Toril LoennechenLucy, Frances E.Nentwig, WolfgangRoy, Helen E.Srėbalienė, GretaTalgø , VencheVanderhoeven, SoniaAndjelković, AnaArbačiauskas, KęstutisAuger-Rozenberg, Marie-AnneBae, Mi-JungBariche, MichelBoets, PieterBoieiro, MárioBorges, Paulo AlexandreClode, João Lemos Gomes ClanningCardigos, FedericoChartosia, NikiCottier-Cook, Elizabeth JoanneCrocetta, FabioD'hondt, BramFoggi, BrunoFollak, SwenGallardo, BelindaGammelmo, ØivindGiakoumi, SylvaineGiuliani, ClaudiaGuillaume, FriedJelaska, Lucija ŠerićJeschke, Jonathan M.Jover, MiquelJuárez-Escario, AlejandroKalogirou, StefanosKočić, AleksandraKytinou, EleniLaverty, CiaranLozano, VanessaMaceda-Veiga, AlbertoMarchante, ElizabeteMarchante, HéliaMartinou, Angeliki F.Meyer, SandroMinchin, DanMontero-Castaño, AnaMorais, Maria CristinaMorales-Rodriguez, CarmenMuhthassim, NaidaNagy, Zoltán Á.Ogris, NikicaOnen, HuseyinPergl, JanPuntila, RiikkaRabitsch, WolfgangRamburn, Triya TessaRêgo, CarlaReichenbach, FabianRomeralo, CarmenSaul, Wolf-ChristianSchrader, GrittaSheehan, RorySimonović, PredragSkolka, MariusSoares, António OnofreSundheim, LeifTarkan, Ali SerhanTomov, RumenTricarico, ElenaTsiamis, KonstantinosUludağ, Ahmetvan Valkenburg, JohanVerreycken, HugoVettraino, Anna MariaVilar, LluísWiig, ØysteinWitzell, JohannaZanetta, AndreaKenis, Marcinfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-10-08T11:56:50Zoai:estudogeral.uc.pt:10316/107188Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-29T05:57:54.769403Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Consistency of impact assessment protocols for non-native species
title Consistency of impact assessment protocols for non-native species
spellingShingle Consistency of impact assessment protocols for non-native species
González-Moreno, Pablo
Environmental impact
expert judgement
invasive alien species policy
management prioritization
risk assessment
socio-economic impact
title_short Consistency of impact assessment protocols for non-native species
title_full Consistency of impact assessment protocols for non-native species
title_fullStr Consistency of impact assessment protocols for non-native species
title_full_unstemmed Consistency of impact assessment protocols for non-native species
title_sort Consistency of impact assessment protocols for non-native species
author González-Moreno, Pablo
author_facet González-Moreno, Pablo
Lazzaro, Lorenzo
Vilà, Montserrat
Preda, Cristina
Adriaens, Tim
Bacher, Sven
Brundu, Giuseppe
Copp, Gordon H.
Essl, Franz
García-Berthou, Emili
Katsanevakis, Stelios
Moen, Toril Loennechen
Lucy, Frances E.
Nentwig, Wolfgang
Roy, Helen E.
Srėbalienė, Greta
Talgø , Venche
Vanderhoeven, Sonia
Andjelković, Ana
Arbačiauskas, Kęstutis
Auger-Rozenberg, Marie-Anne
Bae, Mi-Jung
Bariche, Michel
Boets, Pieter
Boieiro, Mário
Borges, Paulo Alexandre
Clode, João Lemos Gomes Clanning
Cardigos, Federico
Chartosia, Niki
Cottier-Cook, Elizabeth Joanne
Crocetta, Fabio
D'hondt, Bram
Foggi, Bruno
Follak, Swen
Gallardo, Belinda
Gammelmo, Øivind
Giakoumi, Sylvaine
Giuliani, Claudia
Guillaume, Fried
Jelaska, Lucija Šerić
Jeschke, Jonathan M.
Jover, Miquel
Juárez-Escario, Alejandro
Kalogirou, Stefanos
Kočić, Aleksandra
Kytinou, Eleni
Laverty, Ciaran
Lozano, Vanessa
Maceda-Veiga, Alberto
Marchante, Elizabete
Marchante, Hélia
Martinou, Angeliki F.
Meyer, Sandro
Minchin, Dan
Montero-Castaño, Ana
Morais, Maria Cristina
Morales-Rodriguez, Carmen
Muhthassim, Naida
Nagy, Zoltán Á.
Ogris, Nikica
Onen, Huseyin
Pergl, Jan
Puntila, Riikka
Rabitsch, Wolfgang
Ramburn, Triya Tessa
Rêgo, Carla
Reichenbach, Fabian
Romeralo, Carmen
Saul, Wolf-Christian
Schrader, Gritta
Sheehan, Rory
Simonović, Predrag
Skolka, Marius
Soares, António Onofre
Sundheim, Leif
Tarkan, Ali Serhan
Tomov, Rumen
Tricarico, Elena
Tsiamis, Konstantinos
Uludağ, Ahmet
van Valkenburg, Johan
Verreycken, Hugo
Vettraino, Anna Maria
Vilar, Lluís
Wiig, Øystein
Witzell, Johanna
Zanetta, Andrea
Kenis, Marc
author_role author
author2 Lazzaro, Lorenzo
Vilà, Montserrat
Preda, Cristina
Adriaens, Tim
Bacher, Sven
Brundu, Giuseppe
Copp, Gordon H.
Essl, Franz
García-Berthou, Emili
Katsanevakis, Stelios
Moen, Toril Loennechen
Lucy, Frances E.
Nentwig, Wolfgang
Roy, Helen E.
Srėbalienė, Greta
Talgø , Venche
Vanderhoeven, Sonia
Andjelković, Ana
Arbačiauskas, Kęstutis
Auger-Rozenberg, Marie-Anne
Bae, Mi-Jung
Bariche, Michel
Boets, Pieter
Boieiro, Mário
Borges, Paulo Alexandre
Clode, João Lemos Gomes Clanning
Cardigos, Federico
Chartosia, Niki
Cottier-Cook, Elizabeth Joanne
Crocetta, Fabio
D'hondt, Bram
Foggi, Bruno
Follak, Swen
Gallardo, Belinda
Gammelmo, Øivind
Giakoumi, Sylvaine
Giuliani, Claudia
Guillaume, Fried
Jelaska, Lucija Šerić
Jeschke, Jonathan M.
Jover, Miquel
Juárez-Escario, Alejandro
Kalogirou, Stefanos
Kočić, Aleksandra
Kytinou, Eleni
Laverty, Ciaran
Lozano, Vanessa
Maceda-Veiga, Alberto
Marchante, Elizabete
Marchante, Hélia
Martinou, Angeliki F.
Meyer, Sandro
Minchin, Dan
Montero-Castaño, Ana
Morais, Maria Cristina
Morales-Rodriguez, Carmen
Muhthassim, Naida
Nagy, Zoltán Á.
Ogris, Nikica
Onen, Huseyin
Pergl, Jan
Puntila, Riikka
Rabitsch, Wolfgang
Ramburn, Triya Tessa
Rêgo, Carla
Reichenbach, Fabian
Romeralo, Carmen
Saul, Wolf-Christian
Schrader, Gritta
Sheehan, Rory
Simonović, Predrag
Skolka, Marius
Soares, António Onofre
Sundheim, Leif
Tarkan, Ali Serhan
Tomov, Rumen
Tricarico, Elena
Tsiamis, Konstantinos
Uludağ, Ahmet
van Valkenburg, Johan
Verreycken, Hugo
Vettraino, Anna Maria
Vilar, Lluís
Wiig, Øystein
Witzell, Johanna
Zanetta, Andrea
Kenis, Marc
author2_role author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv González-Moreno, Pablo
Lazzaro, Lorenzo
Vilà, Montserrat
Preda, Cristina
Adriaens, Tim
Bacher, Sven
Brundu, Giuseppe
Copp, Gordon H.
Essl, Franz
García-Berthou, Emili
Katsanevakis, Stelios
Moen, Toril Loennechen
Lucy, Frances E.
Nentwig, Wolfgang
Roy, Helen E.
Srėbalienė, Greta
Talgø , Venche
Vanderhoeven, Sonia
Andjelković, Ana
Arbačiauskas, Kęstutis
Auger-Rozenberg, Marie-Anne
Bae, Mi-Jung
Bariche, Michel
Boets, Pieter
Boieiro, Mário
Borges, Paulo Alexandre
Clode, João Lemos Gomes Clanning
Cardigos, Federico
Chartosia, Niki
Cottier-Cook, Elizabeth Joanne
Crocetta, Fabio
D'hondt, Bram
Foggi, Bruno
Follak, Swen
Gallardo, Belinda
Gammelmo, Øivind
Giakoumi, Sylvaine
Giuliani, Claudia
Guillaume, Fried
Jelaska, Lucija Šerić
Jeschke, Jonathan M.
Jover, Miquel
Juárez-Escario, Alejandro
Kalogirou, Stefanos
Kočić, Aleksandra
Kytinou, Eleni
Laverty, Ciaran
Lozano, Vanessa
Maceda-Veiga, Alberto
Marchante, Elizabete
Marchante, Hélia
Martinou, Angeliki F.
Meyer, Sandro
Minchin, Dan
Montero-Castaño, Ana
Morais, Maria Cristina
Morales-Rodriguez, Carmen
Muhthassim, Naida
Nagy, Zoltán Á.
Ogris, Nikica
Onen, Huseyin
Pergl, Jan
Puntila, Riikka
Rabitsch, Wolfgang
Ramburn, Triya Tessa
Rêgo, Carla
Reichenbach, Fabian
Romeralo, Carmen
Saul, Wolf-Christian
Schrader, Gritta
Sheehan, Rory
Simonović, Predrag
Skolka, Marius
Soares, António Onofre
Sundheim, Leif
Tarkan, Ali Serhan
Tomov, Rumen
Tricarico, Elena
Tsiamis, Konstantinos
Uludağ, Ahmet
van Valkenburg, Johan
Verreycken, Hugo
Vettraino, Anna Maria
Vilar, Lluís
Wiig, Øystein
Witzell, Johanna
Zanetta, Andrea
Kenis, Marc
dc.subject.por.fl_str_mv Environmental impact
expert judgement
invasive alien species policy
management prioritization
risk assessment
socio-economic impact
topic Environmental impact
expert judgement
invasive alien species policy
management prioritization
risk assessment
socio-economic impact
description Standardized tools are needed to identify and prioritize the most harmful non-native species (NNS). A plethora of assessment protocols have been developed to evaluate the current and potential impacts of non-native species, but consistency among them has received limited attention. To estimate the consistency across impact assessment protocols, 89 specialists in biological invasions used 11 protocols to screen 57 NNS (2614 assessments). We tested if the consistency in the impact scoring across assessors, quantified as the coefficient of variation (CV), was dependent on the characteristics of the protocol, the taxonomic group and the expertise of the assessor. Mean CV across assessors was 40%, with a maximum of 223%. CV was lower for protocols with a low number of score levels, which demanded high levels of expertise, and when the assessors had greater expertise on the assessed species. The similarity among protocols with respect to the final scores was higher when the protocols considered the same impact types. We conclude that all protocols led to considerable inconsistency among assessors. In order to improve consistency, we highlight the importance of selecting assessors with high expertise, providing clear guidelines and adequate training but also deriving final decisions collaboratively by consensus.
publishDate 2019
dc.date.none.fl_str_mv 2019
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/10316/107188
https://hdl.handle.net/10316/107188
https://doi.org/10.3897/neobiota.44.31650
url https://hdl.handle.net/10316/107188
https://doi.org/10.3897/neobiota.44.31650
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 1314-2488
1619-0033
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Pensoft Publishers
publisher.none.fl_str_mv Pensoft Publishers
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833602533053956096