3D object detection for self-driving vehicles aided by object velocity

Bibliographic Details
Main Author: Alexandrino, Leandro Miguel Ferreira
Publication Date: 2022
Format: Master thesis
Language: eng
Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Download full: http://hdl.handle.net/10773/38700
Summary: The number of road accidents still remains tragically high, being estimated that human error is the main reason behind 90% of the accidents. As such, there is a rising interest in self-driving vehicles, as these shall eliminate human error and ensure safe driving. A self-driving vehicle first needs to perceive its surroundings to drive safely. This is achievable by using vision sensors. Among these sensors, LiDAR presents the unique advantage of acquiring a high-resolution 3D representation of the surroundings. Such rich 3D data, in the form of point clouds, enables accurate 3D object detection. The success obtained from the first and current LiDAR generation has motivated the development of a second-generation LiDAR, now resorting to coherent detection. Besides estimating the coordinates of each point, such a LiDAR also estimates the radial velocity. Therefore, it is expected that the use of the radial velocity enhances 3D object detection, as it helps differentiating moving objects from static background points. This work has the main objective of analysing whether LiDAR-based 3D object detection can be improved by considering the additional feature of radial velocity. As, to the best of the author’s knowledge, no LiDAR dataset including radial velocity information is yet available, the first step taken in this work was to generate a synthetic dataset. Three use cases were created to evaluate the impact of raw and processed radial velocity features, added to ideal and flawed range estimation. Considering the radial velocity, either raw or processed, did not introduce noteworthy benefits to the detection of objects with rich geometrical information. Conversely, for objects represented by few and possibly flawed points, which are typically more challenging to detect, this information was able to improve object detection. As a conclusion, this work suggests that a second-generation LiDAR may indeed contribute to enhanced road safety.
id RCAP_a8b7d3b682d8daf8b66f9212ff38b946
oai_identifier_str oai:ria.ua.pt:10773/38700
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling 3D object detection for self-driving vehicles aided by object velocityAutonomous driving3D object detectionCoherent LiDARPoint cloudRadial velocityDeep learningThe number of road accidents still remains tragically high, being estimated that human error is the main reason behind 90% of the accidents. As such, there is a rising interest in self-driving vehicles, as these shall eliminate human error and ensure safe driving. A self-driving vehicle first needs to perceive its surroundings to drive safely. This is achievable by using vision sensors. Among these sensors, LiDAR presents the unique advantage of acquiring a high-resolution 3D representation of the surroundings. Such rich 3D data, in the form of point clouds, enables accurate 3D object detection. The success obtained from the first and current LiDAR generation has motivated the development of a second-generation LiDAR, now resorting to coherent detection. Besides estimating the coordinates of each point, such a LiDAR also estimates the radial velocity. Therefore, it is expected that the use of the radial velocity enhances 3D object detection, as it helps differentiating moving objects from static background points. This work has the main objective of analysing whether LiDAR-based 3D object detection can be improved by considering the additional feature of radial velocity. As, to the best of the author’s knowledge, no LiDAR dataset including radial velocity information is yet available, the first step taken in this work was to generate a synthetic dataset. Three use cases were created to evaluate the impact of raw and processed radial velocity features, added to ideal and flawed range estimation. Considering the radial velocity, either raw or processed, did not introduce noteworthy benefits to the detection of objects with rich geometrical information. Conversely, for objects represented by few and possibly flawed points, which are typically more challenging to detect, this information was able to improve object detection. As a conclusion, this work suggests that a second-generation LiDAR may indeed contribute to enhanced road safety.O número de acidentes rodoviários continua tragicamente alto, sendo estimado que cerca de 90% dos acidentes sejam culpa do condutor. Como tal, existe um interesse crescente em veículos autónomos, visto que estes prometem eliminar o erro humano e garantir uma condução segura. Um veículo autónomo deve conseguir identificar tudo o que o rodeia de forma a conduzir com segurança. Tal é possível com recurso a sensores de visão. Destes sensores, o LiDAR apresenta a vantagem de adquirir uma representação 3D com alta resolução do ambiente que rodeia o veículo. Dada a riqueza desta informação 3D, representada na forma de nuvens de pontos, torna-se possível efetuar deteção 3D de objetos com elevada precisão. O sucesso obtido pela primeira e atual geração do LiDAR motivou o desenvolvimento da sua segunda geração, agora baseada em deteção coerente. Para além de estimar a distância, tal LiDAR também estima a velocidade radial. Como tal, é esperado que a velocidade radial beneficie a deteção de objetos 3D, ajudando a diferenciar pontos que pertencem a objetos em movimento de outros pontos estáticos que pertencem à cena envolvente. Este trabalho tem como principal objetivo analisar se a deteção de objetos 3D baseada em LiDAR pode ser melhorada considerando a velocidade radial como informação adicional. Visto que, no melhor do conhecimento do autor, nenhum conjunto de dados (dataset) adquirido com um sensor LiDAR que inclua a informação da velocidade radial está publicamente disponível, o primeiro passo deste trabalho consistiu na geração de um dataset sintético. Três casos de estudo foram criados para avaliar o impacto da velocidade radial, sem e com processamento, e com estimação da distância ideal ou com erro. Considerar a velocidade radial, sem ou com processamento adicional, não trouxe benefícios significativos à deteção de objetos cuja informação geométrica é rica. Por outro lado, para objetos representados por poucos pontos, possivelmente afetados por erro, e que são mais desafiantes de detetar, considerar a velocidade radial resultou numa melhor deteção de objetos. Para concluir, este trabalho sugere que um LiDAR de segunda geração pode de facto contribuir para uma maior segurança rodoviária.2023-07-17T10:39:28Z2022-12-13T00:00:00Z2022-12-13info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10773/38700engAlexandrino, Leandro Miguel Ferreirainfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-05-06T04:47:22Zoai:ria.ua.pt:10773/38700Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T14:20:23.660664Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv 3D object detection for self-driving vehicles aided by object velocity
title 3D object detection for self-driving vehicles aided by object velocity
spellingShingle 3D object detection for self-driving vehicles aided by object velocity
Alexandrino, Leandro Miguel Ferreira
Autonomous driving
3D object detection
Coherent LiDAR
Point cloud
Radial velocity
Deep learning
title_short 3D object detection for self-driving vehicles aided by object velocity
title_full 3D object detection for self-driving vehicles aided by object velocity
title_fullStr 3D object detection for self-driving vehicles aided by object velocity
title_full_unstemmed 3D object detection for self-driving vehicles aided by object velocity
title_sort 3D object detection for self-driving vehicles aided by object velocity
author Alexandrino, Leandro Miguel Ferreira
author_facet Alexandrino, Leandro Miguel Ferreira
author_role author
dc.contributor.author.fl_str_mv Alexandrino, Leandro Miguel Ferreira
dc.subject.por.fl_str_mv Autonomous driving
3D object detection
Coherent LiDAR
Point cloud
Radial velocity
Deep learning
topic Autonomous driving
3D object detection
Coherent LiDAR
Point cloud
Radial velocity
Deep learning
description The number of road accidents still remains tragically high, being estimated that human error is the main reason behind 90% of the accidents. As such, there is a rising interest in self-driving vehicles, as these shall eliminate human error and ensure safe driving. A self-driving vehicle first needs to perceive its surroundings to drive safely. This is achievable by using vision sensors. Among these sensors, LiDAR presents the unique advantage of acquiring a high-resolution 3D representation of the surroundings. Such rich 3D data, in the form of point clouds, enables accurate 3D object detection. The success obtained from the first and current LiDAR generation has motivated the development of a second-generation LiDAR, now resorting to coherent detection. Besides estimating the coordinates of each point, such a LiDAR also estimates the radial velocity. Therefore, it is expected that the use of the radial velocity enhances 3D object detection, as it helps differentiating moving objects from static background points. This work has the main objective of analysing whether LiDAR-based 3D object detection can be improved by considering the additional feature of radial velocity. As, to the best of the author’s knowledge, no LiDAR dataset including radial velocity information is yet available, the first step taken in this work was to generate a synthetic dataset. Three use cases were created to evaluate the impact of raw and processed radial velocity features, added to ideal and flawed range estimation. Considering the radial velocity, either raw or processed, did not introduce noteworthy benefits to the detection of objects with rich geometrical information. Conversely, for objects represented by few and possibly flawed points, which are typically more challenging to detect, this information was able to improve object detection. As a conclusion, this work suggests that a second-generation LiDAR may indeed contribute to enhanced road safety.
publishDate 2022
dc.date.none.fl_str_mv 2022-12-13T00:00:00Z
2022-12-13
2023-07-17T10:39:28Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/38700
url http://hdl.handle.net/10773/38700
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833594512302145536