Computer vision analysis of unconstrained urban ground-level images

• Autor(a) principal: Tokuda, Éric Keiji
• Data de Publicação: 2019
• Tipo de documento: Tese
• Idioma: eng
• Título da fonte: Biblioteca Digital de Teses e Dissertações da USP
• Texto Completo: https://www.teses.usp.br/teses/disponiveis/45/45134/tde-20012021-191240/
• topic: Aprendizagem semi-supervisionada; Câmeras de monitoramento; Cidades inteligentes; Computação urbana; Computer vision; Detecção de objetos; Graffiti; Image processing; Machine learning; Object detection; Processamento de imagens; Redes de sensores.; Semi-supervised learning; Sensor network; Smart cities; Urban computing; Visão computacional

Nowadays, images are generated on a large scale and in a decentralized way. Such modality of data carries valuable information but extracting this information is not always trivial. In this thesis, we tackle computer vision challenges when using ground-level images. The first challenge is the high-cost annotation for evaluating object detection methods. In the context of image degradation imposed by weather, the second issue is the lack of analysis that evaluates the impact of de-raining methods to the object detection algorithms on rainy images. The third challenge is the evaluation of the reliability of the density estimation results from a real sensor network. The emergence of sensor network data motivates the last problem, of estimating the urban degradation in the city using city images. These challenges define the scope of this thesis. For the first problem, we proposed an approach with cheap annotation cost for object detectors comparison and we applied it in a semi-supervised learning approach using surveillance images. To address challenge two, we established a protocol and performed an extensive benchmark of object detection preceded by de-raining methods. We find strong indicators that no current de-raining method can robustly improve the posterior object detection accuracy when applied in this naive way. The third issue was tackled by creating a probabilistic sensing model to establish theoretical bounds for the errors of the sensed distributions. The approach has been validated using simulation and applied to compute the pedestrian density map in Manhattan. To attack the last problem, we systematically collected public images of São Paulo and segmented the regions affected by tagging, as an indicator of the urban degradation of the region. The source code is fully released.