Analysis of Illumination Condition Effect on Vehicle Detection in Photo-Realistic Virtual World

Shun Yang; Weiwen Deng; Zhenyi Liu; Ying Wang

者单位:Jilin University

发表期刊SAE Intelligent and Connected Vehicles Symposium2017

摘要:Intelligent driving, aimed for collision avoidance and self-navigation, is mainly based on environmental sensing via radar, lidar and/or camera. While each of the sensors has its own unique pros and cons, camera is especially good at object detection, recognition and tracking. However, unpredictable environmental illumination can potentially cause misdetection or false detection. To investigate the influence of illumination conditions on detection algorithms, we reproduced various illumination intensities in a photo-realistic virtual world, which leverages recent progress in computer graphics, and verified vehicle detection effect there. In the virtual world, the environmental illumination is controlled precisely from low to high to simulate different illumination conditions in the driving scenarios (with relative luminous intensity from 0.01 to 400). Sedan cars with different colors are modelled in the virtual world and used for detection task. Faster RCNN and You Only Look Once (YOLO), which are the object detection neural networks with high accuracy and efficiency, were chosen for experiments. Results show that: (1) vehicle under too high illumination condition can hardly be detected; (2) as the illumination intensity adjusted from 0.01 to 400, the detection confidences of red and blue cars are higher than other colors, the detection confidence deviations of red and blue cars are also small, which means they are robust to the variation of illumination. This work can provide some insights not only on future autonomous vehicle design, but also on future on-board camera design.

关键词:Collision avoidance systems, Neural networks, Autonomous vehicles, Sensors and actuators, Mathematical models, Lidar, Radar