“Hi, this is Chuck Gershman, co-founder and CEO at Owl Autonomous Imaging Previous. Previously, we endorsed Tesla adding radar sensors as a compliment to their vision only camera sensor suite for safe vehicle operation. However, at the time I did mention that we do not believe that radar and visual cameras are the final step.
So, the question has now been raised with Tesla oscillating on their sensor hardware plans, what type of sensors are truly required to ensure safe hands-free Adas operation and beyond? A little background, simply matching the level of safety of today’s driving public is not a reasonable goal. Robotic safety systems must be dramatically better than humans.
To put this in perspective, annually, 1.3 million people are killed in automobile accidents with more than half of the fatalities being persons not in the vehicle. Moreover, when it comes to nighttime operation, we humans really degrade. Of the approximately 700,000 pedestrians and cyclists killed each year, 76% of them are killed at night.
To be safer than humans, sensors must deliver robust operation under a very broad set of environmental operating conditions. With the true challenge of ensuring that no object of interest or vulnerable road user goes unidentified under all driving conditions.
Sensors in an instant must be able to answer the following questions:
Is there something out there? What is it? Where is it? Where’s it going?
Furthermore, the system must be modality redundant. No one’s sensor modality may be relied on to answer any one of these questions alone. Up until recently, three modalities were considered sufficient, that being the fusion of vision cameras, which provide rich detail and color radar, which provides the ability to detect and locate objects under all environmental conditions and lidar, which provides more detail than radar and adds very accurate range.
Those in the know and we at Owl concur that an additional camera modality is required known as 3D thermal imaging. This camera modality delivers passive rich detail both at night and day with operation under degraded visual environments, thereby dramatically supplementing visual cameras.
It also delivers location and range information, thereby supplementing LIDAR and IMP and improving radar fusion. So, in summary, the fusion of visual cameras, lidar, radar, and 3D thermal cameras are the required sensor suite to save lives.”