Elon Musk Was Right: Cheap Cameras Could Replace Lidar on Self-Driving Cars, Researchers Find
Andrew Liszewski
Today 10:15am Filed to: AUTONOMOUS VEHICLES
Among the many tidbits of wisdom that Elon Musk dropped at a Tesla company investor event on Monday was the revelation that Lidar, a laser-based scanning technology that images objects in 3D, was friggin stupid, and that ...anyone relying on LiDAR is doomed. It seemed a grandiose claim given how many autonomous car initiatives rely on the tech, but Cornell researchers have just backed up Musks predictions with a new method for self-driving cars to see the world in 3D using a pair of cheap cameras.
Being able to visualize and detect objects around a vehicle in three dimensions is crucial for autonomous cars to safely operate in a world where roads are shared with other vehicles, cyclists, and often pedestrians. As a driver, every time you turn your head to scan whats around your car, your brain is instantly visualizing your surroundings in 3D and assessing potential hazards. Using cheap sensors to simply detect objects near a self-driving car isnt enough. When its cruising down the road at 60 MPH, it needs to see whats ahead and be able to plan for avoiding hazards.
Thats why youll often see Lidar (Light Detection and Ranging) systems perched atop autonomous vehicles. Using spinning lasers they scan a vehicles surroundings and generate 3D images of objects near and far, allowing the software to analyze the results and pinpoint things to avoid. Lidars expensive, though, often adding $10,000 worth of components to a cars price tag, and it needs to be perched atop a vehicle for the best vantage point. In a time when were trying to maximize the range of both gas and electric vehicles, a Lidar upgrade adds a lot of drag to a cars aerodynamics and its performance.
In a paper that will be presented at the 2019 Conference on Computer Vision and Pattern Recognition in June,
Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving, Cornell researchers detail a potential breakthrough for autonomous vehicles. Cameras have typically been considered an inferior technology to Lidar given that theyre often installed at low angles, near a vehicles bumper, resulting in images that tend to distort objects in the distance which confuses neural networks trying to process and interpret the data.
But by placing a pair of cheap cameras on either side of a vehicle behind its windshield, stereoscopic images are produced which can be converted to 3D data. ...
-snip-