Elon Musk Was Right: Cheap Cameras Could Replace Lidar on Self-Driving Cars, Researchers Find

Andrew Liszewski
Today 10:15am Filed to: AUTONOMOUS VEHICLES

Among the many tidbits of wisdom that Elon Musk dropped at a Tesla company investor event on Monday was the revelation that Lidar, a laser-based scanning technology that images objects in 3D, was “friggin’ stupid,” and that “...anyone relying on LiDAR is doomed.” It seemed a grandiose claim given how many autonomous car initiatives rely on the tech, but Cornell researchers have just backed up Musk’s predictions with a new method for self-driving cars to see the world in 3D using a pair of cheap cameras.

Being able to visualize and detect objects around a vehicle in three dimensions is crucial for autonomous cars to safely operate in a world where roads are shared with other vehicles, cyclists, and often pedestrians. As a driver, every time you turn your head to scan what’s around your car, your brain is instantly visualizing your surroundings in 3D and assessing potential hazards. Using cheap sensors to simply detect objects near a self-driving car isn’t enough. When it’s cruising down the road at 60 MPH, it needs to see what’s ahead and be able to plan for avoiding hazards.

That’s why you’ll often see Lidar (Light Detection and Ranging) systems perched atop autonomous vehicles. Using spinning lasers they scan a vehicle’s surroundings and generate 3D images of objects near and far, allowing the software to analyze the results and pinpoint things to avoid. Lidar’s expensive, though, often adding $10,000 worth of components to a car’s price tag, and it needs to be perched atop a vehicle for the best vantage point. In a time when we’re trying to maximize the range of both gas and electric vehicles, a Lidar upgrade adds a lot of drag to a car’s aerodynamics and its performance.

In a paper that will be presented at the 2019 Conference on Computer Vision and Pattern Recognition in June, Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving, Cornell researchers detail a potential breakthrough for autonomous vehicles. Cameras have typically been considered an inferior technology to Lidar given that they’re often installed at low angles, near a vehicle’s bumper, resulting in images that tend to distort objects in the distance which confuses neural networks trying to process and interpret the data.

But by placing a pair of cheap cameras on either side of a vehicle behind its windshield, stereoscopic images are produced which can be converted to 3D data. ...

-snip-