Over the previous few days, Elon Musk has been making a number of statements claiming that autonomous driving methods that use lidar and radar sensors are extra harmful than Tesla’s camera-only laptop imaginative and prescient strategy as a result of the system will get confused when deciphering information from completely different sensors.
It’s not solely false, Musk advised me instantly that he agreed that radar and imaginative and prescient might be safer than simply imaginative and prescient, proper after he had Tesla take away the radars from its autos.
Tesla has taken a controversial strategy, utilizing solely cameras as sensors for driving inputs in its self-driving know-how. In distinction, most different corporations use cameras along with radar and lidar sensors.
When Tesla first introduced that each one its automobiles produced onward have the {hardware} able to “full self-driving” as much as degree 5 autonomous capability in 2016, it included a front-facing radar in its self-driving {hardware} suite.
Nevertheless, in 2021, after not having achieved something greater than a degree 2 driver help (ADAS) system with its self-driving effort, Elon Musk introduced a transfer that he known as “Tesla Imaginative and prescient”, which consists of shifting Tesla’s self-driving effort solely to make use of inputs from cameras.
Right here’s what I wrote in 2021 about Musk sharing his plan for Tesla to solely use cameras and neural nets:
CEO Elon Musk has been hyping the vision-only replace as “mind-blowing.” He insists that it’ll result in a real degree 5 autonomous driving system by the tip of the yr, however he has gotten that timeline flawed earlier than.
By Might 2021, Tesla had begun eradicating the radar sensor from its lineupbeginning with the Mannequin 3 and Mannequin Y, and later the Mannequin S and Mannequin X in 2022.
Tesla engineers reportedly tried to persuade Musk to retain the usage of radarhowever the CEO overruled them.
We at the moment are in 2025, and in contrast to what Musk claimed, Tesla has but to ship on its self-driving guarantees, however the CEO is doubling down on his vision-only strategy.
The controversial billionaire is making headlines this week for a sequence of latest statements attacking Tesla’s self-driving rivals and their use of radar and lidar sensors.
Earlier this week, Musk took a jab at Waymo and claimed that “lidar and radar scale back security”:
Lidar and radar scale back security as a consequence of sensor competition. If lidars/radars disagree with cameras, which one wins? This sensor ambiguity causes elevated, not decreased, danger. That’s why Waymos can’t drive on highways.We turned off radars in Teslas to extend security. Cameras ftw.
The assertion that “Waymos can’t drive on highways” is just false. Waymo has been conducting absolutely driverless worker testing on freeways in Phoenix, San Francisco, and Los Angeles for years, and it’s anticipated to make this know-how out there to rider-only rides quickly.
Tesla is in an analogous state of affairs with its Robotaxi: they don’t drive on freeways with out an worker supervisor.
Musk later added:
LiDAR additionally doesn’t work effectively in snow, rain or mud as a consequence of reflection scatter. That’s why Waymos cease working in any heavy precipitation. As I’ve stated many instances, there’s a position for LiDAR in some circumstances and I personally oversaw the event of LiDAR for the SpaceX Dragon docking with Area Station. I’m effectively conscious of its strengths and weaknesses.
It’s not true that Waymos can’t work in “any heavy precipitation.”
Right here’s a video of a Waymo car driving by itself in heavy rain:
As compared, Tesla’s personal Robotaxi phrases of service point out that it “could also be restricted or unavailable in inclement climate.”
Final month, Tesla Robotaxi riders had their rides lower quick, and they had been advised it was as a result of rain.
There’s loads of proof that Musk is flawed and deceptive with these statements, however moreover, he himself admitted that radar sensors could make Tesla’s imaginative and prescient system safer.
‘Imaginative and prescient with high-res radar could be higher than pure imaginative and prescient’
In Might 2021, as Tesla started eradicating radar sensors from its car lineup and transitioning to a vision-only strategy, I used to be direct messaging (DMing) Musk to be taught extra concerning the stunning transfer.
Within the dialog, he was already making the declare that sensor competition is reducing security as he did this week in new feedback attacking Waymo.
He wrote on the time:
The chance of security shall be increased with pure imaginative and prescient than imaginative and prescient+radar, not decrease. Imaginative and prescient has turn into so good that radar really reduces sign/noise.
Nevertheless, what was extra fascinating is what he stated shortly after claiming that:
Musk admitted that “imaginative and prescient with high-resolution radar could be higher than pure imaginative and prescient”. Nevertheless, he claimed that such a radar didn’t exist.
In the identical dialog, I pointed Musk to present high-definition millimeter wave radars, however he didn’t reply.
It was nonetheless early for that know-how in 2021, however high-definition millimeter wave radars at the moment are generally utilized by corporations creating autonomous driving applied sciences, together with Waymo.
Waymo makes use of six high-definition radars in its system:
In brief, Musk was already involved about sensor competition in 2021, however he admitted that the issue could be value fixing with higher-definition radars, which already existed then and have gotten extra widespread now.
But, he criticizes corporations utilizing radar and lidar, which work equally to high-resolution radars however on completely different wavelengths, for even trying sensor fusion.
It’s not inconceivable as a result of Tesla can’t do it
A part of the issue right here seems to be that Musk thinks one thing doesn’t work as a result of Tesla can’t make it work, and he doesn’t wish to admit that others are fixing the sensor fusion drawback.
Tesla merely couldn’t clear up sensor fusion, so it centered on attaining autonomy solely by digital camera imaginative and prescient. Nevertheless, those that continued to work on the problem have made vital progress and at the moment are reaping the rewards.
Waymo and Baidu, each of which have degree 4 autonomous driving methods at the moment commercially working with out supervision, not like Tesla, have closely invested in sensor fusion.
Amir Husain, an AI entrepreneur who sits on the Boards of Advisors for IBM Watson and the Division of Pc Science at UT Austin, factors to developments in the usage of Kalman filters and Bayesian methods to unravel sensor noise covariance.
He commented on Musk’s assertion concerning the usage of radar and lidar sensors:
The difficulty isn’t a binary disagreement between two sensors. It generates a greater estimate than any particular person sensor can produce by itself. All of them have a margin of error. Fusion helps scale back this.
If Musk’s argument held, why would the human mind use eyes, ears, and contact to estimate object location? Why would plane mix radar, IRST, and different passive sensors to estimate object location? It is a basic misunderstanding of data principle. Each channel has noise. However redundancy reduces uncertainty.
Musk’s foremost argument to concentrate on cameras and neural nets has been that the roads are designed for people to drive and people drive utilizing their eyes and mind, that are the {hardware} and software program equal of cameras (eyes) and neural nets (mind).
Now, most different corporations creating autonomous driving applied sciences are additionally specializing in this, however to surpass people and obtain higher ranges of security by precision and redundancy, they’re additionally including radar and lidar sensors to their methods.
Electrek’s Take
Musk painted Tesla right into a nook with its vision-only strategy, and now he’s making an attempt to mislead folks into pondering that it’s the just one that may work, when there’s no substantial proof to assist this declare.
Now, let me be clear, Musk is partly right. When poorly fused, multi-sensor information introduces noise, making it tougher to function an autonomous driving system.
Nevertheless, who stated that that is an unsolvable drawback? Others seem like fixing it, and we’re seeing the leads to Waymo’s and Baidu’s commercially out there rider-only taxi companies.
In case you can reap the benefits of radar’s potential to detect distance and pace in addition to work by rain, fog, mud, and snow, why wouldn’t you utilize it?
As he admitted within the DMs with me in 2021, Musk is conscious of this – therefore why he acknowledged that high-resolution radar mixed with imaginative and prescient could be safer than imaginative and prescient alone.
The issue is that Tesla hasn’t centered on bettering sensor fusion and radar integration within the final 4 years as a result of it has been all-in on imaginative and prescient.
Now, Tesla may doubtlessly nonetheless clear up self-driving with its imaginative and prescient system, however there’s no proof that it’s near occurring or any safer than different methods, comparable to Waymo’s, which use radar and lidar sensors.
Actually, Tesla remains to be solely working an autonomous driving system below the supervision of in-car workers with just a few dozen automobiles, whereas Waymo has been doing rider-only rides for years and operates over 1,500 autonomous autos within the US.
Similar to together with his “Robotaxi” with supervisors, Musk is making an attempt to create the phantasm that Tesla just isn’t solely main in autonomy, however it’s the just one that may clear up it.
FTC: We use earnings incomes auto affiliate hyperlinks. Extra.
