Twitter user @EZebroni tweeted a helpful video demonstrating the difference between a Tesla with and without USS. It's noticeably different then what Tesla drivers are used to seeing. The distance lines are gone, and even the images of what is beside the non-USS Tesla are not there, just a lot of white screen.
As seen in the video, a vehicle without USS will not display any information to the driver regarding nearby objects. The distance to nearby objects is not displayed on the screen nor are the colored arcs that usually display when an object is nearby.
However, update 2022.40.4 appears to reintroduce some functionality to owners of these vehicles, at least in shadow mode.
Twitter user @greentheonly, a well-known Tesla hacker, tweeted: 2022.40.4 merges no-ultrasonics code into "mainline," now receives parking distances from Autopilot (where not equipped with proper ultrasonics).
From Green's findings, it looks like Tesla is preparing to mimic ultrasonic sensors with Tesla Vision, which essentially means that the vehicle is likely to display not only the arcs when an object is nearby, but also the distance to the given object.
Greentheonly was asked several questions after tweeting this information. Someone wanted to know if the Tesla no-ultrasonics code was working in shadow mode, a blend or pure AutoPilot. Green said that it is not a blend, but he needed to figure out what is displayed on USS-less cars, encouraging someone with a new Model 3 or Model Y to try 2022.40.4.
Although the code is available in 2022.40.4, it's not clear yet whether Tesla is running this code in shadow mode, meaning that the code is run in the background without notifying the user, or if distances are now being shown on vehicles without USS.
Blind spot
Will Teslas have a blind spot directly in front of the vehicle?
Munro
One of the biggest questions that remains is how Tesla will solve the roughly 3 foot blind spot in front of the vehicle where cameras can't see.
Some speculate that Tesla will fill in this gap by taking the information the cameras saw before the vehicle got closer to the object, but this may not work in all circumstanes.
Others think that Tesla may be able to have the car back up in the rare situations where objects in front of the vehicle may have changed, such as when summong a parked vehicle. As these USS-less vehicles make it into more hands and update to 2022.40.4 we should have answers to some of these questions, however Autopark, Summon and Smart Summon remain unavailable on these vehicles, even with the latest update.
Will Tesla stop utilizing ultrasonic sensors like they did radar?
Another Twitter user asked if this would make the USS on the existing vehicles "ornaments?" This has been a widespread concern since the non-USS cars started showing up. Tesla addressed this matter when it announced it was removing USS. It states on the company website: At this time, we do not plan to remove the functionality of ultrasonic sensors in our existing fleet.
At this time USS have only been removed from the Model 3 and Model Y, but they will also be removed from the Model S and Model X in 2023. Green also believes the existing USS will remain operational, tweeting: not any time soon, I imagine. Also, the front ones still cover an area where the cameras don't see.
Another user questioned, does it only take information from the moving/static object networks, or is it able to use the occupancy, and road edge networks as well? To which Green responded that he had not looked into that kind of detail yet.
The new world of non-USS is upon us, and there will be many questions. This revelation is likely the first of a long line of updates to assist Vision in making up what was lost with ultrasonic sensors.
Last week, Mark Ruber, an engineering YouTuber best known for his glitter bombs, released a video where he tested Tesla's Autopilot against various conditions - including the iconic ACME painted wall.
During this test, many people noted that Mark was using Autopilot rather than FSD, even though his video was titled “Can you Fool a Self-Driving Car?”. The Tesla on Autopilot went up against a vehicle equipped with Luminar’s LIDAR rig, running some sort of basic autonomy or safety software.
New Video Tests FSD
Many people were disappointed with Mark’s video and his testing methods, so several creators got to work to actually test out Tesla’s FSD.
Creator Kyle Paul over on X made a much better follow-up video, using both a HW3 Model Y as well as an AI4 Cybertruck. In a relatively unsurprising turn of events, the Cybertruck was successfully able to detect the wall, slowed down, and came to a stop. The Cybertruck was running FSD 13.2.8.
Kyle’s team did a fantastic job building the wall and testing this in a private area using FSD rather than Autopilot. On top of that - they re-tested the results several times and recorded the entire thing in and out. While Mark’s video was more for entertainment, Kyle really set out to prove what would really happen in this unlikely scenario.
Sadly, the HW3 Model Y was unable to detect the wall, and manual intervention was required in each test. While the Model Y was running FSD 12.5.4.2 rather than an FSD V12.6 build, we don’t expect this to have had a significant impact on the test - this is more of an issue with how computer vision analyzes the environment.
There are several major differences between HW3 and HW4. The first is obviously that the version that runs on AI4 is more advanced, as the hardware is capable of processing a lot more data. However, AI4 also features much higher-resolution cameras than HW3, and Tesla recently added the ability for the video feeds to be processed at full resolution on FSD V13. This could have made the difference, although it’s not entirely clear. Perhaps if HW3 gets a version of FSD V13 in the future, HW3 can be retested to see if it passes the “ACME wall” test.
Watch
Kyle’s entire video is below. It’s only 10 minutes long, so definitely give it a watch. Props to Kyle on the quick and thorough execution.
What Does This Mean for FSD?
We broke down Mark’s test - and examined all the little issues that we discovered after doing some in-depth research - you can read our analysis here.
Putting aside the issues with Mark’s testing and instead using the new results - it seems that if you were to have to fight against Wile-E-Coyote and his ACME tools with your Tesla, cartoon logic may win if you’re on an HW3 vehicle. If you’re on an AI4 vehicle, you’ll likely come to a safe stop.
Vehicle depth perception is definitely something that Tesla has been hard at work to improve - and some fairly drastic improvements came with FSD V13 that haven’t been entirely translated to FSD V12 just yet. Future versions of HW3 FSD may be able to determine that the wall is there successfully. So Kyle - if you’re reading this - don’t get rid of that wall. We’d love to see more testing in the future.
However, this entire test scenario is so out of left field… there is a good likelihood this same test would fool some human drivers as well. The most important part is that the future of autonomy will not fall for these tricks, so it's very unlikely for someone to weaponize this idea as it’d only possibly work on a small segment of vehicles.
If Wile-E-Coyote is after you, someone else may drive into the wall before your Tesla does.
Not a Tesla App
We’re not kidding, this really happened already. This isn’t a realistic scenario outside of someone trying to play an insane prank - but it’s good to know that FSD V13 is capable of dodging this.
Tesla regularly holds quarterly all-hands meetings for employees, but last night marks the first time Tesla has live-streamed the event for the public.
The meeting primarily focused on Tesla’s employees, recent achievements, and the future of Tesla. While it didn’t reveal much new information, it was interesting to see Elon Musk candidly engaging with his teams, who seem to genuinely enjoy working with him. Still, there were a few noteworthy takeaways.
As with Tesla’s Earnings Calls and other live events, we’ve put together a concise, easy-to-digest recap of everything discussed.
General Points
Work-related Injuries declined over time
Planning to expand to new markets
Cell Manufacturing
Continuing to invest in battery supply
Cheapest, lowest cost per kWh cell
The supercharger network continues to grow
Vehicle range and charging speed should match the needs of humans and their required time for breaks