Tesla has made improvements to automatic emergency braking
Tesla
Tesla has introduced notable upgrades to its Automatic Emergency Braking (AEB) system in a recent FSD Beta update. Initially, FSD Beta 11.3, which only went out to Tesla employees, included a significant update to Tesla's automatic emergency braking.
However, when FSD Beta 11.3.1 was released to public testers, the release notes significantly differed from the employee version, leaving some uncertainty regarding the status of AEB enhancements.
Other features were removed from the release notes in FSD Beta 11.3.1, including Voice Drive Notes, which was clearly still available in the public beta. It's not clear whether the changes to the release notes was a mistake or if Tesla chosen to highlight changes between 11.3 and 11.3.1.
AEB Now Detects Vehicles Moving Across Tesla's Path
The company's impact report has recently confirmed that the improved AEB system was incorporated into the FSD Beta. The enhancements include detecting and responding to vehicles moving perpendicular to the Tesla. This advanced feature aims to reduce the likelihood of accidents occurring when other vehicles cross Tesla's path, such as running red lights or cutting the Tesla off.
This development represents a significant leap forward in AEB technology, as traditional systems mainly focus on detecting and reacting to objects and vehicles directly in front of the car. With the ability to detect crossing vehicles, Tesla's upgraded AEB system offers increased safety and assistance to drivers.
Expanded Automatic Emergency Braking (AEB) to handle vehicles that cross ego's path. This includes cases where other vehicles run their red light or turn across ego's path, stealing the right-of-way. Replay of previous collisions of this type suggests that 49% of the events would be mitigated by the new behavior. This improvement is now active in both manual driving and autopilot operation.
Safety Improvements Tested Extensively with Fleet Miles
Tesla has rigorously tested and validated these AEB advancements by utilizing millions of fleet miles in shadow mode. The Tesla Vision system, which consists of eight cameras, allows Tesla vehicles to identify and react to oncoming vehicles well beyond the range of traditional sensors. In addition, the Automatic Emergency Braking system offers a loud warning and rapid braking when a Tesla vehicle senses an impending collision, and the driver has not intervened.
These AEB enhancements demonstrate Tesla's commitment to improving road safety and minimizing accident risks. In 2021, US pedestrian and road-user fatalities reached their highest levels, with a 53% increase since 2012 and over 75% of deaths at night. Tesla's Model S, Model 3, Model X, and Model Y have all received five-star ratings from Euro NCAP, including for nighttime pedestrian crash avoidance. Furthermore, the Model 3 and Model Y have earned a "Superior" rating from IIHS for the nighttime performance of their pedestrian AEB systems.
Improved AEB System Expected to Reach All Tesla Owners
The availability of the improved AEB for all Tesla owners remains uncertain, as FSD Beta is currently separate from other updates. However, considering Tesla's history of prioritizing safety features, it is likely that the upgraded Automatic Emergency Braking system will eventually be made accessible to all users. This move would further solidify Tesla's position as a manufacturer of some of the safest vehicles available today.
Moreover, Tesla's commitment to vehicle safety and continuous software updates demonstrates its dedication to its customers. As Tesla learns more about real-world driving scenarios and collects data from its fleet, it will continue refining and enhancing its driver assistance systems. The result is a safer and more reliable driving experience for Tesla owners and other road users.
Integrating the improved AEB system into Tesla's FSD Beta may pave the way for more advanced driver assistance features. In addition, by incorporating cutting-edge technology and prioritizing safety, Tesla sets a high standard for other automakers to follow in creating vehicles that protect their occupants and other road users.
Last week, Mark Ruber, an engineering YouTuber best known for his glitter bombs, released a video where he tested Tesla's Autopilot against various conditions - including the iconic ACME painted wall.
During this test, many people noted that Mark was using Autopilot rather than FSD, even though his video was titled “Can you Fool a Self-Driving Car?”. The Tesla on Autopilot went up against a vehicle equipped with Luminar’s LIDAR rig, running some sort of basic autonomy or safety software.
New Video Tests FSD
Many people were disappointed with Mark’s video and his testing methods, so several creators got to work to actually test out Tesla’s FSD.
Creator Kyle Paul over on X made a much better follow-up video, using both a HW3 Model Y as well as an AI4 Cybertruck. In a relatively unsurprising turn of events, the Cybertruck was successfully able to detect the wall, slowed down, and came to a stop. The Cybertruck was running FSD 13.2.8.
Kyle’s team did a fantastic job building the wall and testing this in a private area using FSD rather than Autopilot. On top of that - they re-tested the results several times and recorded the entire thing in and out. While Mark’s video was more for entertainment, Kyle really set out to prove what would really happen in this unlikely scenario.
Sadly, the HW3 Model Y was unable to detect the wall, and manual intervention was required in each test. While the Model Y was running FSD 12.5.4.2 rather than an FSD V12.6 build, we don’t expect this to have had a significant impact on the test - this is more of an issue with how computer vision analyzes the environment.
There are several major differences between HW3 and HW4. The first is obviously that the version that runs on AI4 is more advanced, as the hardware is capable of processing a lot more data. However, AI4 also features much higher-resolution cameras than HW3, and Tesla recently added the ability for the video feeds to be processed at full resolution on FSD V13. This could have made the difference, although it’s not entirely clear. Perhaps if HW3 gets a version of FSD V13 in the future, HW3 can be retested to see if it passes the “ACME wall” test.
Watch
Kyle’s entire video is below. It’s only 10 minutes long, so definitely give it a watch. Props to Kyle on the quick and thorough execution.
What Does This Mean for FSD?
We broke down Mark’s test - and examined all the little issues that we discovered after doing some in-depth research - you can read our analysis here.
Putting aside the issues with Mark’s testing and instead using the new results - it seems that if you were to have to fight against Wile-E-Coyote and his ACME tools with your Tesla, cartoon logic may win if you’re on an HW3 vehicle. If you’re on an AI4 vehicle, you’ll likely come to a safe stop.
Vehicle depth perception is definitely something that Tesla has been hard at work to improve - and some fairly drastic improvements came with FSD V13 that haven’t been entirely translated to FSD V12 just yet. Future versions of HW3 FSD may be able to determine that the wall is there successfully. So Kyle - if you’re reading this - don’t get rid of that wall. We’d love to see more testing in the future.
However, this entire test scenario is so out of left field… there is a good likelihood this same test would fool some human drivers as well. The most important part is that the future of autonomy will not fall for these tricks, so it's very unlikely for someone to weaponize this idea as it’d only possibly work on a small segment of vehicles.
If Wile-E-Coyote is after you, someone else may drive into the wall before your Tesla does.
Not a Tesla App
We’re not kidding, this really happened already. This isn’t a realistic scenario outside of someone trying to play an insane prank - but it’s good to know that FSD V13 is capable of dodging this.
Tesla regularly holds quarterly all-hands meetings for employees, but last night marks the first time Tesla has live-streamed the event for the public.
The meeting primarily focused on Tesla’s employees, recent achievements, and the future of Tesla. While it didn’t reveal much new information, it was interesting to see Elon Musk candidly engaging with his teams, who seem to genuinely enjoy working with him. Still, there were a few noteworthy takeaways.
As with Tesla’s Earnings Calls and other live events, we’ve put together a concise, easy-to-digest recap of everything discussed.
General Points
Work-related Injuries declined over time
Planning to expand to new markets
Cell Manufacturing
Continuing to invest in battery supply
Cheapest, lowest cost per kWh cell
The supercharger network continues to grow
Vehicle range and charging speed should match the needs of humans and their required time for breaks