Tesla will introduce an enhanced Automatic Emergency Braking in the latest FSD Beta, v11.3
Tesla
Tesla is introducing improvements to its Automatic Emergency Braking (AEB) system that goes beyond the standard AEB functionality. This new system includes the ability to detect and respond to vehicles that are not only in front of the car but ones that cross the car's path.
AEB is an important safety feature that can help reduce the risk of accidents and save road life. The system uses sensors and cameras to monitor the road ahead and identify potential obstacles, including other vehicles, pedestrians, and objects. When the system detects that a collision is about to occur, it will warn the driver with visual and/or audible alerts. If the driver does not respond, it will apply the brakes automatically to slow down or stop the vehicle.
How Tesla is Advancing AEB
Tesla's improvements to Automatic Emergency Braking system go beyond the standard AEB functionality, adding the ability to detect and react to vehicles that cross the car's path or "steals the right of way," such as a vehicle that runs a red light or cuts off the Tesla. According to Tesla, nearly half of the collisions of this nature would be avoided with this newly expanded system. From Tesla's release notes in the upcoming FSD Beta v11.3, Tesla states:
Expanded Automatic Emergency Braking (AEB) to handle vehicles that cross ego's path. This includes cases where other vehicles run their red light or turn across ego's path, stealing the right-of-way. Replay of previous collisions of this type suggests that 49% of the events would be mitigated by the new behavior. This improvement is now active in both manual driving and autopilot operation.
While the latest update has not gone out to the public, we have seen countless examples of Teslas already reacting to vehicles that turn in front of or swerve in front of them.
History of AEB
Automatic Emergency Braking is a safety technology that has been around since the mid-2000s and has become an increasingly common feature in newer vehicles. AEB is also known by other names, such as Collision Mitigation Braking System (CMBS) on Honda vehicles and Active Brake Assist on Mercedes-Benz vehicles. Bosch and Volvo were among the early pioneers in the field.
Bosch introduced its Predictive Safety System in 2006, and Volvo launched its City Safety system in 2008. Since then, many other car manufacturers and technology companies have developed their AEB systems, incorporating a range of sensors, algorithms, and machine learning techniques to improve the accuracy and effectiveness of the technology.
Learnings From FSD Beta
The AEB advancement is listed in the most recent FSD Beta release notes, v11.3. However, the upgraded system will respond in FSD or with all Autopilot features off. This is a significant safety advancement that Tesla will be providing, free of charge, during the next major over-the-air update for FSD Beta users.
Tesla is clearly taking everything it's learning from FSD Beta and its improved vision system and applying it to other areas, much like how it introduced Auto Cancel turn signals. With Auto Cancel Turn Signals, Tesla learned when to turn off your turn signal with its FSD Beta progress, and now you have the option to let the vehicle to turn off your turn signal for you after switching lanes
Improved AEB for All?
FSD Beta currently remains on a separate track from Tesla's other updates, which means not everyone will get the improvements to AEB, at least initially. Given Tesla's history with safety features, we expect that Tesla will eventually add this feature to non-FSD Beta builds or merge FSD and non-FSD builds so that all owners have access to the improved Automatic Emergency Braking.
It's already been shown that Teslas on Autopilot are ten times safer than human drivers and 2.5 times safer with Autopilot disengaged. It's due to features like this that continue to make the safest car on the planet even safer.
Last week, Mark Ruber, an engineering YouTuber best known for his glitter bombs, released a video where he tested Tesla's Autopilot against various conditions - including the iconic ACME painted wall.
During this test, many people noted that Mark was using Autopilot rather than FSD, even though his video was titled “Can you Fool a Self-Driving Car?”. The Tesla on Autopilot went up against a vehicle equipped with Luminar’s LIDAR rig, running some sort of basic autonomy or safety software.
New Video Tests FSD
Many people were disappointed with Mark’s video and his testing methods, so several creators got to work to actually test out Tesla’s FSD.
Creator Kyle Paul over on X made a much better follow-up video, using both a HW3 Model Y as well as an AI4 Cybertruck. In a relatively unsurprising turn of events, the Cybertruck was successfully able to detect the wall, slowed down, and came to a stop. The Cybertruck was running FSD 13.2.8.
Kyle’s team did a fantastic job building the wall and testing this in a private area using FSD rather than Autopilot. On top of that - they re-tested the results several times and recorded the entire thing in and out. While Mark’s video was more for entertainment, Kyle really set out to prove what would really happen in this unlikely scenario.
Sadly, the HW3 Model Y was unable to detect the wall, and manual intervention was required in each test. While the Model Y was running FSD 12.5.4.2 rather than an FSD V12.6 build, we don’t expect this to have had a significant impact on the test - this is more of an issue with how computer vision analyzes the environment.
There are several major differences between HW3 and HW4. The first is obviously that the version that runs on AI4 is more advanced, as the hardware is capable of processing a lot more data. However, AI4 also features much higher-resolution cameras than HW3, and Tesla recently added the ability for the video feeds to be processed at full resolution on FSD V13. This could have made the difference, although it’s not entirely clear. Perhaps if HW3 gets a version of FSD V13 in the future, HW3 can be retested to see if it passes the “ACME wall” test.
Watch
Kyle’s entire video is below. It’s only 10 minutes long, so definitely give it a watch. Props to Kyle on the quick and thorough execution.
What Does This Mean for FSD?
We broke down Mark’s test - and examined all the little issues that we discovered after doing some in-depth research - you can read our analysis here.
Putting aside the issues with Mark’s testing and instead using the new results - it seems that if you were to have to fight against Wile-E-Coyote and his ACME tools with your Tesla, cartoon logic may win if you’re on an HW3 vehicle. If you’re on an AI4 vehicle, you’ll likely come to a safe stop.
Vehicle depth perception is definitely something that Tesla has been hard at work to improve - and some fairly drastic improvements came with FSD V13 that haven’t been entirely translated to FSD V12 just yet. Future versions of HW3 FSD may be able to determine that the wall is there successfully. So Kyle - if you’re reading this - don’t get rid of that wall. We’d love to see more testing in the future.
However, this entire test scenario is so out of left field… there is a good likelihood this same test would fool some human drivers as well. The most important part is that the future of autonomy will not fall for these tricks, so it's very unlikely for someone to weaponize this idea as it’d only possibly work on a small segment of vehicles.
If Wile-E-Coyote is after you, someone else may drive into the wall before your Tesla does.
Not a Tesla App
We’re not kidding, this really happened already. This isn’t a realistic scenario outside of someone trying to play an insane prank - but it’s good to know that FSD V13 is capable of dodging this.
Tesla regularly holds quarterly all-hands meetings for employees, but last night marks the first time Tesla has live-streamed the event for the public.
The meeting primarily focused on Tesla’s employees, recent achievements, and the future of Tesla. While it didn’t reveal much new information, it was interesting to see Elon Musk candidly engaging with his teams, who seem to genuinely enjoy working with him. Still, there were a few noteworthy takeaways.
As with Tesla’s Earnings Calls and other live events, we’ve put together a concise, easy-to-digest recap of everything discussed.
General Points
Work-related Injuries declined over time
Planning to expand to new markets
Cell Manufacturing
Continuing to invest in battery supply
Cheapest, lowest cost per kWh cell
The supercharger network continues to grow
Vehicle range and charging speed should match the needs of humans and their required time for breaks