Tesla Reveals How It Tests FSD - A Series of Videos

Not a Tesla App

Tesla has published a 16-post series covering a wide range of unique scenarios against which the company tests each FSD release. Tesla’s VP of AI, Ashok Elluswamy, also provided some additional context, which we’ll cover below.

These scenarios could be difficult for a regular driver to respond to and are a good demonstration of FSD’s capabilities. Let’s take a look at all the different scenarios that Tesla regularly tests against. According to Ashok, these tests are only one of 10 ways Tesla validates their software. These tests were done against FSD v12.5.6.3, the HW4 build that’s on approximately 20% of the fleet.

We’ve embedded each video below and also provided some additional information.

1. Reverse Cut-in (Occluded)

Every FSD release is rigorously tested, including rare and adversarial scenarios on closed courses — Here's 16 examples:

1. Reverse Cut-in (Occluded) pic.twitter.com/VWBKDgVuUc

— Tesla AI (@Tesla_AI) November 24, 2024

This first test is for a car reversing out of a parking space, while occluded (vision blocked) by another car or obstacle. In the test, the Model Y notices the incoming car and then brakes with space left over.

2. Peeking (Occluded)

2. Peeking (Occluded) pic.twitter.com/DO3RBhahdy

— Tesla AI (@Tesla_AI) November 24, 2024

In this video, it's hard to even spot the car on the right that’s “peeking” forward—it's occluded by bushes on the side of the road. FSD notices and stops in time to let the other vehicle safely pass.

3. Left Turn Cut-in

3. Left Turn Cut-In pic.twitter.com/ie7VQ9Smtj

— Tesla AI (@Tesla_AI) November 24, 2024

An incoming vehicle that takes a left turn to enter the same lane of travel as FSD - spotted, stopped, and then continuing smoothly. In the second shot, you can see FSD left a considerable amount of space to let the vehicle cut in.

4. Parallel Cut-in (Occluded)

4. Parallel Cut-In (Occluded) pic.twitter.com/RbstvLU7Vo

— Tesla AI (@Tesla_AI) November 24, 2024

This is honestly one of the most common scenarios on a highway - someone cuts in while obscured into your lane of travel. Once again, FSD does its thing with plenty of space to spare.

5. Yield for Oncoming During Overtake

5. Yield for Oncoming During Overtake pic.twitter.com/hXWLCIEHu2

— Tesla AI (@Tesla_AI) November 24, 2024

FSD’s path planner plans an overtake around a stationary vehicle here, sees the oncoming traffic, and politely waits its turn to continue. This is another everyday scenario, especially on urban and suburban streets.

6. Stop Sign Right-of-Way Violator

6. Stop Sign Right-of-Way Violator pic.twitter.com/OHfvzP9t6A

— Tesla AI (@Tesla_AI) November 24, 2024

There are a surprising number of people who don’t know how stop signs work. However, FSD does know how they work and also knows what to do if others act unpredictably. This is one of the best demonstrations of FSD’s capability to react quickly and effectively to unpredictable behavior on the roads.

7. Door Opening During Overtake

7. Door Opening During Overtake pic.twitter.com/ZMDd3BWXI7

— Tesla AI (@Tesla_AI) November 24, 2024

Another overtake scenario, but this time the vehicle being overtaken throws open its door into traffic. Not necessarily the wisest of moves, but humans are unpredictable. Good to see Tesla working to save its vehicles from both hitting the door or having the door hit with its new Blind Spot Monitoring While Parked feature.

8. Right Turn Harsh Braking

8. Right Turn Harsh Braking pic.twitter.com/s4PldABmhK

— Tesla AI (@Tesla_AI) November 24, 2024

This scenario is another common one - someone is taking a right turn, and you expect them to complete the turn, but instead, they slam on the brakes. Here, you can see the vehicle’s Forward Collision Warning goes off due to the sudden reduction of distance between the Tesla and the vehicle in front of it. FSD still manages to brake in time before Automatic Emergency Braking kicks in.

9. Left Turn Across Path

9. Left Turn Across Path pic.twitter.com/MYKj4Z352f

— Tesla AI (@Tesla_AI) November 24, 2024

This one is pretty clean-cut - someone takes a left turn even though you’re on your way through the intersection. This particular accident is one of the most common - 53% of cross-path accidents involve a left turn through an intersection where a side impact will be lethal. FSD can make a big difference - over 8,000 people die in North America alone in this particular scenario.

10. Cut-Out to Static Cone

10. Cut-Out to Static Cone pic.twitter.com/l4OYzLK6XB

— Tesla AI (@Tesla_AI) November 24, 2024

Here, FSD smoothly reacts to an object on the road as the vehicle ahead dodges it. We’d love to see this scenario done with different types of objects or debris, as this is another common item - especially with roadkill on country roads. A good demo of FSD’s collision avoidance maneuvers too!

11. Dynamic Debris (Dropped Cone)

11. Dynamic Debris (Dropped Cone) pic.twitter.com/BMOKmrx9Ds

— Tesla AI (@Tesla_AI) November 24, 2024

Taking it one step further, FSD successfully notices, slows down, stops itself from hitting the bouncing cone, and then makes it around safely. If you’ve ever seen someone strap something down in the bed of a pickup and forget to say “This ain’t going anywhere” - this is that exact scenario.

12. U-Turn Cut-in (Occluded)

12. U-Turn Cut-In (Occluded) pic.twitter.com/gp7H720mJd

— Tesla AI (@Tesla_AI) November 24, 2024

Another high-speed occluded cut-in, this time for a vehicle making a U-Turn from an oddly shaped intersection. FSD started braking the moment the first couple pixels of the Model Y were beyond the bush occluding vision. With a human’s reaction time, this would have resulted in a T-bone.

Ashok Elluswamy mentioned that this is possible because of low latency and high intelligence - combined together, it enables FSD to make a threat assessment and decide what to do, very quickly. It also considers the potential of a rear-end collision - and there is collision avoidance baked into that decision-making.

13. High-Speed Cut-out to Stationary Vehicle

13. High Speed Cut-Out to Stationary Vehicle pic.twitter.com/qC8JQU4WH1

— Tesla AI (@Tesla_AI) November 24, 2024

Similar to the cone cut-out, this one happens at 73mph (117km/h)! FSD sees the car dodging, notices there’s an obstacle, and moves out of the way without dropping speed.

14. High-Speed Harsh Braking

14. High Speed Harsh Braking pic.twitter.com/YD76gh5b2m

— Tesla AI (@Tesla_AI) November 24, 2024

Another common scenario - in fact, the number one reason why pileups occur on highways is the harsh, sudden braking of vehicles in front. FSD once again notices and comes to a safe stop here.

15. High-Speed Stationary Child

15. High Speed Stationary Child pic.twitter.com/sh8xoMo8eF

— Tesla AI (@Tesla_AI) November 24, 2024

Tesla has been previously greatly criticized for its ability to come to a safe stop for children playing on the road. Here, Tesla is demonstrating its capability of doing so - once again with highway speeds of 73mph. 

16. High-Speed Crossing Child

16. High Speed Crossing Child pic.twitter.com/t6bxJpZOZn

— Tesla AI (@Tesla_AI) November 24, 2024

And to really make the point - it can do it with a crossing child too. Tesla has made a strong commitment to safety for vulnerable road users, and this is a good way to show how it works.

That’s a lot of unique scenarios that Tesla tests against - and each and every build has to be vetted against this huge list of different safety tests in order to ensure that the build that ends up in customer hands is as safe as possible. With FSD v13 looking like it's coming soon, we’re excited to see where this takes Tesla next. 

With Musk announcing that FSD v13 is coming soon, it really is starting to feel like Unsupervised FSD and Robotaxi could be pushed out sometime next year.

Follow

Follow

Follow

Is Tesla Planning to Add Steam Support to All Vehicles?

Not a Tesla App

Yesterday, we reported that Tesla updated their Steam integration on Model S and Model X vehicles. The update was part of their 2024 Holiday Update, but it looks like there may be more to this than a simple update.

Steam, a video game library app, makes it easy for users to buy or launch games on their computers. However, a couple of years ago, Valve, who created Steam, launched their own standalone device, the Steam Deck. The Steam Deck runs a custom OS based on Linux.

Steam Launch

When Tesla launched the redesigned Model S and Model X, Tesla introduced a dedicated gaming GPU with 16GB of RAM and touted the ability to play top-tier PC games in Tesla vehicles.

In 2022, Tesla finally launched the Steam app for the Model S and Model X as part of its 2022 Holiday Update. The Steam app runs Steam OS, the same OS as the Steam Deck in a virtual environment.

However, earlier this year, Tesla stopped including the GPU and Steam (Beta) in their vehicles, and we haven’t seen any updates to the Steam in quite some time. In fact, we thought Tesla was axing their gaming-on-the-go dreams.

SteamOS Update

The Steam app, which is still in Beta, is getting an interesting update for the Model S and Model X vehicles with the discrete GPU.

Those vehicles received an update to SteamOS 3.6 - the same version of SteamOS that runs on the Steam Deck. While nothing has visually changed, there’s a long list of performance optimizations under the hood to get things running smoother.

Comparing Steam Deck to Tesla Vehicles

Let’s take a look at the Steam Deck - according to Valve, its onboard Zen4 CPU and GPU combined push a total of 2 TFlops of data, which is fairly respectable, but much lower than today’s home consoles. The Steam Deck is capable of 720p gaming fairly seamlessly on low-to-medium settings on the go and is also built on the AMD platform.

AMD-equipped Teslas, including the Model 3 and Model Y, are packing an older Zen+ (Zen 1.5) APU (processor with a combined CPU and GPU). AMD claims that the V1000 - the same embedded chip as on AMD Tesla vehicles (YE1807C3T4MFB), brings up to 3.6 TFLops of processing power with it, including 4K encoding and decoding with the integrated GPU on board.

While that’s not enough for 4K gaming or comparable to a full-blown console or desktop GPU, that’s enough raw horsepower for light gaming and is currently more powerful than the Steam Deck.

The Model S and Model X’s GPU brings that up to about 10TFlops of power - comparable to modern consoles like the Xbox Series X at 12 TFlops.

Steam Gaming for All Vehicles?

The fact that Tesla is updating SteamOS even though the feature is no longer available in any new vehicles could indicate that Tesla is not only bringing Steam back to Teslas but that it’s going to play a much bigger role.

While SteamOS is run in a virtual environment on top of Tesla’s own OS, we could see Tesla bring SteamOS to all of its current vehicles, including the Model 3, Model Y, and Cybertruck. Steam in these vehicles would likely support any game that’s capable of running on the Steam Deck.

We think this Steam update, which includes performance improvements and a variety of fixes, has quietly passed under most people’s radars. This could be a very exciting update for those who enjoy gaming, especially for those who love to do it in their Tesla.

Follow

Follow

Follow

Tesla Holiday Update Weather Features: All the Small Details

Robert Rosenfeld / YouTube

As part of Tesla’s 2024 Holiday Update, Tesla included two awesome new features - Weather at Destination and the long-awaited Weather Radar Overlay. These two features are big upgrades built upon the weather feature that was added in update 2024.26. The original weather feature added an hourly forecast, as well as the chance of precipitation, UV index, Air Quality Index, and other data.

However, this update also added some smaller weather touches, such as the vehicle alerting you if the weather at the destination will be drastically different from the current weather.

Not a Tesla App

Weather At Destination

When you’re navigating to a destination and viewing the full navigation direction list, the text under the arrival time will show you the expected weather next to your destination. You can also tap this, and the full weather pop-up will show up, showing your destination's full set of weather information.

Note the weather under the arrival time

Not a Tesla App

You can also tap the weather icon at the top of the interface at any time and tap Destination to switch between the weather at your current location and the weather at your destination.

You’re probably considering that the weather at your destination doesn’t matter when you’re three hours away - but that’s all taken into account by the trip planner. It will add in both charge time and travel time and show you the weather at your destination at your expected arrival time.

And if the weather is drastically different or inclement, such as rain or snow, while you’ve got sunshine and rainbows - the weather will be shown above the destination ETA for a few moments before it tucks itself away.

Tesla also recently introduced a new voice command. Asking, “What’s the weather?” or something similar will now bring up Tesla’s weather popup.

The weather pop-up above the ETA

Not a Tesla App

One limitation, though—if you’re planning a long road trip that is more than a day of driving, the weather at destination feature won’t be available until you get closer.

Weather Radar Overlay

As part of the improvements to weather, Tesla has also added a radar overlay for precipitation. You can access the new radar overlay by tapping the map and then tapping the weather icon on the right side of the map. It’ll bring up a radar overlay centered on your vehicle. It’ll animate through the radar data over the last 3 hours so that you can see the direction of the storm, but you can also pause it at any point.

You’re able to scroll around in this view and see the weather anywhere, even if you zoom out. It also works while you’re driving, although it can be a little confusing if you’re trying to pay attention to the navigation system. If you like to have Points of Interest enabled on your map, the weather overlay will hide POIs except for Charging POIs.

Requirements / Data

Unfortunately, you’ll need Premium Connectivity for any of the weather features to work, and being on WiFi or using a hotspot will not be enough to get the data to show up. The data, including the weather radar, is provided by The Weather Channel.

As for supported models, weather and weather at destination are available on all vehicles except for the 2012-2020 Model S and Model X. The weather radar has more strict requirements and requires the newer AMD Ryzen-powered infotainment center available on the 2021+ Model S and Model X and more recent Model 3 and Model Y vehicles.

Follow

Follow

Follow