What’s Coming in Tesla FSD V13

Not a Tesla App

As part of an update to its AI roadmap, Tesla has also announced the features that will be in FSD v13. Tesla provided many details about what we can expect, and there’s a lot of info to break down.

Tesla’s VP of AI, Ashok Elluswamy, also revealed that FSD v13 is expected to make FSD Unsupervised feature complete. That doesn’t mean that autonomy will be ready, as each feature will still need to work at safety levels higher than a human, but it means every key feature of autonomous vehicles will be present in FSD v13.

Let’s examine the v13 feature list Tesla and Tesla employees have recently provided to see exactly what’s coming.

Higher Resolution Video & Native AI4

FSD v12 has been trained using Tesla’s HW3 cameras and downsampling the AI4 cameras to match. For the first time, Tesla will use AI4's native camera resolution to get the clearest image possible. Not only will Tesla increase the resolution, but they’re also increasing the capture rate to 36 FPS (frames per second). This should result in extreme smoothness and the ability of the vehicle to detect objects earlier and more precisely. It’ll be a big boon for FSD, but it’ll come at the price of processing all of this additional information.

The HW3 cameras have a resolution of about 1.2 megapixels, while the AI4 cameras have a resolution of 5.44 megapixels. That’s a 4.5x improvement in raw resolution - which is a lot of new data for the inference computer and AI models to deal with. 

Yun-Ti Tsai, Senior Staff Engineer at Tesla AI, mentioned on X that the total data bandwidth is 1.3 gigapixels per second, running at 36 hertz, with nearly 0 latency between capture and inference. This is one of the baseline features for getting v13 off the ground, and through this feature update, we can expect better vehicle performance, sign reading, and lots of little upgrades.

Bigger Models, Bigger Context, Better Data

The next big item is that Tesla will increase the size of the FSD model by three times and the overall context length by the same amount. What that means, in simple terms, is that FSD will have a lot more information to draw upon—both at the moment (the context length) and from background knowledge and training (model size). 

In layman’s terms, Tesla has made the FSD brain bigger and increased the amount of information it can remember. This means that FSD will have a lot more data to work with when making decisions, both from what's happening right now and from what it has learned in the past.

Beyond that, Tesla has also massively expanded the data scaling and training compute to match. Tesla is increasing the amount of training data by 4.2 times and increasing their training commute power by 5x.

Video of the inside of Cortex today, the giant new AI training supercluster being built at Tesla HQ in Austin to solve real-world AI pic.twitter.com/DwJVUWUrb5

— Elon Musk (@elonmusk) August 26, 2024

Audio Intake

Tesla’s FSD has famously only relied upon visual data—equivalent to what humans can access. LiDAR hasn’t been on Tesla’s books except for model validation, and radar, while used in the past, was mostly phased out.

Now, Tesla AI will integrate audio intake into FSD’s models, with a focus on better handling of emergency vehicles. FSD will soon be able to react to emergency vehicles, even before it sees them. This is big news and is in line with how Tesla has been approaching FSD—through a very human-like lens.

We’re excited to see how these updates pan out - but there was one more thing. Ashok Elluswamy, VP of AI at Tesla, confirmed on X that they’ll add the ability for FSD to honk the horn.

Other Improvements

The other improvements, while major, can be summarized pretty simply. Tesla is focusing on improving smoothness and safety in various ways. The v13 AI will be trained to predict and adapt for collision avoidance, navigation, and better following traffic controls. This will make it more predictable for users and other drivers and improve general safety.

Beyond that, Tesla is also working on a better representation of the map and navigation inputs versus what FSD actually does. In complex situations, FSD may choose to take a different turn or exit, even if navigation is telling it to go the other way. This future update will likely close this gap and ensure that your route and FSD’s path planner match closely.

Of course, Tesla will also be working on adding Unpark, Reverse, and Park capabilities, as well as support for destination options, including parking in a spot, driveway, or garage or just pulling over at a specific point, like at an entrance.

Finally, they’re also working on adding improved camera self-cleaning and better handling of camera occlusion. Currently, FSD can and will clean the front cameras if they are obscured with debris, but only if they are fully blocked. Partial blockages do not trigger the wipers. Additionally, when the B-Pillar cameras are blinded by sunlight, FSD tends to have difficulties staying centered in the lane. This specific update is expected to address both of these issues.

FSD V13 Release Date

Tesla announced that FSD v13 will be released to employees this week, however, it’ll take various iterations before it’s released to the public. Tesla mentioned that they expect FSD v13 to be released to customers around v13.3, but surprisingly, they state that this will happen around the Thanksgiving timeframe — just a few weeks away.

Tesla is known for delays with its FSD releases, so we’re cautious about the late November timeline. However, the real takeaway is that FSD v13 is expected to offer a substantial leap in capability over the next few months—even if it’s exclusive to AI4.

Follow

Follow

Follow

Is Tesla Planning to Add Steam Support to All Vehicles?

Not a Tesla App

Yesterday, we reported that Tesla updated their Steam integration on Model S and Model X vehicles. The update was part of their 2024 Holiday Update, but it looks like there may be more to this than a simple update.

Steam, a video game library app, makes it easy for users to buy or launch games on their computers. However, a couple of years ago, Valve, who created Steam, launched their own standalone device, the Steam Deck. The Steam Deck runs a custom OS based on Linux.

Steam Launch

When Tesla launched the redesigned Model S and Model X, Tesla introduced a dedicated gaming GPU with 16GB of RAM and touted the ability to play top-tier PC games in Tesla vehicles.

In 2022, Tesla finally launched the Steam app for the Model S and Model X as part of its 2022 Holiday Update. The Steam app runs Steam OS, the same OS as the Steam Deck in a virtual environment.

However, earlier this year, Tesla stopped including the GPU and Steam (Beta) in their vehicles, and we haven’t seen any updates to the Steam in quite some time. In fact, we thought Tesla was axing their gaming-on-the-go dreams.

SteamOS Update

The Steam app, which is still in Beta, is getting an interesting update for the Model S and Model X vehicles with the discrete GPU.

Those vehicles received an update to SteamOS 3.6 - the same version of SteamOS that runs on the Steam Deck. While nothing has visually changed, there’s a long list of performance optimizations under the hood to get things running smoother.

Comparing Steam Deck to Tesla Vehicles

Let’s take a look at the Steam Deck - according to Valve, its onboard Zen4 CPU and GPU combined push a total of 2 TFlops of data, which is fairly respectable, but much lower than today’s home consoles. The Steam Deck is capable of 720p gaming fairly seamlessly on low-to-medium settings on the go and is also built on the AMD platform.

AMD-equipped Teslas, including the Model 3 and Model Y, are packing an older Zen+ (Zen 1.5) APU (processor with a combined CPU and GPU). AMD claims that the V1000 - the same embedded chip as on AMD Tesla vehicles (YE1807C3T4MFB), brings up to 3.6 TFLops of processing power with it, including 4K encoding and decoding with the integrated GPU on board.

While that’s not enough for 4K gaming or comparable to a full-blown console or desktop GPU, that’s enough raw horsepower for light gaming and is currently more powerful than the Steam Deck.

The Model S and Model X’s GPU brings that up to about 10TFlops of power - comparable to modern consoles like the Xbox Series X at 12 TFlops.

Steam Gaming for All Vehicles?

The fact that Tesla is updating SteamOS even though the feature is no longer available in any new vehicles could indicate that Tesla is not only bringing Steam back to Teslas but that it’s going to play a much bigger role.

While SteamOS is run in a virtual environment on top of Tesla’s own OS, we could see Tesla bring SteamOS to all of its current vehicles, including the Model 3, Model Y, and Cybertruck. Steam in these vehicles would likely support any game that’s capable of running on the Steam Deck.

We think this Steam update, which includes performance improvements and a variety of fixes, has quietly passed under most people’s radars. This could be a very exciting update for those who enjoy gaming, especially for those who love to do it in their Tesla.

Follow

Follow

Follow

Tesla Holiday Update Weather Features: All the Small Details

Robert Rosenfeld / YouTube

As part of Tesla’s 2024 Holiday Update, Tesla included two awesome new features - Weather at Destination and the long-awaited Weather Radar Overlay. These two features are big upgrades built upon the weather feature that was added in update 2024.26. The original weather feature added an hourly forecast, as well as the chance of precipitation, UV index, Air Quality Index, and other data.

However, this update also added some smaller weather touches, such as the vehicle alerting you if the weather at the destination will be drastically different from the current weather.

Not a Tesla App

Weather At Destination

When you’re navigating to a destination and viewing the full navigation direction list, the text under the arrival time will show you the expected weather next to your destination. You can also tap this, and the full weather pop-up will show up, showing your destination's full set of weather information.

Note the weather under the arrival time

Not a Tesla App

You can also tap the weather icon at the top of the interface at any time and tap Destination to switch between the weather at your current location and the weather at your destination.

You’re probably considering that the weather at your destination doesn’t matter when you’re three hours away - but that’s all taken into account by the trip planner. It will add in both charge time and travel time and show you the weather at your destination at your expected arrival time.

And if the weather is drastically different or inclement, such as rain or snow, while you’ve got sunshine and rainbows - the weather will be shown above the destination ETA for a few moments before it tucks itself away.

Tesla also recently introduced a new voice command. Asking, “What’s the weather?” or something similar will now bring up Tesla’s weather popup.

The weather pop-up above the ETA

Not a Tesla App

One limitation, though—if you’re planning a long road trip that is more than a day of driving, the weather at destination feature won’t be available until you get closer.

Weather Radar Overlay

As part of the improvements to weather, Tesla has also added a radar overlay for precipitation. You can access the new radar overlay by tapping the map and then tapping the weather icon on the right side of the map. It’ll bring up a radar overlay centered on your vehicle. It’ll animate through the radar data over the last 3 hours so that you can see the direction of the storm, but you can also pause it at any point.

You’re able to scroll around in this view and see the weather anywhere, even if you zoom out. It also works while you’re driving, although it can be a little confusing if you’re trying to pay attention to the navigation system. If you like to have Points of Interest enabled on your map, the weather overlay will hide POIs except for Charging POIs.

Requirements / Data

Unfortunately, you’ll need Premium Connectivity for any of the weather features to work, and being on WiFi or using a hotspot will not be enough to get the data to show up. The data, including the weather radar, is provided by The Weather Channel.

As for supported models, weather and weather at destination are available on all vehicles except for the 2012-2020 Model S and Model X. The weather radar has more strict requirements and requires the newer AMD Ryzen-powered infotainment center available on the 2021+ Model S and Model X and more recent Model 3 and Model Y vehicles.

Follow

Follow

Follow