Tesla Finally Launches FSD V12.4.2 to Customers with Vision-Monitoring Changes

Tesla releases FSD 12.4.2

Not a Tesla App

After a month-long delay, Tesla sent FSD v12.4.2 to employees yesterday with update 2024.15.10. After just a few hours of the update going out to employees, Tesla started sending it to OG testers as well, who were already on FSD v12.4.1.

Issues Behind Delay

On X, Elon Musk broke down some of the details behind the delays. He mentioned that part of the issues behind the V12.4.2 delays were based on training. Tesla was seeing fewer interventions with FSD v12.4, but the release suffered from driving smoothness, which ironically was supposed to be one of the key features of this release.

Musk explained that part of the issue was due to too much focus on interventions, and not enough on normal driving. He compared it to training a doctor on emergency room patients, versus training on regular preventative care.

Vision-Based Attention Monitoring Changes

With FSD update 12.4.2, Tesla changed some of the language used for its Vision-Based Attention Monitoring in the release notes. Here’s a breakdown of some of the key points in the language. The changes to the release notes are below. Phrases or words that were removed are crossed out, while those added are in bold.

“When Full Self-Driving (Supervised) is enabled, the driver monitoring system now primarily relies on the cabin camera to determine driver attentiveness. This enhancement is available on vehicles equipped with a cabin camera and only when the cabin camera has clear and continuous visibility of the driver's eyes Cabin camera must have clear visibility (e.g., the camera is not occluded, eyes, arms are visible, there is sufficient cabin illumination, and the driver is looking forward at the road ahead and not wearing sunglasses, a hat with a low brim without sunglasses, or other objects covering the their eyes). Outside of these In other circumstances, the driver monitoring system will continue to primarily rely on a combination of torque-based (steering wheel) and vision-based monitoring to detect driver attentiveness. When the cabin camera is actively monitoring driver attentiveness, a green dot appears next to the steering wheel icon on the touchscreen.

If the cabin camera detects inattentiveness the driver to be inattentive, a warning will appear. The warning can be dismissed by the driver immediately reverting their attention back to the road ahead. Warnings will escalate depending on the nature and frequency of detected inattentiveness, with continuous inattention leading to a Strikeout.

Cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing.”

Arms Need to be Visible and Other Changes

There are various interesting changes here. While some of the changes are just improved wording to make the feature clearer, there are others that are worth highlighting which could point at changes to Tesla’s vision-based monitoring.

The first is the addition of “arms are visible.” Apparently, Tesla now wants to be able to see your arms to better detect attentiveness. Tesla may want to see that your arms are on the steering wheel, or they maybe they want to make sure your arms are moving so that someone isn’t able to post a static photo in front of the cabin camera to circumvent the attention monitoring. The reason isn’t clear, but looks like having your arms visible is now a requirement.

There are other small changes like the removal of a “hat with a low brim,” which was replaced by more generic wording that says the driver’s eyes must be visible.

However, near the end, Tesla removed the portion that said the driver monitoring system will rely on a combination of torque-based (steering wheel) and vision-based monitoring. This was changed to simply say that Tesla will rely primarily on torque-based (steering wheel) monitoring when vision-based monitoring is unavailable. It’s not clear whether this is just semantics and the wording now better describes how the vision-monitoring feature works, or if Tesla made changes so that the vehicle is simply either doing vision monitoring or steering wheel torque detection, and it doesn’t try to combine the two sources to detect whether the driver is paying attention.

Even more interestingly, the last line that says “cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing,” has been removed. This could point to Tesla saving images of the cabin camera to improve its AI training model.

Tesla will display a green dot on the screen whenever its using its vision-based monitoring system.

Release Date

Either way, we’re glad to finally see FSD v12.4.2 going out to employees and early-access owners. The release is expected to have far fewer interventions and improve vehicle smoothness during braking and acceleration. If there are no major issues found, this update could go wide to all customers with FSD and on update 2024.14 or lower in the coming weeks.

Follow

Follow

Follow

Is Tesla Planning to Add Steam Support to All Vehicles?

Not a Tesla App

Yesterday, we reported that Tesla updated their Steam integration on Model S and Model X vehicles. The update was part of their 2024 Holiday Update, but it looks like there may be more to this than a simple update.

Steam, a video game library app, makes it easy for users to buy or launch games on their computers. However, a couple of years ago, Valve, who created Steam, launched their own standalone device, the Steam Deck. The Steam Deck runs a custom OS based on Linux.

Steam Launch

When Tesla launched the redesigned Model S and Model X, Tesla introduced a dedicated gaming GPU with 16GB of RAM and touted the ability to play top-tier PC games in Tesla vehicles.

In 2022, Tesla finally launched the Steam app for the Model S and Model X as part of its 2022 Holiday Update. The Steam app runs Steam OS, the same OS as the Steam Deck in a virtual environment.

However, earlier this year, Tesla stopped including the GPU and Steam (Beta) in their vehicles, and we haven’t seen any updates to the Steam in quite some time. In fact, we thought Tesla was axing their gaming-on-the-go dreams.

SteamOS Update

The Steam app, which is still in Beta, is getting an interesting update for the Model S and Model X vehicles with the discrete GPU.

Those vehicles received an update to SteamOS 3.6 - the same version of SteamOS that runs on the Steam Deck. While nothing has visually changed, there’s a long list of performance optimizations under the hood to get things running smoother.

Comparing Steam Deck to Tesla Vehicles

Let’s take a look at the Steam Deck - according to Valve, its onboard Zen4 CPU and GPU combined push a total of 2 TFlops of data, which is fairly respectable, but much lower than today’s home consoles. The Steam Deck is capable of 720p gaming fairly seamlessly on low-to-medium settings on the go and is also built on the AMD platform.

AMD-equipped Teslas, including the Model 3 and Model Y, are packing an older Zen+ (Zen 1.5) APU (processor with a combined CPU and GPU). AMD claims that the V1000 - the same embedded chip as on AMD Tesla vehicles (YE1807C3T4MFB), brings up to 3.6 TFLops of processing power with it, including 4K encoding and decoding with the integrated GPU on board.

While that’s not enough for 4K gaming or comparable to a full-blown console or desktop GPU, that’s enough raw horsepower for light gaming and is currently more powerful than the Steam Deck.

The Model S and Model X’s GPU brings that up to about 10TFlops of power - comparable to modern consoles like the Xbox Series X at 12 TFlops.

Steam Gaming for All Vehicles?

The fact that Tesla is updating SteamOS even though the feature is no longer available in any new vehicles could indicate that Tesla is not only bringing Steam back to Teslas but that it’s going to play a much bigger role.

While SteamOS is run in a virtual environment on top of Tesla’s own OS, we could see Tesla bring SteamOS to all of its current vehicles, including the Model 3, Model Y, and Cybertruck. Steam in these vehicles would likely support any game that’s capable of running on the Steam Deck.

We think this Steam update, which includes performance improvements and a variety of fixes, has quietly passed under most people’s radars. This could be a very exciting update for those who enjoy gaming, especially for those who love to do it in their Tesla.

Follow

Follow

Follow

Tesla Holiday Update Weather Features: All the Small Details

Robert Rosenfeld / YouTube

As part of Tesla’s 2024 Holiday Update, Tesla included two awesome new features - Weather at Destination and the long-awaited Weather Radar Overlay. These two features are big upgrades built upon the weather feature that was added in update 2024.26. The original weather feature added an hourly forecast, as well as the chance of precipitation, UV index, Air Quality Index, and other data.

However, this update also added some smaller weather touches, such as the vehicle alerting you if the weather at the destination will be drastically different from the current weather.

Not a Tesla App

Weather At Destination

When you’re navigating to a destination and viewing the full navigation direction list, the text under the arrival time will show you the expected weather next to your destination. You can also tap this, and the full weather pop-up will show up, showing your destination's full set of weather information.

Note the weather under the arrival time

Not a Tesla App

You can also tap the weather icon at the top of the interface at any time and tap Destination to switch between the weather at your current location and the weather at your destination.

You’re probably considering that the weather at your destination doesn’t matter when you’re three hours away - but that’s all taken into account by the trip planner. It will add in both charge time and travel time and show you the weather at your destination at your expected arrival time.

And if the weather is drastically different or inclement, such as rain or snow, while you’ve got sunshine and rainbows - the weather will be shown above the destination ETA for a few moments before it tucks itself away.

Tesla also recently introduced a new voice command. Asking, “What’s the weather?” or something similar will now bring up Tesla’s weather popup.

The weather pop-up above the ETA

Not a Tesla App

One limitation, though—if you’re planning a long road trip that is more than a day of driving, the weather at destination feature won’t be available until you get closer.

Weather Radar Overlay

As part of the improvements to weather, Tesla has also added a radar overlay for precipitation. You can access the new radar overlay by tapping the map and then tapping the weather icon on the right side of the map. It’ll bring up a radar overlay centered on your vehicle. It’ll animate through the radar data over the last 3 hours so that you can see the direction of the storm, but you can also pause it at any point.

You’re able to scroll around in this view and see the weather anywhere, even if you zoom out. It also works while you’re driving, although it can be a little confusing if you’re trying to pay attention to the navigation system. If you like to have Points of Interest enabled on your map, the weather overlay will hide POIs except for Charging POIs.

Requirements / Data

Unfortunately, you’ll need Premium Connectivity for any of the weather features to work, and being on WiFi or using a hotspot will not be enough to get the data to show up. The data, including the weather radar, is provided by The Weather Channel.

As for supported models, weather and weather at destination are available on all vehicles except for the 2012-2020 Model S and Model X. The weather radar has more strict requirements and requires the newer AMD Ryzen-powered infotainment center available on the 2021+ Model S and Model X and more recent Model 3 and Model Y vehicles.

Follow

Follow

Follow