A Friday night cruise with Elon Musk has shown the world just how far Tesla’s Full Self-Driving has advanced and gave viewers a preview of real-world problems. To take a line from Rob Zombie, the latest iteration of FSD may be "More Human Than Human," which could be an issue.
"Nothing but net!" proclaimed Musk as he live-streamed to X.com, a video with more than 42 million views. The Tesla CEO referred to neural nets, the technology underpinning Version 12 of FSD. Tesla is removing 300,000-plus lines of code running the current FSD and is now relying on the car's neural networks to drive the car in V12.
Driving through Palo Alto, California, Musk, with Ashok Elluswamy, Tesla’s Director of Autopilot Software, sitting shotgun, picked random places for the Model S to drive to, and it did so smoothly and almost perfectly.
Technology Behind FSD
The test drive started with a construction zone, which was easily handled, but interestingly, at the end of the cones, the car wasn’t jerking over to find a lane immediately. Instead, like a confident human driver, it easily made its way to the lane with no oncoming traffic. We also watched as it effortlessly navigated speed bumps, roundabouts, pedestrians, bicyclists, and, of course - traffic.
For those who have had successful drives with FSD, you may be thinking, what's the big deal? Musk underscored that this version of FSD does not rely on hard-coded programming or a constant internet connection to function. All necessary inference occurs locally, a significant departure from previous versions.
“This is all nets, baby, nothing but net,” Musk exclaimed, emphasizing the vehicle’s dependency on machine learning rather than programmed instructions. The software operates at full frame rate, taking eight cameras at 36 frames per second to decide what to do. No line of code tells the car what to do at an intersection, on the highway or around other vehicles.
The software was impressive to watch, with its countless improvements over the current V11 version of FSD. Musk's vehicle kept a reasonable speed throughout the drive, even though Autopilot was set to a maximum speed of 85 mph.
When Musk reached his destination, the vehicle also automatically pulled over to the side of the road to park itself instead of just stopping in the middle of the road like it does today.
The Real-World, Real Person Challenge
Instead, Tesla has shown the car countless videos of real-world driving so that it will learn what to do in those situations. But that has caused a problem. As the car noticeably did not come to full stops, Musk explained the challenge posed by the fact that less than 0.5% of drivers come to a complete stop at stop signs.
This makes it incredibly difficult to program the vehicle with such sparse data on people obeying the law. This lack of data highlights Tesla's obstacles in training its AI systems to operate in real-world scenarios where human drivers frequently do not adhere to the rules.
Musk's FSD V12 Stream in 10 Minutes
Watch the highlights of Musk's 45-minute video stream below.
Regulatory Hurdles
This appeared in a few other instances where the car behaved like a confident driver, not endangering anyone but technically breaking the rules of the road. FSD suddenly went from the nervous teenager learning to drive to a good driver. But we know how the NHTSA feels about Tesla not following the rules.
In February, the watchdog issued a recall stating that Tesla was acting too human — I mean not following the rules. It cited FSD Beta software:
Traveling or turning through certain intersections during a stale yellow traffic light;
The perceived duration of the vehicle’s static position at certain intersections with a stop sign, particularly when the intersection is clear of any other road users;
Adjusting vehicle speed while traveling through certain variable speed zones, based on detected speed limit signage and/or the vehicle’s speed offset setting that is adjusted by the driver.
Yes, I’m sure we all stop at every yellow light, come to a complete stop at every stop sign, and never go over the speed limit.
Kudos to Tesla and Musk for this real-world demonstration, and if there was any speculation that it was rigged, Musk did have to intervene at an advanced left-hand signal. This small glitch, Musk reassured, could be addressed with further training and data collection. There will be a lot of training announced Tesla’s commitment to invest $4 billion over the next two years in training computing, signaling the company's dedication to perfecting this groundbreaking technology.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Winter is here, and temperatures are dropping, so one of the most common Tesla questions is about to resurface.
If you’ve landed here after frantically searching about “smoke” coming from your Tesla while Supercharging, take a deep breath—it’s completely normal.
Tesla Smoking While Charging
If you’re Supercharging in freezing weather—even with preconditioning—you might notice steam rising from your Tesla. But rest assured, your car isn’t smoking.
Your Tesla’s heat pump is hard at work warming both the cabin and battery to keep you comfortable and ensure optimal charging temperatures. Over time, condensation and ice build-up in the heat exchanger coils.
Why Does It Happen?
When you reach a Supercharger with your vehicle, the heat pump is still running hot, but without the cold air from driving to keep the heat exchanger coils cool, the ice and condensation quickly start to evaporate—creating what looks like smoke.
Since this typically happens near the front of the vehicle, where a car would traditionally have an engine, new vehicle owners can be startled by the discovery. However, rest assured that it’s just water vapor and it’s completely normal in cold weather.
In fact, this behavior can be experienced in any EV with a heat pump in cold climates. So, if you saw steam coming out of your vehicle and panicked, don’t worry—you’re not alone.
Now that you know what’s happening, go ahead and Supercharge with confidence.
Tesla made a lot of improvements in the 2024 Holiday Update, including more than 15 undocumented improvements that were included in the release. One of these was a stealthy performance improvement to the YouTube app.
Several people have mentioned they’ve seen improved performance on YouTube since this year’s Holiday Update - and there’s an interesting reason why.
YouTube Improvements
The improved YouTube performance in Tesla vehicles comes from an unexpected source—Tesla actually rolled back support for YouTube’s newer AV1 video encoding. Instead, vehicles now default to the older VP9 encoding standard.
While AV1 is highly efficient in terms of bandwidth, it requires considerably more processing power to decode and display videos. VP9, on the other hand, is less computationally demanding but uses more bandwidth to achieve the same video quality. This trade-off means smoother playback and better overall performance, even if it comes at the cost of slightly higher data usage.
Intel Inside
The VP9 video codec that the YouTube app is now using is much easier to decode, making it less taxing on the vehicle’s processor. This change is particularly beneficial for Tesla vehicles with Intel processors, which previously struggled to stream video at just 720p. When using AV1, these vehicles often experienced stuttering, sometimes forcing the YouTube app to automatically downgrade playback to 480p.
With this update, Intel-based Teslas should now be able to stream at 1080p smoothly. Streaming at 1440p is also possible, although occasional stutters still occur as the system keeps up with the decoding process.
Intel-based vehicles are the big winners with this change, but this appears to affect AMD Ryzen-based infotainment units as well, providing even smoother playback.
Chromium Web App
Tesla’s Theater apps aren’t native applications; instead, they run as chromeless web apps, leveraging the open-source browser built into Teslas known as Chromium (the open-source version of Chrome). Although this works quite well, there is a severe limitation - Chromium hardware acceleration isn’t supported on Linux, the operating system Tesla uses for their OS.
As a result, Tesla vehicles rely on software decoding instead of hardware decoding, which would otherwise handle video playback far more efficiently. A potential solution could be for Tesla to transition away from Chromium-based web apps in favor of a Mozilla Firefox-based browser, as Firefox does support hardware acceleration on Linux. This switch could also open the door to better streaming performance and the possibility of expanding Tesla’s in-car entertainment options.
However, Tesla’s choice of Chromium likely stems from Digital Rights Management (DRM) requirements for streaming services like Disney+ and Netflix, which rely on DRM-enabled playback. Firefox on Linux has had inconsistent support for DRM due to codec availability and variations in operating system versions.
We’re hopeful that Tesla will either adopt Firefox or develop a fully native application to improve video streaming, rather than continuing with the current web-based Tesla Theater. This shift could also pave the way for additional in-car applications built on Tesla’s native Linux environment—perhaps even reviving the long-rumored Tesla App Store.
Regardless, this update is a welcome improvement, particularly for YouTube, which remains one of the most widely used Theater Mode apps due to its accessibility, free content, and mix of short and long-form videos. It remains to be seen whether similar improvements are made for Netflix, Disney+, or other streaming platforms.
If you’ve noticed improved performance in Theater Mode, now you know why.