As FSD has improved over the years, Tesla has added additional visualizations to the car's display. The car display shows what the car can see and react to in its surroundings.
In early 2018 Tesla showed only certain types of vehicles and lane markings using only the front-facing cameras.
Tesla slowly started processing data from additional cameras and showed more types of vehicles, pedestrians, and traffic cones.
They now show a large variety of objects from trash cans, traffic lights, dogs, speed bumps, and even dynamically resize vehicle models to match their real-life size.
Tesla only shows a fraction of the objects it detects in their visualizations. For example, Tesla's FSD Beta can detect open car doors, emergency vehicles, and more, but these objects are currently not shown on the display, they likely will be in the future.
Although the car does not use the visualizations for Autopilot, the visualizations still play a crucial part in helping the person behind the wheel understand how well the vehicle understands its environment.
Understanding lane markings, road edges, and the curvature of the road is only a portion of what Tesla’s FSD system needs to understand.
To properly understand a curve in the road the car also needs to understand elevation changes.
It looks like Tesla is starting to do just that. According to GreenTheOnly, who analyzes Tesla code, he says that Tesla is “preparing to do some sort of a 3d terrain on the viz.”
It's not clear whether FSD may already understand terrain elevations while navigating, but it looks like Tesla will now add elevation changes to their visualizations as well.
Tesla likes to keep the visualizations simple with a sketch-like, gray-tone feel, so we may see roads and surrounding terrain take on a shading effect to visualize hills and valleys.
GreenTheOnly isn’t sure what the visualization will look like either, but we may know more soon as Tesla starts to add more information and assets in upcoming firmware builds to support 3D terrains.
they are preparing to do some sort of a 3d terrain on the viz. not sure what form it'll take
Elon Musk has also talked about Tesla trying to find a way to display objects it detects but doesn’t completely understand what they are. It could be almost anything; a strange object on the sidewalk, lumber hanging out the back of a pickup truck, or a newspaper vending machine.
The car understands there's an object there, but trying to visualize this object in a way that makes sense for humans is tricky.
In the future, we may even see a more complex 3D environment that will display static objects such as buildings, trees, sidewalk curbs, and more.
We could also see different colors and textures based on the type of terrain (flat gray pavement or textured greenery).
Tesla's MCU chip is already capable of rendering 3D video games, so it's conceivable that it could render a more accurate image of its surroundings.
Tesla initially planned for all FSD visualizations to be rolled out to everyone, even if they didn't have the FSD Beta.
Elon first mentioned visualizations being available in Europe in October of last year, so we’re hopeful Tesla is still planning for this.
Good point, we could enable visualization before control. Will enable that option hopefully next month.
Tesla maintains two primary software branches: the main feature branch and the FSD branch. In general, the FSD branch lags behind on new features pushed to the main branch but provides a more recent FSD version.
However, now Tesla is updating the main branch to a much more recent version of FSD.
Current FSD Build & Shadow Mode
Nowadays, the main branch always includes an older but stable build of FSD. It’s been on FSD V12.3.6 since July 2024. So, if you subscribe to FSD in North America, this is the FSD version you’ll receive until you get added to the FSD track.
Even if you don’t subscribe to or have purchased FSD, your vehicle has v12.3.6 on it. That includes vehicles in regions where FSD isn’t available for general use, such as Europe and China. In those cases, FSD runs in Shadow Mode, providing training data to Tesla if you’ve agreed to their data privacy policies. So Tesla is always analyzing what the vehicle would do compared to what the driver does. When there are contradictions, these are the clips and data Tesla will want to analyze.
FSD V12.5.4.2 on Main Branch
For the first time in five months, Tesla has now updated the baseline version of FSD in the main branch. The new version included with 2024.44 updates is FSD v12.5.4.2. This Tesla is updating the baseline FSD version to FSD V12.5.4.2
FSD 12.5 includes many features for a much smoother experience compared to FSD 12.3.6. Many users will appreciate that it gets rid of the steering wheel nag and instead relies on the cabin camera to provide real-time driver monitoring. This version also includes support for sunglasses with driver monitoring. It’ll be a big upgrade for anyone coming from FSD 12.3.6.
It's always a good thing when Tesla updates the baseline FSD version—that means that Tesla is confident that this new baseline is considerably safer and will continue to train the fleet against it.
What Update Am I Getting?
If you’re already on FSD V12.5.4.2, you’ll likely remain on that FSD build unless V13.3 manages to make its way to the public as Tesla originally planned, but that’s unlikely to happen before the Thanksgiving holiday. In all likelihood, you’ll be getting update 2024.44, which will give you some additional Tesla features while keeping you on the same FSD version.
For those who are already on 2024.44 - if you subscribe now, you’ll have V12.5.4.2 enabled on your vehicle.
If you have a Cybertruck, then you’ll receive update 2024.39.5 with FSD V12.5.5.3. They’re on a unique build for the moment, and this will likely be the case until Tesla acquires enough training data from the Cybertruck fleet.
The Cybertruck is having an eventful November. Just last week, we shared the news that Tesla isn’t offering their in-house wrap service for the Cybertruck anymore; the Foundation Series is now available in inventory in select US locations, Crossbars have arrived, and faster charging is around the corner. Now there’s even more to discuss about the stainless steel beast.
Projection Puddle Lights
Like the recently launched puddle lights for the Model 3 and Model Y, Tesla has introduced a set of add-on Projector Puddle Lights for the Cybertruck. These Cybertruck-specific ones go for $75 USD, or $105 CAD and are available in both the Canadian and US Tesla stores.
However, these don’t have the Tesla wordmark - instead, they feature the iconic Cybertruck symbol and, in our opinion, look even nicer. Here’s to hoping Tesla also introduces a set with the graffiti-style Cybertruck wordmark.
Powershare in Canada
While the Foundation Series Cybertruck has been getting delivered in Canada since November 7th, there was no news on Powershare being supported due to regulatory constraints. On the 20th, Foundation Series owners in Canada began to receive emails to get their Powershare installs started through Tesla’s official installer - Qmerit.
More to follow on pricing and the process as we receive our Canadian quote from Qmerit soon.
FSD in Canada
The Cybertruck Program Manager, Siddhant Awasthi, confirmed that with Powershare now becoming available, FSD for the Cybertruck in Canada will also become available soon. Canadian trucks shipped with a factory software build that didn’t include FSD, but did include TACC and stoplight/traffic control.
Early this morning Tesla began rolling out a new version of FSD 12.5.5.3 for the Cybertruck, which is update 2024.39.5. Will this be the version that rolls out in Canada?
Update: Yesterday, Tesla started rolling out FSD on the Cybertruck in Canada for the first time. The update being rolled out is update 2024.39.5, which not only features the latest FSD available on the Cybertruck, version 12.5.5.3, but it also includes all the features update 2024.38, which includes the huge Sentry Mode improvements that reduce power consumption by about 40%.
Following Integrated Flight Test 6 for SpaceX’s Starship, Elon Musk confirmed that uncrewed Starships are likely to begin making their way to Mars in about 2 years. You’re probably going to ask what’s going to be in those Starships - that’s what Brett Winston on X asked as well. Elon confirmed that Cybertrucks and Optimus robots will be among some of the first items landing on Mars.
That’s a ton of awesome news for Cybertruck, and there’s absolutely going to be more around the corner, especially as we await the big Tesla Holiday Update. While you wait, why not take a look at our Holiday Update Wishlists?