Tesla uses a combination of map data and vision data for FSD visualizations
@ArthurFromX
Tesla’s FSD visualizations are admittedly one of the coolest parts of owning a Tesla. Seeing vehicles all around you on the screen, and watching the car make decisions can be mesmerizing.
However, have you ever wondered exactly how the car generates the visualizations? Is it real-time, or does it rely on map data that is downloaded separately from the vehicle’s firmware?
Map Data
Tesla distributes map data to vehicles worldwide separately from its vehicle firmware versions. This means that the map data updates can have a different tempo than the firmware updates. For instance, some cars on 2024.8.9 (an FSD V11 version from ~3mo ago), as well as cars on 2024.14.7 (an FSD V12 version from just a few days ago) just started receiving the NA-2024.8-14924 map update last week. These updates ensure that vehicles can get the most current information about road layouts, traffic patterns, and other critical driving data.
While FSD can usually work with different map versions, how much does FSD and the in-car visualizations rely on the predefined map data? It obviously uses it for some things such as speed limit, but does it use it more than that? Thanks to user, ArthurFromX on X, we now have a better idea of how much relies on map data.
FSD Visualizations
Tesla’s FSD visualizations rely on a combination of pre-mapped data and real-time information gathered by the cameras. This approach provides both background context (pre-mapped data), as well as real-time context via computer vision.
It all comes together to provide an accurate representation of what the car sees around it, taking into account the width, height, and length of nearby vehicles, curbs, and other objects, such as garbage bins or traffic cones.
A post on X highlighted that FSD visualizations might be more impacted by background data than initially thought. The post mentioned that construction to a local roundabout rendered the visualizations inaccurate, although the car was correctly navigating the lane and making its exit.
This suggests that while real-time data is crucial, the accuracy of pre-mapped data still plays a significant role in the overall effectiveness of FSD visualizations, and perhaps a lesser role in the actual decision-making process of FSD.
FSD Navigation
Of course, these visualizations impact more than just what you see on screen. The mapping data and real-time data provide information on how the vehicle plans its path, and how it makes driving decisions, such as moving into right, or left-turn lanes as required.
Mapping data most likely provides background information, enabling the onboard hardware to process and work on driving the vehicle with an initial idea of where it is and what the road looks like.
In short, map data plays a backseat role to the actual driving of FSD, but does play a bigger role in route decision, as well as providing context and predictions to what the vehicle sees. It seems at the moment that visualizations are based on a combination of map data and camera data the vehicle gathers.
The Cybertruck is having an eventful November. Just last week, we shared the news that Tesla isn’t offering their in-house wrap service for the Cybertruck anymore; the Foundation Series is now available in inventory in select US locations, Crossbars have arrived, and faster charging is around the corner. Now there’s even more to discuss about the stainless steel beast.
Projection Puddle Lights
Like the recently launched puddle lights for the Model 3 and Model Y, Tesla has introduced a set of add-on Projector Puddle Lights for the Cybertruck. These Cybertruck-specific ones go for $75 USD, or $105 CAD and are available in both the Canadian and US Tesla stores.
However, these don’t have the Tesla wordmark - instead, they feature the iconic Cybertruck symbol and, in our opinion, look even nicer. Here’s to hoping Tesla also introduces a set with the graffiti-style Cybertruck wordmark.
Powershare in Canada
While the Foundation Series Cybertruck has been getting delivered in Canada since November 7th, there was no news on Powershare being supported due to regulatory constraints. On the 20th, Foundation Series owners in Canada began to receive emails to get their Powershare installs started through Tesla’s official installer - Qmerit.
More to follow on pricing and the process as we receive our Canadian quote from Qmerit soon.
FSD in Canada
The Cybertruck Program Manager, Siddhant Awasthi, confirmed that with Powershare now becoming available, FSD for the Cybertruck in Canada will also become available soon. Canadian trucks shipped with a factory software build that didn’t include FSD, but did include TACC and stoplight/traffic control.
Early this morning Tesla began rolling out a new version of FSD 12.5.5.3 for the Cybertruck, which is update 2024.39.5. Will this be the version that rolls out in Canada?
Following Integrated Flight Test 6 for SpaceX’s Starship, Elon Musk confirmed that uncrewed Starships are likely to begin making their way to Mars in about 2 years. You’re probably going to ask what’s going to be in those Starships - that’s what Brett Winston on X asked as well. Elon confirmed that Cybertrucks and Optimus robots will be among some of the first items landing on Mars.
That’s a ton of awesome news for Cybertruck, and there’s absolutely going to be more around the corner, especially as we await the big Tesla Holiday Update. While you wait, why not take a look at our Holiday Update Wishlists?
Tesla software update 2024.44.3 has started rolling out to customers in larger waves recently and it brings several new features - including Actually Smart Summon to Europe and the Middle East, as well as improvements to Autopark. But that’s not all, it also adds a new Blind Spot Monitoring feature to the new Model 3, and potentially the Cybertruck, but that’s still to be determined.
We previously covered the Blind Spot Warning While Parked as part of our preview notes for update 2024.44, but now that it's going out to customers, it's time to see it in action.
If the vehicle’s door open button is pressed, and a vehicle or object is near or incoming, the vehicle’s Blind Spot Warning Light (2024 Model 3 and Cybertruck) will illuminate, an audible tone will ring and the door won’t open. A message will also be displayed on the center displaying, letting driver’s know why the door didn’t open.
Pressing the button a second time will allow you to override the warning and open the door normally, providing a way to get out in case you just parked close to a nearby vehicle or obstacle.
The object detection for this new feature includes cars, pedestrians, cyclists, and other objects - like things including traffic cones, bollards, strollers, and other large obstacles that FSD and vision-based Autopark detect during normal operation. Of note - this only works for the front two doors. Thanks to X user Max, who did some testing for us, It does not work for the rear passenger doors.
Optional Feature
The feature is optional - it’ll be enabled by default for safety, but if you need to enable or disable it, you can do so under Controls > Safety. For now, the feature is only available on the 2024 Model 3, but we expect it to roll out to the Cybertruck at least. However, there’s no reason why it can’t be added to other vehicles as well, minus the small red dot. We expect Tesla to eventually add this feature to all Tesla vehicles, but it’s currently not a part of update 2024.44.
Enhauto’s S3XY Buttons & Commander
If that’s not enough safety and vision for you, Enhauto, the makers of the popular S3XY Buttons and Commander recently put out a new software update for the 2024 Model 3, which makes some fantastic use of the ambient lighting.
With Enhauto’s solution, users are able to tie their ambient lights to Autopilot use, turn signals or even if a vehicle is their blind spot. Check out the video below for this awesome implementation, where the ambient lights turn red when another vehicle approaches.
Maybe Tesla will integrate something like this into a future update? We’ve been hoping for more customizability with their ambient lighting - it's an easy safety win and a demonstration of Tesla’s do-more-with-less attitude.
I look forward to @enhauto updates more than Tesla...
Ambient light effects....
I set default color to white. Blinks green on turn signals Turns blue on FSD activation Yellow if someone in blind spot Blinks red if turn signal on and blind spot activity detected.
![First Look at Tesla’s New 'Blind Spot While Parked' Feature [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/model-3-2024/blind-spot-indicator-monitor.jpg/4cdcb11af7b1c7cf021ba96588fd4f1a/blind-spot-indicator-monitor.jpg)
_300w.png)
