Tesla uses a combination of map data and vision data for FSD visualizations
@ArthurFromX
Tesla’s FSD visualizations are admittedly one of the coolest parts of owning a Tesla. Seeing vehicles all around you on the screen, and watching the car make decisions can be mesmerizing.
However, have you ever wondered exactly how the car generates the visualizations? Is it real-time, or does it rely on map data that is downloaded separately from the vehicle’s firmware?
Map Data
Tesla distributes map data to vehicles worldwide separately from its vehicle firmware versions. This means that the map data updates can have a different tempo than the firmware updates. For instance, some cars on 2024.8.9 (an FSD V11 version from ~3mo ago), as well as cars on 2024.14.7 (an FSD V12 version from just a few days ago) just started receiving the NA-2024.8-14924 map update last week. These updates ensure that vehicles can get the most current information about road layouts, traffic patterns, and other critical driving data.
While FSD can usually work with different map versions, how much does FSD and the in-car visualizations rely on the predefined map data? It obviously uses it for some things such as speed limit, but does it use it more than that? Thanks to user, ArthurFromX on X, we now have a better idea of how much relies on map data.
FSD Visualizations
Tesla’s FSD visualizations rely on a combination of pre-mapped data and real-time information gathered by the cameras. This approach provides both background context (pre-mapped data), as well as real-time context via computer vision.
It all comes together to provide an accurate representation of what the car sees around it, taking into account the width, height, and length of nearby vehicles, curbs, and other objects, such as garbage bins or traffic cones.
A post on X highlighted that FSD visualizations might be more impacted by background data than initially thought. The post mentioned that construction to a local roundabout rendered the visualizations inaccurate, although the car was correctly navigating the lane and making its exit.
This suggests that while real-time data is crucial, the accuracy of pre-mapped data still plays a significant role in the overall effectiveness of FSD visualizations, and perhaps a lesser role in the actual decision-making process of FSD.
FSD Navigation
Of course, these visualizations impact more than just what you see on screen. The mapping data and real-time data provide information on how the vehicle plans its path, and how it makes driving decisions, such as moving into right, or left-turn lanes as required.
Mapping data most likely provides background information, enabling the onboard hardware to process and work on driving the vehicle with an initial idea of where it is and what the road looks like.
In short, map data plays a backseat role to the actual driving of FSD, but does play a bigger role in route decision, as well as providing context and predictions to what the vehicle sees. It seems at the moment that visualizations are based on a combination of map data and camera data the vehicle gathers.
Last night on X, Elon Musk confirmed that Tesla will be expanding the service area for its Robotaxi Network pilot in Austin, Texas, this coming weekend. This is the first official confirmation we’ve had of a date for expansion, following news that Tesla is hiring more Vehicle Operators and plans to expand the Robotaxi supervisor ratio in the coming months.
This is a sign of Tesla’s confidence in the Robotaxi pilot program and its current FSD builds.
Expanding to a larger service area in Austin this weekend
The announcement confirms the sights we’ve been seeing of Tesla’s engineering validation vehicles focusing on areas outside the initial geofence. This public test shows that Tesla was likely finalizing FSD builds and gathering the necessary safety data to push the boundaries for the service, and this upcoming weekend’s expansion will be the first direct result of that work.
Given the increase in service zone size, this expansion will also likely include the addition of more vehicles to the initial Robotaxi fleet of approximately 20 vehicles. We expect the new number to be anywhere from 30-50 vehicles serving both the original and new areas, combined, based on Tesla’s previously expected rollout schedule.
What to Expect
While the exact new boundaries haven’t been released, it is almost certain that the expansion will include the South Congress Bridge and the downtown core areas of Austin. Expanding into a dense urban zone will include more complex intersections, heavy pedestrian traffic, and a unique road layout. That is a major vote of confidence for Robotaxi FSD’s capabilities.
The expansion will also help Tesla to close the service area gap with Waymo, its primary autonomous competitor in the city. This quick expansion is a sign of just how scalable Tesla’s vision-only approach is, versus Waymo’s arduous and drawn-out mapping processes.
We also expect that with this first service zone expansion, Tesla will continue to invite more people to its Robotaxi Network in the coming weeks. Tesla has already sent out various rounds of events, as they’ll need users to continue using the system. If you’re waiting for an invite, it may be time to start getting excited about the next rollout.
We’ve been hearing about Grok, xAI’s AI assistant, coming to Teslas for almost two years now, but this is finally coming to fruition soon. XAI unveiled Grok 4 last night, but the entire stream didn’t mention Teslas. However, Musk later posted on X that Grok will arrive in Tesla vehicles “by next week.”
Between leaks and the Grok mobile app, there’s a lot we already know about Grok, but there are a few missing pieces that will be cleared when it finally arrives.
Next Week, or Next Next Week?
Musk said that Grok would arrive by next week, meaning it could arrive before then. However, based on how Musk typically states Tesla timelines, there are a few things to consider that give us a better idea of what to expect.
First, whenever Musk posts a Tesla timeline on X, he typically means when it’ll be released to employees and not a public release. Expect this to be the same thing.
Tesla releases software updates to employees first for a final round of testing before starting a gradual release to the public. Sometimes issues are found, especially with FSD updates, and the update needs some fixes before being released publicly. So expect employees to get it by next week, and not necessarily normal Tesla owners.
The second part to this is that Tesla always rolls out their updates gradually, so when it does finally arrive, it’ll only be available on a small percentage of vehicles. Tesla will gradually monitor issues and logs, continuing the rollout as long as no major issues are found.
Which Software Update?
The entire Grok UI was already included in software update 2025.20, but it’s not exposed to users. Typically, a new feature like Grok requires a vehicle update to be added; however, this version may be different, as it’s locked behind a server-side configuration.
Tesla likely has the ability to enable it for all supported vehicles with a simple switch. However, we feel more confident in it being rolled out in Tesla’s next major update, which is likely to be 2025.24 or 2025.26. Rolling it out in a new update aligns with how Tesla has historically introduced features.
If they turned it on for everyone at the same time, they could be exposing everyone to potential new issues, rather than only a smaller segment of users. While Grok is now well-tested through X and the Grok app, there are several elements that are new in Teslas, likely including the ability to control various vehicle functions, such as opening the glove box or other capabilities that voice commands are currently capable of. The Grok interface in the vehicle is also entirely new and may have some bugs associated with it that will need to be addressed, especially if they impact other features.
What we can likely expect is that Tesla will make some tweaks or bug fixes to Grok with the next major update that weren’t included in update 2025.20 and they’ll begin rolling it out to employees and then customers.
Supported Vehicles
Speaking of supported vehicles, thanks to the behind-the-scenes look at Grok, we have a good idea of the vehicles that will be supported. Tesla uses the same code for most of its vehicles, but then it’s compiled for each type of hardware. However, only the needed code is compiled for each vehicle, meaning that some pieces are left out entirely. Unfortunately, Grok code is not included in Intel software builds, meaning that only AMD Ryzen-based vehicles will receive Grok, at least initially.
We’ve seen Tesla go back and add support for Intel vehicles after it initially released a feature for AMD vehicles. We saw this with the weather radar overlay and several other features in the past. However, Tesla has been developing code with web technologies lately. While this makes development easier, it just doesn’t perform as well on the slower Intel hardware, causing it to be left out. We saw this with the new Dashcam Viewer, which is entirely coded in HTML, CSS, and JS. The new viewer was available on HW3 and HW4 vehicles, but only those that included the Ryzen infotainment processor.
Grok is coming to Tesla vehicles very soon. Next week at the latest.
There’s a lot we’re expecting in Grok for Teslas. Some people will absolutely love it because it’ll completely transform their drives from a singular experience to feeling like they have a knowledgeable person sitting right next to them. Given the recent controversies surrounding Grok, some people will strongly oppose it. Hopefully, Tesla makes it easy for those users to turn off Grok.
The voice command system, which is activated through the steering wheel, is expected to be replaced with Grok. This will mean that you’ll be able to talk to your vehicle much more naturally, rather than having to remember specific syntax and commands, which should be a major improvement.
We’re personally looking forward to just being able to ask questions that pop into our heads while driving, such as What’s the date of Tesla’s next event, or How many miles away is Mars? Knowledge will be available at the touch of a finger and more accessible than ever.
Grok is also expected to support continuous conversations, meaning that you’ll be able to hold a conversation with it and go back and forth about a certain topic. While there are hints of a wake word in the code, for now, it seems like you’ll press the steering wheel button once to activate it, and then again to turn it off.
For those excited about AI and Grok, this will be one of the biggest additions to Tesla’s software in years, possibly only rivaled by the Dashcam / Sentry Mode feature and FSD Beta.
It shouldn’t be long now before we all have a chance to try it out for ourselves.
_300w.png)
![Tesla Updates Robotaxi App: Adds Adjustable Pick Up Locations, Shows Wait Time and More [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/tesla-app/robotaxi-app/25-7-0/robotaxi-app-25.7.0.webp/4ac9ed40be870cfcf6e851fce21c43b9/robotaxi-app-25.7.0.jpg)
