Tesla's early FSD Betas included driving visualizations that used simple wireframe boxes to represent vehicles and lane markings were made up of individual dots.
Tesla adds scalable vehicle models to the latest FSD Beta
The visualizations were a great look into some of the information that is provided to Autopilot, but even then only a fraction of the information Autopilot uses was actually displayed onscreen.
In reality, Autopilot is creating a 3D representation of every object it tracks. Each object detected then has various attributes. For example, a detected vehicle will have attributes for how fast it's going, how far away it is, the type of vehicle, its predicted path, and more.
Tesla's visualizations in early FSD Betas
The car visualizations are an important part of FSD because they help us better understand what the car is capable of seeing and reacting to. However, the information and visualization Autopilot needs is drastically different than what humans need.
In order for Tesla to achieve FSD, they essentially need to be able to build a highly accurate video game that represents the real world, in real-time.
The car wants access to as much information about each object as possible. Meanwhile, humans want a visualization that closely resembles the real world.
With the introduction of FSD Betas 9.x, Tesla released a more human consumable visualization. One that included proper 3D models of general vehicle types, road pylons, and solid lane markers.
The road edges and lane markings are more distinguished lines, 3D models have working brake lights, and other objects such as speed bumps, bike lanes, and crosswalks are depicted using visualizations that match the real world.
In order for Tesla to achieve FSD, they essentially need to be able to build a highly accurate video game that represents the real world, in real-time.
However, something that has been missing is visualizations is dynamic vehicle sizing. The 3D vehicle models that Tesla has been using have a static size. When the vehicle sees a bus, it calculates its length, width, and height in addition to a bunch of other metrics. However, the 3D model that is shown onscreen is a predefined size, meaning that it does not actually match what the vehicle saw.
This is why you may have seen a tractor-trailer shift forward and backward or you may have seen two vehicles on top of each other. One is signifying the start of the vehicle and since the vehicle is so much longer than the model, it's adding another vehicle to the end to signify the end of the vehicle.
Scalable Vehicle Models
However, in the latest 10.10.2 FSD update, we are now seeing Tesla scale individual vehicle models so that they represent the calculated size of surrounding vehicles. Contextually this could be helpful in better understanding our car’s situation in the world.
In 10.10.2, the car shrinks or stretches the 3D vehicle models in each dimension so that the 3D model matches the calculated dimensions for each vehicle. This is especially apparent in longer vehicles such as buses, trucks, and tractor-trailers, where the vehicle lengths are more likely to vary, but you can also see it scale other vehicle models such as very small cars.
In this example below, you'll see that Tesla is now able to accurately represent buses of different sizes. Tesla only has a model for a full length bus, but in this case, Tesla detected that the length of one of the buses is considerably shorter than the vehicle model so it chose to reduce the length of the bus to the length Autopilot had calculated. In the image below you can see how the same bus model is shown in two different sizes.
Tesla can now accurate render vehicles of different sizes
It's important to realize the difference between the visualizations and what Autopilot uses. The visualizations are there merely to help us better understand what Autopilot can see. The FSD computer itself has always been taking note of the size of surrounding objects and various other data points. Trajectory, approach velocity, proximity, and so forth have also been a part of this, but this update helps Tesla achieve visualizations that provide a more accurate representation of reality.
It's not only buses and trucks that are scaled up or down. Tesla resized a bobcat down to a vehicle that is about half the length of its normal sedan model.
Tesla can now accurate render vehicles of different sizes
Models are adjusted in all three dimensions. We witnessed some truck models that were stretched to become taller while also having their length reduced. It's not perfect because you're scaling all components of the truck at the same rate, but it produces a much more accurate representation of the vehicle and the amount of space it takes up.
Vehicles are resized in three dimensions to better match the vehicle's length, width and height
Tesla has come a long way in a short period with how many objects they're able to detect, but obviously, when you compare the environment the car sees today, there is still a lot missing.
In the short term, we'd like to see more objects visualized. Objects that are commonly encountered while driving, such as trailers and gates.
We'd also like to see other common objects added, such as additional traffic light configurations, crosswalks, mailboxes, and maybe even a generic object that lets us know the vehicle sees something it needs to maneuver around, but it may not know exactly what it is.
In the future, I think we'll see Tesla display a rich, fuller 3D environment that will display static and moving objects that are important for the vehicle to avoid, objects such as barriers, buildings, trees, sidewalks, and more. Today Tesla is one step closer to achieving this goal.
We’re eagerly anticipating Tesla’s biggest update of the year — the Holiday update. The update usually arrives in December, typically towards the end of the month. Last year, the rollout was actually earlier, happening in the second week of December.
As part of our ongoing series, we’re sharing our wishlist for features we hope to see in this year’s holiday update. This edition focuses on improvements to Tesla Maps and Autopilot.
User-contributed Map Data
Many users have asked for the integration of more Waze-like features into Tesla’s navigation. Earlier this year, Tesla added Speed Camera locations, traffic lights and stop signs to maps, but users really want it to be a Waze-like experience that lets you contribute data. This includes marking police car locations, accidents, construction, and more. We’re not sure how likely this is to happen. So far, Tesla has relied on the Google API and other vendors to highlight information on the map.
Avoid Highways Option
Users have been asking for an ‘Avoid Highways’ option forever, as it’s a standard option in navigation systems nowadays. While the Alternate Routes feature is helpful, it may not always provide a route that avoids the highway.
In June, Elon Musk confirmed that a “Avoid Highways” option would be added to Tesla navigation. We still haven’t seen it arrive, but we’re fairly confident that it will eventually be available in Tesla vehicles, maybe even for the Holiday update. What better way to enjoy a winter wonderland than to drive through some country roads instead of on the highway?
3D Buildings in Maps
Not a Tesla App
3D maps arrived in China earlier this year, and Google began rolling out 3D maps for various apps just last month. Apple already provides a 3D map with beautiful renderings of nearby buildings, and Rivian already features 3D buildings with an Apple-like look, so Tesla is playing catch-up a little bit here.
While 3D map support could be viewed as mostly eye candy, it can sometimes be useful when navigating an unknown area. Since the Intel infotainment processor is already near its limit and has excluded features in the past, such as improved visualizations and High Fidelity Park Assist, this feature could be limited to newer AMD-powered vehicles.
At Tesla’s recent Robotaxi event, we saw custom 3D maps in the vehicle with a specialized interface, so Tesla knows this is an appealing addition.
Full Screen Visualizations on Intel
BLKMDL3
This year Tesla added support for full screen Autopilot visualizations on AMD-based vehicles. Unfortunately the option to go full screen isn’t available on Intel vehicles, unless you’re in North America and have FSD.
There isn’t a clear reason why this is the case, since Intel vehicles can obviously handle them. It’d be nice if this holiday season Tesla expanded full-screen visualizations to all Intel vehicles, regardless of location.
Detect and Visualize Emergency Vehicles
Greentheonly/X
Tesla already detects emergency vehicles while on Autopilot, however, it doesn’t display them in the visualization any differently than a normal car. Tesla was planning on adding emergency vehicle visualizations as far back as 2021, but they didn’t happen for some reason.
Tesla recently announced that they’re going to step up emergency vehicle detection by not only detecting the vehicles visually but also using audio input as a cue. With FSD v13, which is expected to be released to Tesla employees this month, FSD will detect emergency vehicles using the vehicle’s internal microphone. This should let the vehicle know about emergency vehicles sooner. We’re hoping that on-screen visualization comes along with this update.
If it’s anything like Tesla’s 2021 implementation, Tesla will design emergency lights that could be added to various existing 3D models, such as cars, SUVs, and motorcycles.
FSD Visualizations in Other Regions
This one is long overdue, and we hope it finally arrives. Owners outside of North America have been paying for FSD for years and have almost nothing to show for it. Sure, it includes some features like Summon (with USS vehicles) and, more recently, Autopark, but it doesn’t even include Actually Smart Summon yet.
While Tesla says the FSD is coming to Europe and China in Q1/Q2 next year, it’d be a great addition to add FSD visualizations for the time being.
There’s no doubt that Tesla is already detecting objects and vehicles behind the scenes and comparing what the vehicle would do to what the driver does to help improve Autopilot in these markets. For some reason, Tesla has decided to show different visualizations depending on whether you have Autopilot or FSD and whether you live in North America or elsewhere.
Adding FSD visualizations for everyone, regardless of whether they have Basic Autopilot, EAP, or FSD, would be an exciting addition — and it may even increase the subscription rate to FSD.
Expand Basic Autopilot
Tesla’s Basic Autopilot includes Adaptive Cruise Control and Autosteer, but we’d love for Tesla to expand this further to match what other manufacturers are offering.
Right now, Tesla considers Navigate on Autopilot and automatic lane changes part of Enhanced Autopilot. This means that if you’re on Autopilot and want to change lanes, you need to disable AP, change lanes, and re-enable it. Since many regions no longer offer Enhanced Autopilot for purchase, users are forced to put up with this annoyance or pay for FSD, which isn’t offered as a subscription outside of North America.
By creating a clearer distinction between Autopilot (focused on highway driving) and FSD (designed for city driving), Tesla could improve the Autopilot experience for users while encouraging them to upgrade to FSD.
Actually Smart Summon
Actually Smart Summon is still mostly limited to North America, with some small regions such as Taiwan, also receiving it. However, it still requires you to hold the ‘come’ button currently. The next big leap would be to remove this requirement and enable users to summon their vehicles with a single tap. Tesla previously said this was coming in a future improvement to A.S.S.
Ideally, we’d see the reach of Actually Smart Summon expanded to Europe and other regions and improvements of the feature, although we’re much more likely to see the former for the Christmas update.
Cybertruck is also still waiting for Summon, so this could be an additional surprise.
Autoshift for All Cars
While Autoshift isn’t directly tied to Autopilot, it does leverage AI to decide whether to shift into reverse or drive. This feature has now been released on the new Model S, Model X, the new Model 3, and the Cybertruck. However, Musk once said that it would be added to all Tesla vehicles, so we’re hoping that’s still in the works.
There’s certainly no reason why Tesla can’t add it to older vehicles with stalks. For those not familiar with Autoshift, it allows the vehicle to automatically shift into reverse or drive when the driver is ready to start moving. This makes it even easier to get going: You simply get in the car, press the brake pedal, giving the vehicle a chance to shift, and then press the accelerator.
This is our second wishlist of features we’d love to see in Tesla vehicles this holiday season. If you haven’t seen our first wishlist, the Tesla App Edition, be sure to check it out.
While this is a list of the most popular user requests related to Tesla’s navigation and Autopilot features, we’re sure that there are some we missed. Let us know your thoughts and ideas in our forums.
There’s been a spade of Cybertruck announcements that just came up all at once, so let’s see what the polygonal truck is up to in the month of November. We’ve got a variety of topics to cover, starting with some disappointing news about Tesla’s in-house wrapping services, which are being discontinued for the Cybertruck. But don’t worry — there’s plenty of good news to follow.
No More Tesla Wraps
Tesla no longer offers wraps for the Cybertruck as an option for US customers. Tesla began wrapping vehicles earlier this year but stopped offering wraps for the Cybertruck as of November 13th.
This comes after Tesla previously reduced the color options for Cybertruck wraps from seven to five. However, this isn’t too big of an issue—there are plenty of companies that specialize in vehicle wraps.
The reason Tesla stopped offering wrap services for the Cybertruck isn’t clear. Was there not enough demand? Did it take up too much time from technicians who are already stretched thin?
Given the long repair backlogs in the United States, it makes more sense to have service technicians focus on vehicle repairs rather than spending time wrapping cars.
Inventory Foundation Series
The Cybertruck Foundation Series is now available as an inventory vehicle in certain locations in the United States. That means you can pick up a Foundation-series truck with little to no delay.
Only a few trucks are currently in stock, but this will likely expand as Tesla continues to ramp production and begins to offer the non-Foundation Series trucks as inventory vehicles.
These inventory vehicles are only available in the United States. Canadian owners will still need to put down a deposit for a Foundation Series Cybertruck to get it soon.
Crossbars
Tesla has just announced it is offering a new set of crossbars for the Cybertruck. With a load rating of 200 lbs, it’s on par with roof racks for other trucks. These crossbars also come with mounting pads and quick releases. There are also slots for attaching ski racks, bike racks, or even cargo boxes, letting owners expand the truck's storage capacity.
Interestingly, the Foundation Series trucks can install the crossbars over the cabin or the truck bed, while the non-Foundation Series can only mount the crossbars over the truck bed. That isn’t the greatest news - because one of the best uses for these crossbars is protecting the cabin glass when you’ve got items like long wooden planks hanging over the roof of the truck. Maybe we’ll see more on this soon.
The mounting points for the Cybertruck's crossbars.
Not a Tesla App
Update: It turns out that you can, in fact, install the crossbars anywhere on a non-Foundation series vehicle. You’ll just have to pay for an additional roof applique, according to Wes Morril, Lead Engineer of the Cybertruck Program.
Faster Charging
Tesla announced updated versions of the V4 Supercharger, with a more powerful electrical cabinet that can charge the Cybertruck at up to 500kW. That’s an insanely fast speed—nearly 1,300 mi/hr of charging. This will come as part of a future update for the Cybertruck and as V4 Supercharger stations begin to be deployed.
That’ll make the Cybertruck the fastest-charging Tesla - even with its enormous battery.
![Tesla Unveils V4 Superchargers Capable of Charging at 500kW [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/charging/v4_supercharger.jpg/e6e109be929ba0765b4303a7e9d5bb7d/v4_supercharger.jpg)
![First Look at Tesla's New 'Service History' Feature [Photos]](https://www.notateslaapp.com/img/containers/article_images/service-mode/service-mode-records-4.jpg/8dd9d11fd3f5159c393831cbd9f4815a/service-mode-records-4.jpg)
![Tesla Adds HEPA Filter to New Model 3, Will it Get Bioweapon Defense Mode? [Update: Tesla Edits Post]](https://www.notateslaapp.com/images/news/2023/new-model-3-hepa-filter_300w.jpg)
![Andrej Karpathy considers returning to Tesla to work on Optimus [video]](https://www.notateslaapp.com/images/news/2022/karpathy-podcast_300w.jpg)
