Tesla will now dynamically resize vehicles in Autopilot visualizations
Felix Wepunkt
In Tesla update 2023.32.4, Tesla has improved Autopilot visualizations, bringing a host of enhancements that were once exclusive to Full Self-Driving (FSD) Beta.
New Visualizations Introduced
In order for Tesla to achieve FSD, the vehicle will essentially need to create a 3D representation of the real world, similar to a video game. To create a more accurate representation of the real world, Tesla introduced dynamic vehicle resizing in March 2022 for FSD Beta. This visualization improvement is now making its way over to standard Autopilot. The vehicle will now determine the width, height and length of each vehicle in its surroundings and size the 3D model appropriately in the visualization. Initially, Tesla employed static 3D models to depict other vehicles, which, although informative, didn't match their real-world dimensions.
Whether the vehicle is distinguishing between a full-length bus and a shorter one or identifying the accurate size of small cars, the enhanced visualization lends a deeper insight into the car's situational awareness, thus bridging the gap between the real world and the on-screen depiction.
Although this could lead to some strange looking visualizations, such as a vehicle that is scaled way down to represent a baby stroller, or a truck that's 'squished' to represent its actual dimensions, these are limitations in Tesla's 3D models, as the actual size represenations are much more accurate.
Open Door Visualization
Unfortunately, Tesla hasn't added all the visualizations that are present in the FSD Beta feature in the US and Canada yet, but they did incorporate the ability to display when a vehile has an open door. The door will be displayed in the vehicle's standard gray color, unless Autopilot determines the door is in the vehicle's course, which it will then highlight it in orange.
While Tesla has achieved remarkable milestones, extending the vehice's visualizations will help build trust in the vehicle's capabilities, assuring users of a reliable and safe driving experience. In addition to bringing more visualizations over from FSD Beta, such as road edges, we will hopefully see more objects commonly encountered during driving. We are looking at the potential inclusion of additional traffic light configurations, diverse crosswalks, and even barriers and other road elements, painting a richer and fuller portrayal of the real world.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Tesla software update 2024.44.3 has started rolling out to customers in larger waves recently and it brings several new features - including Actually Smart Summon to Europe and the Middle East, as well as improvements to Autopark. But that’s not all, it also adds a new Blind Spot Monitoring feature to the new Model 3, and potentially the Cybertruck, but that’s still to be determined.
We previously covered the Blind Spot Warning While Parked as part of our preview notes for update 2024.44, but now that it's going out to customers, it's time to see it in action.
If the vehicle’s door open button is pressed, and a vehicle or object is near or incoming, the vehicle’s Blind Spot Warning Light (2024 Model 3 and Cybertruck) will illuminate, an audible tone will ring and the door won’t open. A message will also be displayed on the center displaying, letting driver’s know why the door didn’t open.
Pressing the button a second time will allow you to override the warning and open the door normally, providing a way to get out in case you just parked close to a nearby vehicle or obstacle.
The object detection for this new feature includes cars, pedestrians, cyclists, and other objects - like things including traffic cones, bollards, strollers, and other large obstacles that FSD and vision-based Autopark detect during normal operation. Of note - this only works for the front two doors. Thanks to X user Max, who did some testing for us, It does not work for the rear passenger doors.
Optional Feature
The feature is optional - it’ll be enabled by default for safety, but if you need to enable or disable it, you can do so under Controls > Safety. For now, the feature is only available on the 2024 Model 3, but we expect it to roll out to the Cybertruck at least. However, there’s no reason why it can’t be added to other vehicles as well, minus the small red dot. We expect Tesla to eventually add this feature to all Tesla vehicles, but it’s currently not a part of update 2024.44.
Enhauto’s S3XY Buttons & Commander
If that’s not enough safety and vision for you, Enhauto, the makers of the popular S3XY Buttons and Commander recently put out a new software update for the 2024 Model 3, which makes some fantastic use of the ambient lighting.
With Enhauto’s solution, users are able to tie their ambient lights to Autopilot use, turn signals or even if a vehicle is their blind spot. Check out the video below for this awesome implementation, where the ambient lights turn red when another vehicle approaches.
Maybe Tesla will integrate something like this into a future update? We’ve been hoping for more customizability with their ambient lighting - it's an easy safety win and a demonstration of Tesla’s do-more-with-less attitude.
I look forward to @enhauto updates more than Tesla...
Ambient light effects....
I set default color to white. Blinks green on turn signals Turns blue on FSD activation Yellow if someone in blind spot Blinks red if turn signal on and blind spot activity detected.
The feature is now possible thanks to what Wes Morrill, Cybertruck’s lead engineering, points out is a huge rewrite of Tesla’s Trip Planner, which not only makes it much more accurate but will now allow users to choose their arrival charge percentage.
More Accurate Trip Planner
When you navigate to a destination, your Tesla will automatically calculate when, where, and how much you need to charge. While the process seems straightforward, Tesla deserves a lot of credit for creating a simple user experience because a lot goes into accurately determining this information.
Tesla has to calculate many moving pieces in order to accurately predict when and where you should stop. First, it needs to consider your driving efficiency and wind direction, terrain elevation, traffic, vehicle speed, and ambient temperature. It also needs to predict the best Superchargers to stop at, taking into account congestion and charger speed.
This morning, in response to Dan Burkland, Wes shared that Tesla had significantly rewritten the backend portion of Trip Planner. These improvements, made by several engineers, were designed to improve Trip Planner’s accuracy and open the door to future features.
It sounds like these changes are mostly server-side, so thanks to their OTA connection, more accurate predictions should be available to all vehicles—no vehicle update is required.
Arrival State of Charge
Along with Tesla’s improvements to Trip Planner, Wes also stated that these improvements allow for a popular feature request — the ability to select your desired charge level at arrival.
Up until now, Tesla’s Trip Planner tried to get you to your destination as quickly as possible, which usually meant arriving with a low state of charge.
While this was fine if you have a charger at your destination, it’s not great if you don’t, or it could be even worse if there are no chargers nearby.
Max de Zegher said on X that he has heard the requests for a selectable arrival state of charge. Wes later clarified this by saying that these improvements to Tesla’s Trip Planner now allow for additional features to be added, such as “desired arrival charge.”
Actually trip planner got a huge rewrite on the back end. I had a great conversation with one of the engineers working on this over a morning run a few weeks back, it's pretty neat. The rewrite also unlocks additional features, like desired arrival charge.
Given that Max de Zegher’s comments came last night and Wes Morrill commented this morning, this feature request likely won’t arrive with the upcoming Holiday Update. Tesla actually hinted at such a feature being added in their last app update, so it does seem like they’ve already planned for it.
Although ‘Arrival State of Charge’ was on our wishlist for the Holiday Update, it looks like it may arrive soon after the holidays.
![First Look at Tesla’s New 'Blind Spot While Parked' Feature [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/model-3-2024/blind-spot-indicator-monitor.jpg/4cdcb11af7b1c7cf021ba96588fd4f1a/blind-spot-indicator-monitor.jpg)
![Tesla Adds HEPA Filter to New Model 3, Will it Get Bioweapon Defense Mode? [Update: Tesla Edits Post]](https://www.notateslaapp.com/images/news/2023/new-model-3-hepa-filter_300w.jpg)
![Elon talks about Twitter and job cuts at Bloomberg forum [video]](https://www.notateslaapp.com/images/news/2022/elon-musk-qatar-forum_300w.jpg)
