Tesla's High Fidelity Park Assist looks great in full screen
Not a Tesla App
The latest Tesla update 2024.14 is full of exciting features, including a fresh design, an updated media player, full-screen visualizations, and so much more. This number of features in this update rivals holiday updates when Tesla usually releases the biggest features of the year.
Below you’ll find photos and videos of each of the major new features in this Tesla update.
High Fidelity Autopark
With update 2024.14.5, we're seeing the Park Assist Upgrade which creates 3D versions of the vehicle’s environment in real-time added to vehicles with ultrasonic sensors (USS) for the first time.
Vehicles without USS received this feature as part of the 2023 holiday update.
One of the biggest upgrades of Tesla OS v12 is the new visuals while parked. This feature is available on the Model 3 and Model Y with the AMD-powered infotainment center.
While parked the vehicle is displayed beautifully front and center, while also displaying a snippet of the map in the top right corner. At the bottom of the screen, you have the ‘Navigate To’ module and the media player.
Tesla says the new media player is also part of the visual upgrade in v12, and therefore will only be available on AMD vehicles, however, we think it may become available on Intel-based vehicles in the future.
The new media player makes commonly used actions easily accessible instead of having to expand the media player. Options such as shuffle, repeat, and search are now one tap away, instead of having to expand the media player to access these features.
The new media player is a vast improvement. It now features a more obvious progress bar, and a translucent background, letting the vehicle visualizations shine through. For a full run-down of the new media player, including its new minimized version and a video of the player in action, check out our in-depth look at Tesla’s new audio player.
Tesla's new media payer on the Model 3 and Model Y
Not a Tesla App
Full-Screen Visualization
Full-screen visualizations are no longer tied to FSD and are now available outside of North America for the time. The visualizations themselves are also improved but don’t display the full plethora of visualizations available with FSD. More vehicles are now visualized and additional features such as turn signals are now displayed.
The full-screen visualization view, which is accessible by dragging the edge of the visualization to the right, offers several improvements over the FSD version available in North America. The new media player and navigate to box will now always be present centered on the screen. A small view of the navigation maps is also displayed in the corner, similar to the visualization while parked.
Although full-screen visualizations are available on Intel-based vehicles with FSD in North America, Tesla marked this feature as AMD Ryzen-specific, although that could change in the future.
Here’s a look at the updated driving visualizations that will come standard with Basic Autopilot on every Tesla after the spring update! 👀😎
Tesla has added the Audible audiobook service with update 2024.14. The media player has useful buttons to skip forward and back 15 seconds, as well as adjust the playback speed. Tesla is also expected to launch Amazon Music in the future.
Tesla is adding the Audible audiobook service in update 2024.14
Not a Tesla App
Hands-free Trunk
A pleasant surprise in this update was the ability to open your trunk hands-free. The feature works by having you stand directly behind the vehicle for a couple of seconds, the vehicle will then sound chimes as a warning before opening the trunk for you.
The feature takes advantage of the newer ultrawide band (UWB) protocol, which allows for low energy and extremely high precision location tracking. With UWB, Tesla can accurately tell where the person is in relation to the vehicle and how much they’re moving. The only vehicles that include ultrawide band are the redesigned versions of the Model S and Model X, the new Model 3 and the Cybertruck, however, the feature hasn't been implemented in the Cybertruck in this update.
The video below shows how the hands-free trunk works and tests it out in a variety of cases.
Preview of Sentry Mode
Another long-awaited feature is the ability to view Sentry Mode footage from your phone. In update 2024.14, Tesla will now send you a notification whenever there is a Sentry Mode event. Attached to the notification and accessible through the app is a short video clip of the Sentry Mode event.
Trip Progress
The trip progress bar sees a nice improvement that was previously available in China. Not only can you now see a visual representation of your trip's progress, but the timeline of the trip is also color-coded to show you traffic density along your trip.
This is useful to let you know about potential traffic later on on your trip. The entire module has also been refreshed to have a more modern design. Some information has been moved around such as your ETA and distance to your destination are now the two bits of information at the top of the module.
The progress bar shows traffic along your entire route
@greggertruck
Wiper Controls
Tesla automatic wiper controls have always been problematic, but Tesla is at least now giving us more intuitive wiper controls that let you easily switch the wiper speed.
After this update, there are two new ways to change the wiper speed. You can press the wiper button on the left stalk, or the wiper button on the new Model 3, and then use the left scroll wheel to scroll up and down to adjust the wiper speed. This was available before, but previously required you to tilt the scroll wheel left and right.
You can now also tap the wiper button on the stalk multiple times to go up to the next speed.
Full-Screen Browser
A small, but very useful feature that is buried in the release notes is the internet browser's new "full screen" button. This new feature is only available while you're parked, but it gives you the ability to easily view any website full-screen. This is especially useful when streaming video in your vehicle while parked and not being limited to the choices in Tesla’s Theater app.
Tesla update 2024.14 includes the ability to make the browser full screen.
The rear screen is also receiving a couple of upgrades. The first is that there will now be a status bar along the top of the screen that displays the current time, temperature and estimated time of arrival to your destination so that rear passengers can easily stay up to date on relevant information.
In addition to this new information, Tesla will now turn off the rear screen when there is no one seated in the rear seats, helping improve the vehicle's efficiency.
Vehicles with rear screens will now display the time, temperature and ETA to destination
@greggertruck (edited by Not a Tesla App)
Improved Cybertruck Frunk
The Cybertruck is the first Tesla vehicle to receive an auto closing frunk. While it received some criticism when it was first released around potential dangers when auto closing, Tesla is now addressing this issue with this update. The frunk is now a lot more sensitive to objects that may be in the way, however, as one video shows us, you probably shouldn’t put your finger in it.
New Tesla Cybertruck update claims to make the powered frunk safer. This is 2024.14.3
Otherwise known as the spring Tesla update.
I tested this out BEFORE and AFTER the update to see if there really is a big difference.
Auto Shift is getting two upgrades with this update. The first is a redesign to the feature, which now makes it more compact, leaving additional room for the gear indicator and the media player instead of going from top to bottom on the left side of the screen.
The Model S and Model X are also receiving improvements to the auto shifting functionality. The vehicle will now be able to shift automatically from Drive to Reverse and from Reverse to Drive in some situations, instead of just auto shifting out of Park.
This feature is expected to arrive for the new Model 3 and the Cybertruck in the future as well.
Average Speed Zones UI
Average speed zones, which are used to control speeds over certain periods of roads are now supported in Teslas as well. In countries where this type of speed limit is used, the vehicle will keep track of your average speed and let you know when the average speed zone section started and when it will end.
Pantalla de radares de tramo, donde aparece el límite de velocidad, el promedio de nuestra velocidad y cuanta distancia para salir del tramo.
The Cybertruck has received nine exclusive features in this update, including new lock sounds that are unique to the vehicle.
To use a lock sound, instead of the standard honk when you lock your vehicle, go to the Toybox and navigate to Boombox. You can also create your own custom lock sound by putting it on your USB drive. You can browse our huge list of custom lock sounds to find the perfect one.
As December approaches, Tesla’s highly anticipated Holiday update draws closer. Each year, this eagerly awaited software release transforms Tesla vehicles with new features and festive flair. If you’re not familiar with Tesla’s holiday updates, take a look at what Tesla has launched in the Holiday update the past few years.
For this chapter in our series, we’re dreaming up ways Tesla could improve the charging experience and even add some additional safety features. So let’s take a look.
Destination State of Charge
Today, navigating to a destination is pretty straightforward on your Tesla. Your vehicle will automatically let you know when and where to charge, as well as for how long. However, you’ll likely arrive at your destination at a low state of charge.
Being able to set your destination state of charge would be an absolute game-changer for ease of road-tripping. After all, the best EV to road trip in is a Tesla due to the Supercharger network. It looks like Tesla may be listening. Last week, Tesla updated their app and hinted at such a feature coming to the Tesla app. A Christmas present, maybe?
Battery Precondition Options
While Tesla automatically preconditions your battery when needed for fast charging, there are various situations where manually preconditioning the battery would be beneficial.
Currently, there is no way to precondition for third-party chargers unless you “navigate” to a nearby Supercharger. If you need to navigate to a Supercharger that’s close by, the short distance between your location and the Supercharger will also not allow enough time to warm up the battery, causing slower charging times.
While we already mentioned Live Activities in the Tesla app wishlist, they’d be especially useful while Supercharging. Live Activities are useful for short-term information you want to monitor, especially if it changes often — which makes them perfect for Supercharging, especially if you want to avoid idle fees.
Vehicle-to-Load / Vehicle-to-Home Functionality
The Cybertruck introduced Tesla Power Share, Tesla’s name for Vehicle-to-Home functionality (V2H). V2H allows an EV to supply power directly to a home. By leveraging the vehicle’s battery, V2H can provide backup power during outages and reduce energy costs by using stored energy during peak rates.
Tesla Power Share integrates seamlessly with Tesla Energy products and the Tesla app. We’d love to see this functionality across the entire Tesla lineup. Recently a third party demonstrated that bidirectional charging does work on current Tesla vehicles – namely on a 2022 Model Y.
Adaptive Headlights for North America
While Europe and China have had access to the Adaptive Headlights since earlier this year, North America is still waiting. The good news is that Lars Moravy, VP of Vehicle Engineering, said that these are on their way soon.
Blind Spot Indication with Ambient Lighting
Both the 2024 Highland Model 3 Refresh and the Cybertruck already have ambient lighting features, but they don’t currently offer a practical purpose besides some eye candy. So why not integrate that ambient lighting into the Blindspot Warning system so that the left or right side of the vehicle lights up when there’s a vehicle in your blind spot? Currently, only a simple red dot lights up in the front speaker grill, and the on-screen camera will also appear with a red border when signaling.
Having the ambient lighting change colors when a vehicle is in your blind spot would be a cool use of the technology, especially since the Model Y Juniper Refresh and Models S and X are supposed to get ambient lighting as well.
Tesla’s Holiday update is expected to arrive with update 2024.44.25 in just a few short weeks. We’ll have extensive coverage of its features when it finally arrives, but in the meantime, be sure to check out our other wishlist articles:
It’s time for another dive into how Tesla intends to implement FSD. Once again, a shout out to SETI Park over on X for their excellent coverage of Tesla’s patents.
This time, it's about how Tesla is building a “universal translator” for AI, allowing its FSD or other neural networks to adapt seamlessly to different hardware platforms.
That translating layer can allow a complex neural net—like FSD—to run on pretty much any platform that meets its minimum requirements. This will drastically help reduce training time, adapt to platform-specific constraints, decide faster, and learn faster.
We’ll break down the key points of the patents and make them as understandable as possible. This new patent is likely how Tesla will implement FSD on non-Tesla vehicles, Optimus, and other devices.
Decision Making
Imagine a neural network as a decision-making machine. But building one also requires making a series of decisions about its structure and data processing methods. Think of it like choosing the right ingredients and cooking techniques for a complex recipe. These choices, called "decision points," play a crucial role in how well the neural network performs on a given hardware platform.
To make these decisions automatically, Tesla has developed a system that acts like a "run-while-training" neural net. This ingenious system analyzes the hardware's capabilities and adapts the neural network on the fly, ensuring optimal performance regardless of the platform.
Constraints
Every hardware platform has its limitations – processing power, memory capacity, supported instructions, and so on. These limitations act as "constraints" that dictate how the neural network can be configured. Think of it like trying to bake a cake in a kitchen with a small oven and limited counter space. You need to adjust your recipe and techniques to fit the constraints of your kitchen or tools.
Tesla's system automatically identifies these constraints, ensuring the neural network can operate within the boundaries of the hardware. This means FSD could potentially be transferred from one vehicle to another and adapt quickly to the new environment.
Let’s break down some of the key decision points and constraints involved:
Data Layout: Neural networks process vast amounts of data. How this data is organized in memory (the "data layout") significantly impacts performance. Different hardware platforms may favor different layouts. For example, some might be more efficient with data organized in the NCHW format (batch, channels, height, width), while others might prefer NHWC (batch, height, width, channels). Tesla's system automatically selects the optimal layout for the target hardware.
Algorithm Selection: Many algorithms can be used for operations within a neural network, such as convolution, which is essential for image processing. Some algorithms, like the Winograd convolution, are faster but may require specific hardware support. Others, like Fast Fourier Transform (FFT) convolution, are more versatile but might be slower. Tesla's system intelligently chooses the best algorithm based on the hardware's capabilities.
Hardware Acceleration: Modern hardware often includes specialized processors designed to accelerate neural network operations. These include Graphics Processing Units (GPUs) and Tensor Processing Units (TPUs). Tesla's system identifies and utilizes these accelerators, maximizing performance on the given platform.
Satisfiability
To find the best configuration for a given platform, Tesla employs a "satisfiability solver." This powerful tool, specifically a Satisfiability Modulo Theories (SMT) solver, acts like a sophisticated puzzle-solving engine. It takes the neural network's requirements and the hardware's limitations, expressed as logical formulas, and searches for a solution that satisfies all constraints. Try thinking of it as putting the puzzle pieces together after the borders (constraints) have been established.
Here's how it works, step-by-step:
Define the Problem: The system translates the neural network's needs and the hardware's constraints into a set of logical statements. For example, "the data layout must be NHWC" or "the convolution algorithm must be supported by the GPU."
Search for Solutions: The SMT solver explores the vast space of possible configurations, using logical deduction to eliminate invalid options. It systematically tries different combinations of settings, like adjusting the data layout, selecting algorithms, and enabling hardware acceleration.
Find Valid Configurations: The solver identifies configurations that satisfy all the constraints. These are potential solutions to the "puzzle" of running the neural network efficiently on the given hardware.
Optimization
Finding a working configuration is one thing, but finding the best configuration is the real challenge. This involves optimizing for various performance metrics, such as:
Inference Speed: How quickly the network processes data and makes decisions. This is crucial for real-time applications like FSD.
Power Consumption: The amount of energy used by the network. Optimizing power consumption is essential for extending battery life in electric vehicles and robots.
Memory Usage: The amount of memory required to store the network and its data. Minimizing memory usage is especially important for resource-constrained devices.
Accuracy: Ensuring the network maintains or improves its accuracy on the new platform is paramount for safety and reliability.
Tesla's system evaluates candidate configurations based on these metrics, selecting the one that delivers the best overall performance.
Translation Layer vs Satisfiability Solver
It's important to distinguish between the "translation layer" and the satisfiability solver. The translation layer is the overarching system that manages the entire adaptation process. It includes components that analyze the hardware, define the constraints, and invoke the SMT solver. The solver is a specific tool used by the translation layer to find valid configurations. Think of the translation layer as the conductor of an orchestra and the SMT solver as one of the instruments playing a crucial role in the symphony of AI adaptation.
Simple Terms
Imagine you have a complex recipe (the neural network) and want to cook it in different kitchens (hardware platforms). Some kitchens have a gas stove, others electric; some have a large oven, others a small one. Tesla's system acts like a master chef, adjusting the recipe and techniques to work best in each kitchen, ensuring a delicious meal (efficient AI) no matter the cooking environment.
What Does This Mean?
Now, let’s wrap this all up and put it into context—what does it mean for Tesla? There’s quite a lot, in fact. It means that Tesla is building a translation layer that will be able to adapt FSD for any platform, as long as it meets the minimum constraints.
That means Tesla will be able to rapidly accelerate the deployment of FSD on new platforms while also finding the ideal configurations to maximize both decision-making speed and power efficiency across that range of platforms.
Putting it all together, Tesla is preparing to license FSD, Which is an exciting future. And not just on vehicles - remember that Tesla’s humanoid robot - Optimus - also runs on FSD. FSD itself may be an extremely adaptable vision-based AI.