Exclusive: What Tesla is Changing to Improve Sentry Mode Efficiency

Not a Tesla App

Tesla recently rolled out power efficiency improvements to its Sentry Mode feature for the Cybertruck with software update 2024.38.4. These updates drastically improve the vehicle’s power consumption when Sentry Mode is active.

We’ve now uncovered more details on how Tesla achieved such drastic improvements in the vehicle’s power consumption, which Tesla estimated to be a 40% reduction.

Tesla made architectural changes to how it processes and analyzes video — optimizing which components handle which tasks. While the Cybertruck is the first to benefit from these advancements, Tesla plans to extend these upgrades to other vehicles in the future.

Sentry Mode Power Consumption

Tesla vehicles feature two main computers: the MCU (Media Control Unit) computer, which powers the vehicle’s infotainment center, and the FSD computer, which is responsible for Autopilot and FSD. Both of these computers remain on and powered any time the vehicle is awake, consuming about 250-300 watts.

Typically, the vehicle only uses this power while it’s awake or actively driving. It’s not a major concern since the car automatically goes to sleep and shuts down its computers after about 15 minutes of inactivity. However, the larger issue is that these computers also need to remain on when Sentry Mode is active, causing a 250-watt draw whenever Sentry Mode is on.

Interconnected System

Today, the vehicle’s cameras are connected to the FSD computer, which connects to the MCU, which is finally connected to the USB ports. Because of this interconnected setup, everything needs to remain powered. Footage needs to be streamed from the FSD computer into the MCU, where processes like motion detection occur. The data then needs to be compressed before finally being written to the USB drive. That’s a lengthy process, requiring multiple computers to remain on in order to be able to record and save live video.

Architectural Changes

Tesla is making some architectural changes to address Sentry Mode’s high power consumption by shifting the responsibilities of the vehicle’s computers. By shifting motion detection and possibly the compression activity to the FSD computer, Tesla will now be able to keep the MCU computer asleep. The MCU is still required to push the video to the USB drive, but Tesla can now wake up the system only when it’s needed.

For instance, the FSD computer will still handle the connection to the vehicle’s cameras, but it will now also detect motion. When that Sentry event occurs, it can wake up the MCU to write the data to the USB drive and then have it go back to sleep.

This approach ensures the MCU isn’t continuously powered to analyze and compress video, instead activating it only when data needs to be written.

Processor Isolation & Task Allocation

Tesla’s current architecture separates the Autopilot Unit (APU) from the MCU. This is done for several reasons - but first and foremost is safety. The MCU can be independently restarted even mid-drive without impacting the APU and key safety features.

Additionally, by isolating the APU from the MCU, tasks that are optimized for each unit—processing versus image transcoding—can be offloaded to the processing unit that’s better suited for it. This helps keep both the APU and MCU operating at their optimal power and performance parameters, helping to manage energy consumption more efficiently.

Kernel-Level Power Management

Tesla’s been working on more than just FSD or new vehicle visualization changes and has been putting in the effort to optimize the operating system’s underlying kernel. While not in heavy use, Tesla is underclocking the processors of both the MCU and APU, reducing power usage and heat generation.

Of course, other kernel optimizations and programming tricks, such as the ones Tesla uses to optimize its FSD models, also factor into the increased overall efficiency of the vehicles.

Additional Benefits

Since Tesla vehicles also include a Dashcam that processes video, it’s possible we may also see these additional power savings whenever the vehicle is awake. This could also affect other features, such as Tesla’s Summon Standby feature, which keeps the vehicle awake and processing video to give users almost instant access to the vehicle’s Summon feature.

Roll Out to Other Vehicles

While the Cybertruck was the only vehicle to receive these power improvements to Sentry Mode, we were told that they’re coming to other vehicles too. Tesla is introducing these changes with the Cybertruck first, leveraging its smaller user base for initial testing before expanding the rollout to other vehicles.

USB Port Power Management

To further conserve energy and reduce waste, Tesla now powers down USB ports, even if Sentry Mode is active. This change has impacted many users who rely on 12v sockets or USB ports to remain powered to keep accessories such as small vehicle refrigerators on.

It’s not immediately clear whether these changes to Sentry Mode impact this change or whether power to 12v outlets was removed strictly due to safety concerns.

Follow

Follow

Follow

What’s Coming Next in Tesla FSD V14

Not a Tesla App

With FSD V13.2.6 continuing to make its way to AI4 vehicles, Tesla has been on a streak with minor FSD improvements since the launch of FSD V13 just a little over two months ago. 

FSD V13 brought a new slate of features, including Start FSD from Park, Reverse, and Park at Destination. It also introduced full-resolution video input using the AI4 cameras at 36hz and made use of the new Cortex supercomputer to get faster and more accurate decision-making.

So, what’s next with FSD V14? Tesla gave us a sneak peek at what’s next for FSD.

FSD V14

The standout feature of FSD V14 will be auto-regressive transformers. While that’s a complex term for those unfamiliar with AI or machine learning, we’ll break it down.

Auto-Regressive

An auto-regressive transformer processes sequential data in time, using that information to predict future elements based on previous ones. Imagine completing a sentence: You use the words already written to guess what comes next. This process isn't just about filling in the blank; it's about understanding the flow of the sentence and anticipating the speaker's intent.

FSD could analyze a sequence of camera images to identify pedestrians and predict their likely path based on their current movement and surrounding context. The system's auto-regressive nature allows it to learn from past sequences and improve its predictions over time, adapting to different driving scenarios.

Today, FSD reacts to what it sees, but soon it’ll be able to anticipate what will help, much like humans.

Transformers

The second part of that term is transformer, which is a component used to understand the relationships of elements inside a time sequence. It identifies which parts of the input are most crucial for making accurate predictions, allowing the system to prioritize information much like a human would. Think of it as weighing different pieces of evidence to arrive at a conclusion. For example, a transformer might recognize that a blinking turn signal is more important than the color of the car when predicting a lane change.

Putting It Together

Putting all that together, Tesla’s use of auto-regressive transformers means they’ll be working on how FSD can predict the plans and paths of the world around it. This will improve FSD’s already powerful perception and allow it to predict how other vehicles and vulnerable road users (VRUs) will behave.

What it all comes down to is that FSD will be able to make better decisions and plan its paths by making more informed, human-like decisions. That will be a big step towards improving V13 - which already has some very effective decision-making.

Larger Model and Audio Input

Tesla stated that FSD V14 will see larger model and context sizes, which coincidentally are listed in the upcoming improvements section of FSD V13.2.6.

Interestingly, Tesla says that context size is restricted by AI4’s memory, so it’ll need to be optimized. Tesla is already gathering audio data, and FSD V14 will be the first version to take advantage of it.

FSD V14 Release Date

We haven’t heard from Elon Musk or Ashok Elluswamy (Tesla’s VP of AI) about when FSD V14 will arrive. Ashok previously stated that FSD V13.4 would see audio inputs being used, but at Tesla’s earnings call, Musk said that audio input would become relevant in V14. It seems like Tesla may have scrapped V13.4 for V14.

Since Tesla is planning to launch their Robotaxi network in Texas this June, FSD V14 may be the version used for their autonomous taxi fleet.

Follow

Follow

Follow

Want to See the New Tesla Model Y? Here's Where It’s on Display

Not a Tesla App

Tesla’s refreshed Model Y has started hitting display and Tesla showrooms across North America and Europe, where you can now get up close and personal with the new Model Y and all of its improvements, including the smallest of details.

The refreshed Model Y surprised all of us by sporting its own unique look instead of just being a stretched-out Model 3. While it’s available to order now through the Launch Edition, which includes FSD and Acceleration Boost, deliveries won’t start for another couple of months.

The new front light bar and rear indirect lights make the vehicle unique and worth checking out. There are plenty of new items to check out in the updated interior as well, including new door panels, powered rear seats, and more.

Here’s where you can check out the new Model Y in North America and Europe:

North America

In North America, the updated Model Y can be seen in 19 showrooms across the United States and Canada. The photo below shows the 17 locations in the U.S. and two in Canada. We expect this list to grow as Tesla produces more vehicles and we get closer to the official launch.

New Model Y Displays in North America

Not a Tesla App

Europe

In Europe, the Model Y is already on permanent display at two locations - the Mall of Berlin in Germany, and at Tesla’s Amsterdam Europe Headquarters - both publically accessible. If you’re in the area, definitely drop by and take a look.

Tesla is also holding special events throughout Europe where they’ll be showing the new Model Y through select dates. place to check if you’re far away from the ones above is on Tesla’s Events List.

We recommend checking Tesla’s page to confirm any dates, as Tesla will be adding new locations until each showroom receives its permanent display vehicles.

Tesla will also be visiting major auto shows, including the Toronto and New York International Auto Shows with the new Model Y - so keep an eye out for those events as well.

Follow

Follow

Follow