Tesla shows off the latest capabilities of its robot, Optimus
Tesla
Tesla's venture into the realm of humanoid robots, represented by Optimus, has taken colossal strides since its inception. Remember the first "robot" that was a person dressed up? Or the second one that was barely able to move? Initially met with skepticism due to a less-than-stellar unveiling, the latest updates showcase Optimus' ability to autonomously sort objects and move around — specifically doing yoga and revealing Elon Musk's vision inching closer to reality.
From Skepticism to Anticipation
Initially introduced at AI Day 2021, Optimus — or Tesla Bot — came off as a half-baked concept featuring a dancer in a robot suit, sparking doubts across the spectrum. The journey from a man in a suit and a CGI trailer to working prototypes in AI Day 2022 reflects Tesla's unwavering dedication to innovation. The skeptics have served a stark reminder: Tesla's capability for rapid advancement is unparalleled.
Recent demonstrations depict a more refined Optimus, exhibiting fluid movements, advanced balancing capabilities, autonomous task execution, and even dealing with an annoying human who keeps messing with the blocks! These advancements indicate Tesla's relentless progress in neural network training, ensuring that Optimus can interact autonomously and adapt efficiently to real-world scenarios.
Autonomous Learning, Adaptation & Safety
Autonomous sorting and self-calibration are indicative of the significant leaps made by Optimus. The robot's ability to learn, correct, and adapt showcases a future where monotonous, repetitive tasks are relegated to the past, allowing humanity to explore uncharted territories of creativity and innovation.
Safety remains paramount as Musk emphasizes the necessity for local safety maximization, highlighting the commitment to integrating Optimus seamlessly and safely into society. The promise of a centralized pause function showcases a thoughtful approach to ensuring human control and oversight.
Versatility and Vision
In a captivating display of versatility, Optimus was seen performing yoga poses, a testament to its adaptability and range of potential applications beyond industrial tasks. With Elon Musk envisioning Optimus performing ballet one day, the boundaries seem limitless for this technological marvel. In the video Tesla talks about Optimus's capabilities, stating:
“Tesla Optimus is now capable of self-calibrating its arms and legs. Using only vision and joint position encoders, it can precisely locate its limbs in space. Accurately calibrated, Optimus learns various tasks more efficiently. Its neural net runs entirely on-board, using only vision. For example, it can sort these blocks by color fully autonomously. And it does so while dealing with the dynamic reality of our world. Optimus also demonstrates autonomous, corrective action capabilities. It can be trained to conduct new tasks, such as un-sorting. And after a long day of work, time to stretch. Namaste!”
Musk's bullish predictions hint at Optimus contributing substantially to Tesla's long-term value. With a potential demand reaching billions of units, Optimus is poised to revolutionize industries and redefine the integration of robotics in daily life. A 2027 release might have seemed ambitious, but given the rapid progress, it is increasingly plausible.
Tesla's Optimus program illustrates ambition, innovation, and rapid development from CGI skepticism to witnessing a more refined, adaptable, and autonomous robot. I, for one, can't wait for the next AI Day.
Optimus Sorting Objects
Optimus can now sort objects autonomously ?
Its neural network is trained fully end-to-end: video in, controls out.
Come join to help develop Optimus (& improve its yoga routine ?)
We’ve now uncovered more details on how Tesla achieved such drastic improvements in the vehicle’s power consumption, which Tesla estimated to be a 40% reduction.
Tesla made architectural changes to how it processes and analyzes video — optimizing which components handle which tasks. While the Cybertruck is the first to benefit from these advancements, Tesla plans to extend these upgrades to other vehicles in the future.
Sentry Mode Power Consumption
Tesla vehicles feature two main computers: the MCU (Media Control Unit) computer, which powers the vehicle’s infotainment center, and the FSD computer, which is responsible for Autopilot and FSD. Both of these computers remain on and powered any time the vehicle is awake, consuming about 250-300 watts.
Typically, the vehicle only uses this power while it’s awake or actively driving. It’s not a major concern since the car automatically goes to sleep and shuts down its computers after about 15 minutes of inactivity. However, the larger issue is that these computers also need to remain on when Sentry Mode is active, causing a 250-watt draw whenever Sentry Mode is on.
Interconnected System
Today, the vehicle’s cameras are connected to the FSD computer, which connects to the MCU, which is finally connected to the USB ports. Because of this interconnected setup, everything needs to remain powered. Footage needs to be streamed from the FSD computer into the MCU, where processes like motion detection occur. The data then needs to be compressed before finally being written to the USB drive. That’s a lengthy process, requiring multiple computers to remain on in order to be able to record and save live video.
Architectural Changes
Tesla is making some architectural changes to address Sentry Mode’s high power consumption by shifting the responsibilities of the vehicle’s computers. By shifting motion detection and possibly the compression activity to the FSD computer, Tesla will now be able to keep the MCU computer asleep. The MCU is still required to push the video to the USB drive, but Tesla can now wake up the system only when it’s needed.
For instance, the FSD computer will still handle the connection to the vehicle’s cameras, but it will now also detect motion. When that Sentry event occurs, it can wake up the MCU to write the data to the USB drive and then have it go back to sleep.
This approach ensures the MCU isn’t continuously powered to analyze and compress video, instead activating it only when data needs to be written.
Processor Isolation & Task Allocation
Tesla’s current architecture separates the Autopilot Unit (APU) from the MCU. This is done for several reasons - but first and foremost is safety. The MCU can be independently restarted even mid-drive without impacting the APU and key safety features.
Additionally, by isolating the APU from the MCU, tasks that are optimized for each unit—processing versus image transcoding—can be offloaded to the processing unit that’s better suited for it. This helps keep both the APU and MCU operating at their optimal power and performance parameters, helping to manage energy consumption more efficiently.
Kernel-Level Power Management
Tesla’s been working on more than just FSD or new vehicle visualization changes and has been putting in the effort to optimize the operating system’s underlying kernel. While not in heavy use, Tesla is underclocking the processors of both the MCU and APU, reducing power usage and heat generation.
Of course, other kernel optimizations and programming tricks, such as the ones Tesla uses to optimize its FSD models, also factor into the increased overall efficiency of the vehicles.
Additional Benefits
Since Tesla vehicles also include a Dashcam that processes video, it’s possible we may also see these additional power savings whenever the vehicle is awake. This could also affect other features, such as Tesla’s Summon Standby feature, which keeps the vehicle awake and processing video to give users almost instant access to the vehicle’s Summon feature.
Roll Out to Other Vehicles
While the Cybertruck was the only vehicle to receive these power improvements to Sentry Mode, we were told that they’re coming to other vehicles too. Tesla is introducing these changes with the Cybertruck first, leveraging its smaller user base for initial testing before expanding the rollout to other vehicles.
USB Port Power Management
To further conserve energy and reduce waste, Tesla now powers down USB ports, even if Sentry Mode is active. This change has impacted many users who rely on 12v sockets or USB ports to remain powered to keep accessories such as small vehicle refrigerators on.
It’s not immediately clear whether these changes to Sentry Mode impact this change or whether power to 12v outlets was removed strictly due to safety concerns.
Tesla has initiated another minor design revision, this time improving the rear camera on the Model 3 and Model Y. This minor revision adds a protective lip around the camera, providing better shielding against rain, dirt, snow, and general road grime.
The design revision began rolling out for Model Y vehicles from Shanghai first, with the initial vehicles spotted with the revision dated as early as late September 2024. Tesla regularly makes minor design revisions on its vehicles in between model years, in an iterative design process that gradually improves as more and more vehicles are built.
Design Revision
The design revision adds a small shield around the rear camera, including a small lip towards the bottom end. The little lip is likely going to make the biggest difference, as it will help prevent kickback and wash from the tires landing on the camera lens, which can obscure it.
For now, nothing indicates a potential revision including a camera washer—similar to the Cybertruck’s front camera washer. However, given we already know the Model Y Juniper is likely arriving with a front camera, it’ll probably also have a front camera washer.
This lip for the rear camera should be a nice addition, but we’ll have to see just how much of an improvement it provides in the upcoming winter season as the messy, slushy mix arrives in much of the United States and Canada.
3D Printed Accessory
If you’re feeling left out without the new rear camera shield, you’ll soon be able to 3D print and install a similar design. Some entrepreneurial 3D modelers have already started working on making a retrofittable shield for both the HW3 and HW4 rear cameras.
In the meantime, we recommend using ceramic coating on the rear camera to help keep that slush and grime moving when it does hit the camera. A good application of ceramic coating can help prevent buildup on the lens.
Model S and X
For now, we haven’t seen this design revision on more recent Model S and Model X vehicles yet. There were previously rumors of a light refresh for both of the more premium vehicles. However, we haven’t seen any indications of these changes actually seeing the light of day.
Once the refreshes for these two vehicles arrive, we could see more drastic changes. Tesla has also indicated it is waiting to use some of its upcoming new battery cell technology in 2026, so we could be waiting for a while before seeing further updates to the Model S and Model X.
We’ll be looking for both vehicles to receive this design revision. If you spot them, let us know on social media or on our forums.
![Tesla Unveils V4 Superchargers Capable of Charging at 500kW [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/charging/v4_supercharger.jpg/e6e109be929ba0765b4303a7e9d5bb7d/v4_supercharger.jpg)
