Elon Musk started Tesla's AI Day 2022 by saying, "I want to set some expectations with respect to our Optimus Robot," just before the doors opened behind him. A robot walked out, waved at the audience, and did a little dance. Admittedly a humble beginning, he explained, "the Robot can actually do a lot more than what we just showed you. We just didn't want it to fall on its face." Musk's vision for the Tesla Robot, "Optimus is going to be incredible in five years, ten years mind-blowing." The CEO said other technologies that have changed the world have plateaued; the Robot is just starting.
Tesla's CEO envisions Optimus eventually being like Commander Data, the android from Star Trek the Next Generation, except it "would be programmed to be less robot-like and more friendly." Undoubtedly there is a long way to go to achieve what Doctor Noonien Soong created in Star Trek TNG. What was demonstrated onstage wasn't at that level, but several videos throughout the presentation highlighted what the Robot is capable of at its very early stage in development. The audience watched the Robot pick up boxes, deliver packages, water plants and work at a station at the Tesla factory in Fremont.
Development over 8 Months
The breakdown of some of the systems of the Tesla Robot
Tesla (Edited by Not a Tesla App)
The first Robot to take the stage at AI Day was not Optimus, but Bumble C, another acknowledgement to The Transformers, as Bumble Bee played a significant role in that franchise. However, Bumble C is far less advanced than Optimus, who did appear later but was on a cart.
Several Tesla engineers took turns on the microphone describing some of the most complex elements of the project that was first announced one year ago. Perhaps the best description of the project was the company moving from building a robot on wheels to a robot on legs. However, that may be oversimplifying. For example, the car has two motors, and the Robot has 28 actuators.
Overall Design and Battery Life
Tesla's brightest demonstrated how the production has come to life over the past eight months. It seems this group of computer masterminds had to become anatomist experts as Tesla took hints from the human body to create a humanoid robot. That is an essential factor in creating Optimus. Everything people interact with is made usable by a human, with two legs, two arms, ten fingers etc. If the Robot differed from what the world is already designed for, everything would have to change. However, recreating the human body and its countless movements would take far too long, so Tesla has stripped it down to less than 30 core movements, not including the hand.
Like the human torso contains the heart, the Robot's chest holds the battery. It's projected that a single charge would provide enough for a full day's work with a 2.3-kilowatt-hour battery. All the battery electronics are integrated into a single printed circuit board within the pack. That technology keeps charge management and power distribution all in one place. Tesla used lessons learned from vehicle and energy production to create the battery allowing for streamlined manufacturing and simple and effective cooling methods.
Autopilot Technology
Tesla showed what the Robot sees, and it looked very familiar. That's because the neural networks are pulling directly from Autopilot. Training data had to be collected to show indoor settings and other products not used with the car. Engineers have trained neural networks to identify high-frequency features and key points within the Robot's camera streams, such as a charging station. Tesla has also been using the Autopilot simulator but has integrated it for use with the Robot programming.
Tesla shows off what the Optimus robot sees
Tesla (Edited by Not a Tesla App)
The torso also contains the centralized computer that Tesla says will do everything a human brain does, such as processing vision data, making split-second decisions based on multi-sensory inputs and supporting communications. In addition, the Robot is equipped with wireless connectivity and audio support. Yes, the Robot is going to have conversations, "we really want to have fun, be utilitarian and also be a friend and hang out with you," said Musk.
Motors Mimic Joints
The 28 actuators throughout the Robot's frame are placed where many joints are in the human body. Just one of those actuators was shown lifting a half-tonne nine-foot concert grand piano. There have been thousands of test models run to show how each motor works with the other and how to effectively operate the most relevant actuators for a task. Even the act of walking takes several calculations that the Robot must make in real-time, not only to perform but also appear natural. The robots will be programmed with a locomotion code; the desired path goes to the locomotion planner, which uses trajectories to state estimations, very similar to the human vestibular system.
Human hands can move 300 degrees per second and have tens of thousands of tactile sensors. Hands can manipulate anything in our daily lives, from bulky, heavy items to something delicate. Now Tesla is recreating that with Optimus. Six actuators and 11 degrees of freedom are incorporated into the robot hand. It has an in-hand controller that drives the fingers and receives sensory feedback. The fingers have metallic tendons to allow for flexibility and strength. The hands are being created to allow for a precision grip of small parts and tools.
Responsible Robot Safety
Musk wanted to start AI day with the epic opening scene from Terminator when a robot crushed a skull. He has heard the fears and people warning, "don't go down the terminator path," but the CEO said safety is a top priority. There are safeguards in place, including designs for a localized control ROM that would not be connected to the internet that can turn the Robot off. He sees this as a stop button or remote control.
Optimus Price
Musk said the development of Optimus may broaden Tesla's mission statement to include "making the future awesome." He believes the potential is not recognized by most, and it "really boggles the mind." Musk said, "this means a future of abundance. There is no poverty. You can have whatever you want in terms of products and services. It really is a fundamental transformation of civilization as we know it." All of this at a price predicted to be less than $20,000 USD.
Tesla Shows Off its First Robot at AI Day 2
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
A third-party company called Teslogic, which previously built dashboard kits for Tesla vehicles has launched a Kickstarter for something completely unexpected: a full-bore infotainment replacement for your vehicle.
Screenmate completely transforms your Tesla display from its limited entertainment options into a full-fledged productivity and entertainment hub. But it’s not only for entertainment; Screenmate has built an entire OS that’s capable of controlling most aspects of your Tesla.
Since the unit plugs into your vehicle, it can control various aspects of your vehicle, including charging, operating the glove box, folding mirrors, and even new options Tesla doesn’t include, like preheating your battery or controlling your seats directly from the display.
This is an extremely attractive option that has a fast, intuitive user interface. It even includes CarPlay and Android Auto support.
This could be a good option if you want better access to third-party apps, different navigation options, or even more gaming from within your Model 3 or Model Y.
Features
The top dock/dashboard for Screenmate.
Not a Tesla App
Screenmate is essentially an add-on computer for your Tesla. It takes over the main display, but it can also pass through information from the original infotainment computer, like the FSD visualization.
They’ve also got an updated little top dock that shows all the key car information all the time, including speed, Autopilot / FSD status, speed limit, battery, and the power meter.
App Integration
Screenmate offers a whole host of new apps - pretty much anything available on an Android tablet will be available here. Think better integrations for Netflix, YouTube, Spotify, TIDAL, and others. That’s on top of productivity apps like Zoom, Teams, and even stuff like Microsoft Office or Google Docs.
Navigation Enhancements
Tesla’s navigation system is pretty smart - but a few things are missing that people really would like. Some of these include better information for traffic cameras, speed traps, and other things - usually items available through crowd-sourcing apps like Waze. Screenmate will let you use Waze or another navigation app, and even allow you to display it full screen without having the Autopilot visualizations getting in the way.
Not a Tesla App
While their Kickstarter doesn’t go into too much detail, there could be some shortcomings, such as whether FSD could leverage the routing that you pick on the screen. FSD uses Tesla’s internal routing and also makes its own decisions on the fly, which are likely not displayed here.
Gaming on the Go
Ever since Tesla killed Steam gaming on the Model S and Model X, gaming has been on a steady decline in Tesla vehicles. Screenmate allows you to play most games available through the Android app store or pass through video from a gaming console. Since the Screenmate has a video input, you can display content from almost any device onto the vehicle’s display, including a Nintendo Switch, your phone, or another device.
Streamlined Controls
Not a Tesla App
Screenmate adds an interesting new feature—a control panel for your Tesla. It adds a customizable dock of quick-access options for things you’d normally have to dig into a menu for. You can pull it up with a simple swipe from the left.
This is a feature we’d love to see Tesla add in the future. And the best part? It offers a bunch of features you normally can’t access, like preheating your battery for third-party charging.
Social Media
One thing missing from Tesla’s infotainment is messaging apps—Discord, Slack, Facebook Messenger, Whatsapp—the whole host, really—to display their notifications on the screen. Tesla’s infotainment can only show text messages from your phone.
In addition, there’s little to no integration for social media in general. While you can access X or Facebook through a browser, it’s not a great experience.
Since Screenmate can run Android apps, you have access to all of these apps, and they even include notification support.
Not a Tesla App
Carplay and Android Auto
For those who can’t live without Apple Carplay and Android Auto, Screenmate offers access to both via a simple wireless or wired connection.
Front Wireless Camera
Teslogic sells a separate wireless front camera which can be integrated directly into the Tesla display if you’ve got Screenmate. It even pops up like the Cybertruck’s front camera.
This is a great feature for people who park in tight spaces. On the other hand, Tesla is likely going to add front bumper cameras to the Model Y Juniper, and also the Model S and Model X.
Pricing & Release Date
Screenmate is on Kickstarter. While Teslogic is a real company that ships products, Kickstarters are at the backer’s risk. That means they technically could not ship a product, and you won’t receive a refund. However, it seems that Teslogic already has all its prototyping done and is ready to move into production.
So, with that warning aside, the Screenmate starts at $599 USD ($830 CAD) with the early bird package, which is available right now. The intended retail price after launch is approximately $890 USD.
Teslogic says the estimated delivery date is around May 2025, so that’s not too far away for those willing to back a Kickstarter campaign. Installation appears to be pretty simple: It's plugged into the MCU serial buses under and behind the glove box.
Last month Tesla shared a roadmap with its progress on FSD and its goals for the coming months. Since we’re coming to the end of October and Tesla had yet to release the two items listed under October, we asked Tesla if they could provide an updated roadmap to help keep everyone’s expectations in line.
We’re not sure whether Tesla saw our message or already had plans to provide an updated roadmap, but today Tesla published an update to its initial roadmap.
Instead of focusing on timelines, Tesla has now simply published what their AI team is working on and what customers could expect next.
Tesla’s Original Timeline
The roadmap Tesla provided in early September focused on FSD improvements, releasing Actually Smart Summon, FSD on Cybertruck, FSD v13, and the expansion of FSD outside of North America.
This was Tesla’s initial roadmap which was provided on September 5th.
September 2024
v12.5.2 with ~3x improved miles between necessary interventions
v12.5.2 on AI3 computer (unified models for AI3 and AI4)
Actually Smart Summon
Cybertruck Autopark
Eye-tracking with sunglasses
End-to-End network on highway
Cybertruck FSD
October 2024
Unpark, Park and Reverse in FSD
v13 with ~6x improved miles between necessary interventions
Q1 2025
FSD in Europe (pending regulatory approval)
FSD in China (pending regulatory approval)
Elon Musk also replied to Tesla’s post, saying that, hopefully, right-hand drive markets will also get FSD in late Q1 or early Q2.
Goals Tesla Met
While we’re only at the end of October, Tesla managed to check off their September goals with a perfect score, nailing all of their goals such as eye-tracking with sunglasses, FSD on the Cybertruck and releasing Actually Smart Summon in the United States and Canada.
They also released the unified FSD model for HW3 and AI4, although it seems like the good news may stop there for HW3 owners. At least Tesla has recently said HW3 owners will get a free upgrade to more capable hardware if Tesla isn’t able to achieve unsupervised FSD on those vehicles.
Goals Tesla Is Still Working On
Although the company met its September milestones, the October goals have been delayed. Initially targeting the release of unpark, park, and reverse features and FSD v13 for October, Tesla now plans to integrate these features with FSD v13 in November.
The delay isn’t surprising given the ambitious goals, but we’re thrilled to see that Tesla is keeping the communication lines open.
The goals Tesla set to release FSD outside of North America are still to be determined, but we presume they may shift slightly due to the delay of FSD v13.
What’s Coming
While Tesla avoided dates and timelines for their upcoming features, they actually provided a lot more detail on what they’re working on and what we can expect in FSD v13. Unfortunately for HW3 owners, most of these improvements appear to be destined for Hardware 4 (AI4).
Complete Rollout of End-to-End
Tesla’s first item on its updated list is to complete the rollout of its end-to-end highway stack. Tesla’s current highway stack is based on FSD v11 and doesn’t feature end-to-end AI, meaning that AI is only used for input and not to control the vehicle. End-to-end AI essentially has AI managing everything in the vehicle, from detecting objects and lane markers to the steering and brake pedals.
Tesla started including end-to-end for highway driving in FSD v12.5.5 for the Cybertruck and then opened it up to other AI4 vehicles with FSD 12.5.6. The latest public FSD version is FSD 12.5.6.1, but it’s only available for AI4 vehicles.
The majority of vehicles with FSD are still on version 12.5.4, which doesn’t include the new highway stack. Tesla aims to release the updated highway stack to all AI4 vehicles next week, which will also include improvements to stop smoothness and improved bad weather notifications.
Actually Smart Summon
While Actually Smart Summon was released in September in North America, most of the world is still waiting. Tesla now says that A.S.S. will be available in other regions but didn’t provide a timeline. Users who bought or subscribe to Enhanced Autopilot or FSD in Europe should expect to receive this feature as part of Tesla’s normal feature releases instead of being a part of a special FSD build. It’s possible this could come in Tesla’s next major update, possibly 2024.44.
It’s not clear whether Tesla’s list was in any sort of order, but if it is, we could expect Actually Smart Summon sooner rather than later.
Improved FSD for HW3
Tesla’s updated list was largely focused on FSD for AI4, but HW3 did get mentioned in one bullet point item. Tesla says that HW3 should receive improved FSD v12.5.x models for city driving. Unfortunately, this almost sounds like bad news. AI4 mentions in the roadmap talk about FSD v13 and end-to-end highway support, while HW3 specifically states improved “city-driving,” possibly saying that end-to-end highway driving is not coming to HW3 vehicles soon.
Given that a new version of FSD v12.5.4.2 just started rolling out for HW3 vehicles, it looks like it may be a while before HW3 owners have access to the new highway stack. Earlier this month, Musk said that HW3 owners should receive an update that will increase FSD’s smoothness, so it seems like this is what Tesla is referring to in their roadmap.
FSD V13
The rest of Tesla’s post was dedicated to FSD v13. Tesla provided a lot of specifics such as FSD v13 unlocking the full resolution of Tesla’s HW4 cameras. The computer will now process full-resolution video at 36 FPS instead of using lower frames per second or scaling the video down.
FSD v13 will also increase the AI model by three times and data by 4.2 times. Tesla expects this to provide better collision avoidance, improved traffic controls and navigation.
FSD Unsupervised Feature Complete
Tesla’s VP of AI, Ashok Elluswamy, is just as excited about v13. He reposted Telsa’s post and said that a lot of work is going into the FSD v13 release and that Tesla expects v13 to make FSD Unsupervised feature complete. This is far from saying that FSD v13 will achieve autonomy, but simply that all the pieces of the puzzle are now in place with v13. The car will be able to navigate from a garage to its parking spot at a destination without any human input. Each of these pieces will likely still need to be refined over time to achieve unsupervised FSD.
Release Date for FSD V13
Tesla is targeting the release of FSD v13 to employees by the end of this week. Tesla expects the update to go through several iterations before it’s released to customers in FSD v13.3. Tesla says that the target launch for a public version of FSD v13.3 is around Thanksgiving for AI4 vehicles.
FSD Arrival Options
In addition to FSD v13 including the ability to “unpark,” reverse and park itself, Tesla will also add various options for when the vehicle arrives at its destination. Users will be able to choose from simply pulling over, parking in a parking spot or driveway or even a garage.
We believe that “unpark” in this statement refers to the ability for the user to engage Autopilot while the vehicle is still parked. The vehicle will automatically shift from Park to Drive and drive or reverse out of its parking spot before proceeding to its destination.
Detecting Emergency Vehicles
One other item Tesla pointed out in their roadmap is that FSD v13 will process audio inputs to better handle emergency vehicles. FSD now appears to rely only on detecting emergency vehicles visually, but with FSD v13, Teslas will be able to detect them audibly as well. Unfortunately, all Teslas only have microphones inside the cabin, which are currently used for phone calls and voice commands, but Tesla will soon continuously process the audio to detect emergency vehicles and potentially other things.
Outlook
Tesla has already integrated some v13 improvements and reports a 4x increase in miles between necessary interventions compared to v12.5.4. It’s clear that Tesla’s focus is on AI4 and reaching its goal of Unsupervised FSD. They appear very focused on this goal and will do whatever it takes to get there. Right now, that means focusing on AI4, but if at any point they run out of compute power needed there, they could shift to AI5, but that’s not expected to happen any time soon.
AI5, which is included in the Cybercab, isn’t expected to be released until the end of the year. We expect Tesla to continue marching toward achieving autonomy, regardless of the power required. Once they can figure out FSD, they can work backwards to get it working on older hardware.
![Tesla Display Alternative: Everything the Tesla OS Should Be [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/2024/screenmate.jpg/94e00b1eb97fe30c9f522aeb3e94e4af/screenmate.jpg)
![Tesla Safety Numbers Continue to Improve Alongside Feature Advancements [Vehicle Safety Report]](https://www.notateslaapp.com/img/containers/article_images/2021/emergency-braking.jpg/fa9cced4bf8348db88679602faa5dae5.jpg)
