Tesla has started releasing FSD Beta 10.69.3 to employees
Not a Tesla App
It may be one the most anticipated software updates in recent years. Finally, after weeks of Elon Musk tweeting that Full Self Driving Beta 10.69.3 will come out “next week,” it started to appear on Halloween night. Just before midnight on the west coast @WholeMarsBlog tweeted pictures of the FSD Beta 10.69.3 release notes as they appeared on a Tesla employee's screen. That’s right, pictures, plural, as it took three screenshots to gather all the FSD enhancements packed into this update.
FSD Beta 10.69.3 is update 2022.36.15, which means that it includes all of the features on Tesla's 2022.36 update as well, including popular features such as Tesla's new Energy app, Cabin Overheat Protection and more.
It doesn’t take much reading to understand why Tesla’s CEO has been hyping what he has referred to as a “major update.” Several members of the Autopilot team explained the improvements during A.I. Day 2022. It’s worth a watch to understand just how complex the system is and all the work that goes into it.
Many bullet points from the release notes indicate improvements from 6 percent to more than 50 percent, even reducing the runtime of one system by 80 percent. These are incredible achievements for an already highly advanced platform.
Although it was controversial, Tesla’s numbers appear to back up why it removed the ultrasonic sensors and now relies on the cameras, also known as Tesla Vision. An update to the Object Detection network to photon count video streams refers to a particular emphasis on low visibility scenarios.
The architecture for Vulnerable Road Users (VRU), which encompasses pedestrians, cyclists and people on motorcycles, has a 20 percent improved precision. In addition, there is a two-stage VRU Velocity network to adjust how the car responds to crossing pedestrians. The system also has reduced false slowdowns near crosswalks by better predicting pedestrian movements.
The Vector Lanes, which first appeared a year ago, have also been overhauled. According to the notes, it has improved accuracy “of lanes by 9.2 percent, recall of lanes by 18.7 percent, and recall of forks by 51.1 percent.” Additionally, there is a new road marking module to assist with intersections and a “full network update where all components were re-trained with 3.8x the amount of data.”
To summarize the notes regarding vehicle behavior, FSD will provide a smoother ride, with fewer “unnatural slowdowns” thanks to its improved trajectory systems and quicker decision-making.
When Tesla increased the price of FSD in September, Musk said it will soon be worth even more. The CEO has also said this program will prove to regulators that it is safer than humans driving, potentially saving thousands of people from injury or death as Musk hoped. It’s expected this release will go out to approximately one thousand testers and then be expanded quickly if no issues are detected.
Musk has also committed that every FSD subscriber will have access to the program by the end of the year.
Not only is this a huge update regarding FSD, it also includes many features that were previously unavailable to FSD Beta testers since they're still on one of the 2022.20 updates.
Other Features in This Update
Once FSD Beta testers receive this update, they'll gain access to a slew of new features that were previously included in updates 2022.24, 2022.28 and more recently 2022.36.
Energy App
Tesla's new Energy App that will be available in 2022.36
Not a Tesla App
These features include the new Energy App (video), which displays the vehicle's energy usage down to individual components, letting you easily see how much power is being used by the climate system, versus driving and more.
The long-awaited feature that lets you customize the temperature of Cabin Overheat Protection is also included in this update. You will be able to choose from three different temperature settings at which COP activates.
Blind Spot Camera Placement
One of the more exciting updates of recent was the enhancement of the Blind Spot Camera feature (video). On Model 3s and Model Ys, you'll now be able to pick from three locations for the Blind Spot Camera.
Tesla App
Tesla's adding song title and artist information to the mobile app
@longzheng
The Tesla app has recently been updated to include additional features, although many of these features required a newer vehicle update, which meant that existing beta testers didn't have access to them. However, with the latest FSD Beta, you'll now have access to features such as the ability to view the vehicle's destination and ETA in the app, as well as details on the music currently being played. You'll also be able to unlatch the driver's door on a Model 3 or Model Y if the door handle has become frozen shut.
Minimize Tesla Theater
Another big feature included in this update is that you'll now be able to minimize Tesla Theater (video) when adjusting vehicle controls instead of having to exit the video streaming app completely. When viewing a video in full screen, you'll be able to tap the top of the screen to reveal a minimize button that when pressed will let you access vehicle controls and menus.
Tesla Cloud Profiles
In update 2022.24 Tesla launched cloud profiles which save your vehicle's profiles to the cloud. This is especially useful if you have multiple Teslas or finding yourself renting a Tesla in the future. You'll now be able to carry your vehicle settings and profiles from one vehicle to another.
Car Left Open Notifications
Tesla has recently updated the notifications that you'll receive when the vehicle is parked. You can now choose to receive an alert if the vehicle doors have been left unlocked for a period of time as well.
Undocumented Changes
In addition to all the documented features in this update, there is also an extensive list of undocumented changes that never made it to the release notes.
One of the most interesting is that Tesla will now display suggested destinations when you tap on the Navigate box. The destinations at the top will be suggestions that will vary depending on your location, time of day, history and user profile.
Other undocumented changes include the ability to view tire pressure data in the Service tab even when the vehicle is parked, improvements to vehicle alerts and HomeLink and the capability to uninstall games.
During the unveiling of the Cybercab at We, Robot last year, we saw the Cybercab use a strange laser-like lighting system to project an interesting light pattern. It was a rather peculiar projection, and many observers passed over it without wondering too much - perhaps it was just a trick of the show?
But we went back and thought - what is it really? What kind of lighting technology could Tesla be using to accomplish this visual effect, and does it have a purpose? That led us down the rabbit hole of Structured Light, and we think that Tesla could be using this technique for a few different things.
Cybercab’s Autonomy
Unlike other autonomous vehicles, which are often retrofitted with complex and expensive sensor arrays, the Cybercab is purpose-built to be a mass-market autonomous taxi. Because of that, Tesla is using several new techniques to drive down the cost and simplify the vehicle, from the paint-impregnated panels to the easy-to-clean interior.
However, the drive to keep costs down hasn’t stopped Tesla from looking for ways to present a premium and safe product, which has been one of the Engineering and Design team’s goals for a long time.
Structured Light is a technique involving the projection of light using a distinct pattern (see it in action below). In particular, it’s a machine vision technique for capturing 3D information. Unlike normal, ‘passive’ cameras that interpret ambient light, structured light actively projects a known pattern, such as lines, grids, or dots, onto the environment.
A camera will then observe how the pattern deforms as it hits objects. By analyzing these distortions, the system can precisely calculate the 3D shape and depth of the scene in front of it. Structured light can generate dense, high-resolution 3D data, which is particularly useful at short ranges.
But is this useful for an autonomous vehicle? Potentially. It offers a close-range means of mapping the environment directly in front of the vehicle, and could theoretically complement the existing camera suite for precise maneuvering in tight spaces. It could also be used for detecting low-lying objects, although this task could be handled by the bumper camera that is arriving on newer Tesla vehicles as well.
Structured Light vs LiDAR
Not a Tesla App
The mention of an active 3D sensor brings to mind LiDAR (Light Detecting and Ranging) - which Elon Musk has repeatedly called a crutch for self-driving. But LiDAR is different than Structured Light - it emits a pulse of laser light and measures the time of flight to generate a 3D point cloud of the environment.
While both involve projecting light, structured light systems require specialized hardware distinct from Tesla's current Matrix LED headlights. Matrix headlights are designed to intelligently block parts of the main beam to prevent dazzling other drivers, using an array of controllable LEDs.
Structured light, conversely, requires a dedicated projector to cast a specific, known pattern (dots, lines, or a grid) precisely so a camera can analyze its deformation for 3D mapping. Implementing structured light would likely involve adding a new, dedicated projector component - perhaps another Cybercab exclusive feature.
Tesla already uses computer vision to navigate the environment, and adding Structured Light could potentially aid this process for Robotaxi challenges and edge cases, while not deviating from Tesla’s policy to use the same senses that a human uses to drive.
Structured light could be Tesla’s potential intelligent solution to an active 3D sensing system without adopting a more traditional approach like LiDAR.
Other Uses
Beyond the possibility of 3D sensing, could this light projection serve other purposes? Tesla is known for integrating novel new features into its vehicles - sometimes practical, sometimes just for fun. There are a few possibilities here.
Visual Communication - The lights could be used to project information onto a road surface - perhaps showing the vehicle’s intended path, or displaying warnings to pedestrians. It could even project a virtual crosswalk to signal that it is safe for pedestrians to pass.
Passenger Guidance - For a taxi without a driver, guiding passengers on how to approach and use the Cybercab could be useful. A projected welcome mat could show passengers exactly how to get into the Cybercab, reveal which passengers are being picked up, or provide other important information.
Improved Light Shows - We all know Tesla loves the little things in life. The projection could be used for more whimsical Light Shows in the future. We’re sure they’ll have more than just that in mind, though.
Wrapping Up
While we haven’t had any official confirmation that Tesla is using Structured Light, the possibility of the Cybercab using a novel new technology is relatively fascinating. It suggests that Tesla is looking into using its pre-existing tools and features in even more ways - something that they’ve always focused on. Whether this projection is for sensing or communicating, or even just for fun as a light show, we won’t know until Cybercab actually hits production.
One idea that consistently comes up when discussing the future potential of FSD is the ability to order a Tesla and have it arrive at your home—completely autonomously.
Picture this: a car rolls off the assembly line at Giga Texas, drives itself to the outbound delivery lot, and merges onto the highway—completely driverless. Its destination? A customer in upstate New York. Along the way, the vehicle independently plans its charging stops, navigates traffic, and drives nonstop, no breaks needed, until it pulls into the buyer’s driveway.
Of course, there’s a lot to consider and break down - but Elon Musk doubled down and said that he intends to have Tesla vehicles deliver themselves autonomously by the end of 2025. We’re sure there are some stipulations to that, but it’s an exciting idea that could save Tesla thousands per vehicle sold.
The core idea is that FSD Unsupervised is nearing completeness, with the upcoming launch of Tesla’s first Robotaxi network slated for June. Once Tesla can demonstrate that Unsupervised driving is safe, it will expand beyond simply transporting passengers from Point A to Point B.
That will include moving vehicles from factory to consumer, which will vastly streamline Tesla’s delivery process - and really make a statement about how far Tesla is ahead of the competition.
Reduced Delivery Costs
One of the biggest keys for Tesla throughout its history has been its ability to drive down costs. Delivery costs add to the price of a vehicle, and it’s not just the price of transporting the vehicle, but the cost of the whole delivery experience — delivery center and personnel included.
Instead, if a future Tesla drives itself directly to the consumer, Tesla can further reduce the price of its vehicles or improve its profits.
Improved Customer Experience
Money aside, the real game-changer is that no other vehicle delivery experience will come close to Tesla’s. What other brand will be able to deliver a car that drives itself to your home—straight from the factory?
Having a vehicle deliver itself can also provide other benefits, such as faster delivery times for customers. The customer also won’t need to drive to a delivery center to pick up their vehicle. The vehicle would go directly from the factory to the customer without any steps in between.
There’s something undeniably futuristic about getting a notification on your phone, glancing outside, and seeing your brand-new Tesla autonomously pulling into your driveway.
Limitations
Of course, with any new process or feature - there will be limitations and hurdles for Tesla to address, and these will take time and effort.
Let’s discuss some of the hurdles Tesla will need to solve.
Charging Infrastructure
Besides achieving true autonomy, another big challenge will be charging infrastructure. No Tesla can currently plug itself in at a Supercharger - they’ll need access to the upcoming V4 Superchargers with Wireless Charging to take on a road trip autonomously.
That will be a challenging rollout in the initial few years, especially as Tesla hasn’t been actively replacing older V2 Supercharger sites just yet - and is instead focusing on deploying new ones. We imagine that the rollout of wireless charging will likely also be limited, and it is likely that only Tesla’s more premium vehicles and Robotaxis will receive wireless charging compatibility.
Autonomy Policies / Geographic Limitations
Tesla has been consistently hamstrung by red tape, and unsupervised deliveries will also be a massive hurdle to clear with many states and provinces, as well as at the federal level. That will be an implicit challenge for Tesla in the infancy of the Robotaxi network as well, but once approvals spread wider, we can see these restrictions being lifted and relaxed.
Mileage and Damage
One item that could be a sticking point for customers is mileage and damage. If your brand-new vehicle was damaged on its trip over, what would you do? You’d have to take it from your driveway right to the Service Center, effectively invalidating the entire experience.
Of course, many people will also want to see a low odometer on arrival of a brand new, fresh-from-factory vehicle - and that’s understandable. Having a car arrive with several hundred or even a thousand miles of wear and tear on the tires and paint could be a big negative as well.
What Is Likely to Happen
We think that Tesla will continue to ship vehicles longer distances - but perhaps once they’re offloaded at your local Service Center, an employee taps a button, and begins the self-delivery process. That eliminates many of the above problems we’ve outlined, including charging and additional mileage, while keeping many of the advantages intact.
For any customers who order a Tesla in Austin later this year, it’s possible Tesla could have the vehicle delivered directly to you.