Musk Shares Details on FSD Beta v11: Neural Nets to Be Used for Vehicle Control

By Nuno Cristovao
Elon Musk says we may get FSD Beta v11.3 as early as this week
Elon Musk says we may get FSD Beta v11.3 as early as this week
Not a Tesla App

Elon Musk has provided further guidance on Tesla's next major release of FSD Beta, v11.3. Last week Musk said that v11.3 would be ready in about 'two weeks' and would contain many major improvements.

We've heard these two-week estimates before, but it's reassuring that Musk is being specific with details on this upcoming release.

Now just seven days after his last tweet, Elon Musk is giving us more details on this significant upgrade.

Timeline

Musk said he expects FSD Beta v11.3 to start rolling out to some customers later this week, or next week at the latest. This matches up with his initial two weeks estimate a week ago.

Elon Musk's estimates are known to be overly optimistic, but given the number of details he's releasing, it sounds like Tesla may be close to releasing this next build.

FSD Beta v11.3 will likely roll out to Tesla employees first and then go out to select FSD Beta testers, possibly the original OG group. Since this is a major milestone and includes major improvements, expect a slow and gradual rollout. Although we may get our first glimpse into FSD Beta v11 this week, it may be several weeks or more before the majority of customers have access to this beta.

Neural Nets for Vehicle Behavior

A week ago Musk said this upgrade will include 'many major improvements.' Last night Musk revealed some additional details. He said there will be "many small things," one of which will be that Tesla will begin to use neural nets for vehicle navigation and control, instead of just vision.

Today Tesla uses neural networks to determine the vehicle's surroundings, where objects are, what they are, and their distances from the vehicle to create a 3D environment known as 'vector space.' With this information, the vehicle can then plan a path and navigate around these objects toward its destination.

However, based on Musk's comment, it sounds like Tesla is currently only using neural nets to determine its environment and not for controlling the vehicle. This means that how the vehicle behaves, how it finds a path, and how it moves is still a process that is coded traditionally.

In the same way that Tesla uses millions of images to determine what a stop sign or traffic cone is, it sounds like Tesla will now use a large number of examples to determine how to best control the vehicle in various situations.

That could mean that Tesla will take millions of quality examples of how to gradually accelerate or slow down, based on real driving behavior to determine how the vehicle should accelerate in different situations.

This could be applied to every driving characteristic such as turning, slow downing, driving around a parked vehicle, etc.

If Tesla starts leveraging neural nets to aid vehicle control we may soon see drastic improvements to vehicle behavior, making it much smoother and human-like.

New Features

Although Elon Musk didn't specifically mention new features coming to FSD Beta v11.3, there are several that have been talked about in the past that could show up in this major full self-driving update.

Reverse Creep

Reverse Creep has been a feature that has been talked about as far back as FSD Beta 10.13. This feature would allow the vehicle to go into reverse to move out of the way of danger or adjust its trajectory. Right now FSD Beta will only ever move forward, so this improvement would be a giant step toward achieving human-like behavior.

A good use case for this is when the vehicle moves forward for better visibility. There may be times when the vehicle sees a car coming after moving creeping forward. In these cases, it'd be smart to let the vehicle reverse back to its previous position if it is now in the path of traffic.

Navigating Without Map Data & GPS

In the past Musk also alluded to the fact that Tesla is working on the neural networks' ability to complete 'dead reckoning' navigation, which is navigating based only on inertial measurements such as speed, direction and wheel movement.

He gave underground parking garages as an example of where FSD would need the ability to navigate without GPS or map data.

The car will be able to do this by using its last known GPS location and then determine its future location using only a compass, wheel movement and speed.

FSD Beta v11

FSD Beta v11 has always been expected to be a big leap forward, and as we get closer, that hasn't changed. This update is expected to be a huge improvement to what is currently available to customers. Although Musk's timelines have usually shifted and features have typically taken longer than initially planned, it looks like we may be getting close to the next major release for FSD Beta.

Although we're still years away from true full self-driving, Tesla's mission inches closer with every update. 

Recently there was also a leak revealing some details of Tesla's upcoming cameras in hardware 4.0, which are expected to include a fan and heater for select cameras.

Tesla Preparing to Expand Robotaxi Geofence As Validation Vehicles Spotted

By Karan Singh
Not a Tesla App

Tesla appears to be preparing to expand its Robotaxi geofence in Austin, Texas, with numerous engineering vehicles taking to the road. One of the most interesting sights, between the short and tall LiDAR rigs, was a Cybertruck validation vehicle, which we don’t often see.

Tesla’s expansion is moving the Robotaxi Network into downtown Austin, a dense urban environment that is currently outside the geofence. It appears Tesla is content with the latest builds of Robotaxi FSD and is ready to take on urban traffic.

The inclusion of a Cybertruck in the validation fleet is noteworthy, as the rest of the vehicles are Model Ys. This suggests that Tesla may be addressing two challenges simultaneously: expanding its service area while also addressing the FSD gap between the Cybertruck and other HW4 Tesla vehicles.

Using LiDAR

Recent sightings have shown a fleet of Tesla vehicles, equipped with rooftop validation sensor rigs, running routes throughout downtown Austin and across the South Congress Bridge. While these rigs include LiDAR, it’s not a sign that Tesla is abandoning its vision-only approach.

Instead, Tesla uses the high-fidelity data from the LiDAR as a ground truth measurement to validate and improve the performance of its cameras. In short, it essentially uses the LiDAR measurements as the actual distances and then compares the distances determined in vision-only to the LiDAR measurements. This allows Tesla to tweak and improve its vision system without needing LiDAR.

Additionally, the validation vehicles are likely scouting for the new, pre-determined, selectable pick-up locations that have just rolled out as part of the Robotaxi app.

Expanding the Geofence

This data collection in a new, complex environment right outside the Robotaxi geofence is an indicator that plans to expand the geofence. Tesla has previously indicated that they intend to roll out more vehicles and expand the geofence slowly. Given that their operational envelope includes the entire Austin Metro Area, we can expect more locations to open up gradually.

Once they expand the operational radius to include downtown Austin, they will likely also have to considerably increase the number of Robotaxis active in the fleet at any given time. Early-access riders are already saying that the wait time for a Robotaxi is too long, with them sometimes having to wait 15 minutes to be picked up.

With a larger service area, we expect Tesla to also increase the number of vehicles and the number of invited riders to try out the service.

After all, Tesla’s goal is to expand the Robotaxi Network to multiple cities within the United States by the end of 2025. Tesla has already been running an employees-only program in California, and we’ve seen validation vehicles as far away as Boston and New Jersey, on the other side of the country.

Cyber FSD Lagging Behind

One of the most significant details from these recent sightings is the presence of a Cybertruck. Cybertruck’s FSD builds have famously lagged behind the builds available on the rest of Tesla’s HW4 fleet. Key features that were expected never fully materialized for the Cybertruck, and the list of missing features is quite extensive.

  • Start FSD from Park

  • Improved Controller

  • Reverse on FSD

  • Actually Smart Summon

It may not look like a lot, but if you drive a Cybertruck on FSD and then hop in any of the rest of Tesla’s HW4 vehicles, you’ll notice a distinct difference. This is especially evident on highways, where the Cybertruck tends to drift out of the lane, often crossing over the lane markings.

We previously released an exclusive mentioning that a well-positioned internal source confirmed with us that a new FSD build for the Cybertruck was upcoming, but we never ended up receiving that particular build, only a point release to V13.2.9. The AI team’s focus had clearly shifted to getting the latest Robotaxi builds running and validated, and while a flagship, the Cybertruck fleet was small and new, and really a secondary task.

The Cybertruck’s larger size, steer-by-wire, rear-wheel steering, and different camera placements likely present a bigger set of challenges for FSD. Deploying it now as a validation vehicle in a complex environment like downtown Austin suggests that Tesla is finally gathering the specific data needed to bring the Cybertruck’s capabilities up to par. This focused effort is likely the necessary step to refine FSD’s handling of the Cybertruck before they begin rolling out new public builds.

When?

Once Tesla’s validation is complete, we can probably expect the Robotaxi Network to expand its borders for the first time in the coming days or weeks. However, we’ll likely see more signs of the expansion, such as Robotaxi vehicles driving themselves around the area, before the expansion actually happens.

Hopefully, the Cybertruck will also learn from its older siblings and receive the rest of its much-needed FSD features, alongside an FSD update for the entire fleet.

Tesla Updates Robotaxi App: Adds Adjustable Pick Up Locations, Shows Wait Time and More [VIDEO]

By Karan Singh
Nic Cruz Patane

Tesla is rolling out a fairly big update for its iOS and early-access-only Robotaxi app, delivering a suite of improvements that address user feedback from the initial launch last month. The update improves the user experience with increased flexibility, more information, and overall design polish.

The most prominent feature in this update is that Tesla now allows you to adjust your pickup location. Once a Robotaxi arrives at your pickup location, you have 15 minutes to start the ride. The app will now display the remaining time your Robotaxi will wait for you, counting down from 15:00. The wait time is also shown in the iOS Live Activity if your phone is on the lock screen.

How Adjustable Pickups Work

We previously speculated that Tesla had predetermined pickup locations, as the pickup location wasn’t always where the user was. Now, with the ability to adjust the pickup location, we can clearly see that Tesla has specific locations where users can be picked up.

Rather than allowing users to drop a pin anywhere on the map, the new feature works by having the user drag the map to their desired area. The app then presents a list of nearby, predetermined locations to choose from. Once a user selects a spot from this curated list, they hit “Confirm.” The pickup site can also be changed while the vehicle is en route.

This specific implementation raises an interesting question: Why limit users to predetermined spots? The answer likely lies in how Tesla utilizes fleet data to improve its service.

Release Notes

While the app is still only available on iOS through Apple’s TestFlight program, invited users can download and update the app.

Tesla included these release notes in update 25.7.0 of the Robotaxi app:

  • You can now adjust pickup location

  • Display the remaining wait time at pickup in the app and Live Activity

  • Design improvements

  • Bug fixes and stability improvements

Nic Cruz Patane

Why Predetermined Pick Up Spots?

The use of predetermined pickup points is less of a limitation and more of a feature. These curated locations are almost certainly spots that Tesla’s fleet data has identified as optimal and safe for an autonomous vehicle to perform a pickup or drop-off.

This suggests that Tesla is methodically “mapping” its service area not just for calibration and validation of FSD builds but also to help perform the first and last 50-foot interactions that are critical to a safe and smooth ride-hailing experience.

An optimal pickup point likely has several key characteristics identified by the fleet, including:

  • A safe and clear pull-away area away from traffic

  • Good visibility for cameras, free of obstructions

  • Easy entry and exit paths for an autonomous vehicle

This change to pick-up locations reveals how Tesla’s Robotaxi Network is more than just Unsupervised FSD. There are a lot of moving parts, many of which Tesla recently implemented, and others that likely still need to be implemented, such as automated charging.

Frequent Updates

This latest update delivers a much-needed feature for adjusting pickup locations, but it also gives us a view into exactly what Tesla is doing with all the data it is collecting with its validation vehicles rolling around Austin, alongside its Robotaxi fleet.

Tesla is quickly iterating on its app and presumably the vehicle’s software to build a reliable and predictable network, using data to perfect every aspect of the experience, from the moment you hail the ride to the moment you step out of the car.

View All Upcoming Features

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter