Tesla AI day was last night and most of the event was an in-depth look at how Tesla is solving FSD and all the problems their solving and methods they're using. It definitely wasn't aimed at at the casual consumer.
There was some interesting video where they showed how the integration of all the cameras could predict where other traffic is located, and do it better than the combination of a few cameras combined with radar. We had to take their word for it that the camera integration did a better job. It did look that way on the computer views. Elon also pointed out that they use the Autopilot software not only to drive the car but to predict where the other cars on the road are likely to be in the next few seconds.
Later in the show, things got more interesting. They brought out a person dressed like a robot who danced around a bit. Elon came out again and showed a plan for a human-shaped Tesla robot. He admitted that the one that had danced around the stage wasn't the actual robot, but said that's what the Tesla robot would look like. The purpose of the robot is to perform chores that humans might find boring, repetitive, or dangerous.
Elon mentioned that Teslas are basically semi-sentient robots on wheels. He said that the human-shaped Tesla bot would come out next year. The robots will be friendly and will be able to navigate a world built for humans. They will be five feet eight inches tall and weigh 125 pounds, The face will be a computer screen. The hands will look like human hands and have five fingers. The Tesla bot will be able to walk at five miles/hour. That's faster than normal human walking speed, but most people can run faster than that.
Elon casually mentioned that most people could run away from it and most likely overpower it. He hoped it wouldn't be necessary, but, he said, “You never know.”
So then, he said that the robots would be able to shop for people, do chores around the house, and do repetitive jobs in the workplace. He admitted that having robots available to do jobs in the workplace would be a problem unless there was a universal basic income. That got a cheer from the audience. So I guess there were lots of Andrew Yang fans in the audience.
Then the question period started. The first question was asked of Musk, did he plan to make any of his software open-source? He said that creating it cost too much to just give it away, but he'd be willing to license it to other car companies.
Another interesting question was about whether audible cues would be incorporated into the FSD computer. Elon admitted that it would be important for a fully autonomous car to hear sirens from emergency vehicles, and he said that if someone was yelling at the car from the outside, a fully autonomous car should be able to understand what was being said. It'll be interesting how Tesla plans to tackle this problem for vehicles without external microphones.
Later, someone asked if FSD would work in other countries. Elon said that they were focusing first on the US, but the point was made that driving is very similar in other countries. Elon mentioned that they use training data from fifty countries and that the prime directive of FSD is, “Don't crash.” And that's true in every country. He says that right now, the car is pretty good at not crashing. Clearly, pretty good is not good enough since the drivers still need to pay attention, but the FSD is programmed to not crash into anything on the highway even if it's something it doesn't recognize like a UFO that just crashed on the highway.
I have to mention, here, an experience I had while FSD was engaged. I was driving along a road at night, and I saw a rock in the middle of the road. It was clear that the car didn't see it, and I had to quickly steer around it because it was too late to stop by the time the rock appeared in my headlights. Now I don't have the beta version of FSD, but it's clear Tesla still has some work to do here.
Later, someone asked what will happen with FSD once hardware 4 gets into production. Elon said that hardware 3 will be able to drive much better than any human driver once the software is finished. He says that hardware 4 will come out with the Cybertruck, and it will be able to drive better than hardware 3, but that doesn't mean that hardware 3 is unable to drive. He pointed out that not every regular human driver is the best driver on the road, but that doesn't mean that the regular driver isn't allowed to drive.
An amusing question got asked about whether the car could be spoofed by a picture. Elon suggested that he doesn't see many paintings of tunnels on rock walls as in Wiley E. Coyote cartoons. He mentioned that he has a T-shirt with a stop sign on the front. He says that if someone flashes a Tesla with such a T-shirt, the car will stop, but that Tesla will soon train edge cases like these and the car will learn what is a real stop sign versus a fake one.
Toward the end, someone asked whether we should worry that AI will have its own priorities that might be different from the priorities of the owners of the artificially intelligent robots. Elon said that right now, we're not anywhere near the kind of self-aware super-intelligent robots that people worry about. A car may be able to drive better than most humans. A robot may be able to do boring, repetitive or dangerous activities. That doesn't mean that cars and robots might rise up and rebel against humans. He's going to program his cars and his robots to be “Unequivocally good.”
Elon's final comment about cars was that eventually, cars will drive themselves just like elevators now drive themselves. You get in an elevator, press a button, and it takes you where you want to go. There aren't elevator operators anymore. Eventually, self-driving cars will be the norm. He says that there will still be a few gasoline cars and cars that need to be driven by a human being, just like now, there are still a few horses. But non-self-driving cars will be rare.
You can view the full Tesla AI Day event below:
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
As December approaches, Tesla’s highly anticipated Holiday update draws closer. Each year, this eagerly awaited software release transforms Tesla vehicles with new features and festive flair. If you’re not familiar with Tesla’s holiday updates, take a look at what Tesla has launched in the Holiday update the past few years.
For this chapter in our series, we’re dreaming up ways Tesla could improve the charging experience and even add some additional safety features. So let’s take a look.
Destination State of Charge
Today, navigating to a destination is pretty straightforward on your Tesla. Your vehicle will automatically let you know when and where to charge, as well as for how long. However, you’ll likely arrive at your destination at a low state of charge.
Being able to set your destination state of charge would be an absolute game-changer for ease of road-tripping. After all, the best EV to road trip in is a Tesla due to the Supercharger network. It looks like Tesla may be listening. Last week, Tesla updated their app and hinted at such a feature coming to the Tesla app. A Christmas present, maybe?
Battery Precondition Options
While Tesla automatically preconditions your battery when needed for fast charging, there are various situations where manually preconditioning the battery would be beneficial.
Currently, there is no way to precondition for third-party chargers unless you “navigate” to a nearby Supercharger. If you need to navigate to a Supercharger that’s close by, the short distance between your location and the Supercharger will also not allow enough time to warm up the battery, causing slower charging times.
While we already mentioned Live Activities in the Tesla app wishlist, they’d be especially useful while Supercharging. Live Activities are useful for short-term information you want to monitor, especially if it changes often — which makes them perfect for Supercharging, especially if you want to avoid idle fees.
Vehicle-to-Load / Vehicle-to-Home Functionality
The Cybertruck introduced Tesla Power Share, Tesla’s name for Vehicle-to-Home functionality (V2H). V2H allows an EV to supply power directly to a home. By leveraging the vehicle’s battery, V2H can provide backup power during outages and reduce energy costs by using stored energy during peak rates.
Tesla Power Share integrates seamlessly with Tesla Energy products and the Tesla app. We’d love to see this functionality across the entire Tesla lineup. Recently a third party demonstrated that bidirectional charging does work on current Tesla vehicles – namely on a 2022 Model Y.
Adaptive Headlights for North America
While Europe and China have had access to the Adaptive Headlights since earlier this year, North America is still waiting. The good news is that Lars Moravy, VP of Vehicle Engineering, said that these are on their way soon.
Blind Spot Indication with Ambient Lighting
Both the 2024 Highland Model 3 Refresh and the Cybertruck already have ambient lighting features, but they don’t currently offer a practical purpose besides some eye candy. So why not integrate that ambient lighting into the Blindspot Warning system so that the left or right side of the vehicle lights up when there’s a vehicle in your blind spot? Currently, only a simple red dot lights up in the front speaker grill, and the on-screen camera will also appear with a red border when signaling.
Having the ambient lighting change colors when a vehicle is in your blind spot would be a cool use of the technology, especially since the Model Y Juniper Refresh and Models S and X are supposed to get ambient lighting as well.
Tesla’s Holiday update is expected to arrive with update 2024.44.25 in just a few short weeks. We’ll have extensive coverage of its features when it finally arrives, but in the meantime, be sure to check out our other wishlist articles:
It’s time for another dive into how Tesla intends to implement FSD. Once again, a shout out to SETI Park over on X for their excellent coverage of Tesla’s patents.
This time, it's about how Tesla is building a “universal translator” for AI, allowing its FSD or other neural networks to adapt seamlessly to different hardware platforms.
That translating layer can allow a complex neural net—like FSD—to run on pretty much any platform that meets its minimum requirements. This will drastically help reduce training time, adapt to platform-specific constraints, decide faster, and learn faster.
We’ll break down the key points of the patents and make them as understandable as possible. This new patent is likely how Tesla will implement FSD on non-Tesla vehicles, Optimus, and other devices.
Decision Making
Imagine a neural network as a decision-making machine. But building one also requires making a series of decisions about its structure and data processing methods. Think of it like choosing the right ingredients and cooking techniques for a complex recipe. These choices, called "decision points," play a crucial role in how well the neural network performs on a given hardware platform.
To make these decisions automatically, Tesla has developed a system that acts like a "run-while-training" neural net. This ingenious system analyzes the hardware's capabilities and adapts the neural network on the fly, ensuring optimal performance regardless of the platform.
Constraints
Every hardware platform has its limitations – processing power, memory capacity, supported instructions, and so on. These limitations act as "constraints" that dictate how the neural network can be configured. Think of it like trying to bake a cake in a kitchen with a small oven and limited counter space. You need to adjust your recipe and techniques to fit the constraints of your kitchen or tools.
Tesla's system automatically identifies these constraints, ensuring the neural network can operate within the boundaries of the hardware. This means FSD could potentially be transferred from one vehicle to another and adapt quickly to the new environment.
Let’s break down some of the key decision points and constraints involved:
Data Layout: Neural networks process vast amounts of data. How this data is organized in memory (the "data layout") significantly impacts performance. Different hardware platforms may favor different layouts. For example, some might be more efficient with data organized in the NCHW format (batch, channels, height, width), while others might prefer NHWC (batch, height, width, channels). Tesla's system automatically selects the optimal layout for the target hardware.
Algorithm Selection: Many algorithms can be used for operations within a neural network, such as convolution, which is essential for image processing. Some algorithms, like the Winograd convolution, are faster but may require specific hardware support. Others, like Fast Fourier Transform (FFT) convolution, are more versatile but might be slower. Tesla's system intelligently chooses the best algorithm based on the hardware's capabilities.
Hardware Acceleration: Modern hardware often includes specialized processors designed to accelerate neural network operations. These include Graphics Processing Units (GPUs) and Tensor Processing Units (TPUs). Tesla's system identifies and utilizes these accelerators, maximizing performance on the given platform.
Satisfiability
To find the best configuration for a given platform, Tesla employs a "satisfiability solver." This powerful tool, specifically a Satisfiability Modulo Theories (SMT) solver, acts like a sophisticated puzzle-solving engine. It takes the neural network's requirements and the hardware's limitations, expressed as logical formulas, and searches for a solution that satisfies all constraints. Try thinking of it as putting the puzzle pieces together after the borders (constraints) have been established.
Here's how it works, step-by-step:
Define the Problem: The system translates the neural network's needs and the hardware's constraints into a set of logical statements. For example, "the data layout must be NHWC" or "the convolution algorithm must be supported by the GPU."
Search for Solutions: The SMT solver explores the vast space of possible configurations, using logical deduction to eliminate invalid options. It systematically tries different combinations of settings, like adjusting the data layout, selecting algorithms, and enabling hardware acceleration.
Find Valid Configurations: The solver identifies configurations that satisfy all the constraints. These are potential solutions to the "puzzle" of running the neural network efficiently on the given hardware.
Optimization
Finding a working configuration is one thing, but finding the best configuration is the real challenge. This involves optimizing for various performance metrics, such as:
Inference Speed: How quickly the network processes data and makes decisions. This is crucial for real-time applications like FSD.
Power Consumption: The amount of energy used by the network. Optimizing power consumption is essential for extending battery life in electric vehicles and robots.
Memory Usage: The amount of memory required to store the network and its data. Minimizing memory usage is especially important for resource-constrained devices.
Accuracy: Ensuring the network maintains or improves its accuracy on the new platform is paramount for safety and reliability.
Tesla's system evaluates candidate configurations based on these metrics, selecting the one that delivers the best overall performance.
Translation Layer vs Satisfiability Solver
It's important to distinguish between the "translation layer" and the satisfiability solver. The translation layer is the overarching system that manages the entire adaptation process. It includes components that analyze the hardware, define the constraints, and invoke the SMT solver. The solver is a specific tool used by the translation layer to find valid configurations. Think of the translation layer as the conductor of an orchestra and the SMT solver as one of the instruments playing a crucial role in the symphony of AI adaptation.
Simple Terms
Imagine you have a complex recipe (the neural network) and want to cook it in different kitchens (hardware platforms). Some kitchens have a gas stove, others electric; some have a large oven, others a small one. Tesla's system acts like a master chef, adjusting the recipe and techniques to work best in each kitchen, ensuring a delicious meal (efficient AI) no matter the cooking environment.
What Does This Mean?
Now, let’s wrap this all up and put it into context—what does it mean for Tesla? There’s quite a lot, in fact. It means that Tesla is building a translation layer that will be able to adapt FSD for any platform, as long as it meets the minimum constraints.
That means Tesla will be able to rapidly accelerate the deployment of FSD on new platforms while also finding the ideal configurations to maximize both decision-making speed and power efficiency across that range of platforms.
Putting it all together, Tesla is preparing to license FSD, Which is an exciting future. And not just on vehicles - remember that Tesla’s humanoid robot - Optimus - also runs on FSD. FSD itself may be an extremely adaptable vision-based AI.
![Tesla Unveils V4 Superchargers Capable of Charging at 500kW [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/charging/v4_supercharger.jpg/e6e109be929ba0765b4303a7e9d5bb7d/v4_supercharger.jpg)
![Tesla Adds HEPA Filter to New Model 3, Will it Get Bioweapon Defense Mode? [Update: Tesla Edits Post]](https://www.notateslaapp.com/images/news/2023/new-model-3-hepa-filter_300w.jpg)
![Elon talks about Twitter and job cuts at Bloomberg forum [video]](https://www.notateslaapp.com/images/news/2022/elon-musk-qatar-forum_300w.jpg)
