Tesla's Auto Wipers have been a pain point for the company
Not a Tesla App
Tesla’s Autowipers have been a long-standing issue for customers, as well as Tesla’s engineers. Elon Musk has often mentioned that improvements to Autowipers have been around the corner for years, but they appear to have taken a rain check.
Tesla owners often complain that their wipers are running against a completely dry windshield on a sunny day, or not running at all in light rain. Moderate to heavy rain performance seems to be improved for the most recent update to Auto Wipers.
In our test, we cover the vehicle's windshield with Post-It notes to find out what the vehicle’s cameras can see.
We cover the windshield in Post-It notes
Not a Tesla App
The Water Problem
Tesla vehicles lack a rain sensor. This is a result of Tesla’s strategy to rely upon Tesla Vision to replace all sensors – which they’ve successfully used most recently to replace the ultrasonic parking sensors (USS) on their vehicles. Tesla believes that vision is the solution to achieving all self-driving capabilities, and this includes the elimination of extraneous sensors such as USS and radar.
Of course, many other vehicles employ simple rain sensors that do function fairly well, and effectively detect the presence of water on the windshield. So, what’s stopping Tesla Vision from doing the same thing?
The problem isn’t Tesla’s detection methods, it’s the view of the windshield Tesla has. Water droplets are small and the three front cameras only capture a small portion of the entire windshield, making it difficult for them to capture and acknowledge the fact that there is water on the windshield that needs to be wiped away. This is in addition to the fact that the cameras are focused further away, to drive and navigate the vehicle effectively, rendering the visuals close to the camera blurry – leaving a rather technical challenge.
Our Test
The car's wide-angle camera
Not a Tesla App
Even Tesla’s front-facing, wide-angle camera can barely see the yellow Post-In notes in our test, let alone the blue Post-It notes spread through the windshield. Tesla’s other front-facing camera, the “main” camera, sees only a trace of the Post-Its along the bottom. In reality, Tesla has no idea what’s on the vehicle's windshield and can only make assumptions based on a few square inches near the top of the windshield. If any rain droplets are on this portion of the windshield, they’ll also be out of focus. If the view of the rain droplets was as clear at the image at the top of this article, Tesla would have perfected auto wipers years ago.
Tesla’s third front-facing camera, the “narrow” view, is only available on hardware 3 and it’s just a zoomed-in version of the main camera, which causes it to miss our Post-It notes completely. With hardware 4, Tesla removed the narrow camera and now determines the narrow view by cropping the main camera, which has a higher resolution in hardware 4.
Water droplets on the windshield
Not a Tesla App
Tesla’s Engineering Magic
Tesla is able to detect drops on the windshield when they land in front of the camera cluster, but again, since the cluster is mounted high above most of the windshield, this can lead to the windshield filling up with water droplets before a wipe is triggered.
They’ve also tried using the vehicle’s other cameras, such as the repeater or B-pillar cameras to detect falling rain – which can help the Autowiper system build confidence that there is water on the windshield. Once it has enough confidence, it triggers a wipe – or changes the wipe modes. However, in reality, due to the focal length of the cameras, it has a difficult time detecting rain droplets because they’re out of focus. In the image below, taken from Tesla’s wide-angle camera, you can see that the water droplets from the previous image are nearly impossible to detect. On the left, is the windshield with the water droplets, and on the right is the windshield after being wiped. While the droplets cause a slightly blurry image, they’re extremely difficult to see.
How water droplets look to the camera (left) and how a clean windshield looks (right)
Not a Tesla App
Wiping Away Challenges
The transition to entirely vision has left a considerable challenge for Tesla’s very capable engineering teams. The current Autopilot hardware suite lacks a good view of the windshield itself, but it can detect falling rain. Given that Tesla’s software can detect and display other vehicles using turn signals, it is also possible that they could detect other vehicles using wipers or use other cameras to see rain on the vehicle, such as the B-pillar cameras, to increase the system’s confidence that a wipe is required.
However, these solutions are likely to not be perfect, as they don’t provide an accurate representation of what the driver sees in the windshield, but instead an accurate representation of what the vehicle itself can see.
When engaging FSD on a lightly rainy day, your car may drive perfectly, but you’ll have a windshield full of rain when supervising!
Of course, there are many other reasons to run the windshield wipers beyond simple rain – spray and debris from vehicles in front, water falling from trees or being kicked up by deep puddles, or even snow settling on the windshield. Another challenge is bugs – they leave sticky smears at higher speeds when impacting the windshield, causing spots that can impede either vehicle vision or driver vision.
Future Solutions
Tesla likes to avoid solutions that only solve a single problem – such as adding a rain sensor. It is an additional manufacturing complication, adds additional cost to vehicles, and segments Tesla’s vehicles between model years.
On the other hand, cameras have solved many problems over the years – such as Tesla Vision taking over from the USS system that was present on pre-2022 Tesla vehicles. While it did take until FSD V12 for Autopark to become available to vision-only vehicles, the upgraded Vision-based Autopark is a marked improvement over the older USS solution.
Another such problem has been auto-high beams, which were solved with better oncoming vehicle detection and improved AI – which has led to a feature that is much better than its original implementation. This updated implementation has also led to improvements in the use of Matrix headlights – a feature that for now is only available in Europe and China due to legislative issues in the US.
Tesla is most likely going to be pushing another hardware revision – Hardware 5 – in the coming years. Some of the indications of this include the Cybertruck’s bumper camera – which is also expected to arrive in the Model X and Model S in the future.
There is a chance that Tesla may include a forward-facing interior at some point – to solve the fact that Vision is unable to currently see the windshield. However, Tesla also strongly believes they’ll achieve level 4 or 5 of vehicle autonomy in the future, so they could also be banking on autonomy removing the need for good auto wipers.
A Personal Example
If you get into your Tesla on a rainy day or add some drizzle via a watering jug, you can see how Tesla’s Autowipers will not activate unless water is placed directly in front of the camera cluster. You can also spray some water onto the camera housing and take a seat inside and use the camera preview to view what the cameras can see. It’ll provide you with a blurry, limited view of what the cameras see.
We may see further software improvements, but it may be a difficult engineering problem to solve with the limited camera capabilities that currently exist on hardware 3 and hardware 4 vehicles.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
The Super Manifold is Tesla’s solution to reducing the complexity of a heat pump system for an EV. Tesla showed off its engineering chops back with the original Model Y in 2019, where it introduced a new 8-way valve (the Octovalve) and a new heat pump alongside the uniquely designed Super Manifold to improve efficiency.
Now, Tesla is launching an improved version with the refreshed Model Y - the Super Manifold V2. We got to hear about it thanks to Sandy Munro’s interview with Tesla’s Lars Moravy (Vice President of Vehicle Engineering) and Franz Von Holzhausen (Chief of Vehicle Design). You can watch the video further below.
What Is The Super Manifold?
The Super Manifold (get it, Superman?), is an all-in-one package that brings in all the components of a heat pump system into one component. The Super Manifold packs all the refrigerant and coolant components around a 2-layer PCB (printed circuit board).
This Super Manifold would normally have 15 or 20 separate components, but Tesla managed to integrate them all into one nice package. That presented Tesla with a new challenge: how to integrate a heat pump—capable of both heating and cooling—into a single, efficient platform?
Several years ago, Tesla designed the Octovalve. It combines inlets and outlets and can variably change between heating or cooling on the fly - without needing to be plumbed in different directions. This is especially important for EVs, which may need to heat the battery with the waste heat generated from the motors or the heat pump while also cooling the cabin - or vice versa.
Original Super Manifold V1.1
Tesla launched the Super Manifold V1.1 back in 2022, and it provided some minor improvements to the waste heat processing of the heat exchange system. It also tightened up the Octovalve, preventing the leakage of oils into the HVAC loop that could cause it to freeze at extremely low temperatures.
Tesla has been using the V1.1 for several years now, and it has really solved the vast majority of issues with the heat pump system that many older Model Ys experienced.
Super Manifold V2 Coming Soon
Now, Tesla is introducing the Super Manifold V2 in the new Model Y. It will improve the overall cooling capacity provided by the original Super Manifold, but unfortunately, not every single new Model Y will come with it equipped. Tesla will be introducing it slowly across the lineup and at different rates at different factories, depending on part availability.
Eventually, the Super Manifold V2 will also make its way to other vehicles, potentially including the upcoming refresh for the Model S and Model X, but initially, it’ll be exclusive to the new Model Y. Tesla expects to have the new manifold in every new Model Y later this year.
If you’re interested in checking out the whole video, we’ve got it for you below.
Mark Rober, of glitter bomb package fame, recently released a video titled Can You Fool A Self-Driving Car? (posted below). Of course, the vehicle featured in the video was none other than a Tesla - but there’s a lot wrong with this video that we’d like to discuss.
We did some digging and let the last couple of days play out before making our case. Mark Rober’s Wile E. Coyote video is fatally flawed.
The Premise
Mark Rober wanted to prove whether or not it was possible to fool a self-driving vehicle, using various test scenarios. These included a wall painted to look like a road, low-lying fog, mannequins, hurricane-force rain, and bright beams.
All of these individual “tests” had their own issues - not least because Mark didn’t adhere to any sort of testing methodology, but because he was looking for a result - and edited his tests until he was sure of it.
Interestingly, many folks on X were quick to spot that Mark had been previously sponsored by Google to use a Pixel phone - but was using an iPhone to record within the vehicle - which he had edited to look like a Pixel phone for some reason. This, alongside other poor edits and cuts, led many, including us, to believe that Mark’s testing was edited and flawed.
Flaw 1: Autopilot, Not FSD
Let’s take a look at the first flaw. Mark tested Autopilot - not FSD. Autopilot is a driving aid for lane centering and speed control - and is not the least bit autonomous. It cannot take evasive maneuvers outside the lane it is in, but it can use the full stable of Tesla’s extensive features, including Automatic Emergency Braking, Forward Collision Warnings, Blind Spot Collision Warnings, and Lane Departure Avoidance.
On the other hand, FSD is allowed and capable of departing the lane to avoid a collision. That means that even if Autopilot tried to stop and was unable to, it would still impact whatever obstacle was in front of it - unlike FSD.
As we continue with the FSD argument - remember that Autopilot is running on a 5-year-old software stack that hasn’t seen updates. Sadly, this is the reality of Tesla not updating the Autopilot stack for quite some time. It seems likely that they’ll eventually bring a trimmed-down version of FSD to replace Autopilot, but that hasn’t happened yet.
Mark later admitted that he used Autopilot rather than FSD because “You cannot engage FSD without putting in a destination,” which is also incorrect. It is possible to engage FSD without a destination, but FSD chooses its own route. Where it goes isn’t within your control until you select a destination, but it tends to navigate through roads in a generally forward direction.
The whole situation, from not having FSD on the vehicle to not knowing you can activate FSD without a destination, suggests Mark is rather unfamiliar with FSD and likely has limited exposure to the feature.
Let’s keep in mind that FSD costs $99 for a single month, so there’s no excuse for him not using it in this video.
Flaw 2: Cancelling AP and Pushing Pedals
Many people on X also followed up with reports that Mark was pushing the pedals or pulling on the steering wheel. When you tap on the brake pedal or pull or jerk the steering wheel too much, Autopilot will disengage. For some reason, during each of his “tests,” Mark closely held the steering wheel of the vehicle.
This comes off as rather odd - at the extremely short distances he was enabling AP at, there wouldn’t be enough time for a wheel nag or takeover warning required. In addition, we can visibly see him pulling the steering wheel before “impact” in multiple tests.
Over on X, techAU breaks it down excellently on a per-test basis. Mark did not engage AP in several tests, and he potentially used the accelerator pedal during the first test - which means that Automatic Emergency Braking is overridden. In another test, Mark admitted to using the pedals.
Flaw 3: Luminar Sponsored
This video was potentially sponsored by a LiDAR manufacturer - Luminar. Although Mark says that this isn’t the case. Interestingly, Luminar makes LiDAR rigs for Tesla - who uses them to test ground truth accuracy for FSD. Just as interesting, Luminar’s Earnings Call was also coming up at the time of the video’s posting.
Luminar had linked the video at the top of their homepage but has since taken it down. While Mark did not admit to being sponsored by Luminar, there appear to be more distinct conflicts of interest, as Mark’s charity foundation has received donations from Luminar’s CEO.
Given the positivity of the results for Luminar, it seems that the video had been well-designed and well-timed to take advantage of the current wave of negativity against Tesla, while also driving up Luminar’s stock.
Flaw 4: Vision-based Depth Estimation
The next flaw to address is the fact that humans and machines can judge depth using vision. On X, user Abdou ran the “invisible wall” through a monocular depth estimation model (DepthAnythingV2) - one that uses a single image with a single angle. This fairly simplified model can estimate the distance and depth of items inside an image - and it was able to differentiate the fake wall from its surroundings easily.
Tesla’s FSD uses a far more advanced multi-angle, multi-image tool that stitches together and creates a 3D model of the environment around it and then analyzes the result for decision-making and prediction. Tesla’s more refined and complex model would be far more able to easily detect such an obstacle - and these innovations are far more recent than the 5-year-old Autopilot stack.
While detecting distances is more difficult in a single image, once you have multiple images, such as in a video feed, you can more easily decipher between objects and determine distances by tracking the size of each pixel as the object approaches. Essentially, if all pixels are growing at a constant rate, then that means it’s a flat object — like a wall.
Case in Point: Chinese FSD Testers
To make the case stronger - some Chinese FSD testers took to the streets and put up a semi-transparent sheet - which the vehicle refused to drive through or drive near. It would immediately attempt to maneuver away each time the test was engaged - and refused to advance with a pedestrian standing in the road.
Would FSD hit a transparent film wall? This test showed it just avoids it.
Thanks to Douyin and Aaron Li for putting this together, as it makes an excellent basic example of how FSD would handle such a situation in real life.
Flaw 5: The Follow-Up Video and Interview
Following the community backlash, Mark released a video on X, hoping to resolve the community’s concerns. However, this also backfired. It turned out Mark’s second video was of an entirely different take than the one in the original video - this was at a different speed, angle, and time of initiation.
Mark then followed up with an interview with Philip DeFranco (below), where he said that there were multiple takes and that he used Autopilot because he didn’t know that FSD could be engaged without a destination. He also answered here that Luminar supposedly did not pay him for the video - even with their big showing as the “leader in LiDAR technology” throughout the video.
Putting It All Together
Overall, Mark’s video was rather duplicitous - he recorded multiple takes to get what he needed, prevented Tesla’s software from functioning properly by intervening, and used an outdated feature set that isn’t FSD - like his video is titled.
Upcoming Videos
Several other video creators are already working to replicate what Mark “tried” to test in this video.
To get a complete picture, we need to see unedited takes, even if they’re included at the end of the video. The full vehicle specifications should also be disclosed. Additionally, the test should be conducted using Tesla’s latest hardware and software—specifically, an HW4 vehicle running FSD v13.2.8.
In Mark’s video, Autopilot was engaged just seconds before impact. However, for a proper evaluation, FSD should be activated much earlier, allowing it time to react and, if capable, stop before hitting the wall.
A wave of new videos is likely on the way—stay tuned, and we’ll be sure to cover the best ones.