Tesla Starts Collecting Audio Input; FSD Will Listen for Emergency Vehicles & Honk

Not a Tesla App

Tesla’s FSD continues to expand and learn, and V13 won’t be any slouch on this. V12 implemented end-to-end AI, and V13 brings a host of new features to help it reach feature completeness.

Today, FSD relies almost entirely upon visual data acquired from the vehicle’s cameras. Of course, it does pull information from other sensors, but the primary input is vision. While Tesla previously used radar in its vehicles and still ships the Models S and X with deactivated HD Radars, it relies on vision to guide its decision-making.

But that’s all changing—a revised version of V13 will bring audio-based decision-making to FSD for the first time. FSD is famously designed to work like a human driver—it relies on vision—but now it’ll also begin relying upon audio—both as an input… and an output.

We touched upon these items in our article on FSD V13, but it's time to really dig into them.

Listening for Emergency Vehicles

@steveshap.bsky.social‬

FSD will soon be able to detect emergency vehicles by analyzing the sounds it hears. Interestingly, this will be done through the internal microphone—the same one used for voice commands. That’s because sirens are loud—loud enough for humans (and microphones) to hear them inside a moving car.

This will enable FSD to identify the distinct sounds of an approaching siren - helping to ensure that FSD detects emergency vehicles earlier and takes the correct maneuvers to move out of the way and safely pull over.

In addition, by analyzing the actual sound of the incoming siren, FSD should also be able to make a reasonable determination about whether the siren is approaching or just echoing off the city streets using the Doppler effect and some fairly simple math.

With the release of FSD V13.2 to early access testers and now FSD 12.5.6.4, Tesla has added a new item to the release notes that lets drivers opt-in to sharing audio data. For users who opt-in to sharing this data, Tesla will now receive 10-second audio clips in certain situations. Tesla will listen for certain sounds and then send this data back to Tesla for further analysis. This will help them improve certain sound detections.

In the release notes, Tesla specifically mentions detecting emergency vehicles by sound, but it seems that it will also be used for other things, such as listening for other vehicles honking or potentially someone yelling at the vehicle. These additional capabilities will help FSD navigate a world made for humans, which couldn’t be done with vision alone.

FSD Will Honk

So we’ve covered inputs… what about outputs? Ashok Elluswamy, Tesla’s VP of AI, mentioned that FSD will gain the ability to honk. That means FSD will be able to provide an audio cue to other vehicles - just like a real, human driver would. Whether that’s someone cutting FSD off, or someone dozing off at a traffic light, FSD gaining the ability to honk will be extremely valuable - it’s the first ability FSD will have to communicate with the outside world and with other drivers.

Humans have developed different types of honks, such as short, friendly taps of the horn or louder, longer horn presses for emergency situations. It’ll be interesting to see if Tesla also implements different types of honks as well.

This is one of the key steps to humanizing FSD - one of the final puzzle pieces. This is expected to be the final set of inputs necessary for FSD to be able to drive like a human, and it’s exciting to see Tesla get so close with just vision.

FSD will soon be able to see, hear, and honk. Let’s just hope Tesla’s initial implementation for honking is better than Waymo’s (video below of Waymo vehicles honking repeatedly at 4 am).

Imagine being woken up at 4 a.m. by cars honking at each other. That's what some San Francisco residents have been dealing with for weeks, as the Waymos can be heard in this video honking and blinking headlights in a parking lot outside of their condo. https://t.co/2cVmDfUk4i pic.twitter.com/pkxNTT5vXd

— ABC7 News (@abc7newsbayarea) August 13, 2024

Follow

Follow

Follow

Want to See the New Tesla Model Y? Here's Where It’s on Display

Not a Tesla App

Tesla’s refreshed Model Y has started hitting display and Tesla showrooms across North America and Europe, where you can now get up close and personal with the new Model Y and all of its improvements, including the smallest of details.

The refreshed Model Y surprised all of us by sporting its own unique look instead of just being a stretched-out Model 3. While it’s available to order now through the Launch Edition, which includes FSD and Acceleration Boost, deliveries won’t start for another couple of months.

The new front light bar and rear indirect lights make the vehicle unique and worth checking out. There are plenty of new items to check out in the updated interior as well, including new door panels, powered rear seats, and more.

Here’s where you can check out the new Model Y in North America and Europe:

North America

In North America, the updated Model Y can be seen in 19 showrooms across the United States and Canada. The photo below shows the 17 locations in the U.S. and two in Canada. We expect this list to grow as Tesla produces more vehicles and we get closer to the official launch.

New Model Y Displays in North America

Not a Tesla App

Europe

In Europe, the Model Y is already on permanent display at two locations - the Mall of Berlin in Germany, and at Tesla’s Amsterdam Europe Headquarters - both publically accessible. If you’re in the area, definitely drop by and take a look.

Tesla is also holding special events throughout Europe where they’ll be showing the new Model Y through select dates. place to check if you’re far away from the ones above is on Tesla’s Events List.

We recommend checking the page out to confirm any dates, as Tesla will be rotating the locations until each showroom receives its permanent display vehicles.

Tesla will also be visiting major auto shows, including the Toronto and New York International Auto Shows with the new Model Y - so keep an eye out for those events as well.

Follow

Follow

Follow

Tesla's Holiday Update: The 15 Undocumented Features

Not a Tesla App

While Tesla’s exciting holiday update is now behind us, it left us with amazing new features, such as weather radar, Apple Watch support, mobile Dashcam viewer, SiriusXM, and so many other great features that some of us now use every day.

However, it doesn’t end there. Tesla always includes other smaller changes that don’t make it into the release notes, and the holiday update was a big one in terms of undocumented changes.

We’ll go through all the new features that are now available in your vehicle that Tesla didn’t show in their release notes.

Precipitation Map

Not a Tesla App

While this feature did make it to the release notes, some users may still not be aware that the Precipitation Map (weather radar) is now available on all Teslas with the Intel infotainment unit (except for legacy Model S/X). This feature was requested so long ago that, honestly, we didn’t think it’d ever be released. All Model 3, Model Y and 2021+ Model S and X vehicles now have access to the weather radar map overlay.

Fart on Sit

Not a Tesla App

For the Emissions Testing Mode easter egg, you can now have your vehicle fart when someone sits down in their seat.

The sound will come from the direction of their seat. For example, a fart sound will sound from the front-right speaker when someone sits in the front passenger seat. It will play the sound selected in the fart selection box, or play a random fart if you choose "I'm so random."

This option defaults to off after every drive.

Voice Assistant

Not a Tesla App

You can now say 'Hi' or 'Hello' to your vehicle through the voice command prompt, and the vehicle will respond with "Hello!"

This is the first sign of Tesla adding a smart voice assistant to the vehicle, which is expected to be powered by Grok.

Voice Command Changes

Not a Tesla App

If you use Tesla's voice commands, there are a few changes. When you press the voice command button on the steering wheel, you may now not get audible feedback that the button has been pressed. This will depend on whether there’s music playing or other circumstances.

When sending a text message through a voice command, you may now have to press the steering wheel button again to start dictation after choosing a recipient. It’s not clear what’s causing this change, as sometimes it goes straight into dictation mode, while other times it ask you to press the button to start dictation.

Equalizer

Not a Tesla App

You can now reset the equalizer settings with the touch of a button by tapping the new circular arrow to the right of the equalizer. This will bring all settings back down to 0.

Performance Improvements

Not a Tesla App

Intel users are seeing performance improvements while using the Tesla interface, especially in more demanding areas like Tesla Theater. Videos on YouTube now stutter less and Tesla Theater can be minimized more smoothly than before.

The media controls can now control YouTube videos and other web video content as well, even after the vehicle is put into drive.

Service Mode Updates

Not a Tesla App

Several screens in Service Mode have been updated to show larger visualizations, such as the Airbags and Seats menu.

Tesla has also introduced several new visualizations to vehicles with the Intel infotainment unit, that were previously only available on AMD-based vehicles. Some of these includes Coolant and HVAC options.

The only new feature in Service Mode is for the Cybertruck under Service Mode Plus, which includes:

Connector Reference (Service Mode Plus): A new Connector Reference panel is available to help find connectors and highlight harnesses on the vehicle. Rotate the 3D model to explore or type in the search bar to find a specific connector.

Rearranged Menus

Not a Tesla App

With the addition of the Seats menu to settings, Tesla has now rearranged the menu options so that the more used options are now more easily accessible.

The Software menu has been moved up, while other options like Navigation and Trips have been moved down to be close to WiFi, Bluetooth and Upgrades.

Selected Custom Lock Sound

Not a Tesla App

The currently selected custom lock sound is now shown underneath the Lock Confirmation Sound option in the Controls > Locks menu.

Ambient Lighting Easter Eggs

Not a Tesla App

The Rainbow Road and Santa Mode easter eggs have been updated on vehicles that include the ambient lighting feature.

There are new options in these easter eggs that let you enable or disable the ambient lighting while the easter egg is active.

If enabled, the light strips will cycle through colors of the rainbow when the Rainbow Road easter egg is enabled. For Santa Mode, the interior lights will cycle between red, green and white.

Updated Energy App

Not a Tesla App

The Consumption tab in the Energy app has been updated with several changes, including:

• The last 200 miles are now shown, instead of a user-selectable, 5, 15 or 30 miles.

• Instant Range / Average Range has been removed to simplify the interface.

• The average range as moved to the top left and now shows the offset from the vehicle's EPA-rated Wh/mi

• Total energy consumption is now displayed at the bottom left.

• The colors now have different meanings. Before this update, yellow meant the vehicle was using energy, while green meant the vehicle was generating energy through Regenerative Braking. However, now, yellow means that the vehicle consumed more than the EPA average, and green means that the vehicle consumed less than the EPA average and doesn’t necessarily mean it generated energy.

Toll Roads

Not a Tesla App

When navigating to a destination, the alternative routes menu that is displayed when you first enter a destination will now show you which routes include tolls by displaying a dollar sign icon next to the travel time.

Limiting Explicit Content

Not a Tesla App

The Exlicit Content toggle under Audio Settings now applies to YouTube Music as well. This now supports LiveOne, Apple Music, Apple Podcasts, and TIDAL.

Charging Icons

Not a Tesla App

Tesla has redesigned the charging pins that appear on the map. Supercharger and third-party charger pins are now oval-shaped instead of circular.

Instead of just having the number of charging stalls available, Tesla has added the charging icon to make it more obvious these are charging stations.

Adjust Dashcam Viewer Speed

Not a Tesla App

You can now adjust the Dashcam Viewer's playback speed. Users can pick from 0.5x, 1x or 2x playback speeds by tapping the playback speed button.

Tire Pressure Indicator

Not a Tesla App

Tapping the tire pressure indicator will now open the tire pressure card on the left side of the screen instead of opening the Service menu under Controls > Service.

If you ever spot a change that isn’t listed in Tesla’s release notes, we’d love to hear about it!

Follow

Follow

Follow