Automakers

Toyota combines voice, gesture recognition in new operating system

Toyota Lexus gesture voice control with AI
To get more information about a hotel, restaurant or a landmark in the future, Toyota and Lexus owners will just need to point and ask a question.
January 11, 2024 05:01 AM

SHIMOYAMA, Japan -- Toyota will combine voice and gesture recognition with predictive artificial intelligence in its new Arene operating system.

Toyota in October demonstrated Arene's communication capabilities to the media at its technical center here, near Nagoya, using a model from its premium brand, Lexus.

During one test the driver said, "Hey Lexus, what is that?" and pointed toward an advertising billboard of a restaurant. The car responded by providing the name and location of the restaurant.

If the driver asks more detailed questions, such as the restaurant's opening hours, that day's menu, or asks to book a table and to be driven there, Arene's predictive AI understands that the subject of the questions is still the restaurant. That means the driver doesn't have to start the query from the beginning.

The operating system, which was developed in-house, is scheduled to debut in late 2026 on the production version of the Lexus LS-ZC midsize sedan, which was shown as concept at the 2023 Japan Mobility Show.

The voice and gesture recognition feature could also help drivers and passengers make long trips more insightful because they could point to a church or a landmark and ask for -- and get -- details about the surroundings or nearby locations.

Toyota said Arene will get its information from several sources, including Wikipedia as well as the driver's preferred news and information providers. The operating system will also adapt by learning from the user's habits.

Kerrigan Advisors’ Client Interview Series: Interview with Buckalew Chevrolet

Kerrigan Advisors recently sat down with Donnie and Denny Buckalew, co-owners of Buckalew Chevrolet, the 5th highest-volume Chevrolet dealership in Houston, Texas, to discuss their perspective on the changing auto retail industry and how challenges facing single-point dealers influenced their decision to sell their dealership.

Toyota estimates that Arene will be able to control up to 200 in-vehicle functions and that AI will play a crucial role in "providing a user experience that is as comfortable and natural as if the driver were speaking to an agent."

Toyota Arene operating system test Japan 2023
Toyota Arene operating system test Japan 2023 Toyota estimates that that its Arene operating system will be able to control of up to 200 in-vehicle functions.
Staying current is easy with newsletters delivered straight to your inbox.