Mercedes Driver Gesture Recognition (MBUX)

In their bid to revolutionize the interaction between drivers and cars, Mercedes rolled out Mercedes-Benz User Experience or MBUX feature. The beauty of the system is something everyone agrees on, but intelligence makes it personalized for the user. It’s an intelligent learning system that adapts to the requirements of users, remembering such details as the seat and steering wheel settings, lights and other comfort features.

The MBUX system highlights the importance of AI to next-generation infotainment systems inside the car. The new infotainment system aims to use AI to adapt itself to drivers and passengers — automatically suggesting your favorite music for your drive home, or offering directions to a favorite restaurant at dinner time. It’s also one that will benefit from “over-the-air” updates delivering new features and capabilities.

The aim for Mercedes-Benz is to reduce driver distractedness by making everything as hands-free as possible.Further examples of this natural style of interaction include menu control via gestures or handwriting recognition, whereby the user traces a finger over the display on the head unit. Axogyan championed the gesture recognition technology which used Computer Vision to identify different type of gesutres between driver and a passenger.

The future operations will also be even more intuitive in future, with voice control covering most functions, supported by gestures and touch. In the medium term, it will be possible to dictate text messages and e-mails or to call up messages in this way. This will involve speaking a headline or, in the case of so-called "free" voice browsing, a specific question.