CES 2018: Mercedes-Benz unveils MBUX AI system

CES 2018: Mercedes-Benz unveils MBUX AI system

At CES 2018 Mercedes-Benz has revealed the Mercedes-Benz User Experience (MBUX) multimedia system, that will make its debut on the new A-Class later this year.


The system is centered around an AI-based software capable of adapting to the user’s needs and receiving updates from Mercedes-Benz.

Mercedes-Benz MBUX Concept

In terms of user interface, the new generation cockpit features a high-resolution Widescreen Cockpit with touchscreen operation, navigation display with augmented reality technology and an advanced voice control with natural speech recognition system, activated with the keyword “Hey Mercedes”.

The full clip from the MBUX reveal conference at CES 2018

Additional controls – including buttons and touch sensitive elements – are integrated on the steering wheel and the center tunnel and allow the driver to control the interface minimizing the distractions.

Mercedes-Benz MBUX Concept Display Screenshot

Mercedes-Benz MBUX Concept Display Screenshot

Mercedes-Benz MBUX Concept at CES 2018

Mercedes-Benz MBUX Concept

(Source: Mercedes-Benz)

MBUX: A completely new user experience for the new compact cars

A revolution in the cockpit: Taking centre stage in the Mercedes-Benz presence at the Consumer Electronics Show in Las Vegas (CES; 9 – 12 January 2018) will be the world premiere of the intuitive and intelligent multimedia system MBUX – Mercedes-Benz User Experience.

It will enter series production this year in the new A‑Class. New services from Mercedes me will also be available.

The name MBUX for the new infotainment system signals that the user experience (UX) is to the fore. A unique feature of this system is its ability to learn thanks to artificial intelligence. MBUX can be individualised and adapts to suit the user. It thus creates an emotional connection between the vehicle, driver and passengers. At the same time updates “over the air” are possible. It also heralds a new era at Mercedes me Connectivity.

Its further strengths include the high-resolution Widescreen Cockpit with touchscreen operation, navigation display with augmented reality technology plus intelligent voice control with natural speech recognition, which is activated with the keyword “Hey Mercedes”.

MBUX is used in the entire new compact car generation from Mercedes-Benz and will enter series production in spring 2018 in the new A-Class. Its highlight is the comprehensive touch operation concept – the combination of a touchscreen, touchpad on the centre console and Touch-Control Buttons in the steering wheel. In addition to the intuitive operating experience, less driver distraction is another advantage.

MBUX is a further step in redefining Modern Luxury in the compact class.
The new A-Class breaks new ground, starting in the interior. The unique architecture is particularly marked by the avantgarde design of the dashboard and is a unique feature in this segment.

The design of the dashboard is characterized by an

There is a low-lying body in this open interior architecture. This so-called wing shows the sheer appreciation of form with its powerful and full volume.

The wing shape also appears to float since there are no connection points or transitions to the surroundings. The so-called moat allows the wing body to float to the main body of the dashboard and is also the source of scattered light for indirect lighting. This makes for very special ambience lighting: indirectly lit from below, it illuminates the main body in a similar way to the night-time illumination of a historic building.

Management: “Mobile assistant with artificial intelligence”

“New technologies must focus on the people using them and make their life simpler. That’s why we combine intuitive and natural operation with intelligent and learning software in MBUX,” said Ola Källenius, Member of the Board of Management of Daimler AG responsible for Group Research and Mercedes-Benz Cars Development.

Intelligent systems such as MBUX are also the basis of all four strategical CASE fields. CASE – these letters will shape the future of mobility. They stand for the fields of networking (Connected), autonomous driving (Autonomous), flexible use (Shared & Services) and electric drive systems (Electric). The four CASE fields are an integral part of the corporate strategy.

“With MBUX we have come another step closer to turning the vehicle into a mobile assistant,” said Sajjad Khan, Vice President Digital Vehicle & Mobility at Daimler. “The system’s ability to learn is spectacular, and unique to date in the car industry. We are using artificial intelligence to give the user individual suggestions based on their habits. The algorithm we use for this is optimised for on-board use in the vehicle and exploits the opportunities afforded by the latest chip generation.”

“With the new MBUX generation, we are transporting our user interface design into the digital world,” said Gorden Wagener, Chief Design Officer Daimler AG. “We are thus transferring intelligent technology into an emotional overall experience.”

Design: Intuitive operating system for more safety and comfort

MBUX is a revolution of the User Experience in the car. Emotively appealing and with an easily understood control structure, it offers brilliant 3D maximum-resolution graphics which are rendered, i.e. calculated and displayed, in real time.

The operating system on the free-standing Widescreen Cockpit comprises three levels with increasing information density:

On the first level you find what is known as the Homescreen. This is where, alongside the freely selectable main applications (e.g. telephone, navigation and radio), the most important information (such as arrival time, song currently being played etc.) is displayed.

The next level – the Basescreen – with the display and controls for one main application respectively, such as Media and Navigation, is only one step away. The most important information and control options respectively are attractively presented at this level. Important functions such as destination or music search are grouped at the bottom edge of the screen.

For seldom-used information and settings there is the Submenu on the final level.

Operation is horizontal and makes optimum use of the widescreen format of the display. As on a stage a space is created which not only sets standards visually, but also supports navigation between the individual information levels.

The fully digital instrument cluster can be configured virtually entirely according to personal preferences. As an alternative to the classic speed display in the left-hand tube, displays such as Analog Clock, From Start, From Reset, Range or Information on the current radio station / media title can be placed there. In the right-hand tube, in addition to the rev counter, an assistance graphic, the current consumption, the ECO display or a navigation map can also be displayed.

In Fullscreen Mode the entire area of the instrument cluster is used for displaying Assistance, Journey or Navigation:

Behind the MBUX design is the holistic approach that aims to make operating the vehicle, which is becoming even more complex, as user-friendly as possible and at the same time enjoyable in a sensual way. The merging of the real and virtual worlds opens up new dimensions in the areas of comfort, safety and modern luxury.

MBUX enables the user to operate vehicle functions playfully and intuitively: High-quality, animated 3D renderings of the car are shown on-screen and can be rotated and zoomed in real time. The settings can be changed by simply touching the 3D car model with a finger. There is no more scrolling through long menus. The effect of the changed settings is visualised directly, and is thus self-explanatory. This is facilitated by the use of a particularly powerful Nvidia graphics chip of the latest generation, the kind previously only used in games consoles.

The development and coordination of the overall User Experience is managed by the Development Centre in Sindelfingen. This includes linking all hubs distributed around the world so that they can make their own specific contribution. Mercedes-Benz designers are thus also shaping the digital revolution where the heart of the digital world beats – in Silicon Valley. Programmers, engineers and designers work hand in hand at the Advanced Design Studio in Sunnyvale, with the free interdisciplinary flow of ideas. The MBUX software was developed and programmed in-house. Also involved were China (Beijing), Japan, Korea, India (Bangalore) and others.

Voice control: “Hey Mercedes” obeys every command

Conventional voice control systems in cars call for certain fixed commands from their users. Thanks to natural speech recognition, MBUX’s LINGUATRONIC, on the other hand, obeys virtually every command, recognises and understands nearly all sentences from the fields of infotainment and vehicle operation. For example, “Will the sun be shining tomorrow in Miami?” is now as easily understood as “Do I need sunglasses tomorrow in Miami?”.

The intelligent language assistance is activated either via a button on the steering wheel or with the keyphrase “Hey Mercedes”. It’s not the human who has to adapt to the machine, but the other way round. Indirect speech is also recognised, for instance the user can say “I am cold” instead of the clear command “Temperature to 24 degrees” in order to operate the climate control.

The voice control is also capable of learning. On the one hand it attunes to the user and her voice and also understands non-native speakers better; on the other hand the software models on the server learn new buzzwords or changing use of language with time. The system also no longer answers stereotypically, but varies in the dialogue output too.

The fundamental way the language assistant operates: the voice entries are freed from background noises, compressed and transmitted. Both the computer in the vehicle and the server evaluate the data and send a reply. The system decides which reply is the most likely, then within a few seconds the reply/reaction follows. This means that in contrast to many other assistants, the language assistant also answers even when there is no online connection.

Holistic touch-control system: three control options

Alongside the intelligent voice assistance the MBUX operating concept includes a touchscreen. The new A-Class is the first Mercedes ever to have such a touch-sensitive screen.

The new touchscreen is part of the comprehensive touch-control concept – a triad consisting of the touchscreen, touchpad and Touch-Control Buttons. With the touchpad on the centre console the information in the media display can be changed intuitively as on a smartphone. The contents can simply be enlarged or moved, and in particular the navigation map can be zoomed in and out, via gestures with several fingers. A haptic feedback accompanies every input. The touchpad also recognises handwriting. This means that addresses or telephone numbers can be input conveniently.

The Touch-Control Buttons in the steering wheel facilitate operation of the infotainment (right-hand button) and the instrument cluster, as well as the head-up display (left-hand button) via finger-swiping movements, without the driver’s hands needing to leave the steering wheel.

Mercedes me: new services, easy operation

New and improved Mercedes me connect services are being launched with the new infotainment generation MBUX. These include, among others, navigation functions based on Car-to-X communication (information on road conditions such as slippery roads or snow or approaching emergency vehicles is shown on the map) and vehicle locating, which makes finding a parked vehicle easier, as well as a message in case something has bumped into the parked vehicle or it has been towed away. The Mercedes me App sends a reminder to leave on time so as to arrive at the next appointment punctually, taking traffic conditions into account.

The Mercedes me App collection can be placed as an icon on the screen in a user-friendly way, and can be freely sorted on the homepage like all other main applications. In addition, online content such as current prices at filling stations or the availability of parking spaces at car parks are displayed in MBUX. Online updating is a simple way of allowing new content to be made available in MBUX.


Smartwatch: practical “door-to-door” navigation

The driver can also access MBUX functions via smartwatch. At CES 2018, Mercedes-Benz is showing the integration of smartwatches with the popular operating system Android Wear 2.0 via the Mercedes me Bluetooth® link. “Send2Car” is one of the functions. This can be used to send addresses or Points of Interest (POI) directly from the smartwatch into the vehicle. The Parked Vehicle Locator service shows the car’s location within a radius of 1.5 km. “First and Last Mile” directs the driver to the parked vehicle/from the vehicle to the final destination, for example in a pedestrian zone. The functions are also available for iOS.

Characteristic of MBUX with the smartwatch integration is the modern graphic style and the intuitive operation, which is possible via voice control on request. The intelligent system also makes suggestions, based on the user habits. Anyone who always drives to the office at a certain time in the mornings will, for example, automatically receive the address of their place of work as the navigation destination as a suggestion on the smartwatch at the time in question on a working day.

Customers also expect seamless and intelligent interaction between devices in the Internet of Things (IoT) that are connected to their Mercedes-Benz vehicles and MBUX. These include voice-activated personal assistants supported by artificial intelligence (AI). Customer are given personal support by connecting these very useful services with Mercedes-Benz vehicles. Both Google Assistant with Google Home and Amazon Alexa can be used with all Mercedes-Benz models in the USA, Great Britain and Germany produced in 2016 and 2017.

Individualisation: the car is becoming part of me

Using “prediction features”, MBUX anticipates what the user would like next. For instance, anyone who often telephones their mother on Tuesdays during the journey home will receive her telephone number as a suggestion on the display on this day of the week. Anyone who regularly switches over to a radio station with news at a certain time also receives this as a suggestion. And if the navigation system detects a route frequently driven, navigation to this destination is started in the background. For example, MBUX suggests the fitness studio on the navigation screen, and the driver then only needs to confirm, and all the information on the route, such as congestion warnings, is already to hand.

Artificial intelligence thus gradually turns the car into a personal assistant for the driver.

The customer also has the opportunity to choose from three display styles: alongside Classic and Sport, the Understated style is also offered as a special feature – all displays are reduced to what is absolutely essential here.

The driver can also individually configure the information shown, create different moods with the extended ambience lighting with 64 colours and ten colour worlds, and add many individual settings – from the suspension and the climate control to the exterior lighting.

All settings (e.g. seating position, ambient lighting, favourite radio station, orientation of the navigation map right through to personal predictions) can be saved in a profile. If two drivers share a car, each can call up his/her favourite setting easily.

Augmented reality: navigation with information on the video image

The hard-disc navigation integrated into MBUX on the basis of HERE map data does not just predict destinations in advance, suggest interesting places (POI – Points of Interest) or navigate to the next filling station. It also functions as onboard navigation when there is no online connection.

Map display supplemented by Augmented Reality is a completely new feature. A video image of the surroundings taken with the aid of the front camera is augmented with helpful navigation information, for example arrows or house numbers are automatically superimposed directly onto the touchscreen image. This makes it easier for the driver to search for a certain house number, for example, or to find the correct road for turning off.

About CASE:
CASE – these letters will shape the future of mobility. They stand for the fields of networking (Connected), autonomous driving (Autonomous), flexible use (Shared & Services) and electric powertrains (Electric). The four CASE fields are an integral part of the corporate strategy of Daimler AG. The aim is to shape intuitive mobility for our customers through intelligent dovetailing of the CASE topics.

Mercedes-Benz Cars already plays a leading role in all four areas today. For example, all activities in the area of connectivity are focused on the digital brand Mercedes me, which gives customers access to an extensive and personalised range of services by app, website or straight from their car.

On the road to autonomous driving, Mercedes-Benz has for years been a key driver of development and has repeatedly set the benchmark. To this end, the Mercedes engineers use what is known as sensor fusion. The data from different sensors, such as cameras, ultrasound and radar, are intelligently combined and analysed. With the smart vision EQ fortwo, the smart brand also demonstrates how driving without a steering wheel could look in the future of car sharing.

The inventor of the car already plays a leading role in the field of ‘Sharing & Services’. The mobility services used by over 14.5 million people range from free-floating car sharing (car2go) and private peer-to-peer car sharing (Croove), through ride-hailing (mytaxi) to the mobility platform (moovel).

Mercedes-Benz pursues a holistic approach in powertrain electrification, and develops the EQ brand with a family of vehicles and an all-encompassing ecosystem, which, in addition to the vehicle itself, also comprises a comprehensive range of products related to electric mobility. This extends from intelligent services and energy storage units for private and commercial customers to charging technologies and sustainable recycling. On the road to emission-free driving, Daimler is systematically pursuing a three-pronged powertrain strategy to be able to realise maximum environmental compatibility across all vehicle classes (incl. commercial vehicles, vans) – with an intelligent mix of state-of-the-art internal combustion engines and partial electrification through 48-volt technology, tailor-made EQ Power plug-in hybrids and electric vehicles with battery or fuel cell powertrains.

By focusing on CASE, Daimler is preparing for the intuitive mobility of the future.
More at: http://www.daimler.com/CASE

At a glance

New and extended Mercedes me connect services

2018 will also bring new Mercedes me connect services with the MBUX – Mercedes-Benz User Experience multimedia system. They are integrated into the MBUX display in the vehicle via the Mercedes me tiles: This means that the customer can link his car with his Mercedes me account via a QR code and can check the status of his Mercedes me connect services, all while sitting in his Mercedes. The most important functions of Mercedes me connect:

  • Mercedes-Benz emergency call system
  • Standard Services
    • Maintenance Management
    • Accident Recovery
    • Breakdown Management
    • Telediagnosis
    • Remote vehicle diagnostics

Further services:

  • Vehicle Setup[1]:
    • Theft notification and parking damage detection: sends a message if the parked vehicle is damaged or moved.
    • Remote Retrieval of Vehicle Status: f. i. online check of mileage, tyre pressure and tank content
    • Remote eDoor Locking and Unlocking with smartphone or PC via the Mercedes me App
    • Support for environmentally aware driving (Eco Homepage) documents e.g. consumption data
  • Vehicle monitoring1:
    • Geographical Vehicle Monitoring: checks if the vehicle is leaving/driving into a previously defined area. This documents whether authorised users drive on routes not permitted, so, for example, a joy ride taken by a valet parking employee
    • Parked Vehicle Locator: makes it easier to find the parked vehicle
    • Vehicle Tracker: determines the position via the internet, during the journey too.
  • Mercedes me connect navigation services1:
    • Live Traffic Information
    • Online Map Update
    • Local Search, e.g. for a restaurant
    • Weather information
    • Carpark information
    • Prices at filling stations
    • Display of electric charging stations
    • Download of interesting destinations (POI)
    • Send2Car: send destination/POI to the vehicle for navigation
    • Intelligent route guidance
    • On Street Parking: available parking spaces on public roads with a prediction of the likelihood of availability
  • Mercedes me connect Concierge Service1: personal assistant provides support in the local search for restaurants or hotels and much more.
  • Digital Vehicle Key on the Smartphone1: opening, locking and starting of the vehicle with the smartphone via Near Field Communication (NFC).
    • As a supplement to the Digital Vehicle Key on the Smartphone there is also the Digital Vehicle Key Sticker with NFC technology.

At a glance

The key data on MBUX

The new infotainment generation MBUX – Mercedes-Benz User Experience is significantly more powerful and offers a series of new services and opportunities for interaction. All information is also very attractively displayed. Here are the key data.

  • Displays
    • Cockpit in three versions (figures apply to instrument cluster/touchscreen respectively):
      • with two 7-inch (17.78 cm) displays
      • with one 7 and one 10.25-inch display
      • with two 10.25-inch displays (26 cm) and a resolution of up to 1920 x 720 pixels (200 dpi)
    • Touchscreen: capacitive sensors
    • Touch-Control Buttons: capacitive sensors
    • Touchpad: capacitive sensors and haptic feedback
    • Head-up display: brightness up to 12,000 cd/m²
  • Hardware/computer
    • Basic graphics chip: NVIDIA Reilly PX (Headunit Mid/Entry)
    • Top graphics chip: NVIDIA Parker 128 (Headunit High)
    • RAM: 8GB DDR4 RAM
    • CPU: 6 Core, 2 Denver and 4xA57
    • GPU: 128 – 256 CUDA Cores
    • Performance: 59,300 DMIPS, 500GFLOPS
    • Operating system: Linux
    • Bus systems: user-interface CAN, MOST, CAN
    • Communications module: HERMES LTE
  • Software
    • Data source for navigation map: HERE
    • Data source for voice control: Nuance
    • Data source for weather: Foreca, Autonavi
    • Data source for POI: HERE
  • Interfaces
    • USB: USB 2.0 and USB 1.1 as well as Type C
      for quicker charging
    • Bluetooth®
    • Near Field Communication (NFC)
    • Vehicle data
    • Front camera
    • To “anti-theft alarm system (ATA) ” sensors
  • Integration of mobile devices
    • Smartwatch: watchOS and Android Wear 2.0.
    • Smartphone: Apple CarPlay, Google Android Auto,
      Baidu CarLife (China)

The interior design of the new A-Class

The interior of the A-Class is a completely new departure, and revolutionises the compact class from the inside with a new feeling of spaciousness. The unique architecture is particularly marked by the avantgarde design of the dashboard. There is much a more generous amount of interior space.

This year, the new A-Class as a harbinger of the new compact car generation will replace a bestseller that has decisively contributed to a more youthful brand image for Mercedes-Benz: the average age of European drivers of this most progressive compact class model is now 13 years lower than for the preceding series. And now the revolution is set to continue: the coming A-Class completely redefines Modern Luxury in the interior. At the same time it has considerably more utility value, making it as youthful as ever but as grown-up as never before.

“The new A-Class embodies the next stage in our design philosophy of sensual clarity, and has the potential to usher in a new design era,” said Gorden Wagener, Chief Design Officer Daimler AG. “The interior presents modern luxury at a level previously unattainable in this class, and transports the user interface into the digital age.”

The interior architecture and the control & display systems of the new A-Class are a USP in this segment. The dashboard is divided into two three-dimensional, horizontal sections: the lower section is visually separated from the main body of the dashboard by a “trench”, and it appears to float in front of the dashboard. The optional ambience lighting enhances this effect, accentuating the free-floating impression of the substructure.

The widescreen cockpit is completely free-standing, and for the first time there are absolutely no cockpit cowls above the instruments. The sporty air vents in a turbine-look are another highlight.

The A-Class also takes its lead from the luxury Mercedes-Benz models where many other details are concerned. The multifunction steering wheel comes from the S-Class, for example. The front seats likewise have comfort features available from higher segments, including seat climate control, massage function and multicontour seat. The trim elements have a “wrap-around” design, and the choice of materials (e.g. open-pore wood) underscores the progressive, high-quality positioning.

The interior has a greatly enhanced feeling of spaciousness, better all-round visibility and more space. Utility value is increased by more shoulder-room (front +9 mm, rear +22 mm), elbow-room (front +35 mm, rear +36 mm) and headroom (front +7 mm, rear +8 mm). Easier access to the rear seats is another plus point of the new A-Class. The luggage compartment behind the rear seats is more suitable for family and recreational use, and has a capacity of 370 litres – 29 litres more than the preceding model. Thanks to two-section rear lights, the loading aperture is 20 cm wider than before, and the luggage compartment floor is 11.5 cm longer. If required the rear seat backrest can be positioned more upright, e.g. to accommodate bulky boxes. All-round visibility has also been considerably improved: by around ten percent.

Image Gallery

CES 2018: Mercedes-Benz unveils MBUX AI system - Image 7
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 6
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 12
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 4
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 10
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 2
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 5
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 8
CES 2018: Mercedes-Benz unveils MBUX AI system - Image 15

Related Stories

Comments

Leave a Comment

  1. Baljinder Singh Sidhu
    10/1/2018

    this is so amazing. Any other source for deep information regarding this technology?

Newsletter

Get all the updates with our weekly newsletter!

Find a Car


Scroll To Top
Scroll To Bottom