AI-powered HMI for autonomous cars, integrating four screens to aid novice drivers and adapt to diverse driving conditions.
Project overview
This project is focused on developing an AI-powered HMI system for autonomous cars to assist novice drivers. It aims to integrate four screens(Mobile+Central control screen+Instrument screen+HUD) for an intuitive and safe driving experience, adapting to various driving conditions. The project emphasizes user-friendly design, reducing driver distraction, and enhancing safety, particularly for those new to driving. The goal is to create an interface that is both technologically advanced and easily navigable for beginners.
AI Integration
Natural Language Processing (NLP)+ Machine Learning+ Computer Vision+ Robotics+ Digital Twin
Future-Proofing Design
Information
Type
Product Design
Platform
HMI Screens
My Role
Solo Academia Project
Design Method
User Research | Use Case Scenarios | 3D Modeling | Prototyping | Usability Testing | Heuristic Evaluation | Accessibility Considerations
Final Design
Mobile End
Central Control Screen End
Central Control Screen End
HUD & Hardware
Research
Industry Research
The 2022 study by Du, Y., Zhi, Jy., & He, Sj. in "Scientific Reports" highlights the crucial role of experience in improving driving performance, especially for high-speed train drivers. Novice drivers are slower and more prone to speeding, with a higher risk of accidents. Training and experience significantly reduce these risks; a trainee driver's accident probability drops by 38%, and an experienced driver's by 94%. This emphasizes the need for extensive practice and awareness of traffic complexities in enhancing driving safety.
Design Regulations
Enhanced Vision and Advanced Sensing
User-Centric Interface: A large touchscreen displays navigation and vehicle data, emphasizing user-friendly interaction.
The system aims for full autonomy, potentially allowing hands-free driving in compliance with future regulations.
Traffic-aware cruise control and auto-steer functions align with regulatory safety standards.
Design Principles
Prefer medium font weights and set line heights between 140%-180% of the font size for readability.
Use high contrast colors, especially in direct sunlight, and apply the 60–30–10 color rule for balance.
Verify HMI size with manufacturers, focusing on various screen sizes and resolutions.
Ensure clarity and appropriate sizing of icons, with distinct touch areas for safety.
Prioritize safety, design for various driving conditions, and adhere to a 3-second principle for interactions.
Multimodal Interaction
Interview Insights
HMW Questions
Design Process
Info Architecture
Wireframe
Key Features
Real-Scene Guidebook and Practice: Utilizes real-world scenarios for practical driving training.
Pre-Drive Difficulty Preview: Allows drivers to review potential challenges before driving.
Real-Time Error Feedback and Hazard Warnings: Offers immediate driving corrections and alerts for hazards.
Software and Hardware Notifications: Provides important notifications from both driving software and vehicle hardware.
Multi-Modal Interaction: Supports various interaction methods, including voice, text, gestures, and touchscreen.
Four-Screen Coordination: Integrate Mobile+Central control screen+Instrument screen+HUD four screens for an intuitive and safe driving experience, adapting to various driving conditions.
Driving Scenario Illustration
Mobile Onboarding
Synchronous Driving setting& AI Preference
Synchronous Driving setting& AI Preference
Central control screen + Instrument screen Driving Process Flow