AR-Guided Automotive Maintenance Workflow

About

‍

Overview

A major automotive stakeholder explored whether AR smartglasses combined with voice control could enable safer, faster, and more intuitive maintenance workflows. HEPIUS supported the design and execution of a hands-free feasibility pilot focused on combining multiple device modalities into one seamless guided experience.

‍

Scope of the Project

• Hands-free interaction using AR smartglasses.
• Guided workflows using voice commands instead of touch.
• Use of an Android tablet as a synchronized second screen.
• Real-time communication and instruction overlays above the engine.
• Evaluation of feasibility, latency, clarity, and technician usability.

‍

HEPIUS Responsibilities

• Project coordination across technical and stakeholder teams.
• Definition of the technology stack including AWS, Angular, Android, WebRTC, and the smartglasses SDK.
• Design of application flows for AR guidance, step validation, and dual-device synchronization.
• Ensuring all outcomes aligned with safety and operational requirements in workshop environments.

‍

Technology Components

• AR smartglasses with holographic overlays.
• Real-time sync channel between smartglasses and tablet.
• Voice-recognition functionality using cloud-based speech services.
• Serverless backend for workflow logic and step tracking.

Results

‍

Hands-Free Efficiency

• Technicians were able to follow entire maintenance procedures without touching devices.
• Voice-controlled progression through steps reduced interruptions and improved focus.
• The approach demonstrated strong potential for use in dirt-prone, glove-required environments.

‍

Real-Time Sync Across Devices

• Smartglasses and tablet remained perfectly synchronized across all workflow stages.
• Workers viewed the same step progress simultaneously, improving clarity and reducing mistakes.
• The dual-device setup validated feasibility for collaborative or multi-role maintenance tasks.

‍

AR-Based Procedural Guidance

• AR overlays provided clear visual cues directly above the engine, enabling a guided, intuitive workflow.
• Step indicators, arrows, and confirmation checks helped technicians stay aligned without referencing manuals.
• Early testing confirmed strong usability and reduced cognitive load.

‍

Pilot Outcome

• Stakeholders provided positive feedback and confirmed strong interest in continued exploration.
• All goals of the feasibility study were met, validating the approach for next-phase trials.
• Due to NDA constraints, operational details remain undisclosed, but the pilot successfully demonstrated the value of AR-enhanced, synchronized, hands-free automotive maintenance.
  

‍