Link Copied.
Augmented Reality Gaming System for Assisting Users with Health Needs

中文版本

Opportunity  

Elderly individuals in care homes or living alone face challenges including loneliness, social isolation, chronic diseases, and medication management. While group activities and social events help, introverted residents may prefer solitary activities like reading or tablet games, while active residents want physical exercise. Existing solutions are fragmented—medication reminder apps, exercise videos, and entertainment apps are separate, requiring users to switch between multiple tools. Many lack real-time feedback on exercise form, which is critical for safety and effectiveness, especially for seniors or those in rehabilitation. Furthermore, social engagement features are often missing, failing to address loneliness. An integrated platform combining health management, physical activity, entertainment, and social connectivity is needed, with AI-powered feedback and accessibility for elderly users.

Technology  

This patent presents an augmented reality gaming system with an all-in-one software platform called FunSpark. The system includes a gateway that receives inputs (user actions, medication schedules), an engagement evaluation module that classifies events based on an action-wellness relationship, and a user interaction module that provides health-related recommendations. The platform offers applications across five categories: Elderly Care (exercise with AI posture evaluation, medication reminders), Rehabilitation (hand-eye coordination games, math skill games), Music (drumming, trombone, karaoke), Sports (running, badminton, bowling, pong), and Environment (waste sorting education).

A user recognition module uses pose estimation, hand/gesture detection, and face detection via a camera to capture user movements. An AI-based evaluation engine analyzes posture in real-time, providing guidance to improve form (e.g., showing skeleton overlay with corrective feedback). The system includes medication reminders based on user schedules and supports karaoke with lyrics and song playback. A social connectivity module enables multiplayer modes (e.g., six-player pong) for group engagement. The platform uses WebRTC for real-time communication and signal transmission for device synchronization. Educational modules teach environmental sustainability. Face detection enables personalized user profiles.

Advantages  

  • All-in-One Integration: Combines health management, exercise, entertainment, education, and social features in a single platform—no switching between apps.
  • AI-Powered Posture Feedback: Real-time pose estimation analyzes exercise form and provides corrective guidance, improving safety and effectiveness for elderly/rehab users.
  • Personalized Medication Reminders: Automatic reminders based on individual schedules help prevent missed doses.
  • Multiplayer Social Engagement: Supports group games and activities, reducing loneliness and fostering community.
  • Accessible for Elderly: Simple interface with large buttons, voice support, and camera-based interaction (no wearables).
  • Diverse Content Library: Covers rehabilitation, music, sports, environmental education, and elderly care—engaging a wide range of interests.
  • Real-Time Feedback: Immediate corrections during exercise or karaoke (pitch/rhythm) enhance learning and performance.
     

Applications  

  • Elderly Care Facilities: Providing residents with exercise, medication reminders, karaoke, and social games on shared tablets.
  • Home Care for Seniors: Supporting independent living with daily exercise, medication tracking, and entertainment.
  • Rehabilitation Centers: Guided therapeutic exercises with real-time posture feedback for patients recovering from injuries or strokes.
  • Schools & Community Centers: Environmental education games, music learning apps, and active sports games for all ages.
  • Government Social Programs: Deploying in public spaces to promote active aging and social connection among seniors.
     

Remarks
CIMDA:P00221
IP Status
Patent filed
Technology Readiness Level (TRL)
5
Questions about this Technology?
Contact Our Tech Manager
Contact Our Tech Manager
Augmented Reality Gaming System for Assisting Users with Health Needs

Personal Information

(ReCaptcha V3 Hidden Field)

We use cookies to ensure you get the best experience on our website.

More Information