Regular fitness can help people maintain good physical and mental health. The professional guidance of coaches is important for helping and protecting people doing exercises, but the cost of hiring coaches can be very high. Although there are a few applications providing fitness videos, they provide no feedback of how well users are doing. Furthermore, some people may easily stop exercising when using their current fitness applications or watching videos online because there is a lack of a fitness-room-like environment where everyone is doing exercise.

To fill the current market gap and meet people’s needs, this project involes developing a virtual platform to help people do exercise at home with a smart virtual coach providing guidance and feedback and a fitness-room-like environment in the metaverse. The virtual platform will first be developed on desktop, then extended to mobile devices, and in the long term, dedicated to Internet of Things devices. The core technology involes using a low-cost camera to capture the person’s movements, and then transfering the movements to a virtual character. Then, the user doing the exercise will receive a detailed matching score between the person in the education video and the virtual character controlled by the user as feedback to encourage them to follow the movements as well as they can.