Lip-sync and animation system supports MMS products
Share this article
The real-time lip-sync and animation system was developed by Hong Yan, Professor (Chair) of Computer Engineering at CityU. “This system performs many sophisticated multimedia data processing functions, including speech analysis, image and video processing, data compression, and mathematical modelling of human and animal faces. All computations are performed in real-time. The system, which works with several major languages, such as Chinese (Cantonese and Mandarin), English, French, German, Japanese and Spanish, can create and animate a human or animal character from photos or cartoon drawings and generate different facial expressions, such as a frown, a smile and laughter, making a virtual character appear to talk as naturally as a human.” For computer and mobile phone applications, the user can choose a favourite character from a large database of several hundred human or animal images. The system can produce 20 image frames per second.
At the signing ceremony, Professor Roderick Wong, Dean of Research & Graduate Studies, said, “CityU emphasizes both teaching and research. On the research front, the University focuses on applied research with a view to supporting various industries. We hope we can contribute to strengthening their professional knowledge and skills in order to enhance their competitiveness in the face of ever-changing demands of the market. CityU is pleased to provide the Real-time Communications (HK) Limited with Professor Hong Yan’s facial animation products to help the company enhance its product quality and to develop new business opportunities.”
Officiating at the signing ceremony were Professor Roderick Wong; Professor Chan Chi Hou, Dean of Faculty of Science and Engineering; Professor Hong Yan; and Mr Jonathan Ma Wai Tat, Executive Director, Mr Joseph W O Chu, Chief Engineer, Mr Chong Wei Lam, Marketing Manager, of REAL TIME.
Professor Hong Yan, who created the novel design of the real-time lip-sync and animation system, received his PhD degree from
Real-time Communications (HK) Limited and its affiliates provide wireless interactive entertainment and community services to mobile phone users in