Information Technology
 
Real-time Lip-sync and Facial Animation System
實時語音口形配合和人面動畫系統
 
Principal Investigator
Professor YAN, Hong 嚴洪 教授 [ Profile ]
Professor (Chair) of Computer Engineering , Department of Electronic Engineering
Stage of Technology Transfer: fundamental R&D product level
Research Area: Information Technology

Abstract
Through many years of research and development work, we have made significant progress in computerized human face animation. Our system can create many virtual characters with different styles. The model can animate with accurate synchronization of lip/mouth shapes and voice signals smoothly and automatically. In addition, the virtual character can express his/her emotion with different kinds of facial expressions such as smile, laugh and anger.

Features
• Creation of animated faces from photos or cartoon drawings
• Real-time synchronization of lip/mouth shapes and voice signals
• Producing different facial expressions, such as smile, laugh and anger
• Hundreds of virtual characters to choose from
• Able to process many languages

Applications
• Comic characters on mobile phones
• Personalized reporters for news, stories, stock prices etc
• Multimedia messages (MMS)
• Entertainment on mobile phones, e.g. songs, jokes
• E-learning and e-training

Contact Information
Mr H Y Wong
Director, Technology Transfer Office
City University of Hong Kong
83 Tat Chee Avenue
Kowloon, Hong Kong
Tel : (852) 2788 8428
Fax : (852) 2788 9119
Email : hy.wong@cityu.edu.hk

簡介
我們在計算機人臉影像分析及動畫科技上已進行了多年研究。現時, 我們研發的科技可以創造多種形態的虛擬電腦人物。透過識別語音信號, 此系統能實時自動生成人物說話時的嘴唇形狀。語言、 歌曲和嘴唇形態配合, 順暢自然。 另外, 所表現的人物有不同的面部表情, 例如微笑、大笑及憤怒。

特色
• 將相片或卡通繪圖變成動畫
• 實時地將嘴唇或口部形狀配合聲頻訊號
• 製造不同臉部表情,如微笑、大笑及憤怒
• 數百個虛擬人物選擇
• 能配合多種語言

應用
• 手提電話及互聯網上的漫畫人物
• 新聞、廣告、故事、股票行情的報導員
• 多媒體訊息
• 娛樂如歌曲、笑話
• 電子學習及培訓

查詢
香港城市大學技術轉移處處長黃漢儀先生
地址 : 香港九龍達之路83號
電話 : (852) 2788 8428
傳真 : (852) 2788 9119
電郵 : hy.wong@cityu.edu.hk

 
 
• Demonstration
All Rights Reserved. TOP
For best viewing, use Explorer 4.0 or higher and set your monitor for 1024x768 pixels.