上游文通大学 HANGHAI JIAO TONG UNIVERSIT Research Status of Human-Computer Interaction reading system was not established until 1984.In the following years,more methods including HMM and ANN have been gradually applied to improve this technology. 5.2.2 The methods applied in lip-reading technology Detection and location are the first step,and there are two basic ways.The first is based on the characteristics of face structure,analyzing the information of eyes and nostrils to locate mouth.And the second one is totally different.It is based on the different distribution of skin and lip colors (Zhao Wang,2007). Feature extraction is the next step.Collecting features accurately is an essential basis for the follow- up tracking and recognition work.Scientists have worked out varies of methods,such as Active Appearance Models(AAM),comparing visual features for lip-reading (Sarah,Richard Barry- John,2009)and other new lip models (Shdaifat Grigat,2003). 5.2.3 The application of lip-reading system Lip-reading recognition can be used in two aspects.First,it can complement each other with speech recognition.In 2012,Microsoft was trying to introduce this system to new version of Kinect,so that the users can give their instructions even in a noisy room.Some labs also tried to combine lip- reading and speech recognition,and developed a system that can assist schools for deafmutes on correcting the students'pronunciation in a vivid way (Xie,2005). In addition,researches on lip-reading recognition can also be applied in computer-generated mouth shapes.For example,Poser,a fantastic 3D animation software launched by Metacreations,can synthesize the speaking mouths of the animation roles just by inputting the sound.Similar to speech recognition,lip-reading also has a vast world to develop. 5.3 Facial Expression Recognition 5.3.1 The significance of facial expression research Besides voice,facial expression recognition is also a wide field of human computer interaction.As we all know,human faces contain so essential information about emotions and the mental state of a person.Thus it is utilized in order to enable nonverbal communication with computers(Petar &K. Katsaggelos,2006).Moreover,the recognition of facial expression also relates to psychology, soc iology,anthropology,computer science and some other subjects.As a consequence,the study of expression has a scientific significance of improving the artificial intelligence and promote the development of related disciplines at the same time (Xue,Mao,Guo Lv,2009). 5.3.2 The recognition of facial expression With the active researches of facial expression,various techniques have been developed from all over the world.Above all,establishing a database is a basic step.Currently,the database can be 9/19Research Status of Human-Computer Interaction 9 / 19 reading system was not established until 1984. In the following years, more methods including HMM and ANN have been gradually applied to improve this technology. 5.2.2 The methods applied in lip-reading technology Detection and location are the first step, and there are two basic ways. The first is based on the characteristics of face structure, analyzing the information of eyes and nostrils to locate mouth. And the second one is totally different. It is based on the different distribution of skin and lip colors (Zhao & Wang, 2007). Feature extraction is the next step. Collecting features accurately is an essential basis for the follow￾up tracking and recognition work. Scientists have worked out varies of methods, such as Active Appearance Models(AAM), comparing visual features for lip-reading (Sarah, Richard & Barry￾John, 2009) and other new lip models (Shdaifat & Grigat, 2003). 5.2.3 The application of lip-reading system Lip-reading recognition can be used in two aspects. First, it can complement each other with speech recognition. In 2012, Microsoft was trying to introduce this system to new version of Kinect, so that the users can give their instructions even in a noisy room. Some labs also tried to combine lip￾reading and speech recognition, and developed a system that can assist schools for deafmutes on correcting the students’ pronunciation in a vivid way (Xie, 2005). In addition, researches on lip-reading recognition can also be applied in computer-generated mouth shapes. For example, Poser, a fantastic 3D animation software launched by Metacreations, can synthesize the speaking mouths of the animation roles just by inputting the sound. Similar to speech recognition, lip-reading also has a vast world to develop. 5.3 Facial Expression Recognition 5.3.1 The significance of facial expression research Besides voice, facial expression recognition is also a wide field of human computer interaction. As we all know, human faces contain so essential information about emotions and the mental state of a person. Thus it is utilized in order to enable nonverbal communication with computers (Petar & K. Katsaggelos, 2006).Moreover, the recognition of facial expression also relates to psychology, sociology, anthropology, computer science and some other subjects. As a consequence, the study of expression has a scientific significance of improving the artificial intelligence and promote the development of related disciplines at the same time (Xue, Mao, Guo & Lv, 2009). 5.3.2 The recognition of facial expression With the active researches of facial expression, various techniques have been developed from all over the world. Above all, establishing a database is a basic step. Currently, the database can be