Avatar’s Facial Expressions with “Manpu (Comic Symbols)” by Referring Biometric Information

It is difficult to present natural avatar’s facial expression. We propose a new method for generating avatar’s natural facial expression by combining (1) user’s emotion classification based on his/her facial images analysis, (2) the degree of emotion based by biometric heart rate sensor. Generated avatar’s facial expressions are enhanced by referring emotion classification results and the degree of emotions measured by biometric sensor. Finally, “Manpu” (comic symbols) is adding to visually express the user’s emotions, feelings or sensations.

Images