| 1 |
Speech Driven Facial Animation
|
|
|
|
In: http://www.cs.ucsb.edu/PUI/PUIWorkshop/PUI-2001/a8.pdf (2001)
|
|
Abstract:
The results reported in this article are an integral part of a larger project aimed at achieving perceptually realistic animations, including the individualized nuances, of three-dimensional human faces driven by speech. The audiovisual system that has been developed for learning the spatio-temporal relationship between speech acoustics and facial animation is described, including video and speech processing, pattern analysis, and MPEG-4 compliant facial animation for a given speaker. In particular, we propose a perceptual transformation of the speech spectral envelope, which is shown to capture the dynamics of articulatory movements. An efficient nearest-neighbor algorithm is used to predict novel articulatory trajectories from the speech dynamics. The results are very promising and suggest a new way to approach the modeling of synthetic lip motion of a given speaker driven by his/her speech. This would also provide clues toward a more general cross-speaker realistic animation.
|
|
Keyword:
computer vision; Experimentation; General Terms Algorithms; Human Factors Keywords Facial animation; lip-syncing; Measurement; MPEG-4; Performance; speech processing
|
|
URL: http://www.cs.ucsb.edu/PUI/PUIWorkshop/PUI-2001/a8.pdf
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.16.8423
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Speech Driven Facial Animation
|
|
|
|
In: http://vislab.cs.wright.edu/~anna/PDF-Files/ricardo.pdf (2001)
|
|
BASE
|
|
Show details
|
|
|
|
|
