Avatar News

What is the impact of avatar mouth movement and lip synchronization on e-learning?

A recent search of academic databases turned up a hole in the knowledgebase. For learning professionals who are currently developing avatars for use in e-Learning projects – the question of whether there is any learning impact from the presence (or absence) of avatar mouth movements is not answered yet.

If you are aware of research that can help answer this – please post a comment below to help us find it.

Until empirical research is available – it’s essential for us to share our personal experiences with this kind of work. Please post below to help us arrive at some preliminary insight about learning effectiveness of lip-synched avatars.

Have you developed an avatar who did lip sync? How much difference of impact is there between a simple sync of a jaw movement without lip pursing? How about the difference between an avatar that moves jaw and lips – but not cheeks? Did you pair the speech-related facial movement like smiles or frowns?

We’ll continue to develop this article as new information comes in – Irene T. Boland, Ph.D.

Here at TW, Inc. we are quite thrilled to hear the responses of this proposed discussion. I am personally pleased to hear virtual agents are more and more being integrated into e-learning. This - in itself - is a sign that they are effective as a learning tool.

I personally have experience with using various types of avatars. It is quite an amazing experience to see the reaction and learning retention when learners are given this option vs. conventional text or audio.

Although we soon anticipate to test and measure this type learning for our own research purposes, I can tell you the following in the interim:

1) Learners are by far more receptive to training when a lip syncing avatar is used; especially when “dry material” is involved. This keeps the learner engaged.

2) Among the various avatars and talking heads we have incorporated into e-learning, I have found CodeBaby Production Studios one of the best products to produce this type of deliverable. Although a slight pricey and a high learning curve, Patrick and his staff are right on the mark.

3) Arm/hand gestures, lip, cheek, eyebrows and blinking eyes are all very important in the actual engagement of learners. Based upon general observation, an avatar with simple lip movements are way too mechanical (especially when lip/narration is out of sync). When the above mentioned movements are blended appropriately, it completes the training package and acts more of a "virtual agent".

4) Be very cautious of the chosen avatar or talking head. We've seen learners become fixated more on the avatar than the actual content that is trying to be conveyed to them. The learner hones in on the lifelessness and mechancial function of the avatar, thus losing the ability to retain what is being taught.