I'm working on a system to do lip synch. I already made an animation where
AL the Alien talks back in November 2000, but the system I'm working on now
is much more flexible and powerful than what I had back then.

For any lip pose you can specify the weight, so you for example can have
anything between a little "o" and a roaring "OH!" by specifying a number
from 0 to 1. It also supports weighted lip poses, so you can average
multiple phoneme poses and/or expression poses.

The lips to be animated consist of four bicubic patches. You have some
control over how the mouth looks, but not very much unfortunately. So you
can use them for certain toony characters, but you can't adapt them to any
character you might have.

The attached animation is a test of the system. I still need to implement
support for tongues (which is a major thing), but besides that the system is
fairly complete.

As always, comments are much appreciated! :)

Also, if I made an include file of this system, would anybody have a use for
it?

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message

Attachments:
Download 'lips1.mpg' (637 KB)

over the top excellent... keep up the progress and post results!
:o)

-peter
-- 
Current obsession: "Ballet pour ma fille."
http://www.applesnake.net

Post a reply to this message

very impressive :)

who is the voice? (and do they really sound like that?)


--

Rick

Kitty5 WebDesign - http://Kitty5.com
POV-Ray News & Resources - http://Povray.co.uk
TEL : +44 (01270) 501101 - FAX : +44 (01270) 251105 - ICQ : 15776037

PGP Public Key
http://pgpkeys.mit.edu:11371/pks/lookup?op=get&search=0x231E1CEA

Post a reply to this message

"Dearmad" wrote:
> over the top excellent...

Thank you! :)

> keep up the progress and post results!
> :o)

Will do. However, I'll stick to the same animation and only improve on that.
Making new lip synch animations takes quite a while, so I don't feel like
making additional ones right now.

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message

I'm really amazed.

I remember that you said, not very long ago, that you were going to make a
game using POV images. Have you finished it? Is this lip-synch test going to
be used in the game?

Congratulations on your good work!

Fernando.

Post a reply to this message

> I'm really amazed.
>
> Congratulations on your good work!

Thank you! :)

> I remember that you said, not very long ago, that
> you were going to make a game using POV images.
> Have you finished it? Is this lip-synch test going
> to be used in the game?

The game has nothing to do with this lip-synch. The game was finished a
while ago but it's nothing special and it crashed a lot. You can read about
it in povray.general in the thread "MazeQuest - a computer game" posted
December 19 2001.

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message

"Rick [Kitty5]" wrote:
> very impressive :)

Thank you! :)

> who is the voice? (and do they really sound like that?)

Err... It's my voice times three - and I don't really sound like that... ;)

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message

Incredible work, Rune.  Your animations are just stupendous! Considering there
aren't any actual "lips" present, however, are you going to add support for
different lip sizes?  i.e. creating an ethnic variance?

Lawrence

Rune wrote:

> I'm working on a system to do lip synch. I already made an animation where
> AL the Alien talks back in November 2000, but the system I'm working on now
> is much more flexible and powerful than what I had back then.
>
> For any lip pose you can specify the weight, so you for example can have
> anything between a little "o" and a roaring "OH!" by specifying a number
> from 0 to 1. It also supports weighted lip poses, so you can average
> multiple phoneme poses and/or expression poses.
>
> The lips to be animated consist of four bicubic patches. You have some
> control over how the mouth looks, but not very much unfortunately. So you
> can use them for certain toony characters, but you can't adapt them to any
> character you might have.
>
> The attached animation is a test of the system. I still need to implement
> support for tongues (which is a major thing), but besides that the system is
> fairly complete.
>
> As always, comments are much appreciated! :)
>
> Also, if I made an include file of this system, would anybody have a use for
> it?
>
> Rune
> --
> 3D images and anims, include files, tutorials and more:
> Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
> POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
> POV-Ray Webring: http://webring.povray.co.uk
>
>                 Name: lips1.mpg
>    lips1.mpg    Type: Wmplayer File (video/mpg)
>             Encoding: x-uuencode

Post a reply to this message

"Lawrence Winstead" wrote:
> Incredible work, Rune.  Your animations are just stupendous!

Thank you! :)

> Considering there aren't any actual "lips" present,
> however, are you going to add support for different
> lip sizes?  i.e. creating an ethnic variance?

You can use any texture on the mouth region, and that way "paint" any kind
of lips using pigments and normals. However, you can't make lips that
actually bulge out...

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message

"Rune" wrote:
> Also, if I made an include file of this system,
> would anybody have a use for it?

Maybe I should rephrase this.

Cleaning up the code in an include file and write documentation for it takes
a fair amount of time, so before doing that I'd first like to know if
there's actually anybody interested in it. Would you be interested in a lip
synch system?

Rune
--
3D images and anims, include files, tutorials and more:
Rune's World:    http://rsj.mobilixnet.dk (updated Jan 2)
POV-Ray Users:   http://rsj.mobilixnet.dk/povrayusers/
POV-Ray Webring: http://webring.povray.co.uk

Post a reply to this message