integrating lip sync feature in blender

General discussion about the development of the open source Blender

Moderators: jesterKing, stiv

Post Reply
sharpteam
Posts: 0
Joined: Mon Feb 26, 2007 5:29 pm

integrating lip sync feature in blender

Post by sharpteam » Tue Feb 27, 2007 1:29 am

Hi all,

We spoke about our project on the IRC chat meeting (25/02/2007). You can take a look at the wiki page we made :

http://wiki.blender.org/index.php/Requests/lipSync
(bear in mind that it's only the draft step :) )

It has been updated according to some suggestions.


Again any information or suggestion are welcome

hyenaman
Posts: 0
Joined: Thu Dec 01, 2005 9:53 am

Post by hyenaman » Tue Feb 27, 2007 12:51 pm

Hi...
ooooh!!! man that would be soooooooooo sweeeeeeeeeeeeeeettttttttt!!!!!
As an animator that kinda stuff just gets my blood flowing...thanks man..
I hope it comes out soon.
keep up the awsome work.
p.s:Just a suggestion...why dont you guys keep this as a seperate window called "dubbing window" or something so the action editor can be uncluttered....blender tends to take up much screen real estate as is.

ddwagnz
Posts: 0
Joined: Wed Apr 26, 2006 3:40 am

Post by ddwagnz » Tue Feb 27, 2007 1:59 pm

i have a question about the panel placement though
now, im not sure but are you going to have Tabbed Panels, as having tabbed will save scrolling across tons(remove the pun) of panels,
i'm not sure if you had that planned but that would be a good idea :)

zynek
Posts: 0
Joined: Tue Dec 13, 2005 2:10 pm

Post by zynek » Tue Feb 27, 2007 3:49 pm

Hi there,

this looks like a nice project. I would suggest to be able to drive bones with this though. So that each phoneme is mapped to a bone configuration that can be weighted.

Most lip sync stuff I have seen latley does not use morph targets anymore. The face is usually rigged with bones to create facial animation. Morph targets are often used in real time applications but when doing high quality animations, bones usually provide a finer control.

Just as suggestion, I do realise you have limited time. Keep up the good work.

joeri
Posts: 96
Joined: Fri Jan 10, 2003 6:41 pm
Contact:

Post by joeri » Wed Feb 28, 2007 4:29 pm

And lattices. And modifiers.

Great stuff. Please take a look at the colors you are using, they are not very "blender like"

What about extra mesh movements like eyebrows etc... how to add these?

JiriH
Posts: 0
Joined: Sat Feb 04, 2006 8:46 pm

Post by JiriH » Tue Mar 06, 2007 7:02 pm

Hey boys,

good luck. You are doing amazing work. When I saw your project for the first time I guessed this was too good to be true :-))))))

Thank you very much

sharpteam
Posts: 0
Joined: Mon Feb 26, 2007 5:29 pm

Post by sharpteam » Sat Mar 31, 2007 11:34 pm

Hello,

Finally, we integrate our tool in a new editor. We have finished the university documentation. And we implemented:
- new space for lip-sync window
- load dictionary (uk)


you can read our documentation here: http://marc.gardent.free.fr/files/Lipsy ... tation.pdf

After the end of university project, several details will be able to be modified to integrate to bf-blender source.

We can extend our project to use shape keys driven.


Bye

Koba
Posts: 0
Joined: Thu Apr 15, 2004 9:48 am

Post by Koba » Sun Apr 01, 2007 1:08 pm

When I saw your project for the first time I guessed this was too good to be true
And I'm reading this on April 1st!

This really sounds great. Personally, I don't know how much I would use it but there are a hell of a lot of people who would love this feature.

Blender is really coming along wonderful. Motion tracking and now this! 2.5 is going to be an insane release.

I wish you guys all the best in your project and commend your attempts at doinf something worthwhile in Blender!


Koba

EDIT: I am so jealous of you guys - 3rd years and actually doing something useful in the world! I'm at Oxford doing physics and it sucks - should have done CS elsewhere.

EDIT2: As you need to do this project for the course and you are unfamiliar with the Blender code, don't be afraid to ask and get help!

sharpteam
Posts: 0
Joined: Mon Feb 26, 2007 5:29 pm

Post by sharpteam » Sat Jun 16, 2007 12:58 am

Hi,

thanks for all your support

We have made some changes to our lipsync project and are still working on it

We have decided to use actions for the animation to allow everyone to use his own rigging (shape actions, driven shape keys, lattices...)

You can have a look at our updated wiki page

http://wiki.blender.org/index.php/Requests/lipSync

We also have a temporary demo of our current progress

We have just created few shapes to show how our project's going so far and many things are still under development.

click right >> "save target as" , and open it with VLC: http://discoveryblender.tuxfamily.org/l ... p-demo.mov

once again, all comments are welcome
thank you for your interest on the project

bye

bat3a
Posts: 0
Joined: Sat May 15, 2010 6:09 pm

Post by bat3a » Sun Dec 05, 2010 1:47 am

what happened to this projects it a very nice one did it make it to blender or not

Post Reply