Camera Calibration thru Python proposal

Scripting in Blender with Python, and working on the API

Moderators: jesterKing, stiv

Post Reply
malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Camera Calibration thru Python proposal

Post by malefico » Mon Sep 08, 2003 8:54 pm

I was wondering if would it be possible to code a script in Python which combined with functionalities that Blender already have plus a working algorithm, let us do camera calibration within Blender.

You know, Camera Calibration is the method to get camera position and movement from a video sequence.

The idea would be, using a video as Background image for a camera, add empties (or any other suitable 3D object) as reference points (or features as in some commercial packages). Then going to a different frame, relocate the empties to match the changes in the video and run a script which would take the empties motions to calculate the camera location and rotation that matches accurately (well, more or less) this transformations.

I have surfed a little and found these links which might be useful for the brave coders out there:

http://www.vision.caltech.edu/bouguetj/ ... hesis.html

http://www-2.cs.cmu.edu/People/rgw/TsaiCode.html

I know there are anumber of talented coders here that could do this. I think it would be a nice feature to add to our beloved Blender. My current status as Python (or anything) programmer is "pre-beginner", but willing to help.

Let me know if there are any interested volunteers.

Cheers.

malefico.

PS: I already know there is (or was) Icarus for this.

ilac
Posts: 131
Joined: Mon Oct 14, 2002 8:24 am

Post by ilac » Mon Sep 08, 2003 11:11 pm

John Aughey was once developing such a script for Blender and the demos were pretty impressive! (anybody remembers the animation of a bluish/purplish 3D mech robot in front of a real computer monitor lit using fake HDRI?) As far as I know he had put the project on hold when Nan went down! :?

Don't recall seeing any posts from him since the foundation was established! I've been hoping he would release it at some point!

Fingers still crossed...

malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Post by malefico » Tue Sep 09, 2003 4:47 pm

Wow, that's great. Do you remember his nickname or maybe an email to contact him ?

kino
Posts: 93
Joined: Sun Oct 13, 2002 7:37 pm

Post by kino » Tue Sep 09, 2003 5:22 pm

I'm interested too :)
two more links
these is for augmented reality opersource and camera track
http://www.mic.atr.co.jp/~poup/research/ar/

this is for Max and softimage and it work on linux and win,
maybe can we ask and help for support in blender

http://www.digilab.uni-hannover.de/

kino
kino3d.com italian site

ilac
Posts: 131
Joined: Mon Oct 14, 2002 8:24 am

Post by ilac » Tue Sep 09, 2003 6:18 pm

malefico wrote:Wow, that's great. Do you remember his nickname or maybe an email to contact him ?
Nope, sorry, but afaik he was involved in the development of the python api that was being worked on for NAN 2.25+, so maybe some of the python developers might remember him - ie. if any of the current python developers were also involved back then!

Fingers...
...still crossed! :D

eeshlo
Posts: 73
Joined: Wed Nov 06, 2002 10:02 pm

Post by eeshlo » Tue Sep 09, 2003 6:46 pm

malefico wrote:Do you remember his nickname or maybe an email to contact him ?
As far as I remember it was 'aughey' on the old blender.nl forums, I still have one of the videos he showed as well. I also still have his email address, but don't know if it is still valid.
Anyway, the last I know about this is that just before NaN went bankrupt, he posted a message in the BlenderLeague forum, looking for testers. So it must have been fairly complete, don't know what happened after that, never heard of him again, I think his name is in the Foundation Members list.

malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Post by malefico » Tue Sep 09, 2003 9:48 pm

Well, I sent him an email (thanx eeshlo!) and it didn't bounce, so I'll keep my fingers crossed as ilac :D .

kino: I knew about Camera Tracker from digilab and it would be cool if they could give us support for Blender but wouldn't it be cooler if we had it in Blender and don't depend on somebody else's temperamental license ? (I'm still hurt about Icarus and don't want it to happen again :cry: )

Let me see: here they are eeshlo, kino, ilac... mmm looks like a nice start for something.... :wink:

malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Post by malefico » Wed Sep 10, 2003 12:06 am

John Aughey sent me an email saying he´s too busy to finish the project. He also gave me a link to what he did:

http://www.washucsc.org/~jha/ibl/

I guess most of you already knew that page. Interesting to note is that he did use the Tsai algorithm for camera calibration. It is not a python script at all but a full C++ application for windows.

Well, I'll try to understand the Tsai algorythm and see what can I do. What do you think ? Could we do this as a "community project" or something ?

Cheers.

malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Post by malefico » Wed Sep 10, 2003 5:28 pm

Another interesting reading, who knows, maybe I finished learning maths... :?


http://www.ai.mit.edu/people/bkph/paper ... xplain.pdf (PDF)

http://216.239.51.104/search?q=cache:ZH ... s&ie=UTF-8 (same thing in HTML)

kino
Posts: 93
Joined: Sun Oct 13, 2002 7:37 pm

Post by kino » Wed Sep 10, 2003 8:11 pm

sorry i dont receive email notification
malefico wrote: but wouldn't it be cooler if we had it in Blender and don't depend on somebody else's temperamental license ?
yes will be really cool, i just imagined such apps too much heavy
for python (and users with slow computer)
(I'm still hurt about Icarus and don't want it to happen again :cry: )
me too :cry:
Let me see: here they are eeshlo, kino, ilac... mmm looks like a nice start for something.... :wink:
:) :)
Well, I'll try to understand the Tsai algorythm and see what can I do. What do you think ? Could we do this as a "community project" or something ?
yeeeees please, let me know what i can, if i can :)

ciao
kino
kino3d.com italian site

malefico
Posts: 43
Joined: Mon Oct 14, 2002 6:51 am

Post by malefico » Mon Sep 22, 2003 3:16 pm

Hey great news !

John Aughey has contacted me to tell me he's back working on his camera calibration app which he had abandoned for a while.

He told me he's using some new algorithms and working on an improved user interface using Qt library.-> Yohooo ! Linux stuff too !

He also asked me/us for help to write an import script for his output, which is still unknown for me, so if any of you has some spare time when the time comes, will you give a hand ?

Cheers.

malefico

kino
Posts: 93
Joined: Sun Oct 13, 2002 7:37 pm

Post by kino » Wed Sep 24, 2003 12:53 pm

malefico wrote:Hey great news !

John Aughey has contacted me to tell me he's back working on his camera calibration app which he had abandoned for a while.

He told me he's using some new algorithms and working on an improved user interface using Qt library.-> Yohooo ! Linux stuff too !

He also asked me/us for help to write an import script for his output, which is still unknown for me, so if any of you has some spare time when the time comes, will you give a hand ?

Cheers.

malefico
Really Great news and for linux too 8) 8)

leon is writing an importer for the voodoo 3dmax format
http://www.elysiun.com/forum/viewtopic.php?t=15637

thanks

ciao
kino
kino3d.com italian site

Post Reply