Real-Time 3D Modeling for Augmented Reality

I’m a big geek when it comes to the behind-the-scenes number crunching stuff that makes augmented reality happen. How it all works is a fascinating look at dynamic systems in concert. The two videos below show how on the fly modeling of objects can help create a fully interactive world with occlusion, shadows and other 3D illusions needed to created reality out of pixels.

The first comes from the Australian Center for Visual Technologies (ACVT) with a program called Jiim.  It allows in-situ modeling of the enviroment by picking up points and then allowing the user, in real-time, to draw in the world with those points as reference.   The resulting physics demonstration is quite impressive from throwing balls to killing moles.

The second video shows use of the MRToolKit to model a Chinese dragon figure in real-time and then interact with it.  The results aren’t as impressive as the Jimm ACVT video, but still, it’s nice to have options.

Having played around with a few AR systems like Metaio’s Unifeye, I can say that the programs in these videos look easier to interact with than what I’ve used before.  Instead of programming numbers and coordinate systems, the user can mouse click the world into existence.  Imagine if groups of people collectively worked on drawing in a city to create a general playground for augmented reality.  Just add some sweet HMDs and a SDK to create games and AR would be unleashed.

3 Responses

  1. Excellent stuff.
    And yes, I can certainly see open-source 3d citys being made this way. Or maybe even, as our soceity increasingly depends apon AR, a full time job.
    Keeping the real and virtual “in sycn” is quite a big task after all.

    I only hope we soon see this technology combined with photo-positioning. Using photos to model mesh’s, create a public database of those mesh’s, then use those mesh’s to position clients down to the mm precision level.

  2. Awesome stuff, this is getting closer to what I daydream of. :) I’ve been trying to do something similar with the PTAM stuff in my own time, looks like I’ve been beaten to it by the experts (surprise surprise).

    We _really_ need those slim high-res HMDs about now please hardware manufacturers!

  3. […] Real-Time 3D Modeling for Augmented Reality « Games Alfresco (tags: augmentedreality) […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: