ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University

ISMAR 2009 the world’s best augmented reality event starts in 3 days!

If you are still contemplating whether to go – check out what you might be missing on our preview post.

The folks from the Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ are preparing a real treat for ISMAR 2009 participants.

Sketch recognition (already covered in our previous post) is a major break away from “ugly” markers or NFT  (tracking natural 2d images). It is the dawn of user generated content for Augmented Reality, and an intuitive new interaction approach for changing the CONTENT overlaid on a marker. Big wow.

In-Place 3D Sketching

But the team lead by Nate Hagbi and Oriel Bergig (with support from Jihad El-Sana and Mark Billinghurst) is just warming up…In the next video Nate shows how any sketch you draw on a paper (or even on your hand!) can be tracked.

So are you telling me I won’t need to print stuff every time I want to play with augmented reality?
-That’s right! Hug a tree and save some ink!

Shape Recognition and Pose Estimation

But wait, there is more!

Nate says this demo already runs on an iPhone.

And to prove it, he is willing to share the code used to access the live video on iPhone 3.0.
(note: this code accesses a private API on the iPhone SDK)

Ready for the BIG NEWS?

For the first time ever, the core code necessary for real augmented reality “(real” here means precise alignment of graphics overlaid on real life objects) on iPhone 3.0 is available to the public.

To get access to the source code – send us an email.

May a thousand augmented reality apps bloom!

About these ads

43 Responses

  1. Amazing stuff. That destroyes the whole idea of the fiduciary marker and instead replaces it with a more natural input device – the pen.

  2. Fantastic stuff.
    I have seen components of this stuff before elsewhere…in 2d…without AR.
    But to have it all together is very powerfull.

    This is a wonderfull example of how amazing AR can be. On the fly sketching of ideas and designs, running simulations on these 3d sketchs and shareing the results in realtime….all possible very soon.

  3. [...] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented [...]

  4. makes me want to join HIT Lab NZ or VML, whichever is closer :)

  5. I know that I should put a comment but the truth is that I am speechless

  6. Awesome!

    Makes me want to learn iPhone programming! Is this code of any use for non-programmers?

  7. hi
    this is pretty cool.
    There was a paper in ISMAR last year including Tom Drummond at Cambridge that put the powerful recognition and tracking algorithms sift and fern on a phone. That should really open up arbitrary objects for targets not just drawn shapes. Maybe this system does that already.

  8. This is interesting, and a nice demo; but, the reporting here does seem to be a bit misleading in that none of these videos appear to be recorded from the iPhone. The sketch stuff, and the tracking off non-square markers, is cool, though (nice to see it out, they’ve been working on stuff like this for a while!). But, accessing video on the iPhone is slow, and the video quality sucks (nothing like the Tegra dev kit we used for ARhrrrr, for example).

    Lots of folks have been doing AR on iPhone 3.0 (well, we have, and I know some of our partners have) (and, yes, we’ll have some demos in our pockets at ISMAR, too).

    I’d love to look at their video access code, to see how it compares to what we have (and what we’ve shared with various of our partners over the past few months).

  9. [...] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented [...]

  10. So, when will we see the demo / full-version in the appstore, cydia etc ?

  11. [...] but what if we combined AR with a hacked iPhone API to produce “true” AR? According to Games Alfresco the guys from Visual Media Lab at Ben Gurion University (in collaboration with HIT Lab NZ) have [...]

  12. [...] HIT Lab NZ との共同研究の結果を ARスペシャルブログ Games Alfresco [...]

  13. [...] le vere notizie bomba iniziano adesso: Nate Hagbi e Oriel Bergig hanno dichiarato in esclusiva a Ori Imbar di Gamesalfresco che tutto ciò gira tranquillamente su [...]

  14. [...] well, get ready for a change. some enterprising ppl have figured out the API concerning iphone video and promise to release it to the public. [...]

  15. [...] good news for developers is the following, quoted from the GamesAlfresco blog: For the first time ever, the core code necessary for real augmented reality “(real” here means [...]

  16. [...] El Laboratorio de Medios Visuales en la Universidad Ben Gurion, en colaboración con HIT Lab NZ escribió el código en cuestión y dio a conocer junto con demostraciones de vídeo en el blog especialista en Realidad Aumentada Games Alfresco. [...]

  17. [...] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented [...]

  18. [...] Terrific coverage: ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University [...]

  19. [...] The Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ wrote the code in question, and for the time being it’s being distributed for its creators by Ori Inbar. You can request the code by emailing him (address available at GamesAlfresco). [...]

  20. [...] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented [...]

  21. [...] Posts ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion UniversityTop 10 augmented reality demos that will revolutionize video gamesISMAR 2009: Sneak Preview of Demos [...]

  22. Has anyone been given access to the source code?

    I sent an email to the listed address several days ago and have not received any kind of response.

    Thanks!

  23. [...] for more on this (pic below from Games Alfresco). AR Sketch, Ori notes, is featured “in our top post and popular video.” [...]

  24. @frank: i havnt received any kind of response either …

  25. Very nice work. Do you plan to make the code public under opensource license?

  26. [...] wrong. by Hughes, T. • Augmented reality set for major growth: ABI Research. by Harnick, C. • Top ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University. by Inbar, O. • Augmented reality apps: A business model. by MacAdams, M. • The Experience [...]

  27. [...] Shape Recognition and Pose Estimation for Mobile (!) Augmented Reality [...]

  28. Fantastic stuff!

  29. @Richard and Frank : i haven’t receveid response either…

  30. Code came today, but its (only) the video private API layer (not the 3d stuff) . I’ve gotten it to compile, but it crashes the phone at the moment. hoped there would be a step by step on here. Anyone ?

  31. [...] exemple des travaux du Visual Media Lab de l’université Ben Gourion en Israël, relayés par Games Alfresco. Ici, il suffit de tracer quelques lignes sur le papier pour que les dessins soient reconnus par le [...]

  32. Hi,

    cool!

    i’m waiting de source code, someone could send me?

  33. Hi,

    I’m waiting the source code too, someone could send me ?

  34. [...] marker: Best student paper award went to Oriel, Nate et al. for AR Sketch (which featured in our top post and popular video). Their work is revolutionizing the AR world by avoiding the need to print [...]

  35. Wow. So how does one get the source I emailed comogard@gmail.com twice over one month. Is there any other way to get the source? Has anyone downloaded it yet?

  36. [...] The Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ wrote the code in question, and for the time being it’s being distributed for its creators by Ori Inbar. You can request the code by emailing him (address available at GamesAlfresco). [...]

  37. [...] are some projects I got my inspiration from: EdgeBomber, Laser Sound test, Phun, Crayon Physics, 2d Sketches becomes 3d Reality, ILoveSketch, MotionBeam, Tangible Fire [...]

  38. hi!

    ….source code….
    ……

  39. Exactly what is the point of “ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University Games Alfresco” ?

  40. Great!!

    can i have the source code?

  41. [...] marker: Best student paper award went to Oriel, Nate et al. for AR Sketch (which featured in our top post and popular video). Their work is revolutionizing the AR world by avoiding the need to print [...]

  42. how can i have the source code?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

%d bloggers like this: