ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University

ISMAR 2009 the world’s best augmented reality event starts in 3 days!

If you are still contemplating whether to go – check out what you might be missing on our preview post.

The folks from the Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ are preparing a real treat for ISMAR 2009 participants.

Sketch recognition (already covered in our previous post) is a major break away from “ugly” markers or NFT  (tracking natural 2d images). It is the dawn of user generated content for Augmented Reality, and an intuitive new interaction approach for changing the CONTENT overlaid on a marker. Big wow.

In-Place 3D Sketching

But the team lead by Nate Hagbi and Oriel Bergig (with support from Jihad El-Sana and Mark Billinghurst) is just warming up…In the next video Nate shows how any sketch you draw on a paper (or even on your hand!) can be tracked.

So are you telling me I won’t need to print stuff every time I want to play with augmented reality?
-That’s right! Hug a tree and save some ink!

Shape Recognition and Pose Estimation

But wait, there is more!

Nate says this demo already runs on an iPhone.

And to prove it, he is willing to share the code used to access the live video on iPhone 3.0.
(note: this code accesses a private API on the iPhone SDK)

Ready for the BIG NEWS?

For the first time ever, the core code necessary for real augmented reality “(real” here means precise alignment of graphics overlaid on real life objects) on iPhone 3.0 is available to the public.

To get access to the source code – send us an email.

May a thousand augmented reality apps bloom!

55 Responses

  1. Amazing stuff. That destroyes the whole idea of the fiduciary marker and instead replaces it with a more natural input device – the pen.

  2. Fantastic stuff.
    I have seen components of this stuff before elsewhere…in 2d…without AR.
    But to have it all together is very powerfull.

    This is a wonderfull example of how amazing AR can be. On the fly sketching of ideas and designs, running simulations on these 3d sketchs and shareing the results in realtime….all possible very soon.

  3. […] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented […]

  4. makes me want to join HIT Lab NZ or VML, whichever is closer :)

  5. I know that I should put a comment but the truth is that I am speechless

  6. Awesome!

    Makes me want to learn iPhone programming! Is this code of any use for non-programmers?

  7. hi
    this is pretty cool.
    There was a paper in ISMAR last year including Tom Drummond at Cambridge that put the powerful recognition and tracking algorithms sift and fern on a phone. That should really open up arbitrary objects for targets not just drawn shapes. Maybe this system does that already.

  8. This is interesting, and a nice demo; but, the reporting here does seem to be a bit misleading in that none of these videos appear to be recorded from the iPhone. The sketch stuff, and the tracking off non-square markers, is cool, though (nice to see it out, they’ve been working on stuff like this for a while!). But, accessing video on the iPhone is slow, and the video quality sucks (nothing like the Tegra dev kit we used for ARhrrrr, for example).

    Lots of folks have been doing AR on iPhone 3.0 (well, we have, and I know some of our partners have) (and, yes, we’ll have some demos in our pockets at ISMAR, too).

    I’d love to look at their video access code, to see how it compares to what we have (and what we’ve shared with various of our partners over the past few months).

  9. […] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented […]

  10. So, when will we see the demo / full-version in the appstore, cydia etc ?

  11. […] but what if we combined AR with a hacked iPhone API to produce “true” AR? According to Games Alfresco the guys from Visual Media Lab at Ben Gurion University (in collaboration with HIT Lab NZ) have […]

  12. […] HIT Lab NZ との共同研究の結果を ARスペシャルブログ Games Alfresco […]

  13. […] le vere notizie bomba iniziano adesso: Nate Hagbi e Oriel Bergig hanno dichiarato in esclusiva a Ori Imbar di Gamesalfresco che tutto ciò gira tranquillamente su […]

  14. […] well, get ready for a change. some enterprising ppl have figured out the API concerning iphone video and promise to release it to the public. […]

  15. […] good news for developers is the following, quoted from the GamesAlfresco blog: For the first time ever, the core code necessary for real augmented reality “(real” here means […]

  16. […] El Laboratorio de Medios Visuales en la Universidad Ben Gurion, en colaboración con HIT Lab NZ escribió el código en cuestión y dio a conocer junto con demostraciones de vídeo en el blog especialista en Realidad Aumentada Games Alfresco. […]

  17. […] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented […]

  18. […] Terrific coverage: ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University […]

  19. […] The Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ wrote the code in question, and for the time being it’s being distributed for its creators by Ori Inbar. You can request the code by emailing him (address available at GamesAlfresco). […]

  20. […] the code in question and unveiled it along with video demonstrations at the AR-specialist blog Games Alfresco today. The unveiling comes just days before the International Symposium on Mixed and Augmented […]

  21. […] Posts ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion UniversityTop 10 augmented reality demos that will revolutionize video gamesISMAR 2009: Sneak Preview of Demos […]

  22. Has anyone been given access to the source code?

    I sent an email to the listed address several days ago and have not received any kind of response.

    Thanks!

  23. […] for more on this (pic below from Games Alfresco). AR Sketch, Ori notes, is featured “in our top post and popular video.” […]

  24. @frank: i havnt received any kind of response either …

  25. Very nice work. Do you plan to make the code public under opensource license?

  26. […] wrong. by Hughes, T. • Augmented reality set for major growth: ABI Research. by Harnick, C. • Top ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University. by Inbar, O. • Augmented reality apps: A business model. by MacAdams, M. • The Experience […]

  27. […] Shape Recognition and Pose Estimation for Mobile (!) Augmented Reality […]

  28. Fantastic stuff!

  29. @Richard and Frank : i haven’t receveid response either…

  30. Code came today, but its (only) the video private API layer (not the 3d stuff) . I’ve gotten it to compile, but it crashes the phone at the moment. hoped there would be a step by step on here. Anyone ?

  31. […] exemple des travaux du Visual Media Lab de l’université Ben Gourion en Israël, relayés par Games Alfresco. Ici, il suffit de tracer quelques lignes sur le papier pour que les dessins soient reconnus par le […]

  32. Hi,

    cool!

    i’m waiting de source code, someone could send me?

  33. Hi,

    I’m waiting the source code too, someone could send me ?

  34. […] marker: Best student paper award went to Oriel, Nate et al. for AR Sketch (which featured in our top post and popular video). Their work is revolutionizing the AR world by avoiding the need to print […]

  35. Wow. So how does one get the source I emailed comogard@gmail.com twice over one month. Is there any other way to get the source? Has anyone downloaded it yet?

  36. […] The Visual Media Lab at Ben Gurion University in collaboration with HIT Lab NZ wrote the code in question, and for the time being it’s being distributed for its creators by Ori Inbar. You can request the code by emailing him (address available at GamesAlfresco). […]

  37. […] are some projects I got my inspiration from: EdgeBomber, Laser Sound test, Phun, Crayon Physics, 2d Sketches becomes 3d Reality, ILoveSketch, MotionBeam, Tangible Fire […]

  38. hi!

    ….source code….
    ……

  39. Exactly what is the point of “ISMAR 2009: Sketch and Shape Recognition Preview From Ben Gurion University Games Alfresco” ?

  40. Great!!

    can i have the source code?

  41. […] marker: Best student paper award went to Oriel, Nate et al. for AR Sketch (which featured in our top post and popular video). Their work is revolutionizing the AR world by avoiding the need to print […]

  42. how can i have the source code?

  43. Well written!|
    I’ll immediately seize your rss as I can’t in finding your email subscription
    hyperlink or newsletter service. Do you have any?
    Please allow me recognise in order that I may subscribe.

    Thanks.|
    It is the best time to make some plans for the future and it is time to be happy.
    I have read this post and if I could I want to suggest you some interesting things or tips.
    Maybe you can write next articles referring to this article.
    I desire to read even more things about it!|
    It is perfect time to make a few plans for the long run and it’s time to be happy.

    I have learn this put up and if I could I want to counsel you
    some interesting things or tips. Perhaps you can write
    next articles regarding this article. I want to learn more things approximately it!|
    I’ve been browsing online greater than 3 hours as of late, yet I by
    no means discovered any interesting article like yours. It is
    lovely worth sufficient for me. In my view, if all website owners and bloggers made excellent content as you probably did, the web shall be much more helpful than
    ever before.|
    Ahaa, its good discussion on the topic of this article at this
    place at this website, I have read all that, so now me also commenting
    at this place.|
    I am sure this article has touched all the internet
    users, its really really pleasant paragraph on building up new
    weblog.|
    Wow, this post is pleasant, my sister is analyzing such things, thus I am going to convey her.|
    Saved as a favorite, I really like your blog!|
    Way cool! Some extremely valid points! I appreciate you penning this article and also the rest of the site is also very good.|
    Hi, I do think this is an excellent website. I stumbledupon it ;)
    I am going to revisit once again since I book marked it.
    Money and freedom is the greatest way to change, may you
    be rich and continue to help other people.|
    Woah! I’m really enjoying the template/theme of this website.

    It’s simple, yet effective. A lot of times it’s difficult to get that “perfect balance” between user
    friendliness and visual appearance. I must say
    you have done a amazing job with this. Also, the blog loads super quick for me on Safari.
    Excellent Blog!|
    These are truly fantastic ideas in about blogging. You have touched some nice points here.
    Any way keep up wrinting.|
    I really like what you guys tend to be up too. This kind
    of clever work and exposure! Keep up the wonderful works guys I’ve incorporated you guys to blogroll.|
    Hi there! Someone in my Facebook group shared this
    website with us so I came to take a look. I’m definitely loving the information.
    I’m book-marking and will be tweeting this to my followers!
    Exceptional blog and superb style and design.|
    I love what you guys are up too. This type of clever work
    and coverage! Keep up the good works guys I’ve included you guys to our blogroll.|
    Howdy would you mind sharing which blog platform
    you’re working with? I’m looking to start my own blog in
    the near future but I’m having a hard time
    choosing between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your layout seems different then most blogs and I’m looking for
    something unique. P.S Sorry for being off-topic but I had to ask!|
    Hi would you mind letting me know which hosting company you’re utilizing?

    I’ve loaded your blog in 3 different web browsers and I must say this blog loads a lot quicker then most.
    Can you suggest a good internet hosting provider at a reasonable price?
    Thanks a lot, I appreciate it!|
    Everyone loves it when people come together and share views.
    Great blog, keep it up!|
    Thank you for the auspicious writeup. It in fact was a amusement account it.
    Look advanced to far added agreeable from you!
    However, how could we communicate?|
    Hi there just wanted to give you a quick heads up. The text in your content seem to be running
    off the screen in Safari. I’m not sure if this is a formatting issue or something to do with browser compatibility but I figured I’d post to let you know.
    The design and style look great though! Hope you get the issue fixed soon.
    Cheers|
    This is a topic that is near to my heart… Many thanks! Where are your contact details though?|
    It’s very trouble-free to find out any topic on web as compared to books, as I found
    this paragraph at this web site.|
    Does your site have a contact page? I’m having a tough time
    locating it but, I’d like to send you an email. I’ve got some ideas
    for your blog you might be interested in hearing. Either way, great site and I
    look forward to seeing it grow over time.|
    Hola! I’ve been reading your website for a long time now and finally
    got the bravery to go ahead and give you a shout
    out from New Caney Texas! Just wanted to say keep up the
    fantastic work!|
    Greetings from Ohio! I’m bored to tears at work so I decided to check out your site on my iphone during lunch break.
    I really like the info you provide here and can’t wait to take a look when I get home.
    I’m shocked at how quick your blog loaded on my cell phone ..
    I’m not even using WIFI, just 3G .. Anyhow, great blog!|
    Its such as you learn my mind! You appear to know a lot about this, like you
    wrote the book in it or something. I think that you can do with some p.c.

    to force the message house a little bit,
    but instead of that, that is great blog. A fantastic read.
    I’ll definitely be back.|
    I visited many websites except the audio feature for
    audio songs existing at this site is truly fabulous.|
    Hi there, i read your blog from time to time and
    i own a similar one and i was just curious if you get a lot of spam responses?
    If so how do you prevent it, any plugin or anything you can recommend?
    I get so much lately it’s driving me mad so any support is very much appreciated.|
    Greetings! Very useful advice in this particular post!
    It’s the little changes that will make the most important changes.

    Thanks a lot for sharing!|
    I absolutely love your site.. Pleasant colors & theme.
    Did you develop this amazing site yourself?
    Please reply back as I’m planning to create my own
    personal blog and would love to learn where you got this from
    or just what the theme is named. Cheers!|
    Hi there! This blog post couldn’t be written much better!
    Looking through this post reminds me of my previous roommate!
    He always kept talking about this. I’ll send
    this post to him. Fairly certain he’s going to have a
    very good read. Thanks for sharing!|
    Incredible! This blog looks exactly like
    my old one! It’s on a entirely different subject but it has pretty much the
    same layout and design. Outstanding choice of colors!|
    There’s definately a lot to know about this subject.
    I love all of the points you made.|
    You’ve made some good points there. I checked on the net to find out more about the issue and found most individuals will
    go along with your views on this site.|
    Hello, I log on to your blogs on a regular basis.

    Your writing style is awesome, keep it up!|
    I simply could not leave your web site prior to suggesting that I
    extremely loved the standard info a person provide to your visitors?
    Is gonna be again ceaselessly in order to check
    up on new posts|
    I wanted to thank you for this wonderful read!!
    I definitely enjoyed every bit of it. I have you saved as a favorite to
    check out new things you post…|
    Hi, just wanted to tell you, I enjoyed this post. It was funny.
    Keep on posting!|
    I drop a comment whenever I like a post on a site or if I have
    something to valuable to contribute to the discussion.
    It is triggered by the fire displayed in the article I browsed.
    And on this article ISMAR 2009: Sketch and Shape Recognition Preview
    From Ben Gurion University | Games Alfresco.
    I was actually moved enough to drop a thought ;-) I
    actually do have a couple of questions for you if it’s okay.
    Could it be only me or does it look as if like some of these comments come across
    as if they are written by brain dead individuals? :
    -P And, if you are writing at additional places, I would like to follow you.

    Could you list the complete urls of your shared pages like your Facebook page, twitter feed, or linkedin profile?|
    Hi there, I enjoy reading all of your post. I like to write a little comment to support you.|
    I always spent my half an hour to read this webpage’s articles daily along with
    a mug of coffee.|
    I constantly emailed this website post page to all
    my friends, since if like to read it after that my friends
    will too.|
    My programmer is trying to convince me to move to .net from PHP.
    I have always disliked the idea because of the expenses.
    But he’s tryiong none the less. I’ve been using WordPress on numerous websites for about a year and am worried about switching to another platform.

    I have heard good things about blogengine.net.

    Is there a way I can import all my wordpress posts into it?
    Any kind of help would be greatly appreciated!|
    Good day! I could have sworn I’ve visited this website before but after
    going through many of the posts I realized it’s new to me.
    Regardless, I’m certainly happy I came across it and I’ll be book-marking it and checking
    back often!|
    Great work! That is the type of information that should be shared around the web.

    Disgrace on Google for not positioning this publish upper!
    Come on over and seek advice from my web site . Thanks =)|
    Heya i’m for the first time here. I came across this board and I
    find It really useful & it helped me out a lot. I hope to give something
    back and aid others like you helped me.|
    Howdy, I think your website could be having internet browser compatibility issues.

    When I look at your site in Safari, it looks fine however, when opening in Internet
    Explorer, it’s got some overlapping issues. I just wanted to provide you with a quick heads
    up! Besides that, great website!|
    A person essentially assist to make severely articles I’d state.

    This is the first time I frequented your web page
    and so far? I amazed with the analysis you made to create this actual publish extraordinary.
    Fantastic job!|
    Heya i am for the primary time here. I found this
    board and I find It really useful & it helped me out a lot.
    I am hoping to offer one thing back and aid others such as
    you helped me.|
    Hey there! I simply want to give you a huge thumbs up for the excellent
    information you have got right here on this post.
    I’ll be coming back to your site for more soon.|
    I every time used to read article in news papers
    but now as I am a user of net so from now I am using
    net for content, thanks to web.|
    Your means of telling all in this article is really good, every one be able
    to simply be aware of it, Thanks a lot.|
    Hello there, I discovered your website via Google at the same time as searching for a related matter, your site
    got here up, it seems to be good. I have bookmarked it in my
    google bookmarks.
    Hello there, just changed into aware of your blog thru Google, and found
    that it’s truly informative. I’m gonna watch out for brussels.
    I’ll be grateful in case you proceed this in future.
    A lot of other folks can be benefited out of your writing.

    Cheers!|
    I am curious to find out what blog system you’re working
    with? I’m experiencing some small security issues with my latest blog and I would like to find something more secure.
    Do you have any suggestions?|
    I am really impressed with your writing skills and also with
    the layout on your weblog. Is this a paid theme or did you modify it yourself?
    Either way keep up the nice quality writing, it is rare
    to see a great blog like this one nowadays.|
    I am extremely impressed together with your writing skills and also
    with the structure to your blog. Is this a paid subject or did you modify it yourself?
    Either way keep up the nice quality writing, it’s rare
    to see a nice weblog like this one today..|
    Hi, Neat post. There’s a problem along with your web
    site in web explorer, might check this? IE still is the market leader and
    a good part of people will leave out your excellent writing because of this problem.|
    I’m not sure where you are getting your info, but good topic.
    I needs to spend some time learning much more or understanding more.
    Thanks for wonderful info I was looking for this information for my mission.|
    Hello, i think that i saw you visited my site thus i
    came to “return the favor”.I’m attempting to find things to enhance my
    web site!I suppose its ok to use a few of your ideas!!\

  44. May I simply say what a relief to unmcover an individual who genuinely understands what they’re dealig with online.

    You definitely have learned to bring an issue to lighjt and
    make it important. More people ought to understand this and fully gdasp this
    side of this story.I was surpprised you are not most liked since you certainly experience tthe gift.

  45. There is ϲertainly a lot to find out aƅout
    this topic. I like all the points you’ve made.

  46. I prefer it when anyokne come together and share ideas.
    Great website, keep it up!

  47. Spot on due to this write-up, I absolutely believe
    this great site needs a lot more attention. I’ll likely
    be to come back read through more, many thanks
    for the information!

  48. I come from China, to see the video was very surprised.You can send me a code to study?thank you

  49. I come from China, to see the video was very surprised.You can send me a code to study?thank you .email is 291774803@qq.com

Leave a comment