Robert Rice Speaks At MOMA

Robert Rice, the CEO of Neogence Enterprises and blogger of augmented reality on Curious Raven, spoke back in June at Mobile Monday.  His speech targets the intermediate developer of augmented reality.  If you’re new to the technology, most of this speech will go over your head. 

The video is long, but if you’re serious about augmented reality and the future of mobile, the speech hits major points about the industry.  And at 40 minutes, I’d give it a good five minute buffer if you’re going to watch the whole thing.

“Mobile is dead,” said Robert to begin his speech.  He goes on to explain it should be brought back to life in a different format.  Reincarnated, if you will.  The point-to-point communication that we use right now will need transform into an immersive, predictive, meta-enviroment and can’t just be another way to access the internet. 

Robert briefly explains the history of communications and tells us that if we do augmented reality correctly, it’ll join the pantheon.  If we can remove the excess hardware of keyboards and screens in our mobile devices and convert to sunglasses, then the computer can become a buckle or a watch, conspicuous computing.  We need to get away from the 2D mindset of flat screens and create 3D spaces where we can throw a YouTube video to another person through our AR enviroment, or send an SMS as a paper-airplane. 

Augmented reality needs more than graphics over video, Robert goes on to explain.  Should move past being even interactive and more dynamic and meta.  It should answer the who, what, where, when, why and how.  Computers have been vague points of demographic data because multiple people can use them, but mobile is an individual thing which allows us to break away from aggregate statistics and start answering questions for individuals. 

Robert goes on to talk about venture capital, which he believes doesn’t get AR yet, and smart cities, and give suggestions to developers to keep the tagging of the world in mind, so we don’t have to go back and retag later.

Overall, I have to say I enjoyed the speech, though I was hoping Robert would get into specifics about Neogence Enterprises and their recent Mirascape announcement.  And having spoken to him at length at ISMAR09 about the details of augmented reality, I thought he might elaborate on his anecdotes about furries and micro transactions.  But maybe those weren’t appropriate for MOMA, anyway.

(edit note: while this was originally filmed back in June and even covered on GA by Ori, it’s still very relevent.  Enjoy.)

Apple’s iPad Camera Fail

Unless you’ve been living in a box today, you know that Apple finally unveiled the tablet iPad today. The biggest surprise about the announcement was the lack of a camera on the lap sized PC. No camera, really? If you don’t believe it, check the official spec page.

Besides the implications for augmented reality, which I’ll get to in a moment, the iPad not having a camera is a giant fail.  I actually expected the iPad to have two cameras.  One forward-looking so the iPad could function as a giant Polaroid and the other user-facing so videos could be recorded.  We could forgive eliminating one of them, probably the forward-looking one since its so big, but not having the user-facing camera is inexcusable.

The series of tubes we call the Internet has moved beyond simple text.  People want to record and upload videos straight to YouTube without having to yank out their dust-covered hand held or use Skype to call their friends while they’re watching the game.

The Apple iPad not having even one camera is like hooking up satellite without DVR.  Sure you can do it, but why?

Of course, I’m being overly melodramatic here.

The real point to the iPad is competition for the Kindle, eReader and the Nook.  Apple wants to revolutionize the way we read magazines, books and newspapers.  Functionality for augmented reality isn’t even an afterthought.  How many people are using their camera lying in bed reading an interactive book?

And is this a major setback for augmented reality?  Not really.  A giant-sized magic lens would add a fun new canvas to play with, but really wouldn’t be a game changer.  Additionally, Apple isn’t expecting the tablet market to come even close to the smartphone market in sales.

So in the end, the iPad is a fail for augmented reality, but will probably give Jeff Bezos nightmares for months as he wonders how he’s going to compete against a Pentium 286 when he’s selling a Commodore 64.

And maybe, just maybe, Steve Jobs is still working on a see-through AR-enabled HMD.  Then I’d say, all is forgiven Stevie, I’m coming home to Apple.

Spatial Computing Concept Video for Shopping

This summer, Phedhex, posted a concept video showcasing what augmented reality, or spatial computing, could do.  The video was well thought out and I enjoyed it.

In the second video, he uses hand gestures to show how we can use augmented reality to purchase furniture in our homes and verify it for decor and size.  The idea has been around with smartphone apps from Metaio, but Phedhex supersizes the idea and gives us a glimpse into an immersive version we’d see with a HMD.  The production value of the video makes me think Phedhex should be doing a regular series on AR because it shows a tangible business case for increased investment into the fledgling technology. 

Real-Time 3D Modeling for Augmented Reality

I’m a big geek when it comes to the behind-the-scenes number crunching stuff that makes augmented reality happen. How it all works is a fascinating look at dynamic systems in concert. The two videos below show how on the fly modeling of objects can help create a fully interactive world with occlusion, shadows and other 3D illusions needed to created reality out of pixels.

The first comes from the Australian Center for Visual Technologies (ACVT) with a program called Jiim.  It allows in-situ modeling of the enviroment by picking up points and then allowing the user, in real-time, to draw in the world with those points as reference.   The resulting physics demonstration is quite impressive from throwing balls to killing moles.

The second video shows use of the MRToolKit to model a Chinese dragon figure in real-time and then interact with it.  The results aren’t as impressive as the Jimm ACVT video, but still, it’s nice to have options.

Having played around with a few AR systems like Metaio’s Unifeye, I can say that the programs in these videos look easier to interact with than what I’ve used before.  Instead of programming numbers and coordinate systems, the user can mouse click the world into existence.  Imagine if groups of people collectively worked on drawing in a city to create a general playground for augmented reality.  Just add some sweet HMDs and a SDK to create games and AR would be unleashed.

Weird Augmented T-Shirt Game

In a strange Frankenstein stitched together way, this augmented reality product is both a piece of textile covering and a game of rock-paper-scissors.  If that doesn’t make any sense to you then watch the video and see the site for more details. 

Augmented Reality Panel at Web 2.0 Expo and Explosion in AR Meetups

Don’t you love going to conferences that take place in your home town?
And how about being invited to talk about your #1 passion?

Double awesome.

Last November, I was lucky enough to participate in a panel about augmented reality at the Web 2.0 Expo. (In all fairness, it was part of Web2Open co-located with Web 2.0)

The fun actually started the night before at a meetup organized by John Havens which was a great warm up for the real deal.

John also moderated the panel which included the following participants:

Robert Rice, CEO of Neogence delivered as usual a great intro to augmented reality and explained the virtues of the AR Consortium;

Jack Mason (Global Business Services, Strategic Programs and Social Media at IBM)
opened our eyes to the possibilities (and concerns) revolving around AR;

Lynne d Johnson, SVP Social Media at the Advertising Research Foundation and host of the NYC Android Developer’s Meetup showed off the latest AR rage embodied in this week’s Esquire Magazine: the augmented reality issue;

Erik Manley: Manager, Digital Media at GE and Michael Eisenreich: Technology Leader for GE’s company-wide Internet presence – proudly presented what I describe as the first high production augmented reality campaign ever. It’s probably one of the key reasons AR went off the charts on Google trends in the first quarter of the year.

Matt Szymczyk, CEO of Zugara, demonstrated Fashionista, a virtual dressing room his company just launched with Rich Relevance. Who says AR is just a novelty? This is a very Cool and practical use of augmented reality on webcams.

Marco Neumann, CEO and Founder of KONA, and the Organizer for New York Semantic web meet up gave the…semantic web back story behind augmented reality. 

All great guys and gals, enthusiastic about augmented reality, and…doing something about it.

Yours truly gave a little schpiel about Ogmento and demonstrated the upcoming (currently in beta) learning game for the iPhone: Put A Spell Learn to Spell with Augmented Reality.

Here is a video of my 100 slides under 5 minutes intro (seriously):

The crowed was not huge but very engaged. In the spirit of the web2Open unconference most of the interesting discussions happened afterwards.

We will be back at Porter Novelli’s office (Thanks John for hosting once again!) for the upcoming Augmented Reality NY (ARNY) meetup this Tuesday, featuring an amazing line up of speakers and demos:
1) John Swords – Circ.us – his latest AR game developed for Cisco Systems

2) Ryan CharlesZagat– New Augmented Reality view integrated into Zagat’s flagship restaurant rating and review app, Zagat To Go

3) Noora GuldemondMetaio – LEGO application and mobile markerless tracking

4) Dana Farbo – President of Acrossair – will present the fresh new Acrossair AR Browser

5) Craig Kapp – NYU – Whisper Deck – will introduce an experimental interface to access information using AR

These days, AR Meetups are all the rage – sprouting like mushrooms around the globe: From Los Angeles, to Palo Alto, Chicago, Raleigh, Toronto,  London, Manchester, Switzerland, and all the way to New Zealand). Here’s a big shout out to all our friends around the world – and thanks to Chris Grayson – we now have a live stream channel for all AR meetups – so you can participate in real time from the comfort of your home!
(though it’s much more fun being there in person)

Training the Visual Way

A picture is worth a thousand words. 

Homo sapiens are visual creatures.  We receive 75% of our information through our eyes.  Explaining how to do something can be tedious and inefficient.  Augmented reality offers a visual medium for explanation.  This quick demo on how to assemble a LEGO tower using ARToolKit illustrates how effective this technique can be.  If you don’t believe me, give a friend a pile of LEGOs and then try to explain how to create the tower in the video.  Time your result and compare it.  I’ll guarantee the AR method will win.

Augmented Reality for CRPS Treatment

Augmented reality can help create illusions for the mind.  These phantoms are usually considered as avatars or game devices, but using virtual avatars in a real enviroment can also help solve medical issues related to pain.

CRPS, or Complex Region Pain Syndrome, is a chronic pain condition. 

The key symptom of CRPS is continuous, intense pain out of proportion to the severity of the injury, which gets worse rather than better over time. CRPS most often affects one of the arms, legs, hands, or feet.  Often the pain spreads to include the entire arm or leg.  Typical features include dramatic changes in the color and temperature of the skin over the affected limb or body part, accompanied by intense burning pain, skin sensitivity, sweating, and swelling.  Doctors aren’t sure what causes CRPS.  In some cases the sympathetic nervous system plays an important role in sustaining the pain.  Another theory is that CRPS is caused by a triggering of the immune response, which leads to the characteristic inflammatory symptoms of redness, warmth, and swelling in the affected area.

Because pain has roots within the mind, non-typical treatments like mirror work can help reduce discomfort.  The group 09am734 group at AAU have developed an augmented reality solution to the mirror treatment.  Using AR, they can simulate work in the opposite hand forcing the participant to use their pain hand (or appropriate limb.)

This kind of treatment can also work for missing limb patients who are experiencing phantom pain.  It’s good to see applications of AR stepping outside of the normal marketing or reality browsers and solve real medical problems.

Hallmark Launches AR Greeting Cards

Not a big surprise that Hallmark would get into the augmented reality game with a line of AR greeting cards. It makes a lot of sense to add content to a static piece of cardboard. I would suggest they consider adding free smartphone apps to view the cards so people can check them at the birthday table, but it’s a start.

Hallmark Launches Webcam Greetings with Augmented Reality
New cards combine the physical and virtual world
KANSAS CITY, Mo. (Jan. 12, 2010) /PRNewswire/ — Hallmark Cards, Inc., today announced the release of webcam greetings, new cards that use augmented reality technology to bring the card to life on a computer screen.

The person receiving the card can visit www.hallmark.com/extra and follow the directions to be able to view a 3D animated feature by holding the greeting card up to the web camera. The technology breathes a digital life into the card. The animation tracks with the movement of the card, so no matter which way the card is moved, the animation will rotate along in full 3D. In many cards, various scenes appear as the card is turned in different angles in front of the webcam for a range of digital experiences.

“As Hallmark embarks upon our next 100 years in business, it’s important to continually identify new ways to help amplify the emotions our consumers feel when experiencing and sharing our products,” said Monic Muldrew, associate product manager. “With the experience available through these cards that come to life with a webcam, we hope consumers will fully explore and interact with this fun new way to connect.”

The augmented reality enhancements in webcam greetings are unique to the greeting card industry. Ten cards currently are available for Valentine’s Day and, as the year progresses, the company will roll out additional webcam greetings. Most webcam greetings retail for $2.99. Some webcam greetings include a sound clip that plays when the recipient opens the card (clip is audible without going online). These cards retail for $5.99. All webcam greetings are available wherever Hallmark cards are sold.

Vuzix Wrap 920AR Video Eyewear at CES 2010

The Vuzix Wrap 920AR aren’t the sexiest of specs, but they do perform the function of AR glasses. I got a chance to see this setup at ISMAR09 which they’re now showing at CES 2010.

The specs for the glasses look like:

The stereo camera pair delivers a single 1504 x 480 side-by-side image that can be viewed in 3D stereoscopic video, while the video eyewear provides an unprecedented 67-inch display as seen from 10 feet. The Wrap 920AR also includes a 6 Degree-of-Freedom Tracker, which allows for absolute accuracy of roll pitch and yaw and also X, Y and Z positioning in 3D space

Vuzix Wrap 920AR Specifications:

• 1/3-inch wide VGA Digital Image Sensor
• Resolution: 752H x 480W
• Includes 6 Degree-of-Freedom Tracker
• Frame rate: 60 fps
• Dynamic range: >55dB linear; >80-100dB in HiDy mode
• Shutter efficiency: >99%
• ADC Resolution: 10-bit column parallel
• High-speed USB 2.0
• PC and Mac compatible
• System requirements: Windows XP SP2, Windows Vista, Windows7, Mac OS X 10.4.9 or higher
• MSRP: $799.99

[Youtube=http://www.youtube.com/v/lpcyMn6UVKY&amp]

They probably won’t be worn in public anytime soon, but some creative programmers could create interesting house-only interactive avatars or AR spaces. While some might scoff at this idea, see this video from Georgia Tech last year to see how even semi-cheesy graphics can make augmented reality immersive. Having played the old VR game Dactyl Nightmare in the 1990s, the head-tracking really creates the illusion of reality.

[Youtube=http://www.youtube.com/watch?v=h8c6U7dpI7g]

We haven’t seen any developers put together a product that takes advantage of these $800 glasses, but hopes are that exposure at CES 2010 will bring more interest. The only thing I’ve seen using the setup is the Whisper Deck from Craig Kapp.

Maybe later this year we might see some products that would entice the hard core AR enthusiast to fork out the cash for these un-sexy specs.