Spatial Computing Concept Video for Shopping

This summer, Phedhex, posted a concept video showcasing what augmented reality, or spatial computing, could do.  The video was well thought out and I enjoyed it.

In the second video, he uses hand gestures to show how we can use augmented reality to purchase furniture in our homes and verify it for decor and size.  The idea has been around with smartphone apps from Metaio, but Phedhex supersizes the idea and gives us a glimpse into an immersive version we’d see with a HMD.  The production value of the video makes me think Phedhex should be doing a regular series on AR because it shows a tangible business case for increased investment into the fledgling technology. 

Real-Time 3D Modeling for Augmented Reality

I’m a big geek when it comes to the behind-the-scenes number crunching stuff that makes augmented reality happen. How it all works is a fascinating look at dynamic systems in concert. The two videos below show how on the fly modeling of objects can help create a fully interactive world with occlusion, shadows and other 3D illusions needed to created reality out of pixels.

The first comes from the Australian Center for Visual Technologies (ACVT) with a program called Jiim.  It allows in-situ modeling of the enviroment by picking up points and then allowing the user, in real-time, to draw in the world with those points as reference.   The resulting physics demonstration is quite impressive from throwing balls to killing moles.

The second video shows use of the MRToolKit to model a Chinese dragon figure in real-time and then interact with it.  The results aren’t as impressive as the Jimm ACVT video, but still, it’s nice to have options.

Having played around with a few AR systems like Metaio’s Unifeye, I can say that the programs in these videos look easier to interact with than what I’ve used before.  Instead of programming numbers and coordinate systems, the user can mouse click the world into existence.  Imagine if groups of people collectively worked on drawing in a city to create a general playground for augmented reality.  Just add some sweet HMDs and a SDK to create games and AR would be unleashed.

Weird Augmented T-Shirt Game

In a strange Frankenstein stitched together way, this augmented reality product is both a piece of textile covering and a game of rock-paper-scissors.  If that doesn’t make any sense to you then watch the video and see the site for more details. 

Training the Visual Way

A picture is worth a thousand words. 

Homo sapiens are visual creatures.  We receive 75% of our information through our eyes.  Explaining how to do something can be tedious and inefficient.  Augmented reality offers a visual medium for explanation.  This quick demo on how to assemble a LEGO tower using ARToolKit illustrates how effective this technique can be.  If you don’t believe me, give a friend a pile of LEGOs and then try to explain how to create the tower in the video.  Time your result and compare it.  I’ll guarantee the AR method will win.

Augmented Reality for CRPS Treatment

Augmented reality can help create illusions for the mind.  These phantoms are usually considered as avatars or game devices, but using virtual avatars in a real enviroment can also help solve medical issues related to pain.

CRPS, or Complex Region Pain Syndrome, is a chronic pain condition. 

The key symptom of CRPS is continuous, intense pain out of proportion to the severity of the injury, which gets worse rather than better over time. CRPS most often affects one of the arms, legs, hands, or feet.  Often the pain spreads to include the entire arm or leg.  Typical features include dramatic changes in the color and temperature of the skin over the affected limb or body part, accompanied by intense burning pain, skin sensitivity, sweating, and swelling.  Doctors aren’t sure what causes CRPS.  In some cases the sympathetic nervous system plays an important role in sustaining the pain.  Another theory is that CRPS is caused by a triggering of the immune response, which leads to the characteristic inflammatory symptoms of redness, warmth, and swelling in the affected area.

Because pain has roots within the mind, non-typical treatments like mirror work can help reduce discomfort.  The group 09am734 group at AAU have developed an augmented reality solution to the mirror treatment.  Using AR, they can simulate work in the opposite hand forcing the participant to use their pain hand (or appropriate limb.)

This kind of treatment can also work for missing limb patients who are experiencing phantom pain.  It’s good to see applications of AR stepping outside of the normal marketing or reality browsers and solve real medical problems.

Hallmark Launches AR Greeting Cards

Not a big surprise that Hallmark would get into the augmented reality game with a line of AR greeting cards. It makes a lot of sense to add content to a static piece of cardboard. I would suggest they consider adding free smartphone apps to view the cards so people can check them at the birthday table, but it’s a start.

Hallmark Launches Webcam Greetings with Augmented Reality
New cards combine the physical and virtual world
KANSAS CITY, Mo. (Jan. 12, 2010) /PRNewswire/ — Hallmark Cards, Inc., today announced the release of webcam greetings, new cards that use augmented reality technology to bring the card to life on a computer screen.

The person receiving the card can visit www.hallmark.com/extra and follow the directions to be able to view a 3D animated feature by holding the greeting card up to the web camera. The technology breathes a digital life into the card. The animation tracks with the movement of the card, so no matter which way the card is moved, the animation will rotate along in full 3D. In many cards, various scenes appear as the card is turned in different angles in front of the webcam for a range of digital experiences.

“As Hallmark embarks upon our next 100 years in business, it’s important to continually identify new ways to help amplify the emotions our consumers feel when experiencing and sharing our products,” said Monic Muldrew, associate product manager. “With the experience available through these cards that come to life with a webcam, we hope consumers will fully explore and interact with this fun new way to connect.”

The augmented reality enhancements in webcam greetings are unique to the greeting card industry. Ten cards currently are available for Valentine’s Day and, as the year progresses, the company will roll out additional webcam greetings. Most webcam greetings retail for $2.99. Some webcam greetings include a sound clip that plays when the recipient opens the card (clip is audible without going online). These cards retail for $5.99. All webcam greetings are available wherever Hallmark cards are sold.

Vuzix Wrap 920AR Video Eyewear at CES 2010

The Vuzix Wrap 920AR aren’t the sexiest of specs, but they do perform the function of AR glasses. I got a chance to see this setup at ISMAR09 which they’re now showing at CES 2010.

The specs for the glasses look like:

The stereo camera pair delivers a single 1504 x 480 side-by-side image that can be viewed in 3D stereoscopic video, while the video eyewear provides an unprecedented 67-inch display as seen from 10 feet. The Wrap 920AR also includes a 6 Degree-of-Freedom Tracker, which allows for absolute accuracy of roll pitch and yaw and also X, Y and Z positioning in 3D space

Vuzix Wrap 920AR Specifications:

• 1/3-inch wide VGA Digital Image Sensor
• Resolution: 752H x 480W
• Includes 6 Degree-of-Freedom Tracker
• Frame rate: 60 fps
• Dynamic range: >55dB linear; >80-100dB in HiDy mode
• Shutter efficiency: >99%
• ADC Resolution: 10-bit column parallel
• High-speed USB 2.0
• PC and Mac compatible
• System requirements: Windows XP SP2, Windows Vista, Windows7, Mac OS X 10.4.9 or higher
• MSRP: $799.99

[Youtube=http://www.youtube.com/v/lpcyMn6UVKY&amp]

They probably won’t be worn in public anytime soon, but some creative programmers could create interesting house-only interactive avatars or AR spaces. While some might scoff at this idea, see this video from Georgia Tech last year to see how even semi-cheesy graphics can make augmented reality immersive. Having played the old VR game Dactyl Nightmare in the 1990s, the head-tracking really creates the illusion of reality.

[Youtube=http://www.youtube.com/watch?v=h8c6U7dpI7g]

We haven’t seen any developers put together a product that takes advantage of these $800 glasses, but hopes are that exposure at CES 2010 will bring more interest. The only thing I’ve seen using the setup is the Whisper Deck from Craig Kapp.

Maybe later this year we might see some products that would entice the hard core AR enthusiast to fork out the cash for these un-sexy specs.

Augmented Reality at CES 2010

Thursday begins the Consumer Electronics Show 2010, the gadget-head show of the year.  While the Nexus One has all the buzz going into the show and 3D TV will probably be the talk of it, readers of Games Alfresco will want to know what to expect from CES2010 for augmented reality. 

Overall, there’s not going to be any big surprises for augmented reality, but there will be some products that will help further the cause. 

AR Drone

The combination of self-adjusting mini-helicopter and augmented reality interface has turned this little toy into quite the buzz maker pre-show for the device maker Parrot (so much so the website is currently crashed due to traffic.)  The drone has two cameras that can connect to an iPhone or iTouch through a wi-fi network. 

The Drone was introduced Tuesday and attracted the biggest crowd.  This creative application of AR really shows what’s possible using well placed cameras and some ingenuity.  The price or released date hasn’t been announced but it’s expected in late 2010. 

Tablets

Microsoft & HP are expected to release a tablet during the 2010 show while Apple plans to release theirs afterwards.  Tablets are interactive stylish screens that are supposed to be the next wave of portable computers.  Their built-in webcam, wi-fi, processor speeds and portability will give augmented reality the option to upside the “magic lens.”  Redmondpie website has supposed leaked specifications that include a projector which would allow Sixth Sense type AR. 

The supposed iSlate or iPad (really how hard is it to sound like you’ve found leaked Apple information by adding an “i” in front of a random techy word) will need to have GPS, accelerometer, and a compass to truly be AR ready.  Otherwise, the only thing the tablet will be able to do is object recognition and marker-based AR. 

TVs with Cameras

The stealthier possible boon for augmented reality might be in the form infusing TVs with computer sensibilities.  The Skype tool is looking to add webcams to HD TVs for video-calls.  With TVs having wi-fi access, computer processors and downloadable widgets, TV-apps could be a huge market for augmented reality.  The technology would have to be marker and object recognition based, but the stationary setting could allow for creative products like the Sony EyePet without having to fork-out $400 for the PS3.  I’m sure the furry-crowd would love to talk to each other on video-Skype, augmented to look like their favorite animal. 

In general, we’re not going to have an OMFG moment from the CES 2010.  There could be a few surprises similar to the AR Drone, but mostly we’ll grind out more processing power, camera speeds and other un-sexy improvements that will help make augmented reality better.

What I Want For Augmented Reality in 2010

I was going to expand on my predictions that Rouli had posted on Games Alfresco because, frankly, they were pretty lame (mine and not the other nine, those were good.)  But decided that there have been enough predictions for 2010.  So instead, I want to go over the things I want to happen in 2010 in regards to augmented reality.   

1. I want the Nexus One phone from Google to be untethered, cheap and make AR apps fun.

2. I want to be surprised by an AR ready HMD.

3. I want to see fun, creative AR games that are across all platforms and come at an affordable price. 

4. I want the AR inspection assist project I’m working on with Metaio to go flawlessly and for it to revolutionize the way we do difficult inspection job at Toyota and make it easier on our team members. 

5. I want Google Goggles to be a database that other programs can use for pattern recognition and markerless tracking.

6. I want to attend ISMAR10 even though its all the way over in South Korea.

7. I want the ISMAR09 presentations to be put up on YouTube so we can see all the great things that happened.

8. I want Apple to free their live video API for better AR on the iPhone.

9. I want to know what Neogence Enterprises has been working on all these years. 

10. I want to continue to make Games Alfresco the hands-down, defacto source for all your augmented reality news. 

So for all you programmers and entrepreneurs working on the latest in augmented reality tech, even though I may put up your YouTube video or link to your webpage and make semi-snarky comments about its usefulness or how its so-2009, I certainly appreciate your hard work.  Unless you were just mailing it in hoping to capitalize on the AR buzz, then you deserve it and then some.  For all of you in the former category, I leave you with my two favorite quotes to keep you going when things get tough:

All courses of action are risky, so prudence is no in avoiding danger (it’s impossible), but calculating risk and acting decisively.  Make mistakes of ambition and not mistakes of sloth.  Develop the strength to do bold things, not the strength to suffer. 

   — Niccolo Machiavelli, The Prince

IT IS NOT THE CRITIC WHO COUNTS: not the man who points out how the strong man stumbles, or where the doer of deeds could have done them better.  The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood, who strives valiantly, who errs and comes up short again and again…who spends himself in a worthy cause; who, at the best, knows, in the end, the triumph of high achievement, and who at the worst, if he fails, at least fails while daring greatly. 

   — Teddy Roosevelt

Apple See-Through Augmented Reality HMD Glasses

The January issue of Mac Life sports a fauxtograph of possible Apple augmented reality HMD glasses. It’s hard to know how much of this article is based on concept, but Apple working on an AR HMD would be a huge jumpstart to the nascent technology.

In mid-April of 2008, Apple published a patent for a “Head Mounted Display System.”  The patent shows screens and fiber optics and vision imaging controls.  Would the display use pico projection or utilize OLED displays?  Pico displays could be used right now, but OLEDs might be a year out.

Would Apple make HMD goggle for augmented reality?  Looking back at this 2006 interview on MacSimumNews, we can see that Steve Jobs was already considering it.  Given that he also denies Apple is looking at a HMD practically guarantees they have something in the works. 

Jobs: Yes, you want a nice big screen so that you can see lots of music and you can pick out what you want, versus a tiny little screen. But then again, you want the screen to be small so that you can put it in your pocket. Actually, discovering and buying music on a computer and downloading it to the iPod—in our opinion, that’s one of the geniuses of the iPod. So you can look at changing that—and maybe that will happen over time—but I think the experience you’ll get on a device optimized for putting in your pocket is going to be far less satisfactory than on a personal computer. You may still want to do that [on a small screen] occasionally, but I don’t think it’s ever going to mean that you can not have some other device that is your primary device for buying and cataloguing music.

Swisher: What would solve that? Can it be solved?

Jobs: Rollable screens, goggles you can put on; I don’t know. It’s not on the horizon.

Given Apple’s trademark secrecy, it’s a huge unknown if MacLife’s article is pure speculation or its based on some real knowledge.  We do know that Apple has patented aspects of an AR HMD, so it’s not crazy to think they might come out with one.  With tons of augmented reality applications hitting the market, I can’t imagine that Apple will wait too long to unveil their AR glasses to grab a critical market lead.  All the pieces of the technology are available as we speak and I’m not the only one to notice this (read PatentlyApple).   

Microvision, Vuzix and Lumus are telling us to wait until 2011 for AR HMDs, but if Apple gets involved, we just might see it happen in 2010.