Toyota Augments its Mini iQ too

We were all impressed by last year’s Mini advertising campaign using Metaio’s Augmented Reality technology. It featured  in the top spot of my Top 10 Milestones in Augmented Reality for 2008

Toyota couldn’t afford staying behind and had “one upped” BMW with a more sophisticated ad for its own mini – the iQ.

In the augmented world, the car drives on a road – and is blown up to reveal all its parts. Or in Toyota’s own words:

interact with the car to discover its agility and interior space.

Neat.

Give it up for the  “iQ_Reality“:

Vodpod videos no longer available.

Now try it for yourself on Toyota’s site.

***update***

Rouli brings to our attention that Nissan didn’t stay behind and just introduced its Cube brochure:

Yet a new update from Le5emeP: another auto maker to play with AR advertising is Citroen with its C3:

Lastly is Ford with its own mini – the Ka:

A new addition (2009) to the AR cars phenomena with an artistic angle for the BMW Z4:

[youtibe=http://www.youtube.com/watch?v=tr66vs5W7as]

Now we have a complete round up, which one do you like best?

Boy Meets Girl Remake: Virtual Boy Meets Real Girl

YDreams’ Flapi will flip your mind.

You all know the classic story: boy meets girl; girl plays with boy; boy falls in love with girl; girl leaves…

Maria Palma just shared with me YDream‘s take on the story, featuring their virtual Mascot, Flapi the cute, and an even more cute – real girl (the Creative Director’s daughter which totally steals the show).

I like the attempt for drama driven by the interaction between real and virtual.

But I’d love to see this on a portable device. The girl should see Flapi in her field of view avoiding the need to turn her head to watch it on the screen.

YDreams response: they’re thinking about it…

This demo (based on their SimVideo augmented reality platform) and others were presented by YDreams’ CEO, Antonio Camara, at the Digital Signage Expo in Las Vegas this week.

YDreams wasn’t the only AR company to present at the event: Total Immersion made a splash as well.

Microsoft to Demo Augmented Reality at TechFest

Technology Review reports the news:

Today, Microsoft researchers will demonstrate software that can, in real time, superimpose computer-generated information on top of a digitized view of the real world.

Michael Cohen,  principal researcher at Microsoft, and his colleagues will demo the augmented-reality technology at TechFest, an annual showcase of Microsoft’s research projects, in Redmond.

Well, we have seen augmented reality running on a Vaio before – but never from Microsoft. This could be interesting. Especially the tools.

Michael spits all the right examples of real life applications using AR, however at TechFest, the software will be used to lead people on a treasure hunt to a hidden prize of a (virtual) pot of gold.

The bubble flow navigation is way cool. Coming up right after the poster demonstration.

Games will lead the way.

***Update***

via KZero: a collection of additional Microsoft-produced videos of the future – featuring largely augmented reality applications.

Vodpod videos no longer available.

Vodpod videos no longer available.

Vodpod videos no longer available.

Vodpod videos no longer available.

Vodpod videos no longer available.

ISMAR 2009: The World’s Best Augmented Reality Event Wants You to Contribute!

This post is directed at you. Yes – you: the augmented reality aficionado.

For those who followed my coverage of ISMAR 2008 – prepare to be blown away by ISMAR 2009.

ismar-2009-wants-you

If you are an AR researcher – ISMAR 2009 is as always the best event to learn about the latest and greatest in AR technology.

If you work in the AR industry – congratulations! Unlike previous years – at ISMAR 2009 you’ll see AR breaking out into commercial success.

If you work in interactive entertainment – come to ISMAR 2009 to experience the phenomen that will revolutionize interactive entertainment forever.

If you are an artist – at ISMAR 2009 you’ll have an opportunity to join this emerging industry and change the way people experience the world, literally.

Interested? Good.

Because all of the above will only transpire – if YOU contribute.

ISMAR 2009 is now officially calling for proposals.

Here are excerpts from the call for proposals. For details check out the official call.

The veteran Science and Technology track will be complemented this year with new Arts, Media and Humanities tracks. ISMAR 2009 will introduce expanded Tutorials, Workshops, Demonstrations and Competitions.

Topics of the Technical Track:

Sensing – Tracking technologies, calibration methods, sensor fusion, vision-based registration and tracking, acquisition of 3D scene descriptions
Information presentation – Object overlay and spatial layout techniques, handling of occlusions or x-ray vision, photorealistic augmentation, real-time augmentation, optical display technologies (HWDs, HMDs, HUDs, mobile projectors), aural or haptic augmentation, combined presentation across several displays (combining mobile and stationary devices), display and view management
User interaction – Interaction techniques and metaphors for MR/AR, collaborative MR/AR, multimodal input and output, tangible interaction, combined interaction with virtual and real objects
Human factors – Usability studies and experiments of MR/AR-based interaction and presentation concepts, acceptance of MR/AR technology, social implications
System architecture – Wearable and mobile computing, distributed and collaborative MR/AR, display hardware, performance issues (real-time approaches), embedded computing for MR/AR, integration of MR/AR technologies into wide-area pervasive computing environments
MR/AR applications – across all areas of personal and professional activities, such as: Personal MR/AR information systems, games, applications in industry, military, medicine, science, entertainment, architecture, tourism, art, cultural heritage, education, training etc.

Topics of the Arts, Media & Humanities Tracks:

Compelling applications of Mixed & Augmented Reality. Applications include artistic expression, experiential-media or interpretive pieces that reflect the study of the human condition.
• Art – The Art program is looking for notable artists that have stretched the boundaries of expression with the use of Mixed and Augmented Reality.  The creative interaction between real, virtual and the imaginary realities to create provoking experiences are highly encouraged.  Written papers and posters are to include position statement with notes and images on approach, implementation and the technology used.  A gallery show will be mounted to support physical entries (see call for demonstrations).
Media – submissions from media practitioners who have stretched the boundaries of the creative impact of Mixed and Augmented Reality.  This venue seeks innovative uses of creative techniques for communication and entertainment to enhance the experience of MR/AR through novel applications of head-mounted, embedded projection, or mobile displays.  Submissions may include new tools, conventions or taxonomies for developing these new media.
Humanities – academic submissions that relate to Mixed and Augmented Reality content that allows for innovative analytical, critical or speculative approaches to reflect the study of the human condition. and digital media.

Call for Innovation Workshops

ISMAR 2009 will have a series of workshops the day before the conference (Monday) to cover the innovative application of Mixed and Augmented Reality to specific industry domains.  Three workshops have been defined.  We invite you to submit papers or panel discussions that will address topics of transferring MR/AR to solve critical real world problems (see web site for details).  If your paper or panel does not fit the existing workshop, you may submit a proposal for a new workshop.
Designing the Future (Design and Manufacturing Workshop):  This workshop will continue the ISMAR legacy of showcasing the pioneering efforts of the auto and other industries’ use of Mixed and Augmented Reality as design tools.
Falling in Love with Learning (Entertainment & Education Workshop):  Entertainment and Education converge in Mixed Reality Experiential Learning Landscapes for museums, libraries, schools and parks.
Transforming Lives (Medical and Military Training Workshop):  Extreme Mixed Reality needs to meet high-risk, high-performance training to enhance human preparation for life and death scenarios.

Call for Pioneering Tutorials

To mark ten years of ISMAR, the 2009 conference will include a three-day comprehensive tutorial program that covers a wide spectrum of topics in Mixed and Augmented Reality.  We are looking for submissions from pioneers to share their experiences and insights.  Formats can be from 30 to 90 minutes.  These tutorials will be video captured and distributed as a series along with special features covering the work of pioneering laboratories worldwide.

Call for Demonstrations

There will be four formats to submit demonstrations.  Demonstrations can be related to papers, posters or panels, but that is not required.  A proposed abstract, floor plan and list of requirements are requested with the letter of intent (see websites for details).  Accepted Participants will receive notification by June 30th, 2009 to start coordination with the ISMAR 2009 Planning Committee.  To accommodate late breaking discoveries, we will accept “Laboratory Demonstrations” until the last minute, pending committee discretion and conference  accommodations (submissions received after August 15th, 2009 will not be included in the publications). Letters of intent are recommended for all submissions to assist in the planning.
Laboratory Demonstrations will provide the opportunity for “late breaking” research teams to informally demonstrate their latest inventions and allow for interaction with attendees and other pioneers.
Research Showcase will be a more formal presentation of innovative Mixed and Augmented Reality content that involve more production support and exhibit design considerations.
Art Gallery will present innovative Mixed and Augmented Reality artwork within a unique gallery format based on a combination of invited and submitted work.
Innovation Exhibitions (See industry/Sponsor relations) will feature the latest commercially available products and services for use in Mixed and Augmented Reality applications.  The exhibition will be available for rental to industry buyers from the entertainment, medical, military and educational markets.  A special “Start-up Park” will be available for small, first time commercial exhibitors at more affordable prices.  Early registration is recommended for the expected increased participation and limited space.

Tracking Competition

The first event of this kind at ISMAR 08 (http://ismar08.org/wiki/doku.php?id=program-competition) caught much attention. A sequel will be organized at ISMAR 2009. Details regarding the tracking task and the rules of competition will be made available on the web site. It is to be expected that only a limited number of teams can participate.

***********************

Don’t be wary.

Even if you do not have a rigorous research paper – you still have an important role in ISMAR 2009.

If you have developed a cool AR tool, app or game, or –

if you have conceptualized an interesting AR idea, or even-

if you just had a vision of the killer AR app  – we want to hear from you!

Don’t wait for the May 16th deadline – you can’t afford to. Submit your proposal today.

**********************

Send your proposals to:

Gudrun Klinker, Blair MacIntyre and Hideo Saito

Science and Technology Program Chairs (Science@ismar09.org)

Blair MacIntyre

Art and Humanities Program Co-Chair (Humanities@ismar09.org, Art@ismar09.org)

Jay Bolter

Humanities Program Chair (Humanities@ismar09.org)

Jarrell Pair

Media Program Chair (Media@ismar09.org)

Charlie Hughes

Tutorial Chair (tutorials@ismar09.org)

Christian Sandor

Laboratory Demonstration Chair (Demos@ismar09.org)

Sean White,

Research Showcase Chair (Showcase@ismar09.org)

Larry Davis

Innovation Exhibition Chair (Exhibits@ismar09.org)

Christopher Stapleton

Interim Workshop Chair (Workshops@ismar09.org)

Daniel Pustka

Tracking Contest Chair (Tracking@ismar09.org)

We want to hear from you!

As a member of ISMAR’s Media track committee – I hereby vow to emphatically review every single proposal in the media track. Your voice must be heard.

Augmented Reality in Flash Now Commercially Available

Mark Billinghurst just shared with me the good news: ARToolworks announces commercial availability of FLARToolKit. He explains:

Basically it means that companies can now get commercial licenses to FLARToolKit and build flash based Augmented reality websites without having to release their source code as required by the GPL license.

Saqoosha (Tomohiko Koyama) was the first to marry AR with flash as open source – a major step in simplifying AR apps on a PC. Now ARToolworks CTO, Philip Lamb, is taking it to a commercial level.

The code is available at the Spark Project site.

To get your creative juices going, here’s a reminder of the kind of things this baby can deliver:

Vodpod videos no longer available.

Vodpod videos no longer available.

What are YOU going to create with it?

The Curious Raven Says: Tonchidot Has Real Demo…But He’s Not Impressed

Robert Rice (Curious Raven) just unveiled this new demo by Tonchidot, and although this time it looks real, compared to the TechCrunch50 concept video of yesteryear – he’s not impressed.

Judge for yourselves.

Vodpod videos no longer available.

What strikes me is the similarities with 2 other apps launched recently: wikitude and Nru.

These apps don’t do image recognition. They rely solely on GPS (for location) and sensors (compass – for direction, latitude – for angle, accelerometers – for pose) – to give you más info about what you’re looking at.

Wikitude’s founder, Philipp Breuss, presented last week at WARM, his simple yet powerful design of an app that tells you what wikipedia knows about what you’re looking at (mostly sites.) He boasts 60,000 downloads so far. Not too shabby.

Nru by Lastminute.com does a similar job with 2 distinct differences: it omits the live video stream for a purpuly radar like UI, and it tells you what Qype and fonefood know about what you’re looking at (mostly restaurants and shows.) Still waiting for the release of the app.

These apps make do with GPS and sensors, and lack visual recog capabilities – but they have one  advantage – they are getting popular by the minute.

Nru

Augmented Reality Game Poised to Win Game Award: Vote for Kweekie

Stephan Cocquereaumont, president and lead developer of Int13, a French next-gen games studio for Smartphones, has just shared with me the latest video of his mobile Augmented Reality game – Kweekies:

Kweekies is an Augmented Reality virtual pet game that allows gamers to interact with their pet by using the embedded camera of their Smartphone. 3 selling points – Augmented Reality that just works – Cute Virtual Pets – Online Competition


Kweekies is one of the 6 nominees for International Mobile Gaming Awards (IMGA) in the newly established Real World Games Category.

The competition is taking place this week at the Mobile World Conference in Barcelona.

Here are the nominees:
Ghostwire
FastFoot-Challenge
Kurai: The Dark Monolith
Kweekies
MoveYa!
Aikon Ghost Hunter

Is Kweekie the only true Augmented Reality Game in the bunch?

We already had that debate before…

In any case, the winners will be announced soon – and you can make a difference.

Vote for the best!

Live From WARM ’09: Keynote – Projection Over Four Orders of Magnitude

Oliver Bimber (Bauhaus University – Weimar) one of the world’s leaders is spatial augmented reality kicks off with barb: “unlike other sessions, this session is NOT about mobile augmented reality but rather – spatial (projected) augmented reality. Welcome  to the wonderful world of Oliver Bimber.
He projects visuals on every day surfaces, by using structured light and camera feedback.
Oliver amazes by demonstrating a projection on…a glass of wine – using inverted lighting.
Adaptive photometric: Have you ever seen Shrek projected on a stone wall? Oliver makes it look easy with a smooth resulting image.
Another demonstration shows how you can record footage that would usually require a green screen – in the scene itself, with no need to go to a dedicated studio.
Oliver keeps going with Reverse Radiosity and Multi Focal Projection. You have to see it (because I can’t put it in words…)

On to more applications: visualization of radiological images – x ray film, diagnostic monitors, and high quality paper prints – aren’t optimal for diagnostics because of its low contrast.
Super Imposing Dynamic Range (demonstrated at ISMAR ’08.) offers 6 times higher contrast than x ray film.
Radiologists have confirmed that this technique does better than existing techniques.
Another application is for Light Microscopy. Contrast is a problem is shiny surfaces in operations or manufacturing scenarios. Oliver shows a prototype of projected light microscopy – with a size of 2 micro meters that increases the contrast by a factor of 5 and removes the background noise on a more uniform illumination – and this is just the beginning.  This is important for applications of image analysis.

Now why the mysterious title?
Simply because with Oliver’s techniques, contrast is improved by 4 orders of magnitude…

Question from the audience – why not use laser projectors?
Oliver responds that the issue is not within the projector but mostly on the surface – so even with laser projectors you’ll need the compensation discussed.

After lunch – demos!

Live From WARM ’09: The World’s Best Winter Augmented Reality Event

Welcome to WARM 2009, where augmented reality eggheads from both sides of the Danube meet for 2 days to share ideas and collaborate.

It’s the 4th year WARM is taking place – always in Graz university, and always in February – to provide an excuse for a skiing event, once the big ideas are taken in. Hence the cunning logo:

This year 54 attendees from 16 different organizations in 5 countries are expected (Austria, Germany Switzerland, England and the US). The agenda is jam-packed with XX sessions, Lab demos and a keynote by Oliver Bimber. I have the unenviable pleasure of speaking last.

It’s 10 am. Lights are off. Spotlight on Dieter Schmalstieg, the master host, taking the stage to welcome everybody.
He admits, the event started as a Graz meeting and just happened because guests kept coming.

Daniel Wagner, the eternal master of ceremony of WARM, introduces Simon Hay from Cambridge (Tom Drummond group) the first speaker in the Computer Vision session. Simon will talk about “Repeatability experiments  for interest point location and orientation assignment”  – an improvement in feature based matching for the rest of us…

The basic idea: detect interest regions in canonical parameters.
Use, known parameters that come through Ferns, PhonySift, Sit Mops, and MSERs searches,
and accelerate and improve the search with location detectors and orientation assignments.

After a very convincing set of graphs, Simon concludes by confirming Harris and FAST give reasonable performance and gradient orientation assignment works better than expected.

Next talk is by Qi Pan (from the same Cambridge group) about “Real time interactive 3D reconstruction.”

From the abstract:
“High quality 3D reconstruction algorithms currently require an input sequence of images or video which is then processed offline for a lengthy time. After the process is complete, the reconstruction is viewed by the user to confirm the algorithm has modelled the input sequence successfully. Often certain parts of the reconstructed model may be inaccurate or sections may be missing due to insufficient coverage or occlusion in the input sequence. In these cases, a new input sequence needs to be obtained and the whole process repeated.
The aim of the project is to produce a real-time modelling system using the  key frame approach which provides immediate feedback about the quality of the input sequence. This enables the system to guide the user to provide additional views for reconstruction, yielding a complete model without having to collect a new input sequence.”

Couldn’t resist pointing out the psychological sounding algorithms (and my ignorance) Qi uses such as Epipolar Geometry and PROSAC, reconstructing Delauney Triangulation followed by probabilistic Tetrahedral carving. You got to love these terms.

The result is pretty good, though still noisy – so stay tuned for future results of Qi’s research.

Third talk is by Vincent Lepetit from Computer Vision Lab from the Swiss CV Lab at EPFL.
Vincent starts with a recap of Keypoint recognition: Train the system to recognize keypoints of an object.
Vincent then demonstrates works leveraging this technique: an awarded work by Camille Scherrer “Le monde des montagnes” a beautiful augmented book, and a demo by Total Immersion targeted for advertising.

Now, on to the new research dubbed Generic Trees. The motivation is to speed up the training phase and to scale.
A comparison results shows it’s 35% faster. To prove, he shows a video of a SLAM application.
Generic Trees method is used by Willow Garages for autonomous robotics – which is implementing Open CV.

Next, he shows recognizing camera pose with 6 degrees of freedom (DOF) based on a single feature point (selected by the user). Impressive.

That’s a wrap of the brainy Computer Vision session. Next is Oliver Bimber’s keynote.

Meet the “Six Sense” Device: Augmented Reality MIT style

This week at TED, on the very stage where Bill Gates unleashed mosquitos into the audience to make a point about the need to cure Malaria, an MIT researcher, Patty Maes, unveiled a “six sense” device.

Maes demonstrated a portable device constructed out of commercial of the shelf products such as a web camera, pocket projector, and a cell phone.

What kind of “six sense” feats can it achieve?

Yahoo Tech captured the new ways to interact with the world made possible with this device:

  • turn any surface into a touch-screen for computing, controlled by simple hand gestures
  • take photographs by framing a scene with your hands
  • project a watch face by creating a circle on your wrist with your finger
  • recognize items on store shelves and provide personalized recommendations
  • look at an airplane ticket and know whether the flight is on time
  • project information about a book while browsing at a store
  • recognize articles in newspapers, retrieve the latest related stories or video from the Internet and play them on pages

Augmented reality enthusiasts would immediately recognize these fantastic ideas. Whether you use cell phones, goggles, or a projectors to view the added information – it’s a whole new way to interact with the world.

Now we have to wait patiently until TED uploads the video. ***update*** see videos below.

Last year cellphones took center stage in spearheading augmented reality into the main stream. Out of the blue comes this spatial augmented reality cobbled-together-device and takes the spot light.

Oliver Bimber is not surprised. He’s been leading that school of thought for a while and even wrote a book about it: Spatial Augmented Reality: Merging Real and Virtual Worlds

So what’s the total?

“Six sense” device: $300

Interacting with the world in a totally new way: priceless…

ETA: 2019

***update***

Andy Baio just tipped me off that Wired posted up these videos – thanks Andy!

Vodpod videos no longer available. Vodpod videos no longer available.