Technology behind Sony's Qrio: Seeing and Acting

The content of this page is taken from the official Sony Qrio website at http://www.sony.net/SonyInfo/QRIO/. Unfortunately the page closed at the end of March 2007 - so we saved some of the info before the site was taken down.

Part 1:
Walking Stably

Part 2:
Surviving a Fall Unscathed

Part 3:
Remembering People & Talking

Part 4:
Seeing and Acting

Part 5:
Living with People

One thing is absolutely indispensable for a robot to move around safely within the same space as human beings - the robot itself must be able to recognise what kind of place it is in and what its location is. QRIO understands its environment in three dimensions. QRIO can approach a ball or turn to face a human voice while avoiding obstacles. In addition, it can use special coloured "landmarks" to gain an even greater understanding of its surrounding space, enabling it to perform in a variety of ways. For example, if the landmarks are set up like a soccer goal, QRIO can kick a ball between them.

Stereovision and Multiple Microphones
QRIO's head is equipped with two cameras. Just like a human, through a detailed comparison of the right and left images (stereoscopic vision) it determines the distance to the object in view. It is also equipped with seven microphones, so that by analyzing the sound waves they detect..		..it can calculate the direction of the sound it hears. By then analyzing that sound it can determine whether it is a person's voice, hands clapping, etc. If you applaud QRIO, it just might turn its attention to you.

Detecting and Avoiding Obstacles
In order for QRIO to detect surface obstacles, it must be able to perceive its environment in three dimensions. While turning its head, it uses its stereoscopic vision to calculate the distance to objects; it then analyzes the data to determine whether the objects it sees are part of the floor or an obstacle to be avoided -		- like drawing a mental map of its environment. When QRIO moves to approach you, it first determines the best path and then approaches you while avoiding any obstacles that might be in the way. Thus, QRIO is able to move about in an actual home.

Creating a Map and Determining Location
QRIO can use its special colored markers to create a map of its location. As it moves, it uses the image of the marker it gathers through its cameras to calculate its own location and the relative location of the marker, repeating this calculation over and over to increase precision.		In this way it can detect if the markers are laid out in a special pattern, or distinguish one space from another. Place the markers in a shape like a soccer field and QRIO will play soccer; arrange them like a stage and QRIO will dance.