By Roland Piquepaille
The Japanese Humanoid Robotics Project has produced the HRP-2 robot, which is known for dancing and preserving Japanese culture. But now, the HRP-2, which is about 1.6 meter high and weighs about 60 kilograms, can hear humans and understand them with its sophisticated software and hearing equipment. It uses an array of microphones consisting of eight omnidirectional microphones mounted around the robot's head. Stable speech recognition is obtained by combining information from the microphone array and a camera also mounted on its head, and by isolating and eliminating noises, even from your TV. These hearing capabilities are essential "for helping humans to communicate with robots in real environments by 2025." Read more...Before going further, here is how looks the HRP-2, also known as 'Prométhée' (Credit: Kawada Industries, Inc.)
Now here are the technical details provided by Japan's National Institute of Advanced Industrial Science and Technology (AIST) about the microphone array.
The microphone array consists of eight omnidirectional microphones mounted around the robot's head. The sound source is located on the basis of difference in times for arrival to individual microphones, and at the same time, a camera mounted at the robot's head detects, tracks and locates a person giving the vocal instruction.
Here is the robot's head with its array of microphones. The red arrows show the positions of the eight microphones (Credit: AIST).
Stable speech recognition is obtained by combining information derived from the microphone array and the camera and by isolating and eliminating noises. Hardware to eliminate noises in real time has been developed and built into a robot, making it possible for a human operator to give robot vocal instructions, and to control IT appliances through a robot, even in a field where multiple noise sources such as TV exist.
It is expected, therefore, that natural communications may be realized in the living environment between a human operator and a humanoid robot through the auditory function of robot.
Please read the AIST document for more details about the voice interface and its hardware and software components. I just want to emphasize that the goal of this project is to allow natural communications between human beings and humanoid robots through the auditory function of the robots, and even in noisy environments.
Sources: Japan's National Institute of Advanced Industrial Science and Technology (AIST) news release, June 20, 2005; and various web sites
Related stories can be found in the following categories.
Famous quotes containing the words robot, understands, noisy and/or environments:
“The person who designed a robot that could act and think as well as your four-year-old would deserve a Nobel Prize. But there is no public recognition for bringing up several truly human beings.”
—C. John Sommerville (20th century)
“A wise man hears one word and understands two.”
—Yiddish proverb.
“Maybe it’s understandable what a history of failures America’s foreign policy has been. We are, after all, a country full of people who came to America to get away from foreigners. Any prolonged examination of the U.S. government reveals foreign policy to be America’s miniature schnauzer—a noisy but small and useless part of the national household.”
—P.J. (Patrick Jake)
“Corporate America will likely be motivated to support child care when it can be shown to have positive effects on that which management is concerned about—recruitment, retention and productivity. Indeed, employers relate to child care as a way to provide growth fostering environments for young managers.”
—Dana E. Friedman (20th century)