Recently, engineers at the University of Pennsylvania gave PR2 some literacy skills. As seen in the video below, it can roam the halls of campus reading out posters on doors and walls.
Menglong Zhu and colleagues at the university's GRASP robotics lab tinkered with a Kinect-equipped PR2 dubbed "Graspy" and taught it to recognize printed text on paper and signs as well as handwriting on whiteboard.
First, it locates text on a nearby surface (including the floor and labels on household products). Then it performs text recognition using Tesseract OCR software, and reads the words aloud.
Graspy can handle various fonts and text colors, but its reading isn't smooth or perfect, missing the digits "50" on one poster--perhaps because they were stylized.
The skill isn't earth-shattering, and indeed humanoid robots have been reading text and even musical scores for years. Still, it's cute to see Graspy exploring its new ability to read just like a child does. … Read more