The functionality of the Sypole device is as following:

Automatic text reading tool

As described previously, the main aim of the Sypole project was to build a mobile reading machine for visually impaired. The user takes only a snapshot of the text document and the system output is then an audio answer of the textual part.

Object recognition through dedicated barcodes

In order to distinguish all similar-by-touch objects such as medicine boxes, bottles and so on, this application aims at recognizing dedicated barcodes. First of all, the user sticks a barcode onto the object to be recognized and takes a picture of it. The system recognizes it is a new code and asks the user to record a message describing the object (such as orange juice bought Friday, 10th and so on). During the further use, the user takes another snapshot and the system recognizes the code as a used code and plays the audio recorded message.

Colour recognition

After taking a snapshot of the object whose colour is needed, the system recognizes the colour and provides an audio answer with two levels of luminance (bright/dark) for each colour.

Banknote recognition

When a blind has doubt about the banknote's value he holds, he can take a picture of it and after analysis and validation, the system provides an audio answer, with the right answer in a very high percentage for security reasons.

Daisy book reading

Blind users who wish to “read” books do not use reading machine for this purpose as page by page it is not very convenient. Hence the Daisy standard appeared to give them access to book reading through audio content and navigation in chapters, sections and pages. These devices are currently quite expensive and dedicated to this application only. Hence the Sypole device includes this additional functionality onto a PDA. From a CD in a PC, one part of the application (on PC) uploads the CD data to the PDA, connected to the cradle and then the second part (on PDA) plays the book under the Daisy format.

Enhancing and enlarging text visualization

For partially sighted people, an enlarging and enhancing application for text of daily life is necessary and sufficient to have access to main textual information. Such devices exist but they are not portable, expensive and only dedicated to this application. In order to make Sypole richer, this application was included in the project. Through video visualization and a dedicated optical lens, the Sypole device may turn into an enhancing and enlarging text visualization.

Training system for picture taking

As it is not convenient at all for visually impaired to take “good” pictures, meaning without blur, with less uneven illumination, with correct perspective and convenient focus, a training system has been built for this purpose. The user takes a picture of a particular pattern and receives an audio comment on the snapshot (“not in front of the camera”, “rotated”, “too much perspective”, and so on).

News reading

In order to have access to news without having the paper version, an application has been developed on PC in which news articles are synchronized from internet using RSS technologies, parsed and copied to the mobile device. This free service can be extended to a subscription for full access to the newspaper. The system plays the audio-synthesized output with an adapted navigation through the headings.

Telephony service

In order to complete services from a smartphone or a PDA-phone, telephony services are available. The user may send and receive phone call, dial with existing keyboards or through the Sypole interface, manage some personal contacts and so on.

Personal assistant

As the system is built inside a personal digital assistant, all other classical functionalities of these devices are available. Moreover, some of them have been extended with audio inputs/outputs such as memo and so on.