Projects / Programmes
Assisting visually impared people in using the computer with the aid of spatial sound
| Code |
Science |
Field |
Subfield |
| 2.08.00 |
Engineering sciences and technologies |
Telecommunications |
|
| Code |
Science |
Field |
| T180 |
Technological sciences |
Telecommunication engineering |
human auditory system, acoustics, spatial sounds, localization, user interfaces, human-machine interaction
Researchers (1)
| no. |
Code |
Name and surname |
Research area |
Role |
Period |
No. of publicationsNo. of publications |
| 1. |
23408 |
PhD Jaka Sodnik |
Telecommunications |
Head |
2008 - 2010 |
0 |
Organisations (1)
Abstract
In the present research project we propose the research and development of an acoustic computer interface for assisting blind people in the use of computers. The aim of the project is to develop an upgrade of the classic screen reader which reads the content of a computer screen to a blind user. Screen readers are based on automatic speech synthesis. Human orientation and communication depends primarily on the visual information which means that the sense of sight is much more developed and accurate as the sense of hearing. Therefore we propose an upgrade of the acoustic computer interface in order to improve the efficiency of the human auditory channel. Our idea is based on the use of spatial sounds which increase the perception of multiple simultaneous sound sources and the information flow from a computer to a person. The proposed project consists of three main phases. The first phase is dedicated to the study of the human auditory system. Based on its limitations and its main advantages and disadvantages, the research will establish a basic set of acoustic signals which could be used effectively in human-machine interaction. In the second phase of the project, a basic structure of a 3D acoustic computer interface will be designed. The interface will consist of various spatial sounds and will therefore occupy the entire virtual space around the user. A basic set of acoustic interface components will be determined with analogy to visual interface: icons, menus, windows, etc. In addition to the software and hardware structure, interaction techniques and devices should also be chosen carefully. The efficiency of the proposed interface will be evaluated on a simple custom-made application that enables the interaction both via an acoustic and a visual interface respectively. Such a comparison shall reveal all possible disadvantages of the acoustic interface and thus enable its optimization. In the third stage of the project, we intend to design and develop a 3D screen reader similar to the already existing 2D versions. The most important part of the new screen reader will be the algorithm for converting the 2D computer screen into 3D acoustic space. The references of the candidate for the present postdoc project reveal his high level of expertise in all the research areas of the proposed project.
Significance for science
In Slovenia, so far there hasn’t been any extensive research on the information technologies for blind and visually impaired people based on the use of spatial sounds and other innovative approaches in acoustic signal processing. The present research project therefore introduces a new research area which also extends into the study of various mechanisms in human computer interaction and the use of various sound signals. The results and most important findings of the project offer a basis for future research in this area. The most important contributions of the project are undoubtedly the results of our user studies with blind and visually impaired computer users reporting on the responses and feedback of “real” users of such systems and their practical experience and recommendations. Most of the users that took part in the user studies showed great interest for and support of the research activities in this area. This is not surprising since they represent a national minority which is often ignored and left to their own devices. Many of them also expressed interest in collaboration in potential future projects and similar user studies.
The auditory interfaces developed within this project were designed specifically for blind and visually impaired computer users. However, with some minor adjustments they could easily be used in other areas and for other users as well. We see a great potential for the use of such systems in the area of user interfaces for various mobile devices. These devices are meant to be used primarily while walking, running or driving a car, which is why the interaction based on the visual channel and the use of displays is dangerous and sometimes even impossible. Some devices offer alternative auditory interfaces with limited functionality and often very low efficiency. The results of our research project offer some important suggestions and recommendations on the improvement of such interfaces with the stress on the increase of information flow through the use of spatial sounds. The latter also enables a more intuitive representation of various spatial objects in the interface.
We continue with the research in this field through the research program entitled “Algorithms and Optimization Methods in Telecommunications”. The results of this project as well as the developed applications and prototypes will be used as the basis for future research.
Significance for the country
The research project focused on blind and visually impaired people, a very underprivileged group in Slovenia. Due to substantial limitations in their movement and orientation in space, most blind and visually impaired people are unemployed or forced to take on temporary part-time jobs. The minority that is employed mostly works with computers, which (with some adjustments) allows them to be equally efficient as their normal sighted colleagues. While working with blind and visually impaired people, we established that specially adapted computer equipment remains to be both too inaccessible and too expensive. Most blind and visually impaired people only manage to procure a standard screen reader which constitutes their main user interface when working with the computer. Our research demonstrates an example of an upgraded version of a screen reader which enables the transmitting of a significantly larger amount of information, while at the same time making the presentation of additional information very intuitive and graspable. A Slovenian version of screen readers does not exist, but it is possible to use English screen readers with a Slovenian synthesizer. The latter could be upgraded with the mechanisms presented in the results of our research project. Besides improving the quality of life for the blind and visually impaired people, the upgrades and improvements of the audio interfaces would enable them to take a more active role in the society and facilitate their work with the computer.
The results of the project from the field of human-computer interaction proved to be very interesting also for the developers of various technological solutions from the field of mobile phone and web convergence due to the fact that innovative user interfaces present a vital part of their solutions. During the course of the project, we managed to make contact with various Slovenian companies from the afore-mentioned field and several expressed an interest in a more concrete and applicative co-operation also in the future.
Most important scientific results
Annual report
2008,
final report,
complete report on dLib.si
Most important socioeconomically and culturally relevant results
Annual report
2008,
final report,
complete report on dLib.si
