• Investigating the process of print interpreting
• Studying the comprehensibility of the interpretation
• Developing new technology and methods for analyzing and supporting print interpreting
• This project is part of the MOTIVE program.

1. Understanding the process of print interpreting. Which factors influence the interpreting process and the accuracy of interpretation? Which methods are used (verbatim/edited etc.)? What are the demands of various settings? How is the interaction between deafened and hearing persons conducted?
2. The relation of the interpreted output to the spoken source text (including nonverbal elements). What kind of expression is the product? How close is it to the speech, and which factors affect the acceptability and the adequacy of the text? What are the effects of delay? How are the nonverbal elements conveyed?
3. The target text will be examined also in its own right, as an independent message: the object is the comprehensibility of the written text including its processing (perception, reading, understanding; effects of display mode, errors and corrections, text coherence).
4. Reading process of the emerging text. How is the target text read? How does it differ from the reading of static text? How do the various rendering options affect the reading?
5. The development of a new technology as well as methods for print interpreting. We will experiment with buffering the text so that it does not appear letter-by-letter but in suitable burst, in the style of Rapid Serial Visual Presentation. The tool used by the interpreter will be enhanced by allowing quick access to common operations.

The aim of this project is to study the real-time transmission between two communication modes, speech and writing in human interaction with a method called "print interpreting". It means translation of spoken language and accompanying significant audible information into written text simultaneously with the talk. The text is typed on a computer and displayed on a screen where the letter-by-letter emerging text is visible. Print interpreting is needed as a communication aid for people with hearing disability to give them access to the speech. Since they have acquired the language in a hearing speech culture and usually can speak it, they need an interpretation which is as close as possible to the original speech. This interpretation must also give an impression of the speaker and the linguistic variation. The challenges of print interpreting are the demands of simultaneity (requiring a high production rate) and verbatim transcription. Another important challenge is to transfer all the relevant auditory information (including non-language sounds from surroundings, etc.) into a visible modality which is understandable to the hearing impaired.

The objectives of the study are 1) to investigate the process of print interpreting and 2) the comprehensibility of the interpretation; and 3) to develop new technology and methods for analyzing and supporting print interpreting. The process means in the narrow sense the real-time conversion act and the changes in the message; in the broader sense it covers the whole communicative event, including the activity of interpreting and the actions of the participants and their interaction. The comprehensibility will be examined in terms of readability and coherence. The main research methods are textual and multimodal analysis, and eye movement analysis. Because the research problems are multidisciplinary, they will be studied in an interdisciplinary collaboration combining approaches from Linguistics, Translation Studies (especially Interpreting Studies), and Computer Sciences.

The practical aim of the study is to develop new technological solutions and to improve the accessibility of communication. Results on the reading process can provide valuable information to develop better ways of rendering the text, and thereby help in making the hearing impaired persons more equal partners in the ubiquitous communication situation. In addition, the study will contribute to deeper understanding of the relationship between writing and speaking, verbal and non-verbal communication, and produce new information of their interchangeability in various media.