Research Isabelle Robert

Abstract

Simultaneous interpreting (SI) is a complex cognitive activity comprising concurrent tasks: language comprehension, production, and monitoring. It is carried out in an increasingly technologized environment, in which information is presented through multiple channels, i.e., multimodally. Incoming verbal and nonverbal information from the speaker is frequently complemented by supports such as a slide presentation (with or without captioning) or computer-assisted interpreting (CAI) tools (e.g., terminology software). Yet, the equation between the facilitating effect of these supports in terms of performance and the added cognitive load on information processing lacks empirical investigation. We attempt to fill this gap by investigating the effect of multimodality on interpreters' performance, visual attention, cognitive load, stress, and user experience. To this end, we will conduct two experimental, within-subject studies involving 12 professional interpreters. Study 1 investigates one support: participants will perform their task in 4 conditions, that is, (1) SI (no support - baseline); (2) SI + slides; (3) SI + CAI-tool; (4) SI + intralingual captioning. Study 2 investigates 4 combinations of supports: (1) SI + slides (baseline); (2) SI + slides + CAI; (3) SI + slides + intralingual captioning; (4) SI + slides + interlingual captioning. During the tasks, speech rate, a major problem trigger in SI, is manipulated to measure its effect in relation to the support type. The project combines objective and subjective data collection and analysis such as mobile eye tracking, wristbands, and interviews, to generate profound fundamental knowledge on multimodality and cognition, and benefit interpreter training and practice.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: de Boe Esther

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

One of the main challenges in higher education in the 21st century is providing educational access to an increasingly multilingual and multicultural student population. Many universities are therefore considering using English as language of instruction (EMI), but students' limited proficiency in English can be a serious drawback. Live subtitling might help to overcome this language barrier, by removing physical (auditory) and linguistic barriers at the same time. The aim of this research project is therefore to investigate (1) how university students in Flanders perceive EMI lectures with intralingual live subtitles, i.e. lectures for which the words of the lecturer are subtitled in real time in the same language (English), (2) whether these subtitles influence their performance, and (3) what impact these subtitles have on their cognitive load. We will compare two different production methods of subtitling: (1) respeaking and (2) trained automatic speech recognition. We will also compare two different projection methods: (1) subtitles in a block of 2 lines underneath the PowerPoint of the lecturer, and (2) scrolling subtitles on a separate screen. We will investigate the impact of subtitling on perception, performance and cognitive load among two student groups: (1) students who study English as a major, and (2) students who do not study English. Quantitative and qualitative data will be collected during real lectures using online questionnaires and eye tracking glasses.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: Schrijver Iris

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

Simultaneous Interpreting (SI) is a real-time oral translation of a speaker's oral discourse by an interpreter who usually works from a sound-proof cabin in a conference room. SI requires complex information processing, since the interpreter has to carry out several tasks in parallel (i.e., listening, comprehending and producing speech). Interpreters are often provided with a written version of the oral speech to be delivered by the speaker beforehand, an additional information source that can be used for task preparation, but also during the delivery of the oral speech. The latter practice is referred to as "SI with text" or "SIMTEXT". This involves multimodal cognitive processing since the interpreter now receives information through different channels, simultaneous auditory and visual. Although intuitively, the availability of the text appears to be useful support for achieving the interpreting task, previous experiments with SIMTEXT have indicated that multimodal input may in fact complicate cognitive processing and, as such, undermine the potential facilitating effect. However, the evidence supporting this hypothesis is inconclusive, since only few studies have addressed the matter, and their methodological design often lacks ecological validity due to artificial experimental conditions, the use of less accurate tools, subjective measurements or the exclusive focus on only one input variable. We therefore propose to explore the effect of multimodal input on cognitive processing in SIMTEXT by designing experiments with professional simultaneous interpreters who will carry out one SI and one SIMTEXT task in near to real-life conditions, that is, in an interpreting booth, wearing eye tracking glasses. By manipulating a combination of input variables related to content, form and delivery of the oral speeches in both experimental conditions (SI and SIMTEXT), we will investigate the facilitating effect of text in SI. The study has a mixed-method design. One the one hand, quantitative data are collected by means of mobile eye tracking glasses to measure the effect of the use of text on cognitive processing and on the allocation of visual attention. On the other hand, qualitative data will be collected by means of retrospective online questionnaires aimed to elicit the participants' perceived cognitive load. Apart from studying the effect of the use of text on information processing, we will also look into its effect on the interpreting product in the form of recordings from the interpreting tasks, which will be submitted to a qualitative analysis. By using a combination of input variables and complementary methods, we intend to investigate the cognitive processing of multimodal information sources in SI from a much broader perspective than has so far been the case in studies on this topic. As such, we intend to generate new insights into the study of multimodality and cognition, that will also be invaluable for SI practice and training.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: de Boe Esther

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

This research project focuses on the subtitling of lectures taught in L2 English, more specifically on how subtitling influences student comprehension of lectures and on what mental effort that subtitling requires from students. This topic is inspired by one of the greatest challenges in higher education in the 21st century: providing educational access to an increasingly multilingual and multicultural student population. To face this challenge, many European universities are considering the possibility of using English as the language of instruction. Yet, a serious drawback to the use of English is many students' limited proficiency in English as a foreign language (L2 English). Subtitling might help to overcome the language barriers posed by L2 English, since it has shown to facilitate comprehension and knowledge acquisition. However, there are currently several knowledge gaps regarding the effects of subtitles on the processing and comprehension of lectures taught in L2 English. We will address the four most relevant knowledge gaps here. First, the potential benefits of subtitles have been studied mainly in the context of foreign language training, with very little research into benefits of using subtitling in other learning contexts. Second, very few studies on the processing of subtitles have measured to what extent subtitles are actually read, which is vital to understanding how subtitled lectures are processed. Third, it is crucial to know - for learning purposes - to what extent subtitles influence the mental effort (i.e., cognitive load) it takes to process subtitling. However, very few studies have measured the cognitive load that subtitling imposes on learners. Fourth, the effects of subtitled English lectures have been examined in students with a high command of English and who have had English as their main language of instruction in primary and secondary education. However, the effects on other types of students remain unknown. In this research project, we aim to address these four knowledge gaps in a controlled setting by conducting an experimental study among Flemish undergraduate students with different levels of proficiency in English. All students will watch three lectures taught in English: one lecture without subtitling, one lecture with English subtitles (intralingual subtitling) and one lecture with Dutch subtitles (interlingual subtitling). Students' eye-movements will be registered using eyetracking. As part of the experiment, the students will fill out post hoc comprehension tests and questionnaires about the cognitive load they experienced. We will conduct statistical analyses to explore if student comprehension and cognitive load of English lectures are influenced by subtitling (present vs. not present), subtitle language (English vs. Dutch) and the students' level of English proficiency (intermediate vs. advanced).

Researcher(s)

• Promoter: Schrijver Iris
• Co-promoter: Robert Isabelle
• Fellow: Van Hoecke Senne

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

In the United Nations' Convention on the Rights of Persons with Disabilities, accessibility to education is mentioned as one of the areas where access has to be ensured. At the University of Antwerp, accessibility services are offered to individual students with a functional impairment; however, the offer does not include the use of new technologies yet, which hold a real potential for breaking down linguistic, physical as well as cultural barriers for a large and diverse student body. One such innovative technology is live subtitling, which can make lectures in large lecture rooms more accessible to all students who attend the class: not only deaf and hard of hearing students, but also students whose mother tongue is not the language of the lecture. The aim of this study is therefore to initiate research into the reception of intralingual live subtitles in an educational setting in Flanders, and in particular, to focus on the reception of intralingual live subtitles by first-year students attending a theoretical lecture in Dutch in a large lecture room. As far as the methodology is concerned, we will opt for a mixed-methods approach: an experiment and focus group discussions. The experiment will consist of two lectures in Translation Studies in Dutch, with and without intralingual live subtitles, attended by 150-200 1st-year students in Applied Linguistics. Student reception of the subtitles (perception and performance) will be investigated through an online questionnaire. Two focus group discussions will allow for the collection of additional qualitative data over perception.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: Schrijver Iris

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project website

Project type(s)

• Research Project

Abstract

An important component of communicative competence is sociolinguistic competence, which is the ability to use language appropriately in communication. Despite an increasing body of research into sociolinguistic features of foreign language (L2) learning, a feature that has received relatively little and/or one-sided treatment to date is the acquisition of sensitivity to (in)formal language use in L2 learners. This project addresses that gap by investigating sensitivity to grammatical formality in L2 learners of English. By using both quantitative and qualitative data, we will map – cross-sectionally and longitudinally – the acquisition of sensitivity to grammatical formality.Quantitative data from an online revision task and qualitative data from semi-structured interviews will be integrated to acquire a more nuanced understanding of how sensitivity to grammatical formality is acquired in L2 learners of English. The results will contribute to a better understanding of how sociolinguistic competence develops in L2 learners and to facilitating sociolinguistically responsive foreign language instruction.

Researcher(s)

• Promoter: Ureel Jim
• Co-promoter: Robert Isabelle
• Co-promoter: Schrijver Iris
• Fellow: Diels Ella

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

Internet, audiovisual media and digital technology are transforming our world. However, their potential will not be realised until they become fully accessible and enable the participation of all citizens in everyday life. Audiovisual translation and media accessibility have become drivers of social inclusion and integration and have lately received full recognition in the literature (Remael, Orero and Carroll 2012) and in EU-funded projects (DTV4ALL, ADLAB, HBB4ALL). In the area of subtitling for the deaf, a key priority for the users has always been to access live content such as news and public events (AOHL 2013). The preferred technique for this is respeaking, where subtitlers listen to the original soundtrack of a programme or public event and simultaneously repeat or rephrase what they hear to a speech recognition software that turns these words into intralingual subtitles for deaf and hard-of-hearing viewers and for all people who support their viewing with subtitles. When respeaking was first introduced in Europe in 2001, subtitling companies needed professionals who could produce intralingual live subtitles but did not know how to go about it, since there was no academic training or research in this area. As a result, respeaking practices differ greatly across countries and quality has suffered (Romero-Fresco, 2011). Since then, the work carried out, amongst others, by the partners in this application as part of EU-funded projects such as DTV4ALL and SAVAS, has helped to advance research and training in this area, and the industry is now employing respeakers trained at our institutions. However, a new challenge has now emerged, as migration streams and the increased multilingual and multicultural composition of societies worldwide have led to a growing demand for accessibility to live audiovisual content and events conducted in a foreign language. Broadcasters such as the BBC and VRT and political institutions such as the UK and the Spanish Parliament have highlighted the need to find professionals who can produce interlingual live subtitles (ILS) through respeaking, a new discipline that will require translating, subtitling and simultaneous interpreting skills. Although the partners in this project are the only scholars in the world who have so far produced research on this new discipline (Szarkowska et. al 2016, Romero-Fresco and Pochhacker 2017, Remael and Robert, fc.), there is still no training available. The main objective of ILSA is to design (IO3), develop (IO4 and IO5), test (IO6) and validate (IO7) the first training course for ILS and to provide a protocol for the implementation of this discipline in three real-life scenarios, namely TV, the classroom and the Parliament (IO7). The curriculum and training materials will be flexible so that they can be integrated in different learning environments for the users and initial target group of the course: translation and interpreting graduate and postgraduate students, and professionals already working as respeakers, interpreters or more generally in translation and accessibility.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: Remael Aline
• Co-promoter: Schrijver Iris

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Education Project
• Research Project

Abstract

Translation and writing are increasingly converging in the professional and educational fields, but it is unclear which competencies translators and writers actually share. This project examines how translation competence and writing competence are related, what writing competence of translators entails and how it is different from the writing competence of writers. The results can inspire a larger study on text-productive competence.

Researcher(s)

• Promoter: Schrijver Iris
• Co-promoter: Leijten Mariëlle
• Co-promoter: Robert Isabelle

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project

Abstract

Translation revision competence has scarcely been addressed as a research topic in translation studies and there is no well-developed model of translation revision competence. The aim of this project is to construct a translation revision competence model and to initiate its validation through an experimental pilot study. The results would subsequently be used as a starting point for a larger study (e.g., a PhD project) on revision competence.

Researcher(s)

• Promoter: Robert Isabelle
• Co-promoter: Remael Aline
• Co-promoter: Ureel Jim

Research team(s)

• Translation, Interpreting and Intercultural Studies (TricS)

Project type(s)

• Research Project