Association of Interpreters and Translators (AIT) – Written Evidence (ITS0047)
House of Lords Public Services Committee
Inquiry: Interpreting and translation services in the courts
At AIT our aim is to achieve and maintain protection of title and the regulation of the profession by helping to raise the skill and passion of Interpreters and Translators. AIT links members with professional training courses, CPD training, networking opportunities and more. AIT is a member of the International Federation of Translators (FIT), FIT Europe – Regional Centre for Europe of the International Federation of Translators (FIT), the European Legal Interpreters and Translators Association (EULITA), Professional Interpreters for Justice (PI4J), Public Service Interpreters and Translators Group (PSIT) and the MOJ Language Services External Stakeholder Forum.
Contributors: Byron Campbell, Elena Shutova, Gintare Daunoraviciute, Helena El Masri, Irina Sanders, Sophie Man-Cheung and Sue Leschen.
Table of Contents Page
Submission
Appendix 1
Appendix 2
Appendix 3 – Response by FIT Europe to Question 6 and 7 of the Inquiry
Submission
To what extent do the current interpreting and translation services provided in courts meet the needs of those involved in proceedings, including defendants, witnesses, prosecutors and legal professionals?
How have interpreting and translation services changed in recent years?
What are the key issues in the provision of interpreting and translation services and what impact do they have on the running of the courts, public trust, interpreters and translators.
Is there data on the number of miscarriages of justice due to ITS error?
Are the required qualifications and experience of interpreting and translation services in the courts consistent?
Are the recommended requirements standardised across all governing bodies, contractors, and institutions?
Are the current requirements fit for purpose?
What quality assurance and complaints procedures are in place in relation to interpreting and translation services in the courts?
How easy is it for people to report or submit a complaint?
What data exists on the number and types of complaints made?
How easy is it to recruit and retain skilled interpreters and translators to work in the courts?
What opportunities, barriers and pitfalls exist and how might these be addressed?
What is the potential role of new technology (such as artificial intelligence, machine translation and the digitisation of court proceedings) in the future of interpreting or translation services in the courts? (see Appendices 1,2,3)
Would adoption of this technology in the courts be an appropriate use? (see Appendices 1,2,3)
What tools already are already in use in ITS, what form do they take and in what situations are they used?
Is the current and future ITS workforce being prepared to work with technology? If so, how?
What is the current capability and accuracy of market leading artificial intelligence and machine translation tools in relation to ITS? (see Appendices 1,2,3)
How does this vary between languages (e.g. low resource languages or languages with relatively few written language samples), interpreting (speech to text) and translation (text to text)? (see Appendices 1,2,3)
What capability do these tools have to deal with dialects, nuance and colloquial use of language? Request for written evidence (see Appendices 1,2,3)
Appendix 1
Position Paper on the Use of AI in Interpreting by the International Federation of Translators
The integration of Artificial Intelligence (AI) into the field of translation and interpreting presents significant issues for both professional interpreters and the individuals whose words they interpret. As a global body representing over 65,000 individual translation, interpreting and terminology practitioners in over 65 countries, the stance of the International Federation of Translators is firmly against the replacement of human interpreters with unsupervised, unrevised machine interpreting and translation, as it creates unacceptable levels of risk and error, and undermines the role of professional interpreters and translators.
The global trend of the previous decades has been towards increased support and investment for wider implementation of strict accreditation and quality assessment standards, increased training and ongoing professional development. We fear that increased use of artificial intelligence will severely reduce overall levels of human skill and professional competence in vital areas, leading to deskilling of professions and a marked decrease in the number of active professionals. Given the vulnerabilities evidenced during the recent technology failure due to a global IT outage, replacing skilled humans with technology entirely is a decision fraught with risk, liability, and very real consequences.
Legal Basis
The right to a fair trial is a fundamental right enshrined in law[27]. Those who do not speak the language of the court have a legal right to the assistance of an interpreter in order to be able to exercise this right in proceedings in which they participate [Article 8(2)(a) ACHR[28], 2010/64/EU[29]].
Replacing certified human interpreters with machine ‘interpreting’ via voice-to-text and text-to-voice transfer raises serious concerns regarding the accuracy, impartiality, and clarity of interpreting in sensitive legal and administrative proceedings.
Rights Denied
Given the right to a fair trial is a fundamental right enshrined in law, those who do not speak the language of the court are legally entitled to an interpreter’s assistance to exercise this right. Miscarriages of justice have occurred due to the lack of a professional interpreter[30]. Critical failure in interpreting caused by technology would similarly result in miscarriages of justice and subsequent legal challenges. MT and AI are not currently capable of replacing legal translators and interpreters.
Accountability
The use of technology in legal and administrative proceedings raises the issue of accountability. A human interpreter can be held liable for errors, but a technical device cannot. This lack of accountability for machine-generated errors poses significant risks to the fairness and integrity of proceedings. All parties to the proceedings should be liable for their actions and the implications thereof, and this includes those who supply a device being held liable for the device’s failures.
Confidentiality
Machine translation and AI cannot reliably ensure the confidentiality required in such proceedings, posing risks under GDPR and other privacy laws.
Personal Context
Individuals requiring interpreting in legal or crisis settings are likely to be highly traumatised and in a situation of high stress, lacking adequate social, family, and financial support. They are highly vulnerable, making accurate and empathetic interpretation critical. Machine versus empathetic human interpreting would compound their situation of vulnerability.
Technical Issues
Machine translation has demonstrated limited competence[31] with speech recognition complexities, such as modulation, volume, pitch, regional dialects and linguistic nuances. These errors are much greater in rare language combinations or languages with limited training data. Even small errors can have grave consequences in legal situations. The automated transfer between languages is (and is likely to remain) far from fault-free for a considerable time in the future.[32] Machine translation is but a translation tool, not an interpreting service. It fails to adequately address cultural differences and contextual subtleties that are critical in high-stakes interpreting situations such as legal, health, emergency and crisis management and refugee settings.
Cultural Considerations
Cultural understanding and nonverbal communication are crucial in interpreting. Technology cannot adequately convey cultural nuances, body language, idiomatic expressions, and context-dependent meanings, leading to possible misinterpretations and subsequent harm and infringement of rights.
Sustainability of the profession
Experienced, professional practitioners are leaving the profession. Issues with poor rates of pay and conditions, changes in the way individual practitioners are engaged and remunerated, and the “appification” of service provision are major contributors to job dissatisfaction and low morale. Similarly, the use of technology as a cost-saving measure has negatively affected working conditions. If current trends continue, they “may cause a skills drain in the language industry, jeopardising the sustainability of the translator workforce and hindering the industry’s healthy growth”.[33]
Using machine interpreting as a stop-gap for a lack of interpreters is problematic. The solution to any shortage is not to fill it with untrained professionals willing to do the work for less or with technology. While technology can assist in quality assurance in interpreting, it falls short of human capability. Effective interpretation requires more than just any form of translation; it requires accuracy and human oversight.
Conclusion
AI-powered translation is currently an unreliable technology and is not sufficiently mature to adequately replace human translators and interpreters in sensitive legal situations. Artificial Intelligence cannot be used in an unsupervised manner and requires professional human oversight both now and for the foreseeable future. Arguments in its favour that derive from financial and budgetary considerations belie a false economy, as the costs associated with failure far outweigh the cost of appropriate implementation by humans.
Appendix 2
Position Paper on the Use of AI-generated Translation and Interpreting at Court
By EULITA - European Legal Interpreters and Translators Association
On 27 September 2024
At EULITA we know that the quality of software products in our sector is increasingly better, but we also know that the accuracy level of their output is not the same as that of human translators and interpreters. We strongly believe that in sensitive areas, such as administrative, legal, medical and other settings, focus should remain on the risks involved. Even the slightest inaccuracy in translation and/or interpreting can result in serious consequences for the parties involved and we take the stance that such risk must not be taken.
Machine and AI-generated translation and interpreting are above all much faster than human translation and interpreting. However, they struggle with complex context, lack consistency, are inaccurate for lower-resource languages and not sufficiently accurate for legal, administrative, medical and other settings. The courts should be the last setting where machine and AI-generated translation/interpreting are used. If the new technologies are introduced to courts without a proper risk assessment, serious damage will be done.
Legal Basis
The right to interpretation and translation is guaranteed by the European Convention of Human Rights and Fundamental Freedoms, in particular its Article 6, which ensures the right to a fair trial by requiring that a defendant must be assisted by an interpreter if they do not understand or speak the language used at the hearing. The Directive 2010/64/EU of the European Parliament and of the Council of 20 October 2010 on the right to interpretation and translation in criminal proceedings facilitates the application of the right to a fair trial in practice. Member States shall take concrete measures to ensure that the interpretation and translation provided meets the quality required under Article 2(8) and Article 3(9).
Liability
It is worth noting that the liability issue with machine and AI-generated translation and interpreting remains unresolved. The software developers of such applications are reluctant to take any liability for their products used in the public domain, and are only willing to take liability up to the amount of the license fee for licensed applications. Our worry is that the deployers of such technologies in the administrative and legal fields, for example ministers putting forward legislative proposal[34] for technical devices to be used in the aforementioned settings, are also not willing to take on the liability for any mistakes of such tools and technical devices. Before there is a clear answer regarding the liability for both, software developers and deployers of their products, no technical device or tool should be used for interpreting or translation in administrative, legal, medical and other settings, where mistakes can lead to serious consequences.
Confidentiality
Machine translation and AI pose risks under GDPR and other privacy laws, as well, as the issue of confidentiality remains unresolved. It needs to be addressed, as in administrative, legal, medical and other similar settings personal data are always used. Therefore, it should be known in advance how they are stored and if appropriate protocols are being followed.
Accuracy
Professional legal translators and interpreters are trained in order to acquire and maintain their language proficiency in two languages (source language – SL and target language – TL), to get familiar with different fields of law and other subjects, and to learn interpreting techniques. They also abide by the code of professional ethics[35], putting emphasis on impartiality, accuracy, confidentiality, obstacles to performance quality etc. Because of this, they know where the major differences are between legal systems and can adequately translate/interpret the meaning. They are also aware of cultural differences. When interpreting, they understand the context, as well as the emotional state and the body language of the speaker, which allows them to choose the right tone of the output. Because of all that they are accurate when translating and interpreting.
It needs to be noted that the source for data of any AI and machine translation tools is the internet, where a lot of data are provided for some language pairs, in particular in combination with English, however, data which could serve as a basis for other language combinations, in particular involving the languages of lesser diffusion, are scarce or even non-existent. These tools also struggle with dialects, nuance and colloquial use of language. Sometimes they tend to convert positive statements to negative ones. They may add some phrases (hallucinations) or omit crucial parts of a sentence or an utterance. If this would happen in any part of a police investigation or court proceedings, the consequences may be devastating.
Conclusion
At EULITA we believe that even machine generated or AI generated texts/speech should be checked by a qualified translator/interpreter who is fluent in both languages (the source language and the target language) and is able to check the proposed output.
AI presents both benefits and risks. It is the role of the states to ensure that human rights, democracy and the rule of law are protected and promoted in the digital environment. We propose that any changes in the field of translation and interpreting are introduced only after thorough consultation with professional translators and interpreters and their associations.
Appendix 3
Written Evidence submitted by the FIT Europe – Regional Centre for Europe of the International Federation of Translators (FIT) on 23 September 2024
FIT Europe, the regional centre of the International Federation of Translators in Europe, represents the interests of around 40,000 professional translators and interpreters who are members of European T&I associations. This submission was prepared at the request of AIT, one of the UK-based members of FIT which falls within the FIT Europe territory.
Our internal statistics show that many such associations have individual members who are engaged in legal translation/court interpreting. We are therefore uniquely placed to respond to certain of the issues raised as part of this inquiry and to provide a European perspective on them.
FIT Europe monitors the state of the T&I sector at European level and has identified several important trends in recent years:
In light of the above, in response to questions 6 and 7 posed by the Inquiry, the Board of FIT Europe is of the opinion that technological systems like neural machine translation (NMT) and artificial intelligence (AI) should not be deployed on their own in high stakes settings like court/police/migration interpreting or for related translations. While there have been advancements in these technologies (especially NMT) they are still not there. Translation by AI is a mere side-effect. LLMs were not designed to translate. Developers of such NMT/LLMs specifically recognise their limitations in this regard and include disclaimers that the output should not be trusted and that the services of a professional should be sought. Even the European Commission which has developed the e-translate tool (its own NMT system) includes such a disclaimer. MT requires caution. Raw outputs cannot be relied on is high stakes settings.
Any attempt to deploy such technologies unsupervised are to be deplored. Governments around Europe are increasingly seeking to cut costs/ “cut corners” using such tools (with such initiatives being launched in the Czech Republic, Poland and Greece at present) but in doing so they overlook concerns which ought to be central to any well-functioning legal system: ensuring that trials are fair, upholding the rule of law, providing full access to justice for all parties. Governments may be saving money in deploying such tools but this is a false economy: more is lost than gained when professionals are removed from the equation. Especially in the realm of court interpreting/legal translation the academic consensus is that such systems cannot perform comparative law operations; each legal system represents—via the medium of its own language—its own unique legal approach to the world. While such technological systems may be able to replace one word with another, that is not what a professional translator does in the legal realm; they adequately convert the meaning of the phrase into another language; they can identify areas where such conversion is difficult/not possible because of the major differences between legal systems; they can modulate the tone of the text/words to make them comprehensible to the reader/listener (for example by converting a highly legalistic text into simpler words for an uneducated before the court to grasp what is going on in the proceedings). Such systems also have a well-recognised tendency to convert positive obligations/statements to negative ones and to omit key parts of the sentence, things which are unacceptable in a legal setting. Such technologies promote the idea that a “sort of rough idea of what was said / written” is ok; in legal settings, though, accuracy and precision are key. The law operates through the medium of words; lawyers and judges choose their words with great care. Such systems unfortunately do not in their current statement of development. System performance differs from language to language. These systems tend to perform better between major languages (say between French/German and English) and much poorer between lesser spoken languages (say between Hungarian/Maltese and English). Improvements are, of course, constantly being made, but numerous studies show that the improvements are now incremental and that a plateau of performance may have been reached. Irrespective of such improvements, the problems outlined above (omissions, etc.) have not been resolved and may not ever be resolved given the architecture of these systems. Such inconsistent levels of performance in the specific setting speak more to the need not to use such systems (or use them with great circumspection and always under the guidance of a paid expert) rather than to use them. In response to your specific questions, nuance is frequently lost. Such tools and systems also struggle with dialects. Simply adding data does not appear to solve these problems. Using synthetic data can lead to language model collapse and worsening quality of the output rather than better quality.
Interestingly, judges all around Europe have differing opinions on the acceptability and use of such technologies in the courtroom. Our research into this matter reveals more instances of judges rejecting such technologies than accepting their use because of deep-seated (and well-founded, we would add) concerns about the reliability / accuracy of these tools. We reiterate the language of the law is the language of precision, not the language of approximation. The future of a court system reliant on such technological systems alone is a future likely to one of injustices being done. Thus, FIT Europe is of the opinion that the adoption of this technology in the courts is not an appropriate use.
Additionally, there is a growing body of evidence that the environmental implications of wide-spread use of such systems is devastating in terms of power and water requirements for the data centres and in terms of mining to procure the rare earths needed for these technologies.
This is not to say that such tools should not be used by professionals. One would not envisage creating scalpel-welding devices to perform cheaper, more efficient surgery on people; a qualified surgeon is always required. Similarly, a qualified professional may use MT/AI as a tool to help them with their task but the tool should not be used on its own. The risks and harms in legal settings are simply too high. Naturally since the emergence of these technologies professionals all around Europe have been engaged in training on how to use them properly. The annual ELIS surveys have consistently shown over many years now that technology is the number one topic that translators/interpreters take training courses in.
FIT Europe is of the view that no AI or MT tool is capable of ensuring the requisite decree of accuracy in relation to ITS. The cost of procuring and using such systems/tools is high; they do not solve the problem in reality. They undermine fundamentals of the legal system that the judiciary should be striving to safeguard. The government would be better served investing in human professionals who are better able to provide procedural safeguards, through better pay, recognition of status and improved working conditions.
30 September 2024
[1] https://www.lawgazette.co.uk/news-focus/courtwatchers-expose-a-wild-west/
[2] https://www.thetimes.com/uk/law/article/shortage-of-interpreters-delays-trials-6l0s63hvr
[3] https://www.lawgazette.co.uk/law/blame-game-begins-as-google-translate-stands-in-for-court-interpreter/5062426.article
[4] https://publications.parliament.uk/pa/cm201213/cmselect/cmjust/645/64505.htm
[5] https://www.lawgazette.co.uk/news/court-interpreters-raise-grievances-over-new-booking-system/5120088.article
[6] Interpreter for the R.vs Rrahman, Koro,Tabaku, Petku and others trial dated 18/07/2023 shared the following experience: The trial was adjourned due to a lack of Albanian interpreter, I was notified that the Birmingham Crown Court is looking for an Albanian interpreter for as soon as possible. I attended the trial, interpreted during a 6-week long trial alone for 3 Albanian defendants with no dock partner.
[7] https://publications.parliament.uk/pa/cm201213/cmselect/cmjust/645/645vw52.htm
[8] https://www.ft.com/content/55447226-af9c-11e9-8030-530adfa879c2
[9] Later renamed to Diploma in Police Interpreting (DPI)
[10] https://irr.org.uk/article/still-privatised-still-undervalued-new-court-interpreting-contract-from-31-october/ - :~:text=In July 2016,an interpreter attends
[11] https://webarchive.nationalarchives.gov.uk/ukgwa/20100920143916/http:/frontline.cjsonline.gov.uk/guidance/race-confidence-and-justice/
[12] https://publications.parliament.uk/pa/cm201213/cmselect/cmjust/645/64505.htm
[13] https://insidetime.org/legal/lost-in-translation-interpreters-and-the-need-for-caution/
[14] https://publications.parliament.uk/pa/cm201213/cmselect/cmjust/645/645.pdf
[15] https://www.thebritishacademy.ac.uk/documents/4540/Languages_Provision_in_UK_Final_v2.pdf
[16] https://www.lawgazette.co.uk/practice-points/lost-in-translation/5118545.article
[17] https://restofworld.org/2023/ai-translation-errors-afghan-refugees-asylum/
[18] https://easyai.uni-mainz.de/html/machine-interpreting.html
[19] https://www.theguardian.com/us-news/2023/sep/07/asylum-seekers-ai-translation-apps
[20] https://openresearch.surrey.ac.uk/esploro/outputs/journalArticle/Video-mediated-interpreting-in-legal-settings-in/99513677302346
[21] https://en-gb.thebigword.com/news/uk-courts-implement-new-safety-measures/
[22] https://www.sciencedirect.com/science/article/pii/S2095809921002745 - :~:text=First, new evaluation,not be translated.
[23] https://www.theguardian.com/us-news/2023/sep/07/asylum-seekers-ai-translation-apps
[24] The ethics of artificial intelligence: Issues and initiatives, a study produced by the Science Communication Unit at the University of the West of England outlines a number of ethical implications and moral questions that arise from the development and implementation of AI technologies: https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf
[25] https://www.middlebury.edu/institute/news/eight-key-insights-ai-and-future-translation-and-interpretation
[26] https://aiic.co.uk/site/uk-ie/AI-interpreting/AI-human-insight-importanceofunderstanding
[27] Universal Declaration of Human Rights (UDHR) 1948, Articles 10 and 11; International Covenant on Civil and Political Rights (ICCPR) 1966, Article 14; European Convention on Human Rights (ECHR), 1950, Article 6, Geneva Convention III, Article 102 and Additional Protocol I, Article 75, Rome Statute of the International Criminal Court (ICC) 1998, Article 67, among others.
[28] “[T]he right of the accused to be assisted without charge by a translator or interpreter, if he does not understand or does not speak the language of the tribunal or court;”
[29] This requires that Member States ensure that interpretation and translation are of sufficient quality, and to ensure this quality, Member States must endeavour to establish a register of suitably qualified independent translators and interpreters not only at national but also at European level.
[30] Kunnath v. Switzerland (2006) – European Court of Human Rights; Cuscani v. United Kingdom (2002) – European Court of Human Rights; Abdusamatov and Others v. Russia (2019) – European Court of Human Rights; among others.
[31] https://www.theguardian.com/us-news/2023/sep/07/asylum-seekers-ai-translation-apps
[32] See the notion of ‘catastrophic errors’ as used in pertinent scholarly literature: Kocmi et al., 2021, p.160).
[33] Sakamoto et al., p55.
[34] An example of such a deployer is the Czech Minister of the Interior who in autumn 2023 sent to the Czech Parliament a draft Foreigners Act with the following provision in Article 419, para. 3, which reads: “(3) In interpreting an act in proceedings, the administrative authority may use a certified technical device instead of an interpreter registered in the list of interpreters and translators.” He has slightly changed this provision since, but still proposes the use of a technical device.
[35] EULITA Code of Professional Ethics at https://www.eulita.eu/wp-content/uploads/files/EULITA-code-London-e.pdf.