UK Home Office May Face Investigation Over Use of OpenAI-Powered Tools

The UK's Independent Chief Inspector of Borders and Immigration (ICIBI) is weighing a potential investigation into the Home Office’s deployment of generative AI tools to assist in processing asylum applications. This move follows growing pressure from researchers and lawmakers concerned about the transparency and accuracy of these systems.

Use of AI in Asylum Processing

Since late 2024, the Home Office has piloted the Asylum Case Summarisation (ACS) and Asylum Policy Search (APS) tools. These systems are built on OpenAI’s GPT-4 model and Microsoft Foundry. They are designed to:

• Summarize transcripts from asylum seeker interviews.
• Assist caseworkers in searching and summarizing country-of-origin policy information.
• Save approximately one hour per case during review.

Transparency and Accuracy Concerns

The non-profit Open Rights Group (ORG) has conducted a six-month investigation into these tools, highlighting that the Home Office has withheld detailed information regarding their implementation. Concerns raised include:

• Accuracy: Researchers argue the actual error rate for summaries exceeds the 9 percent reported in pilot evaluations. One judge previously cited an "AI hallucinated" document in an asylum case.
• Lack of Disclosure: The tools are not listed in the government's public repository of algorithmic tools as required by the UK’s “AI Playbook.”
• Human Oversight: While the Home Office maintains that trained caseworkers make final decisions, critics worry that automated summaries may introduce cultural biases or factual errors that applicants cannot contest.

Official Response

The Home Office stated that AI tools are used to assist caseworkers rather than replace them, and it has committed to publishing updated evaluations. OpenAI noted its ongoing efforts to improve model accuracy. The ICIBI has not confirmed specific upcoming inspection topics but acknowledged awareness of the concerns regarding AI effectiveness and reliability.