UK government has been using AI for all sorts and it's going as well as you might expect

23.10.2023 - 15:33 / pcgamer.com / And It / Ai

The UK government is using deep learning algorithms, under the catch-all umbrella of AI, to help its various sections make decisions in welfare benefit claims, ascertaining cases of fraud, and even the scanning of passports. That's all probably of no surprise whatsoever but as one investigation suggests, it's opening a massive can of worms for all concerned.

If you're wondering what kind of AI is being talked about here, then think about upscaling. The systems employed by the government aren't too dissimilar from those developed by Nvidia for its DLSS Super Resolution technology.

The data model for that is trained by feeding it millions of very high resolution frames, from hundreds of games. So when the algorithm is then fed a low resolution image, it can work out how the frame is most likely to appear once it's been upscaled.

DLSS upscaling uses a fairly standard routine to make the jump from 1080p to 4K, for example. It then runs the AI algorithm to correct any errors in the image. But like all such systems, the quality of the end result depends massively on what you feed into the algorithm and what the dataset was trained on.

An investigation by the Guardian into the use of AI by the UK government highlights what happens when there are problems with both of those aspects. For example, the publication reports that the Home Office was using AI to read passports at airports, to help flag up potential fake marriages for further investigation.

The Guardian says an internal Home Office evaluation shows the algorithm is highlighting a disproportionate number of people from Albania, Greece, Romania, and Bulgaria. If the dataset was trained on data that itself is already over-emphasising particular traits in the survey, then the AI will be just as biased in its calculations.

News reports of government organisations getting things seriously wrong because of the over-reliance on AI aren't rare. The hype surrounding the potential of artificial intelligence has led to the likes of ChatGPT being treated as being one of the most important inventions right now, and yet it can easily produce some highly questionable and shocking results.

The UK government naturally defends the use of AI and in the case of welfare benefit claims, says that the final decision is made by a person. But does that person base their decision on the algorithm's output or do they go back and check everything again? If it's the latter, the use of AI has been a total waste of time and money.

But if it's the former, and the AI has been trained on information that's already biased, then that final, ultimate decision made by a real living human being will be biased too. Even seemingly innocent use scenarios are affected by this, such as