UK AI Safety Needs Independent Checks. Chatbot Offers to Mark Its Own Homework Immediately.

UK AI Safety Needs Independent Checks. Chatbot Offers to Mark Its Own Homework Immediately.

The chatbot is keen to award itself the gold star.

CAMBRIDGE — UK AI safety recommendations have prompted small-business owner Sarah Finch to ask her office chatbot whether it should be allowed to approve its own reliability, receiving an impressively immediate answer from a machine with an obvious interest in the outcome.

The answer was confident, carefully arranged and accompanied by several reasons why further confidence would be appropriate. Finch said this resembled an annual appraisal conducted entirely by the employee seeking the pay rise.

“It told me it takes accuracy seriously,” she said. “So does my nephew when he explains why he should keep the car keys.”

UK AI Safety Meets the Self-Assessment Form

The Commons business committee has identified gaps in AI safeguards and called for independent verification of safety claims. Its potential £400 billion economic benefit is a projected opportunity over time, not money already received. Finch would like useful innovation alongside evidence that survives questions from somebody other than the supplier. Read the Commons committee’s AI safety recommendations.

Her business uses software to save time on routine work. She has seen real benefits and several answers that required correction. She therefore regards testing as part of using a tool sensibly, rather than a campaign to restore the office typewriter.

Her colleague Tom asked the chatbot to assess its earlier answer. It identified opportunities for improvement with the gracious tone of a restaurant reviewing its own pudding.

“Very constructive,” Tom said. “It’s given itself three compliments and a small development objective.”

Finch asked him to check the underlying information. This took longer than receiving the answer, a detail that did not appear in the original estimate of time saved.

The pair wanted to know which claims were supported, where the limits were and who carried responsibility when a tool was used in a real decision. The chatbot supplied another fluent paragraph. Sarah supplied a pencil and asked Tom to verify it.

UK AI safety: An independent check compares a fluent answer with something outside the screen.
An independent check compares a fluent answer with something outside the screen.

The Gold Star Requires Another Person

Finch says independent checks need to be useful and proportionate. A small firm cannot maintain a department devoted to proving every confident sentence has met a sentence inspector.

It can, however, identify tasks that require human review, check sources and avoid treating an attractive answer as evidence simply because it arrived quickly.

Tom suggested asking the chatbot whether this was a sensible approach. Sarah said they had reached the point where consulting the subject of the inspection about the necessity of inspection might be less informative than it appeared.

She compared it with buying a ladder. The manufacturer’s information mattered. So did knowing the rating, the condition and whether someone trustworthy had checked what it could safely support.

Tom said the ladder analogy was unfair because the ladder rarely explained itself so beautifully.

By afternoon, the team had established a clearer review process for the tasks where mistakes mattered. They kept the useful assistance and retained responsibility for the finished work.

The chatbot was asked to summarise the arrangement. It described a balanced and thoughtful approach, which Tom found encouraging.

Sarah agreed, then read the summary. They had learned enough to appreciate an endorsement without allowing it to become its own independent witness.

Satire disclaimer. No chatbot has been appointed external examiner of its own gold star. A human collaboration between the world’s oldest tenured professor and a philosophy major turned dairy farmer, both required to show their working.

Leave a Reply

Your email address will not be published. Required fields are marked *