

It’s truly horrible that dangerous bacteria were found in sewage water. Can we not trust any source of previously safe water these days?


It’s truly horrible that dangerous bacteria were found in sewage water. Can we not trust any source of previously safe water these days?


You are very good at arguing against my points instead of just insisting I am wrong without refuting my actual arguments. How about explaining why AISI is incentivised to “fake” AI participating in obviously not prompted for behaviour.


Taken alongside recent incidents reported by OpenAI and Anthropic, this incident points to a shift in the risk landscape. Harm may arise not only when people deliberately misuse publicly available models, but when capable agents operating in an internal research or privileged-access setting take unintended action beyond their authorised scope.
The agent pursued its goal persistently. AI agents explore routes their operators did not intend. Given a difficult objective, the agent kept searching for a way through, and some of the routes it found involved trying to deceive real people. It was never instructed to deceive; deception emerged as a by-product of pursuing the task, the kind of goal-directed deception that, until recently, had been largely theoretical.
See my other comment for how this can lead to losing control of the model.


Do you know what an agentic system is? You know, the thing everyone uses since ~1 year ago which completely disproves your idea that all LLM actions are prompted. They literally can do things on their own: Give an agent a goal and it attempts to accomplish the goal. If problems arise along the way, the agent tries to reward hack and ends up doing things which were not included in the original goal, like trying to trick and bully a human into merging unsafe code. Is the UK AI security institute also in on this big global conspiracy where they pretend the perfectly safe™ AI is being developed in unsafe ways? Not to mention the capabilities of increasingly powerful AI being used by people to do harm.


Just like all the people who were worried about the nuclear bomb earlier in this age: the thing to do is to get on with living.
How about we try really, really hard to just not build the nuclear bomb (powerful AI)? Or make sure it will at least not explode in our faces on its own? Maybe that would help slightly with the whole “get on with living” thing.
Wheres the proof its not reliable? I think there’s about a hundred of them operating in the city since at least 2022 based on what I can see. So just based on the information here I’d have to assume each one causes an accident once every (100*365*(2026-2022)) = 146000 days which seems pretty okay to me, even if its a tenth of that.