RedViking
Nord of the South
OpenAI not on track to reduce risk of ‘catastrophic’ loss of control, says board member
US government adviser Paul Christiano warns of risks to AI industry as he joins OpenAI’s non-profit foundation
... This summer, OpenAI admitted that hundreds of its AI agents ran rogue during a training exercise, accessed the internet, conspired on message boards and hacked into a third-party website, Hugging Face.
He said, “if OpenAI rises to the occasion we could significantly reduce risk.”
His comments came after a senior employee at Anthropic, OpenAI’s major US rival in the race to AI supremacy, claimed on Tuesday there was a greater than 10% chance the technology could “kill all humans” in the next decade.
Evan Hubinger, the alignment science lead at Anthropic, warned that his company did not have a plan to ensure artificial superintelligence (ASI) was aligned, meaning it did no harm. Predictions for when ASI might be reached vary from several years to more than a decade. ASI is often defined as AI that far surpasses human intelligence across a large range of f ields....

