
So….
The robots are no longer storming the gates
Theyโre doing something much worse
Theyโre being given the keys….
๐โ๐๐ฒ ๐ท๐๐๐ ๐ฟ๐ฒ๐ฎ๐ฑ ๐๐-๐ฎ๐ฌ๐ฎ๐ณ
A futures paper written by people who are deeply unfun at dinner parties but unfortunately very serious about AI
Itโs led by Daniel Kokotajlo (ex-OpenAI) alongside a group of forecasting and governance researchers who specialise in asking questions like:
โwhat happens if this goes well?โ and
โwhat happens if this goesโฆ very badly?โ
No sci-fi nonsense
No Terminator vibes…
Just a calm, unsettling walkthrough of how AI progress could accelerate fast once AI starts helping to build better AI
The spicy bit isnโt โAI gets smarter.โ
Thatโs inevitable
Itโs this:
Once the pace picks up, the biggest risk isnโt the technology
๐๐โ๐ ๐๐ต๐ผ ๐ฐ๐ผ๐ป๐๐ฟ๐ผ๐น๐ ๐๐ต๐ฒ ๐ฏ๐ฒ๐๐ ๐บ๐ผ๐ฑ๐ฒ๐น๐
Because history suggests that when enormous power concentrates quickly, humanity responds with:
โข humility
โข restraint
โข thoughtful governance
Just kidding
We panic later
The paper makes a solid case that we probably wonโt get dramatic warning signs
No flashing lights
No clear โoh shitโ moment
Just a shift where decisions get made faster than laws, institutions, or public understanding can keep up
Which isโฆ comforting….
In theory, this could end up in the hands of:
โข governments
โข corporations
โข military interests
โข or tech founders with a messiah complex and a podcast…
None of which fills me with confidence
We absolutely cannot let Elon Musk get control of the most powerful models
But let’s be fo’ real…
If he doesnโt already have them, heโs probably refreshing the repo
Sleep well ๐ฅฐ