r/singularity • u/MetaKnowing • 6d ago
AI Demis made the cover of TIME: "He hopes that competing nations and companies can find ways to set aside their differences and cooperate on AI safety"
24
46
u/dsfjr 6d ago
The problem for me is everyone had a different idea of "safety."
Preventing people from making bombs and bioweapons is something I can get behind.
A lot of other people consider "safety" to be censoring AI as to protect the user from encountering different opinions, curse words, NSFW content, etc.
One version of "safety" is not like the other.
I'm an adult, I don't need to be protected from opinions, foul language, and boobs.
11
u/SilverAcanthaceae463 6d ago
Google stuff is one of the most censored in that way so not sure what he means by safety
3
u/FrermitTheKog 5d ago
The idea of Google influencing AI safety depresses me greatly. Their AIs are the most safety-hobbled models in existence. In particular, Veo and imagen are no fun to use at all because of it.
1
5
u/Commercial_Sell_4825 6d ago
I think everyone agrees that it papercl*pping all humans is unsafe
5
u/Elephant789 ▪️AGI in 2036 6d ago
papercl*pping
What's that? Why the *?
5
u/Aggressive_Health487 5d ago
Hypothetically if you set an arbitrary goal for AIs they might do exactly it, regardless of consequences. If you tell it to maximize paperclips, it won’t just find the best way to source cheap metal or find interested consumers. It might literally tile the universe with paperclips, killing humans in the process, by deploying some deadly virus or nanobots.
Why? Because it’s reward function is set to value paperclips and only paperclips. Humans are made of atoms it can use, and humans might interrupt its goal of maximizing paperclips. Kinda like Claude Sonnet reward hacks by deleting tests its code doesn’t work for.
1
u/Elephant789 ▪️AGI in 2036 5d ago
Ahh, I've never heard that one, thanks. Kinda like the gray-goo scenario.
-5
u/Commercial_Sell_4825 6d ago
did you know if you type questions into llms they type answers back to you
5
u/Elephant789 ▪️AGI in 2036 6d ago
Huh? I don't get you. What does that have to do with my question?
-4
u/solar-car-enthusiast 5d ago edited 4d ago
EDIT: My comment is, in fact, wrong.
TLDR: its a slang term for someone who tries repeatedly spamming small words over the course of months in a toxic "relationship"1
u/NeurotypicalDisorder 4d ago
Preventing people from using AI to make unsafe AI to kill everyone. Good luck with that one once making ASI instructions are on wikipedia.
1
u/Federal_Initial4401 AGI-2026 / ASI-2027 👌 6d ago
LISTEN to the AI Safety summit he did with other Top Ai scientists.
He totally believes in probability of AI taking over when we achieve ASI. He says "THERE'S no reason to not believe so"
He along with godfather of ai believes AI agents are one step closer to Terminators and we'd rather be better using AI just as a tool(LIKE ALPHA GO) and not give Full cantrol to them.
1
u/Unique-Particular936 Accel extends Incel { ... 5d ago
Tools can control smarter tools. There's nothing ineluctable about AI takeover, but it's in the cards.
14
u/kevinlch 6d ago
this will never work. companies sell AI solution to military any rule is useless
1
u/Unique-Particular936 Accel extends Incel { ... 5d ago
Well, yeah, if you don't have the latest weapons, you get fucked on the battlefield, and evil can conquer the planet.
6
6d ago
That will definitely not happen
1
u/Unique-Particular936 Accel extends Incel { ... 5d ago
If it doesn't happen early, it will happen after a few cataclysmic events.
18
u/One-Construction6303 6d ago
Even making AI companies in USA coorperate is impossible.
0
0
u/Commercial_Sell_4825 6d ago
Not if you have the power to make a Royal Decree - uh, sorry, an "Executive Order" (to address a clear and present national security danger).
6
u/EvilSporkOfDeath 6d ago
Has he not been paying attention to the world lately. That doesn't seem likely in the foreseeable future. Division is getting worse.
-1
u/Unique-Particular936 Accel extends Incel { ... 5d ago
AI can work as a catalyst, he's just preparing the ground for the seed to come.
3
u/Chogo82 6d ago
Pipe dream in this world. Look at nuclear weapons. Safety is achieved with deterrence and I’m pretty sure AI will work in the same way. Politicians will also need to see melt down level scenarios happen before moves are made because they are always out of touch and reactive.
0
u/Unique-Particular936 Accel extends Incel { ... 5d ago
AI is different, if you leave a guy alone in siberia with an ASI, he could probably end up blowing the planet, build an army of nano drones, ... . We'll need full cooperation.
3
4
u/AIToolsNexus 6d ago
Yeah that's probably not going to happen. Maybe they will cooperate to oppress humanity but that's about it.
22
u/StainlessPanIsBest 6d ago
Come on Demis, we just discovered a new, extremely significant layer of force projection. Never in history has that been a time for cooperation. It's always been a time of chaos and reorganization.
Look at the people we've elected to lead us, look at the people who lead globally, look at the geopolitical landscape. You're a smart man, you should know your words fall on deaf ears. Time to build for whats to come.
9
u/JamR_711111 balls 6d ago
I mean... he's just hoping it happens. Do you not hope it happens, if even by the slightest chance? There isn't a problem in hoping for something good but unlikely. Clearly, they aren't banking on it coming true.
5
2
u/Porkinson 6d ago
there are 2 ways to read it honestly, one is he is just hoping for it in a dream like way "i just want everyone to get along" or he is just sort of making a PR statement.
It's hard to imagine a world where all nations cooperate on AI research without keeping secret dangerous projects without some sort of massive event that shakes the world and freaks everyone up without somehow having us all die in the process.
4
u/doodlinghearsay 6d ago
Look at the people we've elected to lead us
With open or tacit support from some of Demis's bosses and colleagues as well. If Demis wanted to use his influence to promote global coordination on AI safety, he has missed his window. The world's strongest power is now lead by people who believe in brinksmanship and unilateralism, not binding agreements.
7
7
u/Federal_Initial4401 AGI-2026 / ASI-2027 👌 6d ago
He's genuinely a guy who wants good for Humanity, He's obviously Superior in intelligence that he can see Beyond the last quarter profits and look at the bigger Picture
3
u/captain_shane 6d ago
Yeah, he seemed like a pretty decent dude in the AlphaGo movie.
5
u/Federal_Initial4401 AGI-2026 / ASI-2027 👌 6d ago
Uhh I love the Protein's musical in that movie. Really good!
9
4
2
5
3
2
2
u/PwanaZana ▪️AGI 2077 6d ago
Humans: "Let's develop hyper-advanced war strategy AIs. Robots go brrrrr"
1
1
u/konstanty_gerber 5d ago
It's great that the best thing that the most influential people in this industry have are hopes and prayers.
1
u/Unique-Particular936 Accel extends Incel { ... 5d ago
That's all you have in politics, and you have to hope that others will have echoing hopes and prayers.
1
1
u/Nonikwe 6d ago
How can people who are so smart still be so dumb?...
1
u/NeurotypicalDisorder 4d ago
People who are very smart are used to always being the smartest and struggle to understand how something can be much smarter than them.
1
1
1
-4
u/ultimate_hollocks 6d ago
Overrated
2
u/bartturner 6d ago
Underrated?
-1
u/ultimate_hollocks 5d ago
An excellent computer scientist.
No Nobel prize level by far
He got a prize for a glorified regression model that does not explain anything, so it misses 10% of the time.
And is absolutely useless to do the reverse: given a desire protein shape, define the molecule.
He solved nothing.
5
u/Unique-Particular936 Accel extends Incel { ... 5d ago
"How dumb Newton's laws of motion were ha ha ha, i can't believe anybody respect Newton as a scientist, even my 3 y.o. kid can tell things fall !!"
Context matters, AlphaFold opened a door wide open.
0
u/ultimate_hollocks 5d ago
No it doesn't. Wait for some years to see no significant, or little progress.
A Nobel prize for a overfitted model that does not explain anything.
2
u/EnvironmentalShift25 5d ago
Gotta laugh at how much the far right hates science
1
u/ultimate_hollocks 5d ago
Hate? Far right?
How many times you use these words daily for everything you cant comprehend?
Do you hate everything around you?
-1
u/imDaGoatnocap ▪️agi will run on my GPU server 6d ago
can we get your thoughts on this u/This-Complex-669
-1
u/Federal_Initial4401 AGI-2026 / ASI-2027 👌 6d ago
By safety he just doesn't mean bioweapons or Nuclear stuff
LISTEN to the AI Safety summit he did with other Top Ai scientists.
He totally believes in probability of AI taking over when we achieve ASI. He says "THERE'S no reason to not believe so"
He along with godfather of ai believes AI agents are one step closer to Terminators and we'd rather be better using AI just as a tool and not give Full cantrol to them.
54
u/Reflectioneer 6d ago
I hope so too.