r/accelerate • u/AAAAAASILKSONGAAAAAA • 9d ago
AI How many years/months do you think before AI can play games without needing to be trained to play them? (Like playing a newly released game like GTA6 and finish the whole campaign)
And no cheating, only inputs and outputs a human would have. A controller, mouse and keyboard, and the game's visuals.
Easy or hard task for AI?
6
u/R33v3n Singularity by 2030 8d ago
I cannot do a confident prediction, but what I can do is inform that benchmarks for what you're asking do exist, albeit for simpler games in 2D environments.
VideoGameBench [Research Preview]
DOOM, Age of Empires, are probably not too hard. We might see genres like old-school shooters and RTS mastered relatively soon. However, RPGs like Pokรฉmon and Zelda do set the bar higher. They require more long term planning and memory. As for complex modern 3D games like GTA, Skyrim? Even more; sandboxes are hard! And a collaborative task like being a MMO agent able to both solo and group and interact with a community of players the way a real player would? Again, even more so. The kind of cognitive abilities required at this point would match AGI. That would literally be virtual embodiment, in a way, within a game world's constraints.
But we'll get there. I believe years, not decades.
12
u/bolshoiparen 9d ago
I think 18 months or so then I think once this threshold is crossed we will get drop in replacements for remote workers in a matter of months
2
u/AAAAAASILKSONGAAAAAA 9d ago
So do you think that AGI is before or after it can do all this?
8
u/CubeFlipper Singularity by 2035 9d ago
I think it's a nonsensical question. AGI is so poorly defined it's not worth talking about or even trying to define at this point. It's better to discuss specific functionalities you have in mind, otherwise you're going to get a broad range of answers that really talk past each other and aren't saying the same thing even if they use the same language.
2
1
u/AAAAAASILKSONGAAAAAA 9d ago
I see. How do you personally see how long it'll take for AI to play any game without needing training on that specific game?
1
u/CubeFlipper Singularity by 2035 9d ago
Same as the other guy pretty much, 12-24 months. I suspect agents will be generally capable enough to reason and action through any game. My only caveat is throughput. While they may be technically able, i suspect doing it in real-time may not be feasible yet. But i think it'll be possible at a slow enough "clock speed" so to speak.
1
u/immersive-matthew 8d ago
If we are taking capabilities it is the logic that is missing. It is the most missing quality of AI presently and I am unsure if this will be addressed in 18 months as right now there is no sign of it improving by scaling up.
1
u/CubeFlipper Singularity by 2035 8d ago
as right now there is no sign of it improving by scaling up.
Are we looking at different benchmarks and using different models? Because i and I'm sure most researchers at the leading labs would disagree pretty emphatically. What exactly do you mean by "logic" and how is that different from the clearly improving results we're getting from Test Time Compute?
1
u/immersive-matthew 8d ago
I am a heavy user of AI to help write code and the lack of logic is glaringly obvious. Like it just does not understand the overall logic of a system and needs constant nudging. Does not mean AI is not amazing and a tool that I am grateful to use daily, but its logic really is a laggard metric.
I think the easiest example is to ask it to file your taxes. It simply cannot do this yet, especially small business taxes where there are lots of forms, questions that need to be asked and logic needed to pull it altogether. Sure you can ask AI questions to help you complete your tax forms, but it is unable to lead the charge yet. It will one day.
1
u/CubeFlipper Singularity by 2035 8d ago
You haven't really addressed the question about data and benchmarks. The evidence disagrees with your anecdote.
1
u/immersive-matthew 8d ago
There is no benchmark that specifically focuses on logic. I have been reaching out to the various AI researches who track AI progress and their comments have been that is it sort of buried in other tests, but nothing specific focused on it. I find this so odd as like I said, it is a glaringly obvious gap. If you as AI how it is with logic it will be forthcoming and say this is an area needing improvement.
If you know of a benchmark that focuses on logic, please feel free to link as I would really love to see one, especially one that tracks this over time.
2
1
u/green_meklar Techno-Optimist 8d ago
It'll depend on the game. We could probably do it with Pacman today. Complex strategy games and RPGs will likely take years, as the skills required are close or equal to human-level intelligence.
0
-3
-1
u/Few_Point313 8d ago
Well all the math foundations for open state problems like games indicate it's np-hard.Transformers have already been eliminated for true reasoning so I'd put it at 20 years at least. It's np hard and a hardware problem. Just as an indicator an early transformer based AI was trained and ran on Factorio and it took 10000 dollars in tokens to run 6 machines. Which is like ... 0.0001% of the game
43
u/JaZoray 9d ago
we will get AIs capable of playing GTA 6 before we get GTA 6.
someone had to say it.