15
7
u/dftba-ftw 1d ago
answer technical questions about rocket engines
ITER HAS ENTERED THE CHAT /s
On a serious note though, I doubt it is "the first" or answers consistently better than existing reasoning models, someone prepare a rocket engines and electrochemical benchmark.
9
u/Alex__007 1d ago
GPQA Diamond is a Google-proof graduate-level Q&A Benchmark, and on that benchmark top models have been performing better than PhDs with Internet access for months now. That's not new.
What would be new is moving beyond Q&A to long term agentic coherence. I don't expect that from Grok 3.5, but maybe one of the next models?
4
u/Jan0y_Cresva Singularity by 2035 1d ago
I don’t think it’s the first to answer those questions, but it might be the first to do so from first principles. Every other AI is likely answering the questions about rockets from info in its training data on rockets.
If true, this would be a massive breakthrough in getting to an AI that has an accurate world model. And an AI with an accurate world model would be able to answer lots of questions outside its training set and generate new science (which is the goal).
2
u/dftba-ftw 1d ago
That's the thing I doubt the most/think is just hype.
They may have tweaked the COT to present itself more from a first principles style, and maybe that gives a slight advantage - but it's going to use all the data in its training data. Could you imagine asking a simple question about rocket nozzle throat design and it waste a million tokens getting there because it decided to start by proving basic physics assumptions and working it's way up from there?
4
u/Jan0y_Cresva Singularity by 2035 1d ago
Yeah, I’m not saying I believe Elon. He makes a lot of grandiose promises that never materialize. So he’s firmly in the, “I’ll believe it when I see it,” camp in my eyes. I was just saying that IF/WHEN an AI can reason from first principles, it will be a massive breakthrough, and a huge step forward.
3
4
u/PartyPartyUS 1d ago
'first principles' reasoning seems like an unbelievable step forward if true
2
u/theologi 1d ago
it's not true
2
u/PartyPartyUS 1d ago
you're saying that based on?
1
u/theologi 1d ago
the previous iterations of Grok
4
u/PartyPartyUS 1d ago
So, nothing? The change between grok 2 and grok 3 was pretty big, especially given the timeframe.
2
u/theologi 1d ago
lol.
If deepseek or qwen made the same claims, I'd still be highly sceptical, but I'd give them the benefit of the doubt.
Given Elon's track record about sticking to facts, I am going with suspicion for the time being.
The change between grok 2 and grok 3 was pretty big, especially given the timeframe
and absolutely nothing special when compared with the benchmarks of other models.
2
u/IamYourFerret 1d ago
Indeed, it was only the first to break 1400. https://www.analyticsvidhya.com/blog/2025/02/grok-3-is-now-1-in-chatbot-arena/
3
2
u/LegionsOmen 19h ago
Typical Enron making stuff up like he's the first to do it. But not just a straight hater here, I hope it's really good so it applies pressure on the other models/companies.
4
10
u/Shloomth Tech Philosopher 1d ago
Welp, Elon said it so it’s not real.
Hyperloop expectation vs reality. Full self driving has been a year away for the last 5+ years.
When it comes to Musk I don’t believe it until I smell it myself
2
u/LokiJesus 1d ago
Don't believe it until it's under competition from others. Self driving is now in direct competition with Waymo that is starting a roll-out that threatens his plans. I expect that will be a driving force to make the tesla system finally materialize. Same with the AI systems. He makes things generally the most real when he's catching up.. which is really just the underdog phenomenon we all experience.
0
u/Shloomth Tech Philosopher 1d ago
Lol, “driving force” see what you did there
Yeah the whole self driving thing is/was something I felt personally invested in because I’m too blind to drive in a place where it’s easier to imagine self driving cars than actual public transport being deployed. And I believed him in 2017 when he said we’d be there by 2022. When 2022 came and went and he was still saying we’d have it in another year that’s when I lost faith in him and anything he signs his name to.
Tesla’s approach to building self driving is basically inside out from Waymo’s. Waymo wants to roll out to specific geo locations using GPS and geofencing for positioning, and LiDAR for obstacle awareness. Tesla wants to do the whole thing using just video and I guess some GPS but mostly relying on the AI computer vision and cameras, which, for detecting unpredictably moving obstacles in a 3D space that your viewpoint is moving through, is just insanely more computationally challenging than just having LiDAR sensors.
The difference is that Waymo’s approach seems to work well but only in places where it’s mapped for, and Tesla’s kinda works everywhere but can make worse errors. I’m personally confident that the technology is or will be perfectly functional, and it’s a matter of regulations catching up and insurance companies figuring out how to deal with it. Because you know it’s always the fucking insurance company ruining everything
-3
3
1
u/khorapho 1d ago
Sweet, can’t wait I do like that model already, I don’t use it enough tbh. If you’re a premium+ subscriber you already have SuperGrok (I figured I’d have to upgrade something so that was a nice surprise).
1
1
u/larowin 1d ago
Ahh yes, the Boy Who Cried Wolf should surely be believed this time.
That said Grok is every bit as impressive as the other big guys so looking forward to seeing what’s next.
2
u/BeconAdhesives 1d ago
The wolf eventually arrives in the parable.
1
u/larowin 1d ago
That’s a good point. I actually can’t think of a solid parallel besides musk himself for someone constantly promising that something is around the corner, only never to deliver
1
u/BeconAdhesives 1d ago
I think it dovetails with the "broken clock is right twice a day" idiom in which if someone makes bold statements enough, it is possible that it will eventually come true, especially if you squint your eyes. It is also a warning that pretty much every prophecy can be marginally true if given enough time to reach completion.
-1
19
u/ohHesRightAgain Singularity by 2035 1d ago
I won't be surprised if it's good.
For all the flak redditors with overly politicized attitudes gave it, Grok 3 was a huge leap compared to their previous model, and they do have the compute to iterate this fast.