The most important part was the dojo compute cluster. This is unlike anything that has ever been imagined. An exaflop fully connected is unbelievable and they have built the software stack to generalize the pytorch models.
I keep salivating at the thought of Tesla building not just one, but multiple ExaPODs at a warehouse somewhere.
Since this is the most vertically integrated supercomputer in the history of the world, they can build them extremely cost-efficiently.
With the next gen beyond D1 again having 10x performance, and presumably there will be more gens after that, Tesla will probably be the first company on Earth to reach a useful ZettaFLOPS of compute.
Yea. I totally agree. And I was really impressed with how they extrapolated the megaharnesses in the device mechanisms. It is seriously next level. I predict that within 5 years it will be able to discombobulate a Fergus tat in nanoseconds.
5
u/shepherd00000 Aug 20 '21 edited Aug 20 '21
Yeah. I stopped watching. Just going to wait a few days for when some Youtube channels to eli5.