He mentions that biologically all mammals follow a scaling law of body size to brain size. The glaring exception is hominids, the ancestors of and present day humans. So there is a way that's different than everything else.
Meaning, just because the scaling law of data to AI quality is what we see right now, it doesn't mean a new fundamental paradigm or architecture can't come around and change that scaling law significantly on us. There's precedent for that.
This recap misses one major point from the talk.
He mentions that biologically all mammals follow a scaling law of body size to brain size. The glaring exception is hominids, the ancestors of and present day humans. So there is a way that's different than everything else.
Meaning, just because the scaling law of data to AI quality is what we see right now, it doesn't mean a new fundamental paradigm or architecture can't come around and change that scaling law significantly on us. There's precedent for that.