Ask HN: Case Study on Training LLMs on Apple M2 Ultra Neural Engine?

  • The Neural Engine itself on those is pretty much non-comparable to something like an H100. The GPU is much more suitable for training, or even the CPU probably.