Training LLMs with AMD MI250 GPUs

  • Their "Table 1" needs 2 more rows: purchase price, and typical hourly rent price.

    The article mentions cost efficiency couple times, yet fails to say anything substantial about that.

  • AMD anounced support for this stack on the RX 7900 XTX is forthcoming. Great to see some challange to the nVIDIA ML monopoly in the homebrew segment.