Gaia: An Open-Source Project from AMD for Running Local LLMs

  • Seems to be windows only. Also worth noting that the all the currently supported models are 8B or less based on the readme on github