LLaVA C++ server (based on llama.cpp)

by trzyon 10/16/2023, 4:31:52 AM with 2 comments
  • by juliangoldsmithon 10/18/2023, 7:31:05 AM

    Glad to see you're still working on something interesting. I saw the game console you developed many years ago. That paper demystified HDLs and the hardware side of the Z80 for me.

  • by trzyon 10/16/2023, 4:31:52 AM

    Simple API server for LLaVA based on llama.cpp. The llama.cpp project will add server and interactive support for LLaVA but I just couldn't wait. Runs great on my M1 Pro Macbook w/ 32gb RAM. Enjoy! :)