WebGPU in Chrome Canary now supports float16 for faster local LLM inference

by NiekvdMaason 9/5/2023, 4:29:10 AM with 2 comments
  • by no_timeon 9/5/2023, 6:55:05 AM

    I hope they gate webGPU behind a per domain allow/deny notification like they do with location and camera access.

    This whole thing is just begging to be exploited by cryptominers.

  • by NiekvdMaason 9/5/2023, 4:31:58 AM

    To test, run Chrome Canary with:

      --enable-dawn-features=allow_unsafe_apis,disable_robustness
    Then, open: https://webllm.mlc.ai/#chat-demo