Blooper or Real Small Model Benchmark – 3000 tokens/sec in your browser

1 point by logicallee 12 hours ago

I saw some great results from really tiny LLM's, and ended up making a little benchmark so I could test them in the browser. Chrome, Firefox, Safari and Edge are all supported via web-GPU. I got very fast speeds 30-40 tok/sec even on limited hardware. Let me know what you think!