Show HN: WebGPU enables local LLM in the browser – demo site with AI chat
andreinwald Saturday, August 02, 2025Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android.
Demo, similar to ChatGPT https://andreinwald.github.io/browser-llm/
Code https://github.com/andreinwald/browser-llm
- No need to use your OPENAI_API_KEY - its local model that runs on your device
- No network requests to any API
- No need to install any program
- No need to download files on your device (model is cached in browser)
- Site will ask before downloading large files (llm model) to browser cache
- Hosted on Github Pages from this repo - secure, because you see what you are running
Summary
The article explores the potential of large language models (LLMs) for browser-based applications, discussing their capabilities, limitations, and future developments in this domain, with a focus on enhancing user experiences and enabling new interactive web-based experiences.
142
54
Summary
andreinwald.github.io