WebLLM GitHub repository · inference-research

Fields

id

sources/niche-webllm-repo

URL

https://github.com/mlc-ai/web-llm

Publisher

MLC AI

Kind

repo

Accessed

2026-10-03

notes

WebLLM README: fully in-browser inference accelerated by WebGPU, no server component, OpenAI-API-compatible, shipped as the @mlc-ai/web-llm npm package, and described as a companion to MLC-LLM. Live demo at chat.webllm.ai. API metadata 2026-10-03: created 2023-04-13, last push 2026-10-03, v0.2.85 (2026-09-08), Apache-2.0, 439 open issues, 19220 stars.

Notes

WebLLM README: fully in-browser inference accelerated by WebGPU, no server component, OpenAI-API-compatible, shipped as the @mlc-ai/web-llm npm package, and described as a companion to MLC-LLM. Live demo at chat.webllm.ai. API metadata 2026-10-03: created 2023-04-13, last push 2026-10-03, v0.2.85 (2026-09-08), Apache-2.0, 439 open issues, 19220 stars.

Cross-references

This record references no other records.