LMCache GitHub repository · inference-research

Fields

id

sources/pap-sys-lmcache-github

URL

https://github.com/LMCache/LMCache

Publisher

LMCache project

Kind

repo

Published

2024-05-28

Accessed

2026-10-03

notes

Repository created 2024-05-28, pushed_at 2026-10-03 — i.e. actively maintained, not abandoned. Description: 'LMCache: Supercharge Your LLM with the Fastest KV Cache Layer'. vLLM ships LMCacheConnectorV1 and LMCacheMPConnector integration points for disaggregated prefilling, so LMCache is wired into vLLM as an external KV cache layer rather than being a vLLM subsystem.

Notes

Repository created 2024-05-28, pushed_at 2026-10-03 — i.e. actively maintained, not abandoned. Description: 'LMCache: Supercharge Your LLM with the Fastest KV Cache Layer'. vLLM ships LMCacheConnectorV1 and LMCacheMPConnector integration points for disaggregated prefilling, so LMCache is wired into vLLM as an external KV cache layer rather than being a vLLM subsystem.

Cross-references

This record references no other records.