verifiedhigh · 0.95updated 2026-10-03

mistral.rs GitHub repository

repo

Fields

sources/engine-mistralrs-github

URL

https://github.com/EricLBuehler/mistral.rs

Publisher

EricLBuehler

Kind

repo

Accessed

2026-10-03

notes

mistral.rs repo README: Rust engine on Candle, OpenAI + Anthropic compatible serving, GGUF/UQFF/GPTQ, NCCL TP + ring attention. Self-reported v0.8.2 CUDA benchmarks.

Notes

mistral.rs repo README: Rust engine on Candle, OpenAI + Anthropic compatible serving, GGUF/UQFF/GPTQ, NCCL TP + ring attention. Self-reported v0.8.2 CUDA benchmarks.

Cross-references

This record references no other records.