arXiv:2404.00456 — QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs

Fields

id

sources/pap-quant-quarot

URL

https://arxiv.org/abs/2404.00456

Publisher

arXiv

Kind

paper

Published

2024-03-30

Accessed

2026-10-03

notes

arXiv:2404.00456. v1 submitted 2024-03-30. Title on the /abs/ page confirmed as: "QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.

Notes

arXiv:2404.00456. v1 submitted 2024-03-30. Title on the /abs/ page confirmed as: "QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead.

Cross-references

This record references no other records.