arXiv:2405.07135 — Post Training Quantization of Large Language Models with Microscaling Formats

arXiv:2405.07135. v1 submitted 2024-05-12. Title on the /abs/ page confirmed as: "Post Training Quantization of Large Language Models with Microscaling Formats". Venue/year for the corresponding paper record come from the Semantic Scholar graph API; see that record's notes where the arXiv comment field or OpenReview was used instead. ENLSP 2024 publisher deposit confirmed via PMLR v262 proceedings at https://proceedings.mlr.press/v262/sharify24a.html ('Post Training Quantization of Large Language Models with Microscaling Formats', Proceedings of The 4th NeurIPS Efficient Natural Language and Speech Processing Workshop, PMLR 262:232-240).