DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale (arXiv 2207.00032)

Fields

id

sources/pap-sys-deepspeed-inference-arxiv

URL

https://arxiv.org/abs/2207.00032

Publisher

arXiv (Microsoft)

Kind

paper

Published

2022-06-30

Accessed

2026-10-03

notes

arXiv cats cs.LG/cs.DC, no venue in comment. Venue verified via Crossref: DOI 10.1109/SC41404.2022.00051, container 'SC22: International Conference for High Performance Computing, Networking, Storage and Systems'. Also available as the DeepSpeed-FastGen companion arXiv 2401.08671.

Notes

arXiv cats cs.LG/cs.DC, no venue in comment. Venue verified via Crossref: DOI 10.1109/SC41404.2022.00051, container 'SC22: International Conference for High Performance Computing, Networking, Storage and Systems'. Also available as the DeepSpeed-FastGen companion arXiv 2401.08671.

Cross-references

This record references no other records.