A Length-Extrapolatable Transformer

Fields

id

sources/pap-attn-ntk-aware-scaled-rope

URL

https://arxiv.org/abs/2212.10554

Publisher

arXiv

Kind

paper

Published

2022-12-20

Accessed

2026-10-03

notes

arXiv preprint; no journal_ref. Included as the NTK-aware/relative-PE precursor cited by later scaling work; the widely used name 'NTK-aware scaled RoPE' comes from the associated blog post, not this paper's title.

Notes

arXiv preprint; no journal_ref. Included as the NTK-aware/relative-PE precursor cited by later scaling work; the widely used name 'NTK-aware scaled RoPE' comes from the associated blog post, not this paper's title.

Cross-references

This record references no other records.