answerdotai/ModernBERT-base config.json

ModernBERT: bidirectional encoder with alternating local (local_attention 128) and global attention (global_attn_every_n_layers 3), 8192 context, no_rope on local layers. Primary source for every architecture field in this record; values read from the repo's config.json, not from a model card summary. W10 LOWCONFIDENCE PROVENANCE AUDIT 2026-10-10: re-classified UNCHECKED after an actual re-fetch. Fetched over HTTPS from this host: HTTP 200, the returned file is live JSON and parses. Every architecture field this note names was then read back out of the live config.json and matches the note's value field-for-field. The 0.5 rating therefore marked a lookup nobody had run, not a property of the source: it is the model publisher's own repository, so it is a primary-shaped source, and the one caveat is that it is a mirror for the license-gated originals (see 'a-hosting-platform-is-not-a-vendor' and the gated-repo records). Raised 0.5 -> 0.88, status draft -> verified.