Sources (2,562)
Provenance. Every source here is cited by at least one record; the back-reference count on each row is how many records rely on it.
Cambricon MLU590 — aggregated analyst and brokerage estimates
reviewflopper.io (aggregating brokerage/analyst notes)sources/cn-cambricon-mlu590
contestedlow · 0.30
Data Center Dynamics: Nvidia creates pared back H100 GPU for export to China, called H800
blogData Center Dynamicssources/acc-fill-dcd-h800-interconnect-halved
contestedlow · 0.60
Mixture of A Million Experts (PEER layers)
paperXu Owen Hesources/ev-moe-million-experts
contestedmedium · 0.75
Refurbished channel for datacenter accelerators - ITAD and refurbisher market
databaseIT Creations / derived from multiple repo recordssources/ppl-dep-refurbished-datacenter-channel
contestedmedium · 0.80
Reuters: Nvidia tweaks flagship H100 chip for export to China as H800 (2023-03-21)
blogReuterssources/acc-fill-reuters-h800-export-china
contestedmedium · 0.80
Serverless GPU & LLM Inference Benchmark - container cold start comparison (Sep 2026)
blogserverlessgpubench.com (affiliate-linked comparison site)sources/dep-serverless-gpu-coldstart-comparison
contestedlow · 0.60
sgl-router POLICY_DESIGN.md target design (per-engine admission limits, bucket fallback, error mapping)
repoSGLang projectsources/ops-sglang-router-policy-design
contestedmedium · 0.70
SGLang: Fast and Expressive LLM Inference with RadixAttention (LMSYS blog post)
blogLMSYS Org (UC Berkeley)sources/ev-sglang-lmsys-benchmark-blog
contestedmedium · 0.70
Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast (NeurIPS 2024)
paperChufan Shi et al.sources/ev-scmoe-moe-paper
contestedmedium · 0.70
Uptime Institute Global Data Center Survey - executive summaries (2024/2025/2026): landing pages reachable, PUE figures behind membership paywall
databaseUptime Institutesources/nrg2-uptime-institute-survey-paywalled
contestedlow · 0.50
ahelpme: EPYC 9554 llama.cpp inference benchmarks
benchmarkahelpme.comsources/ahelpme-epyc-9554-llama-cpp-inference-benchmarks
draftlow · 0.50
airockchip rknn-llm benchmark table
benchmarkRockchipsources/airockchip-rknn-llm-benchmark-table
draftlow · 0.50
airockchip/rknn-llm — RKLLM runtime repo
repoRockchip (airockchip)sources/airockchip-rknn-llm-rkllm-runtime-repo
draftlow · 0.50
airockchip/rknn-llm benchmark.md (RK3588 w8a8 tok/s table)
benchmarkRockchipsources/airockchip-rknn-llm-benchmark-md-rk3588-tok-s
draftmedium · 0.70
AMD ROCm compatibility matrix
spec-sheetAMDsources/rocm-docs-amd-compatibility-matrix
draftmedium · 0.70
AMD: llama.cpp on AMD EPYC (ZenDNN backend)
blogAMDsources/amd-llama-cpp-on-amd-epyc-zendnn-backend
draftlow · 0.50
Arm Kleidi Libraries product page (developer.arm.com)
spec-sheetArmsources/w7k-arm-kleidi-libraries
drafthigh · 0.85
arXiv:2509.07379 - DuoServe-MoE: Dual-Phase Expert Prefetch and Caching for LLM Inference QoS Assurance
paperarXivsources/pap-duoserve-moe-arxiv
draftlow · 0.50
Ascend GraphEngine (GE) README - CANN's graph compiler and executor
repoHuawei / Ascendsources/w7k-ascend-graphengine-readme
drafthigh · 0.85
Beelink GTR9 Pro product page (Strix Halo 128GB, dual 10GbE)
spec-sheetBeelinksources/beelink-gtr9-pro-product-page
draftmedium · 0.70
CDW product page - NVIDIA DGX B200 8x180GB server (quote-only)
spec-sheetCDWsources/sup-buy-cdw-dgx-b200
draftlow · 0.60
CDW product page - NVIDIA RTX PRO 6000 Blackwell Server Edition (4-6+ week lead time)
spec-sheetCDWsources/sup-buy-cdw-rtx-pro-6000-be
draftlow · 0.60
Cerebras corporate site (CS-3/CS-4 + Inference Cloud)
spec-sheetCerebrassources/cerebras-corporate-site-cloud-only
draftmedium · 0.70
Cerebras CSL compiler (cslc) reference
repoCerebrassources/w7k-cerebras-csl-compiler
drafthigh · 0.85
chihaoy/AI_100_server — Qwen3-30B on 4x Cloud AI 100 server
repochihaoysources/chihaoy-ai-100-server-qwen3-30b-on-4x-cloud-ai-100-server
draftlow · 0.50
chihaoy/AI_100_server (Qwen3-30B on 4x Cloud AI 100)
repoGitHub communitysources/chihaoy-ai-100-server-qwen3-30b-4x-cloud-ai100
draftmedium · 0.70
Clipper2: Triton Inference Server: An Open Source Triton Inference Server for Machine Learning (arXiv)
repoNVIDIAsources/pap-sys-clipper2-arxiv
draftmedium · 0.75
CUDA NVRTC User Guide (NVIDIA, v13.4 docs)
repoNVIDIAsources/w7k-nvrtc-user-guide
drafthigh · 0.85
DeepEP GitHub repository (DeepSeek)
repodeepseek-aisources/kern-deepep-github
drafthigh · 0.90
DeepGEMM GitHub repository (DeepSeek)
repodeepseek-aisources/kern-deepgemm-github
drafthigh · 0.90
DemoAIExperience/qualcomm-ai100-llama — Llama-3.3-70B on Cloud AI 100 demo
repoDemoAIExperiencesources/demoaiexperience-qualcomm-ai100-llama
draftlow · 0.50
DemoAIExperience/qualcomm-ai100-llama (Llama-3.3-70B on Cloud AI 100)
repoGitHub communitysources/demoaiexperience-qualcomm-ai100-llama-70b-repo
draftmedium · 0.70
eBay search: NVIDIA A100 80GB SXM4 modules (asking prices)
spec-sheeteBaysources/sup-buy-ebay-a100-80gb-sxm4
draftlow · 0.50
eBay search: NVIDIA H200 (no complete H200/H100 modules listed; baseboards, bridges, adapters only)
spec-sheeteBaysources/sup-buy-ebay-h200
draftlow · 0.50
eBay used EPYC 9354 Genoa CPU market (Oct 2026)
forumeBaysources/ebay-used-epyc-9354-genoa-cpu-market-oct2026
draftmedium · 0.70
eBay used Mac Studio M1 Ultra market (Oct 2026)
forumeBaysources/ebay-used-mac-studio-m1-ultra-market-oct2026
draftmedium · 0.70
eBay used Tenstorrent Grayskull e75/e150 market
forumeBaysources/ebay-used-tenstorrent-grayskull-market
draftmedium · 0.70
eBay used V100 32GB SXM2 module market (Oct 2026)
forumPicClick (eBay aggregator)sources/ebay-used-v100-32gb-sxm2-module-market-oct2026
draftmedium · 0.70
eBay/PicClick AMD Instinct MI210 asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-amd-instinct-mi210-asking-listings
draftmedium · 0.70
eBay/PicClick AMD Instinct MI250X OAM asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-amd-instinct-mi250x-oam-asking-listings
draftmedium · 0.70
eBay/PicClick Cambricon MLU270-S4 asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-cambricon-mlu270-asking-listings
draftmedium · 0.70
eBay/PicClick Tesla M40 24GB asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-tesla-m40-24gb-asking-listings
draftmedium · 0.70
eBay/PicClick Tesla P100 16GB asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-tesla-p100-16gb-asking-listings
draftmedium · 0.70
eBay/PicClick Tesla V100 32GB PCIe card asking listings
forumPicClick (eBay aggregator)sources/picclick-ebay-aggregator-tesla-v100-32gb-pcie-card-asking
draftmedium · 0.70
FlashAttention GitHub repository (FA2/FA3/FA4)
repoDao-AILabsources/kern-flashattention-github
drafthigh · 0.95
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
blogTri Daosources/kern-flashattention-3-blog
drafthigh · 0.90
FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling
blogTri Daosources/kern-flashattention-4-blog
drafthigh · 0.90
FlashInfer-Bench: Building the Virtuous Cycle for AI-driven LLM Systems
paperarXivsources/pap-attn-flashinfer-bench
draftmedium · 0.80
FlashMLA GitHub repository (DeepSeek)
repodeepseek-aisources/kern-flashmla-github
drafthigh · 0.90
Framework community: AI Max+ 395 gpt-oss-120b thread
forumFramework communitysources/framework-community-ai-max-395-gpt-oss-120b-thread
draftlow · 0.50
Framework Desktop product page
spec-sheetFrameworksources/framework-desktop-product-page
draftlow · 0.50
Framework Desktop product page (Ryzen AI Max+ 395/PRO 495 Strix Halo)
spec-sheetFrameworksources/framework-desktop-product-page-strix-halo
draftmedium · 0.70
FuriosaAI corporate + developer docs (RNGD furiosa-llm)
spec-sheetFuriosaAIsources/furiosaai-corporate-and-developer-sites-rngd
draftmedium · 0.70
FuriosaAI corporate site
spec-sheetFuriosaAIsources/furiosaai-corporate-site
draftlow · 0.50
geerlingguy/ai-benchmarks README Findings tables — measured Ollama/llama.cpp eval rates across consumer GPUs and Apple Silicon (DeepSeek-R1-14b, Llama-3.1-70b/405b)
benchmarkJeff Geerlingsources/geerlingguy-ai-benchmarks-findings-tables
draftlow · 0.50
GitCode Ascend/MindIE-LLM issue #623 — MindIE 3.0.0 on Atlas 300I Pro (310P3): HDC fault; vllm-ascend 0.17.0 Qwen3-4B ~9 tok/s
forumAscend MindIE-LLM issue tracker (gitcode)sources/gitcode-mindie-llm-issue-623-atlas300ipro
draftlow · 0.50
GMKtec EVO-X3 product page (128GB + OCuLink)
spec-sheetGMKtecsources/gmktec-evo-x3-and-metal-monolith-product-page
draftmedium · 0.70
GMKtec product page (EVO-X2/X3)
spec-sheetGMKtecsources/gmktec-product-page-evo-x2-x3
draftlow · 0.50
Google Coral products page
spec-sheetGoogle Coralsources/google-coral-products-page
draftlow · 0.50
Google Coral products page (Edge TPU)
spec-sheetGooglesources/coral-ai-products-page-edge-tpu
draftmedium · 0.70
Groq corporate site (LPX neocloud, no devkit)
spec-sheetGroqsources/groq-corporate-site-cloud-only
draftmedium · 0.70
hailo_model_zoo_genai MODELS.rst compiled-model TPS table
benchmarkHailosources/hailo-model-zoo-genai-models-rst-compiled-model-tps-table
draftlow · 0.50
hailo-ai/hailo_model_zoo_genai MODELS.rst compiled-model TPS table
benchmarkHailosources/hailo-model-zoo-genai-models-rst-tps-table
draftmedium · 0.70
hailo-ai/hailo-apps — Ollama-compatible HailoRT apps
repoHailosources/hailo-ai-hailo-apps-ollama-compatible-hailort-apps
draftlow · 0.50
Hardware Corner — Definitive GPU Ranking for LLMs (llama-bench CUDA 12.8, Q4_K_XL decode/PP vs context)
benchmarkHardware Cornersources/hardware-corner-gpu-ranking-local-llm
draftlow · 0.50
Hardware Corner RTX 3090 benchmark page (avg market value + measured tok/s)
databaseHardware Cornersources/hardware-corner-rtx-3090-benchmark-page-market-value
draftmedium · 0.70
Hardware Corner RTX 3090 LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-3090-llm-benchmark-page
draftlow · 0.50
Hardware Corner RTX 3090 market value tracker
benchmarkHardware Cornersources/hardware-corner-rtx-3090-market-value-tracker
draftlow · 0.50
Hardware Corner RTX 4090 benchmark page (measured llama.cpp tok/s)
databaseHardware Cornersources/hardware-corner-rtx-4090-benchmark-page-llm-tok-s
draftmedium · 0.70
Hardware Corner RTX 5090 benchmark page (measured llama.cpp tok/s)
databaseHardware Cornersources/hardware-corner-rtx-5090-benchmark-page-llm-tok-s
draftmedium · 0.70
Hardware Corner RTX PRO 6000 Blackwell benchmark page (measured llama.cpp tok/s)
databaseHardware Cornersources/hardware-corner-rtx-pro-6000-blackwell-llm-tok-s
draftmedium · 0.70
Hardware Corner used-GPU price tracker (3090/4090/5090 history)
databaseHardware Cornersources/hardware-corner-used-gpu-price-tracker-3090-4090-5090-history
draftlow · 0.50
Hardware Corner used-GPU price tracker + llama.cpp measured table
benchmarkHardware Cornersources/hardware-corner-used-gpu-price-tracker-llama-cpp-measured-table
draftlow · 0.50
Hardware-Aware FP4 FlashAttention-4
paperarXivsources/pap-attn-flashattention-4-fp4
draftmedium · 0.70
Harness probe
reposources/zz-harness-probe
draftlow · 0.10
HF space: V100 Homelab Field Guide
blogKyleHessling1 (Hugging Face)sources/hf-space-v100-homelab-field-guide
draftlow · 0.50
HipKittens README (HazyResearch) - AMD port of the ThunderKittens primitives
repoHazy Research / Stanfordsources/w7k-hipkittens-readme
drafthigh · 0.85
Hugging Face blog: Llama2 performance on AWS Inferentia2 (optimum-neuron, inf2.xlarge/inf2.48xlarge) — encoding time, e2e latency, throughput tables
blogHugging Face (optimum-neuron team)sources/hf-blog-inferentia-llama2-benchmarks
draftlow · 0.50
Hugging Face TGI GitHub repository (archived)
repoHugging Facesources/engine-tgi-github
draftmedium · 0.80
Iluvatar CoreX BI-V150 (Tiangai 150) — product overview and estimates
reviewmirrorfrog.com (aggregating Chinese sources)sources/cn-iluvatar-bi-v150
draftlow · 0.30
Intel Gaudi AI accelerator products page (Shop section: Dell/HPE/Supermicro)
spec-sheetIntelsources/sup-buy-intel-gaudi
draftlow · 0.50
Introducing nvFuser, a deep learning compiler for PyTorch (PyTorch blog)
blogPyTorch Foundation / NVIDIAsources/w7k-pytorch-nvfuser-announcement
drafthigh · 0.85
IT Creations enterprise server distributor catalog page
spec-sheetIT Creationssources/sup-buy-it-creations
draftlow · 0.60
Jeff Geerling sbc-reviews issue 80: Framework Desktop power
benchmarkJeff Geerlingsources/jeff-geerling-sbc-reviews-issue-80-framework-desktop-power
draftlow · 0.50
KleidiAI README (Arm Kleidi Libraries, the primary repository on GitLab)
repoArmsources/w7k-kleidiai-readme
drafthigh · 0.85
LeaseWeb: AMD EPYC LLM inference benchmark CPU vs GPU
benchmarkLeaseWebsources/leaseweb-amd-epyc-llm-inference-benchmark-cpu-vs-gpu
draftlow · 0.50
Level1Techs forum: 4x RTX 3090 price parity with 5090
forumLevel1Techs forumssources/level1techs-forum-4x-rtx-3090-price-parity-with-5090
draftlow · 0.50
Level1Techs forum: cheap local LLM GPU thread
forumLevel1Techs communitysources/level1techs-forum-cheap-local-llm-gpu-thread
draftlow · 0.50
Level1Techs post: 8x Arc Pro B60 on PEX88096 PCIe switch + X870
forumLevel1Techs forumsources/level1techs-8x-arc-pro-b60-pex88096-switch-build
draftmedium · 0.70
Level1Techs thread: Arc Pro B60/B70 llama.cpp + vLLM measured runs
forumLevel1Techs forumsources/level1techs-arc-pro-b60-b70-vllm-llamacpp-thread
draftmedium · 0.70
lhl/strix-halo-testing llm-bench sweep
benchmarklhl (GitHub)sources/lhl-strix-halo-testing-llm-bench-sweep
draftlow · 0.50
llama.cpp discussion #19480 — CPU inference thread (EPYC 9454P / Ryzen)
forumsources/llama-cpp-discussion-19480-cpu-inference-thread-epyc-9454p-ryzen
draftlow · 0.50
llama.cpp discussion #2824: MI100 multi-GPU measured tok/s
forumllama.cpp communitysources/llama-cpp-discussion-2824-mi100-multi-gpu-measured-tok-s
draftlow · 0.50
llama.cpp discussion #3167: CPU channel population effect
forumllama.cpp communitysources/llama-cpp-discussion-3167-cpu-channel-population-effect
draftlow · 0.50
llama.cpp discussion #4167 comment: Mac mini M6 llama-bench (jhen0409, 2026-10-01)
forumllama.cpp community (jhen0409, collaborator)sources/llama-cpp-discussion-4167-comment-18694932-m6-mac-mini
draftlow · 0.45
llama.cpp discussion #4167: Apple Silicon llama-bench table
benchmarkllama.cpp communitysources/llama-cpp-discussion-4167-apple-silicon-llama-bench-table
draftlow · 0.50
llama.cpp discussion: RX 7900 XTX ROCm llama-bench vs 3090/4090
forumGitHub / ggml-orgsources/llama-cpp-discussion-rx-7900-xtx-rocm-vs-3090-4090-bench
draftmedium · 0.70
llama.cpp issue #28863: ROCm/gfx1100 Qwen3.8-27B Q4_K_XL batch-1 tensor-split decode on 2x RX 7900 XTX
forumllama.cpp contributors (community)sources/bench-llamacpp-issue-28863-rx7900xtx-tensor-split
draftmedium · 0.80
llama.cpp MMQ quantized GEMM kernel source (mmq.cuh)
repoggml-orgsources/kern-llamacpp-mmq-source
drafthigh · 0.90
llama.cpp PR #28398: hardware v_perm_b32 for Q1_0 vec_dot on AMD (+110% decode on gfx1201)
forumllama.cpp contributors (community)sources/bench-llamacpp-pr-28398-radeon-r9700-q1
draftmedium · 0.80
llamabench.ai — community crowdsourced llama.cpp results, NVIDIA A100 PCIe 40GB board page
repollamabench.ai (crowdsourced, submitter @wmeddie)sources/llamabench-ai-a100pcie40
draftlow · 0.50
LMCache GitHub repository
repoLMCachesources/kern-lmcache-github
drafthigh · 0.85
LMCache GitHub repository
repoLMCache projectsources/pap-sys-lmcache-github
draftmedium · 0.75
LocalScore methodology (llamafile, 9-task geometric mean) + HX 370 / Radeon 890M submitted result
benchmarkLocalScore (Mozilla Builders / cjpais)sources/localscore-about-methodology-and-hx370-890m
draftlow · 0.40
macpro-la.com used Mac Pro / Mac Studio pricing listings
databasemacpro-la.comsources/macpro-la-used-mac-studio-pricing
draftlow · 0.60
MAX platform and Mojo's inline MLIR escape hatch
repoModularsources/w7k-modular-max-and-mojo-mlir
drafthigh · 0.85
MLX-LM benchmark data for Qwen3-4B and Qwen3-30B-A3B across precisions (mlx-lm PR #552)
benchmarkml-explore (Apple) / communitysources/bench-apple-mlx-lm-qwen3-benchmarks
draftmedium · 0.70
MLX-LM M3 Pro benchmarks for Qwen3-4B-Instruct-2507-4bit (mlx-lm PR #1569)
forumcommunity / ml-exploresources/bench-apple-mlx-lm-m3-pro-qwen3-4b
draftmedium · 0.80
mlx-lm PR #1584: RotatingQuantizedKVCache / BatchRotatingQuantizedKVCache
repoml-exploresources/mdl2-mlxlm-pr1584-rotating-quantized-kv
draftmedium · 0.80
Mythic M1108 AMP Specs (Hackster.io)
blogHackster.iosources/mythic-m1108-amp-specs-hackster-io
draftlow · 0.50
Mythic M1108 host interface is PCI Express 2.0 (Hackster.io report of Mythic AMP specs)
blogHackster.io (third-party report; Mythic is not the publisher)sources/w3a-mythic-m1108-pcie-gen2-host-interface
draftlow · 0.50
Nebius prices page and Token Factory (per-token inference vs GPU-hour split)
databaseNebiussources/svc-src-nebius-token-factory-2026-10-14
draftmedium · 0.70
Newegg Arc Pro B60 24GB retail listings (ASRock/ARKN/GUNNIR)
forumNeweggsources/newegg-arc-pro-b60-24gb-retail-listings
draftmedium · 0.70
Newegg Arc Pro B70 32GB retail/preorder listings
forumNeweggsources/newegg-arc-pro-b70-32gb-retail-listings
draftmedium · 0.70
Newegg consumer GPU listings (RX 9070 XT, Arc B60/B70)
forumNeweggsources/newegg-consumer-gpu-listings-rx-9070-xt-arc-b60-b70
draftlow · 0.50
Newegg marketplace Tesla P40/M40/V100 refurbished listings
forumNeweggsources/newegg-tesla-p40-v100-m40-marketplace-refurb-listings
draftmedium · 0.70
Newegg RX 9070 XT 16GB retail listings (Oct 2026)
forumNeweggsources/newegg-rx-9070-xt-retail-listings-oct2026
draftmedium · 0.70
Newegg Tesla M40 refurbished listings
forumNeweggsources/newegg-tesla-m40-refurbished-listings
draftlow · 0.50
Newegg Tesla P40 refurbished listings
forumNeweggsources/newegg-tesla-p40-refurbished-listings
draftlow · 0.50
nvFuser (NVIDIA/Fuser) - a fusion code generator for NVIDIA GPUs
repoNVIDIAsources/w7k-nvfuser-github
drafthigh · 0.85
NVIDIA CUDA PTX ISA 9.4 documentation
whitepaperNVIDIAsources/kern-ptx-isa
drafthigh · 0.98
NVIDIA CUTLASS GitHub repository
repoNVIDIAsources/kern-cutlass-github
drafthigh · 0.95
NVIDIA Enterprise Marketplace - Data Center Where to Buy (NPN partners)
spec-sheetNVIDIAsources/sup-buy-nvidia-marketplace-wtb
draftlow · 0.50
NVIDIA GeForce RTX 5070 Family product page (official spec table)
spec-sheetNVIDIAsources/local-nvidia-rtx-5070-product-page
draftlow · 0.60
OWC / macsales.com used-Mac inventory (Mac Studio / MacBook Pro used pricing)
databaseOWC (macsales.com)sources/owc-macsales-used-mac-inventory
draftlow · 0.60
Pallas Mosaic GPU backend and the Blackwell matmul optimisation guide
repoGoogle / JAXsources/w7k-pallas-mosaic-gpu
drafthigh · 0.90
picclick eBay aggregator — Intel Gaudi 2 HL-225B asking listings
forumsources/picclick-ebay-aggregator-intel-gaudi-2-hl-225b-asking-listings
draftlow · 0.50
PicClick eBay aggregator: AMD Instinct MI100 asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-amd-instinct-mi100-asking-listings
draftlow · 0.50
PicClick eBay aggregator: Cambricon MLU370 asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-cambricon-mlu370-asking-listings
draftlow · 0.50
PicClick eBay aggregator: Intel Gaudi 2 HL-225 asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-intel-gaudi-2-hl-225-asking-listings
draftlow · 0.50
PicClick eBay aggregator: RTX 3090 used asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-rtx-3090-used-asking-listings
draftlow · 0.50
PicClick eBay aggregator: Tesla P40 24GB asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-tesla-p40-24gb-asking-listings
draftlow · 0.50
PicClick eBay aggregator: Tesla V100 32GB PCIe asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-tesla-v100-32gb-pcie-asking-listings
draftlow · 0.50
PicClick eBay aggregator: Tesla V100 32GB SXM2 asking listings
forumPicClick / eBaysources/picclick-ebay-aggregator-tesla-v100-32gb-sxm2-asking-listings
draftlow · 0.50
PicClick/eBay price-refresh scrape Dec-2026 (cron)
forumPicClick / eBaysources/picclick-ebay-price-refresh-dec2026-cron
draftlow · 0.50
Qualcomm AI Engine Direct SDK product page
spec-sheetQualcommsources/w7k-qualcomm-ai-engine-direct-sdk
drafthigh · 0.85
Qualcomm cloud-ai-sdk (vLLM serving path)
repoQualcommsources/qualcomm-cloud-ai-sdk-vllm-serving-path
draftlow · 0.50
qualcomm/cloud-ai-sdk GitHub repo (vLLM serving path for Cloud AI 100)
repoQualcommsources/qualcomm-cloud-ai-sdk-github-repo
draftmedium · 0.70
quic/efficient-transformers — HF→QPC compile pipeline for Cloud AI 100
repoQualcommsources/quic-efficient-transformers-hf-qpc-compile-pipeline-for-cloud-ai
draftlow · 0.50
quic/efficient-transformers GitHub repo (HF to QPC compile pipeline)
repoQualcommsources/quic-efficient-transformers-hf-to-qpc-compile-repo
draftmedium · 0.70
r/homelab 'DGX-1 for $2500' thread + eBay DGX-1 market
forumReddit / eBaysources/r-homelab-dgx-1-2500-thread-and-ebay-dgx1-market
draftmedium · 0.70
r/LocalLLaMA Atlas 300I Duo ~150 tok/s Llama-3 report
forumr/LocalLLaMAsources/r-localllama-atlas-300i-duo-150-tok-s-llama-3-report
draftlow · 0.50
Raspberry Pi AI HAT+ 2 product page
spec-sheetRaspberry Pisources/raspberry-pi-ai-hat-2-product-page
draftlow · 0.50
Raspberry Pi AI HAT+ 2 product page (Hailo-10H)
spec-sheetRaspberry Pisources/raspberry-pi-ai-hat-plus-2-product-page
draftmedium · 0.70
ROCm Composable Kernel user guide (CK 1.2.0 documentation)
repoAMDsources/w7k-rocm-composable-kernel-guide
drafthigh · 0.85
runaihome: CPU vs GPU LLM inference home lab 2026 (DRAM crisis)
blogrunaihome.comsources/runaihome-cpu-vs-gpu-llm-inference-home-lab-2026-dram-crisis
draftlow · 0.50
Runpod GPU Cloud published hourly pricing (Community and Secure Cloud)
blogRunpodsources/pwr-runpod-pricing-page
draftlow · 0.50
ServeTheHome Inspur NF5488M5 8x V100 SXM2 server review
reviewServeTheHomesources/servethehome-inspur-nf5488m5-8x-v100-server-review
draftmedium · 0.70
ServeTheHome: GMKtec EVO-X3 mini PC review
reviewServeTheHomesources/servethehome-gmktec-evo-x3-mini-pc-review
draftlow · 0.50
ServeTheHome: Marvell Structera X CXL 3.2 memory expanders
reviewServeTheHomesources/servethehome-marvell-structera-x-cxl-3-2-memory-expanders
draftlow · 0.50
Silicon Score benchmarks.csv (machine-level measured tok/s export)
databaseSilicon Scoresources/silicon-score-benchmarks-csv-machine-level-measured-tok-s-export
draftlow · 0.50
Silicon Score Llama 3.3 70B model page + benchmark CSV
benchmarkSilicon Scoresources/silicon-score-llama-3-3-70b-model-page-benchmark-csv
draftlow · 0.50
SiMa.ai corporate site
spec-sheetSiMa.aisources/sima-ai-corporate-site
draftlow · 0.50
SiMa.ai Modalix DevKit access portal
spec-sheetSiMa.aisources/sima-ai-modalix-devkit-access-portal
draftlow · 0.50
SiMa.ai Modalix DevKit access portal
spec-sheetSiMa.aisources/sima-ai-modalix-devkit-portal
draftmedium · 0.70
Strix Halo homelab wiki — AI capabilities overview
blogstrixhalo-homelab.d7.wtfsources/strix-halo-homelab-wiki-ai-capabilities-overview
draftlow · 0.50
Strix Halo homelab wiki: llama.cpp performance
blogstrixhalo-homelab.d7.wtfsources/strix-halo-homelab-wiki-llama-cpp-performance
draftlow · 0.50
Supermicro air-cooled GPU servers portfolio (HGX B200/B300, MI350X, H200 NVL)
spec-sheetSupermicrosources/sup-buy-supermicro-gpu-servers
draftlow · 0.50
Supermicro SYS-521GE-TNRT 5U 10-GPU PCIe system
spec-sheetSupermicrosources/sup-buy-supermicro-sys-521ge
draftlow · 0.50
Taobao used Huawei Ascend 310P (Atlas 300I Pro) market
forumTaobao marketplacesources/taobao-used-huawei-ascend-310p-market
draftlow · 0.50
TensorRT 11.3 Optimization guide: builder tactic profiling, layer fusion, engine build time
repoNVIDIAsources/w7k-tensorrt-optimization-11-3
drafthigh · 0.85
TensorRT 11.3 Support Matrix and engine portability rules
repoNVIDIAsources/w7k-tensorrt-support-matrix-11-3
drafthigh · 0.85
TensorRT-LLM PR #18542: FMHA NVRTC JIT warmup on the cold-start critical path
repoNVIDIAsources/w7k-trtllm-pr-18542-nvrtc-jit-warmup
drafthigh · 0.85
Tenstorrent hardware cards shop
spec-sheetTenstorrentsources/tenstorrent-hardware-cards-shop
draftlow · 0.50
Tenstorrent hardware cards shop (Wormhole n150/n300 prices)
spec-sheetTenstorrentsources/tenstorrent-hardware-cards-shop-wormhole-n150-n300-prices
draftmedium · 0.70
Tenstorrent software stack overview (TT-Forge, TT-NN, TT-Metalium, TT-Lang)
repoTenstorrentsources/w7k-tenstorrent-software-stack
drafthigh · 0.85
Tenstorrent Wormhole N300 Llama-3.1-8B decode measurement (YouTube/community, vLLM+TT-Metal)
forumcommunity video summary gistsources/tenstorrent-n300-llama31-8b-decode-video
draftlow · 0.50
tenstorrent/tt-inference-server — model serving reference
repoTenstorrentsources/tenstorrent-tt-inference-server-model-serving-reference
draftlow · 0.50
tenstorrent/tt-metal tech_reports — Grayskull-era and Wormhole notes
repoTenstorrentsources/tenstorrent-tt-metal-tech-reports-grayskull-era-and-wormhole-not
draftlow · 0.50
ThunderKittens GitHub repository (HazyResearch)
repoHazyResearchsources/kern-thunderkittens-github
drafthigh · 0.90
ThunderKittens README (HazyResearch) - tile primitives for CUDA kernels
repoHazy Research / Stanfordsources/w7k-thunderkittens-readme
drafthigh · 0.85
TileKernels GitHub repository (DeepSeek)
repodeepseek-aisources/kern-tilekernels-github
drafthigh · 0.85
TileLang README and autotuning guide (tile-ai/tilelang)
repoTile-AIsources/w7k-tilelang-readme-and-autotune
drafthigh · 0.85
Triton language and compiler GitHub repository
repotriton-langsources/kern-triton-github
drafthigh · 0.90
UNREACHABLE (SECOND, INDEPENDENT VENDOR DOMAIN): Enflame's hardware documentation centre on support.enflame-tech.com is behind the same Tencent Cloud WAF as the main site, so the vendor's most detailed interconnect material is doubly inaccessible
spec-sheetEnflame Technology (support.enflame-tech.com, the company's own documentation host)sources/w7f-enflame-support-docs-waf-blocked-second-domain
drafthigh · 0.90
UNREACHABLE: Enflame's own S60 product page and hardware doc centre are behind a WAF that blocks four independent client types, and no Wayback capture exists
spec-sheetEnflame Technology (enflame-tech.com, the company's own site)sources/w5a-enflame-s60-vendor-site-unreachable-waf-confirmed
drafthigh · 0.90
vLLM documentation: Disaggregated Prefilling (experimental)
repovLLM projectsources/pap-sys-vllm-disagg-prefill
draftmedium · 0.75
vLLM issue #6073 request for a dedicated /ready endpoint
forumvLLM projectsources/ops-vllm-ready-endpoint-request
draftmedium · 0.70
vLLM Machete weight-only GEMM kernel source (machete_mm_kernel.cuh)
repovllm-projectsources/kern-machete-vllm-source
drafthigh · 0.90
vLLM MacheteLinearKernel dispatch and hardware gate
repovllm-projectsources/kern-machete-vllm-python
drafthigh · 0.95
voyageai/voyage-code-3 README.md
repoHugging Facesources/hf-embed-voyage-code-3
draftlow · 0.30
vramguide Tesla P40 modelled tok/s
benchmarkvramguidesources/vramguide-tesla-p40-modelled-tok-s
draftlow · 0.50
vramguide V100 32GB modelled tok/s
benchmarkvramguidesources/vramguide-v100-32gb-modelled-tok-s
draftlow · 0.50
XiongjieDai GPU-Benchmarks-on-LLM-Inference (RunPod measured llama.cpp)
benchmarkXiongjieDai (GitHub)sources/xiongjiedai-gpu-benchmarks-on-llm-inference-runpod-measured-llam
draftlow · 0.50
0xSero TurboQuant: consumer-GPU KV compression measurements on RTX 3090 and RTX 5090
repo0xSerosources/github-0xsero-turboquant-consumer-gpu
verifiedmedium · 0.70
1337hero/rx7900xtx-llama-bench-rocm: llama.cpp ROCm 7.1.1 bench on 2x RX 7900 XTX
repo1337hero (GitHub)sources/gh-1337hero-rx7900xtx-llama-bench-rocm
verifiedlow · 0.60
A Domain-Specific Supercomputer for Training Deep Neural Networks (TPU v2/v3 architecture; ISCA 2017, CACM reprint 2020)
paperCommunications of the ACM / Google (Jouppi et al.)sources/asic-tpu-v2-paper
verifiedhigh · 0.90
A Length-Extrapolatable Transformer
paperarXivsources/pap-attn-ntk-aware-scaled-rope
verifiedhigh · 0.85
A Survey on Efficient Inference for Large Language Models (arXiv:2404.14294)
paperarXivsources/mkt-efficient-inference-survey
verifiedhigh · 0.90
A Watermark for Large Language Models (Kirchenbauer et al., KGW)
paperThe green-list/red-list scheme: hash the previous token, seed a PRNG, split the vocabulary in half, softly promote green tokens during sampling, detect with a one-proportion z-test. Section 1.2 states the low-entropy caveat explicitly - perturbing low-entropy completions produces high-perplexity unexpected tokens, and human and machine completions are near-identical there.sources/sec-arxiv-2301-10226
verifiedhigh · 0.90
Accelerating Large Language Model Decoding with Speculative Sampling
paperarXiv (Chen et al.; DeepMind)sources/flop-speculative-sampling-deepmind
verifiedhigh · 0.90
Accelerating Production LLMs with Combined Token/Embedding Speculators (arXiv:2404.19124)
blogsources/pap-eff-token-speculators
verifiedmedium · 0.75
Achieving Top Inference Performance with the NVIDIA H100 Tensor Core GPU and NVIDIA TensorRT-LLM
blogNVIDIAsources/bench-nv-nvidia-h100-tensorrtllm-blog
verifiedmedium · 0.80
ACL Anthology 2025.acl-long.595 - SAM Decoding: Speculative Decoding via Suffix Automaton
databaseACLsources/sco-aclanthology-2025-sam-decoding
verifiedhigh · 0.95
ACL Anthology ACL 2024 event index
databaseACLsources/sco-acl-2024-event
verifiedhigh · 0.95
ACL Anthology paper page 2025.emnlp-main.334 - TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text
paperAssociation for Computational Linguisticssources/w6p-aclanthology-2025-emnlp-main-334-turborag
verifiedhigh · 0.90
AcruxCore docs blog - How much overhead does an LLM gateway add? (five-path controlled measurement)
blogAcruxCore (gateway vendor; self-interested, methodology disclosed)sources/dep-acruxcore-gateway-overhead-measurement
verifiedhigh · 0.85
Agent-Assisted Side-Channel Attacks on Non-Prefix KV Cache in RAG (SpliceLeak)
paperPrior KV-cache side channels need strict linear prefix alignment and so fail against real RAG queries with unique private prefixes. SpliceLeak exploits the deterministic micro-architecture of chunk alignment and fusion: a +104 ms hardware latency void, as few as 63 requests per token, up to 100% extraction success in bounded-entropy scenarios, evaluated on vLLM integrated with LMCache.sources/sec-arxiv-2606-21842
verifiedhigh · 0.90
AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
paper97 realistic tasks (email, e-banking, travel), 629 security test cases. The standard yardstick for measuring an injection defence, and the source of the CaMeL 77%/84% figures.sources/sec-arxiv-2406-13352
verifiedhigh · 0.90
Agentless: Demystifying LLM-based Software Engineering Agents
paperChunqiu Steven Xia et al.sources/ev-agentless-swebench-paper
verifiedhigh · 0.85
ahelpme.com — LLM inference benchmarks with llama.cpp on AMD EPYC 9554 (Genoa 64c, 12-channel DDR5-5600)
blogahelpme.comsources/ahelpme-epyc-9554-llama-bench-cpu-inference
verifiedlow · 0.50
AI Application Benchmarking: Power-Aware Performance Analysis for Vision and Language Models (arXiv:2603.16164, RRZE-HPC)
paperarXivsources/nrg2-arxiv-rrze-hpc-ai-power-limits
verifiedhigh · 0.85
AI Inference on AMD Ryzen AI Max Processor (ROCm Blogs)
benchmarkAMDsources/bench-amd-ryzen-ai-max-uma-ollama
verifiedmedium · 0.80
ai-infos/guidances-setup-16-mi50-deepseek-v32 issue #1: Deeply Rooted Single-Node Communication (IPC / Shared Memory) Limitations
forumGitHub (user Felloty)sources/comm-ai-infos-issue-1-ipc-multinode
verifiedmedium · 0.70
AirLLM GitHub repository
repoGavin Lisources/niche-airllm-repo
verifiedhigh · 0.85
AirLLM user reports contradicting the compression speed-up claim
forumGitHubsources/niche-airllm-speed-issue
verifiedmedium · 0.70
AITER integration into SGLang for DeepSeek-R1 inference on MI300X
benchmarkAMD ROCm Blogssources/amd-aiter-sglang-deepseek
verifiedhigh · 0.85
AITER-enabled MLA layer inference on MI300X with matrix absorption
benchmarkAMD ROCm Blogssources/amd-aiter-mla-mi300x
verifiedhigh · 0.85
AITER: AMD's AI Tensor Engine for ROCm
repoAMD ROCmsources/src5-aiter-github
verifiedhigh · 0.90
Albert Tseng - Research (publication list)
repopersonal (Cornell / Cornell-RelaxML)sources/quant-tseng-publications
verifiedmedium · 0.80
Aleph-Alpha/Kolibri-1 config.json
repoAleph Alphasources/hf-aleph-alpha-kolibri-1-config
verifiedhigh · 0.90
Aleph-Alpha/Kolibri-1 model card
repoAleph Alphasources/hf-aleph-alpha-kolibri-1-card
verifiedhigh · 0.85
Alibaba-NLP/gte-base-en-v1.5 config.json
repoHugging Facesources/hf-embed-gte-base
verifiedhigh · 0.88
Alibaba-NLP/gte-Qwen2-1.5B-instruct config.json
repoHugging Facesources/hf-embed-gte-qwen2-1-5b-instruct
verifiedhigh · 0.88
Alibaba-NLP/gte-reranker-modernbert-base config.json
repoHugging Facesources/hf-embed-gte-reranker-modernbert
verifiedhigh · 0.88
AliExpress secondary market listings for RTX 4090 48GB GDDR6X modded cards
databaseAliExpresssources/sup-used-aliexpress-4090-48gb
verifiedlow · 0.45
allenai/Molmo-7B-D-0924 config.json
repoHugging Facesources/mbl-cfg-molmo-7b-d
verifiedhigh · 0.90
allenai/OLMo-2-0425-1B config.json
repoHugging Facesources/hf-edge-olmo-2-1b
verifiedhigh · 0.88
allenai/OLMo-2-0425-1B config.json
repoHugging Facesources/mbl-cfg-olmo-2-1b
verifiedhigh · 0.90
allenai/OLMo-3-7B-Instruct config.json
repoHugging Facesources/mbl-cfg-olmo-3-7b
verifiedhigh · 0.90
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (arXiv 2302.11665)
paperarXiv (Alibaba / SJTU)sources/pap-sys-alpaserve-arxiv
verifiedhigh · 0.90
Amazon Bedrock pricing page (per-provider on-demand/batch/provisioned model tables)
databaseAmazon Web Servicessources/svc-src-aws-bedrock-pricing-2026-10-14
verifiedhigh · 0.85
Amazon EC2 Capacity Blocks for ML overview
spec-sheetAmazon Web Servicessources/sup-cloud-aws-ec2-capacityblocks-overview
verifiedhigh · 0.95
Amazon EC2 Capacity Blocks for ML pricing
databaseAmazon Web Servicessources/sup-cloud-aws-ec2-capacityblocks-pricing
verifiedhigh · 0.97
Amazon EC2 Inf1 Instances - first-generation Inferentia chip specs and instance table
spec-sheetAmazon Web Servicessources/w7z-aws-inf1-instance-page
verifiedhigh · 0.90
Amazon EC2 Inf2 Architecture
spec-sheetAmazon Web Servicessources/alt-inf2-arch
verifiedhigh · 0.95
Amazon EC2 Inf2 instances
spec-sheetAmazon Web Servicessources/asic-aws-inf2-instances
verifiedhigh · 0.90
Amazon EC2 P5 Instances product page
spec-sheetAmazon Web Servicessources/sup-cloud-aws-ec2-p5-instance-page
verifiedhigh · 0.95
Amazon EC2 Spot Instances Pricing
spec-sheetAmazon Web Servicessources/sup-cloud-aws-ec2-spot-pricing
verifiedhigh · 0.90
Amazon EC2 Trn1 Instances - first-generation Trainium chip specs and instance table
spec-sheetAmazon Web Servicessources/w7z-aws-trn1-instance-page
verifiedhigh · 0.90
Amazon EC2 Trn2 Architecture
spec-sheetAmazon Web Servicessources/alt-trn2-arch
verifiedhigh · 0.95
Amazon EC2 Trn2 instances and UltraServers
spec-sheetAmazon Web Servicessources/asic-aws-trn2-instances
verifiedhigh · 0.90
Amazon EC2 Trn2 Instances product page
spec-sheetAmazon Web Servicessources/sup-cloud-aws-ec2-trn2-instance-page
verifiedhigh · 0.95
Amazon EC2 Trn3 UltraServers (Trainium3)
blogsources/amazon-ec2-trn3-ultraservers-trainium3
verifiedhigh · 0.85
Amazon S3 pricing (storage per GB-month, GET/PUT request prices, Lambda GB-second)
spec-sheetAWSsources/rent-src-aws-s3-pricing
verifiedhigh · 0.90
Amazon.com search results for RTX 3090
databaseAmazonsources/noncuda-amazon-rtx3090-search
verifiedmedium · 0.80
AMD 'Introducing AMD CDNA 4 Architecture' white paper
whitepaperAMDsources/net2-amd-cdna4-whitepaper
verifiedhigh · 0.90
AMD 'Introducing AMD CDNA 4 Architecture' white paper - prior-generation Infinity Fabric lane rate of 32 Gbps
whitepaperAMDsources/w7a-amd-cdna4-whitepaper-cdna3-lane-rate-32gbps
verifiedhigh · 0.95
AMD 'Introducing the AMD CDNA 2 Architecture' white paper - endnotes MI200-29 and MI200-43 (Infinity Fabric formula and per-card totals)
whitepaperAMDsources/w7a-amd-cdna2-whitepaper-endnote-if-formula-and-per-card-totals
verifiedhigh · 0.95
AMD blog: AMD Ryzen AI MAX+ 395 Processor: Breakthrough AI Performance (Radeon 8060S LLM token-throughput measurements)
blogAMDsources/acc-fill-amd-ryzen-ai-max-395-8060s-blog
verifiedmedium · 0.75
AMD developer - 'llama.cpp on AMD EPYC: ZenDNN backend' (EPYC 9755 128c benchmarks)
blogAMDsources/amd-llama-cpp-on-amd-epyc-zendnn-9755
verifiedlow · 0.60
AMD EPYC 9755 product page - per-socket fabric figures published as PCIe width and memory bandwidth only (verified negative)
spec-sheetAMDsources/w7a-amd-epyc-9755-no-if-link-bandwidth-published
verifiedhigh · 0.90
AMD Instinct Customer Acceptance Guide MI100 (32GB HBM2, 1.2 TB/s)
spec-sheetAMDsources/amd-mi100-acceptance-guide
verifiedmedium · 0.80
AMD Instinct GPUs MLPerf Inference v6.0 Submission (ROCm Blogs)
blogAMDsources/bench-amd-mlperf-v6-0-submission
verifiedmedium · 0.80
AMD Instinct MI100 product page
spec-sheetAMDsources/amd-mi100-product-page
verifiedhigh · 0.90
AMD Instinct MI100 product page - Infinity Fabric link count and peak link bandwidth rows
spec-sheetAMDsources/w7a-amd-mi100-product-page-if-link-table
verifiedhigh · 0.90
AMD Instinct MI100 product page GPU Specifications table
spec-sheetAMDsources/acc2-amd-mi100-product-page
verifiedhigh · 0.90
AMD Instinct MI210 product page
spec-sheetAMDsources/amd-mi210-product-page
verifiedhigh · 0.90
AMD Instinct MI210 product page - Infinity Fabric link count and peak link bandwidth rows
spec-sheetAMDsources/w7a-amd-mi210-product-page-if-link-table
verifiedhigh · 0.90
AMD Instinct MI250 microarchitecture (ROCm documentation)
spec-sheetAMDsources/link2-amd-rocm-mi250-microarch
verifiedhigh · 0.90
AMD Instinct MI250 product page
spec-sheetAMDsources/amd-mi250-product-page
verifiedhigh · 0.90
AMD Instinct MI250X product page
spec-sheetAMDsources/amd-mi250x-product-page
verifiedhigh · 0.90
AMD Instinct MI250X product page - Infinity Fabric link count and peak link bandwidth rows
spec-sheetAMDsources/w7a-amd-mi250x-product-page-if-link-table
verifiedhigh · 0.90
AMD Instinct MI300 Series Accelerators product page
spec-sheetAMDsources/link-amd-mi300-series-specs
verifiedhigh · 0.90
AMD Instinct MI300A product page
spec-sheetAMDsources/amd-mi300a-product-page
verifiedhigh · 0.90
AMD Instinct MI300X / MI325X / MI350X / MI350P / MI355X product specification tables (dense-vs-sparse convention)
spec-sheetAMDsources/acc2-amd-ml300-convention
verifiedhigh · 0.95
AMD Instinct MI300X / MI325X product pages - Infinity Fabric board rows and the 8-vs-7 link count (VERBATIM)
spec-sheetAMDsources/w7a-amd-cdna3-board-table-if-rows
verifiedhigh · 0.95
AMD Instinct MI300X accelerator datasheet (GD-176)
spec-sheetAMDsources/amd-mi300x-datasheet
verifiedhigh · 0.95
AMD Instinct MI300X Accelerator product specifications
spec-sheetAMDsources/link-amd-mi300x-specs
verifiedhigh · 0.90
AMD Instinct MI300X product page
spec-sheetAMDsources/amd-mi300x-product-page
verifiedhigh · 0.90
AMD Instinct MI300X product page 'Specs Comparisons' charts - NVIDIA H100 figures printed at SPARSE (VERBATIM)
spec-sheetAMDsources/vb-amd-mi300x-h100-comparison-chart-sparse-basis
verifiedhigh · 0.95
AMD Instinct MI300X product page footnote - 5.325 TB/s memory bandwidth derivation (VERBATIM)
spec-sheetAMDsources/vb-amd-mi300x-footnote-memory-bandwidth-derivation
verifiedhigh · 0.95
AMD Instinct MI300X product page specification table - dense and structured-sparse rows (VERBATIM)
spec-sheetAMDsources/vb-amd-mi300x-product-page-spec-table
verifiedhigh · 0.95
AMD Instinct MI325X product page
spec-sheetAMDsources/amd-mi325x-product-page
verifiedhigh · 0.90
AMD Instinct MI325X product page 'Specs Comparisons' charts - NVIDIA H200 figures printed WITHOUT a sparsity label
spec-sheetAMDsources/vb-amd-mi325x-h200-comparison-chart-dense-basis
verifiedhigh · 0.95
AMD Instinct MI325X product page (TBP and Passive OAM cooling)
spec-sheetAMDsources/pwr2-amd-mi325x-product-page
verifiedhigh · 0.90
AMD Instinct MI325X product page footnote - 6 TB/s memory bandwidth as an AMD Performance Labs estimate (VERBATIM)
spec-sheetAMDsources/vb-amd-mi325x-footnote-memory-bandwidth-estimate
verifiedhigh · 0.95
AMD Instinct MI325X product page specification table - dense and structured-sparse rows (VERBATIM)
spec-sheetAMDsources/vb-amd-mi325x-product-page-spec-table
verifiedhigh · 0.95
AMD Instinct MI350 series product page
spec-sheetAMDsources/sup-buy-amd-instinct-mi350
verifiedhigh · 0.85
AMD Instinct MI350P PCIe cards product page
spec-sheetAMDsources/amd-mi350p-product-page
verifiedhigh · 0.90
AMD Instinct MI350P product page - board table publishes no Infinity Fabric link rows (verified negative)
spec-sheetAMDsources/w7a-amd-mi350p-no-if-link-rows-published
verifiedhigh · 0.92
AMD Instinct MI350X product page
spec-sheetAMDsources/amd-mi350x-product-page
verifiedhigh · 0.90
AMD Instinct MI350X product page - explicit Scale-up / Scale-out Infinity Fabric rows
spec-sheetAMDsources/w7a-amd-mi350x-product-page-scale-up-scale-out-rows
verifiedhigh · 0.95
AMD Instinct MI350X product page (TBP and Passive OAM cooling)
spec-sheetAMDsources/pwr2-amd-mi350x-product-page
verifiedhigh · 0.90
AMD Instinct MI350X product page spec table
spec-sheetAMDsources/vb-amd-mi350x-spec-table
verifiedhigh · 0.95
AMD Instinct MI355X GPU datasheet brochure
spec-sheetAMDsources/amd-mi355x-brochure
verifiedhigh · 0.95
AMD Instinct MI355X product page
spec-sheetAMDsources/amd-mi355x-product-page
verifiedhigh · 0.90
AMD Instinct MI355X product page - explicit Scale-up / Scale-out Infinity Fabric rows
spec-sheetAMDsources/w7a-amd-mi355x-product-page-scale-up-scale-out-rows
verifiedhigh · 0.95
AMD Instinct MI355X product page spec table
spec-sheetAMDsources/vb-amd-mi355x-spec-table
verifiedhigh · 0.95
AMD Instinct where-to-buy (OEM and system-builder partner list)
spec-sheetAMDsources/sup-buy-amd-instinct-where-to-buy
verifiedhigh · 0.85
AMD newsroom press release: AMD Unveils World's Most Advanced Gaming Graphics Cards, Built on Groundbreaking AMD RDNA 3 Architecture with Chiplet Design
blogAMDsources/acc-fill-amd-rx-7900-series-press-release-rdna3
verifiedhigh · 0.90
AMD partner article: Introducing the AMD Radeon RX 7900 Series Graphics
blogAMDsources/acc-fill-amd-rx-7900-series-launch
verifiedhigh · 0.90
AMD Radeon AI PRO R9700 product specifications page (AI 9000 Series)
spec-sheetAMDsources/acc-fill-amd-radeon-ai-pro-r9700-product-page
verifiedhigh · 0.95
AMD Radeon Instinct MI50 datasheet (archived 2021-01-12)
spec-sheetAMDsources/amd-mi50-datasheet
verifiedhigh · 0.85
AMD Radeon Instinct MI50 datasheet (archived AMD PDF) - MI50 figures are dense, no structured-sparsity footnote on this generation
spec-sheetAdvanced Micro Devices (AMD-authored PDF, retrieved via the Wayback Machine copy of amd.com)sources/w4h-amd-mi50-datasheet-dense-no-sparsity-label
verifiedhigh · 0.90
AMD Radeon Instinct MI60 datasheet (archived AMD PDF) - MI60 and MI50 compute table, no sparsity labelling at all
spec-sheetAdvanced Micro Devices (AMD-authored PDF, retrieved via the Wayback Machine copy of amd.com; the live amd.com URL is dead)sources/w4h-amd-radeon-instinct-mi60-datasheet
verifiedhigh · 0.90
AMD Radeon Instinct MI60 product page (archived 2018-11-22)
spec-sheetAMDsources/amd-mi60-product-page
verifiedhigh · 0.85
AMD Radeon Pro VII archived product page - the GPU Specifications table, quoted in full, which supersedes a wrong negative finding about this same page
spec-sheetAMD (archived AMD product page, retrieved via the Wayback Machine)sources/w5a-part2-amd-radeon-pro-vii-page-does-contain-the-figure
verifiedhigh · 0.95
AMD Radeon Pro VII product page (archived 2021-02-16)
spec-sheetAMDsources/amd-radeon-pro-vii-product-page
verifiedhigh · 0.85
AMD Radeon PRO W7900 datasheet (PID 232010504)
spec-sheetAdvanced Micro Devicessources/acc2-amd-radeon-pro-w7900-datasheet
verifiedhigh · 0.95
AMD Radeon RX 6600 product page (8 GB GDDR6, 224 GB/s, 132 W)
spec-sheetAMDsources/amd-radeon-rx-6600-product-page
verifiedhigh · 0.90
AMD Radeon RX 6600 XT product page (8 GB GDDR6, 256 GB/s, 160 W)
spec-sheetAMDsources/amd-radeon-rx-6600-xt-product-page
verifiedhigh · 0.90
AMD Radeon RX 6650 XT product page (8 GB GDDR6, 280 GB/s, 180 W)
spec-sheetAMDsources/amd-radeon-rx-6650-xt-product-page
verifiedhigh · 0.90
AMD Radeon RX 6700 XT product page (12 GB GDDR6, 384 GB/s, 230 W)
spec-sheetAMDsources/amd-radeon-rx-6700-xt-product-page
verifiedhigh · 0.90
AMD Radeon RX 6750 XT product page (12 GB GDDR6, 432 GB/s, 250 W)
spec-sheetAMDsources/amd-radeon-rx-6750-xt-product-page
verifiedhigh · 0.90
AMD Radeon RX 6800 product page (16 GB GDDR6, 512 GB/s, 250 W)
spec-sheetAMDsources/amd-radeon-rx-6800-product-page
verifiedhigh · 0.90
AMD Radeon RX 7600 product page (8 GB GDDR6, 288 GB/s, 165 W)
spec-sheetAMDsources/amd-radeon-rx-7600-product-page
verifiedhigh · 0.90
AMD Radeon RX 7900 XTX product specifications page
spec-sheetAMDsources/acc-fill-amd-radeon-rx-7900xtx-product-page
verifiedhigh · 0.95
AMD Radeon RX 9070 XT product specifications page
spec-sheetAMDsources/acc-fill-amd-radeon-rx-9070xt-product-page
verifiedhigh · 0.95
AMD Radeon RX Vega 56 product page (Wayback capture 2020-01-21, spec table)
spec-sheetAMDsources/amd-radeon-rx-vega-56-product-page-archive-2020
verifiedmedium · 0.75
AMD Radeon RX Vega 64 product page (Wayback capture 2020-11-18, spec table)
spec-sheetAMDsources/amd-radeon-rx-vega-64-product-page-archive-2020
verifiedmedium · 0.80
AMD Radeon VII product page (Wayback capture, spec table)
spec-sheetAMDsources/amd-radeon-vii-product-page-archive-2022
verifiedmedium · 0.80
AMD RDNA architecture page (generation comparison table and RDNA 4 overview)
blogAMDsources/acc-fill-amd-rdna-architecture-page
verifiedhigh · 0.85
AMD ROCm 'AMD Instinct MI350 Series microarchitecture' reference page
spec-sheetAMDsources/net2-rocm-mi350-microarch
verifiedhigh · 0.92
AMD ROCm blog: 4-bit TurboQuant KV in LMCache on MI355X
blogAMDsources/amd-rocm-4bit-kv-lmcache-mi355x
verifiedmedium · 0.70
AMD ROCm Blog: Efficient LLM Serving with MTP: DeepSeek V3 and SGLang on AMD Instinct GPUs
blogAMDsources/w15-amd-rocm-deepseek-mtp-benchmark
verifiedhigh · 0.90
AMD ROCm: Open-source software stack for AMD GPU computing
repoAMDsources/src5-rocm-github
verifiedhigh · 0.95
AMD Ryzen AI Max+ 395 (Radeon 8060S Graphics) product specifications page
spec-sheetAMDsources/acc-fill-amd-ryzen-ai-max-plus-395-product-page
verifiedhigh · 0.90
AMD/Xilinx Alveo U280 Data Center Accelerator Card Data Sheet (DS963 v1.2)
spec-sheetXilinx (now AMD)sources/xilinx-alveo-u280-ds963-datasheet
verifiedhigh · 0.90
An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic
paperFormulates extraction monitoring as benign-calibrated traffic-window distribution testing (MMD over a semantic embedding), thresholded from benign-vs-benign comparisons only. 0.3% benign FPR, 100% pure-attacker TPR, 90.5% average TPR over attacker fractions, 95.1% balanced accuracy, across 14 attacker-normal query pairs and three seeds.sources/sec-arxiv-2606-05725
verifiedhigh · 0.90
Android NNAPI deprecation notices (AOSP and Android NDK)
whitepaperAndroid Open Source Projectsources/niche-android-nnapi-deprecation
verifiedhigh · 0.95
Announcing Llama 3.1 Support in vLLM
blogvLLM projectsources/bench-nv-vllm-llama31-blog
verifiedmedium · 0.80
answerdotai/ModernBERT-base config.json
repoHugging Facesources/hf-embed-modernbert-base
verifiedhigh · 0.88
Anthropic Claude Platform API pricing docs (per-MTok model tables, cache tiers, batch)
spec-sheetAnthropicsources/rent-src-anthropic-api-pricing
verifiedhigh · 0.90
Anyscale ACU pricing - Compute unit rates and instance mapping
databaseAnyscalesources/ppl-cloud-anyscale-acu-detail
verifiedhigh · 0.90
Anyscale as cloud orchestrator - ACU billing, Ray platform, BYOC or hosted
databaseAnyscalesources/ppl-orch-anyscale-billing-model
verifiedhigh · 0.90
Anyscale Pricing - Pay-as-you-go GPU rates (Hosted tier)
databaseAnyscalesources/ppl-cloud-anyscale-pricing
verifiedhigh · 0.95
Anyscale vs raw cloud GPU pricing - ACU rates vs per-GPU-hour
databaseAnyscalesources/ppl-cloud-anyscale-vs-cloud-price
verifiedhigh · 0.85
Apache TVM documentation
repoApache Software Foundationsources/apache-tvm-documentation
verifiedhigh · 0.85
aphrodite-engine/aphrodite-engine redirects to dphnAI/sonar
databaseGitHubsources/niche-aphrodite-rename-redirect
verifiedhigh · 0.90
Apple Mac Studio (2022) technical specifications (M1 Max / M1 Ultra)
spec-sheetApplesources/consumer-apple-mac-studio-2022-tech-specs
verifiedhigh · 0.85
Apple Mac Studio (2025) technical specifications (M4 Max / M3 Ultra)
spec-sheetApplesources/consumer-apple-mac-studio-2025-tech-specs
verifiedhigh · 0.85
Apple Mac Studio (M5 Max, M5 Ultra) Tech Specs
spec-sheetApplesources/local-apple-mac-studio-m5-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro (14-inch, M4 Pro or M4 Max, 2024) technical specifications
spec-sheetApplesources/consumer-apple-macbook-pro-14-m4-max-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro (16-inch, Nov 2023) technical specifications (M3 Max)
spec-sheetApplesources/consumer-apple-macbook-pro-16-m3-max-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro (M3 Pro) Tech Specs
spec-sheetApplesources/local-apple-macbook-pro-m3-pro-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro (M4 Pro) Tech Specs
spec-sheetApplesources/local-apple-macbook-pro-m4-pro-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro (M5, M5 Pro, M5 Max) Tech Specs
spec-sheetApplesources/local-apple-macbook-pro-m5-tech-specs
verifiedhigh · 0.85
Apple MacBook Pro 14/16-inch (2021) tech specs — M1 Max up to 32-core GPU, 64GB unified, 400 GB/s
spec-sheetApplesources/apple-m1-max-specs
verifiedmedium · 0.70
Apple MacBook Pro 16-inch (2023) M2 Max tech specs
spec-sheetApplesources/apple-macbook-pro-16-inch-2023-m2-max-tech-specs
verifiedhigh · 0.90
Argonne LLM-Inference-Bench: All_results.csv (4771 measured rows) + arXiv:2411.00136
paperArgonne National Laboratorysources/argonne-llm-inference-bench-all-results-csv
verifiedhigh · 0.90
Artificial Analysis Llama 3.3 Instruct 70B provider comparison (independent TTFT / tps / price measurements)
benchmarkArtificial Analysissources/svc-src-artificialanalysis-llama33-70b-providers-2026-10-14
verifiedhigh · 0.85
Artificial Analysis Llama 3.3 Instruct 70B provider comparison (speed, TTFT, price ranks), fetched 2026-10-16
benchmarkArtificial Analysissources/svc-src-artificialanalysis-llama33-70b-providers-2026-10-16
verifiedhigh · 0.90
Artificial Analysis Llama 3.3 Instruct 70B provider comparison, long-prompt medians, fetched 2026-10-17
benchmarkArtificial Analysissources/svc-src-artificialanalysis-llama33-70b-providers-2026-10-17
verifiedhigh · 0.90
arXiv 2403.19887
paperarXivsources/pap-arch-2403-19887
verifiedhigh · 0.90
arXiv 2406.02532: SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices
paperarXivsources/w15-pap-specexec
verifiedhigh · 0.88
arXiv 2410.05355
paperarXivsources/pap-arch-2410-05355
verifiedhigh · 0.90
arXiv 2503.13565: ML-SpecQD: Multi-Level Speculative Decoding with Quantized Drafts
paperarXivsources/w15-pap-ml-specqd
verifiedhigh · 0.85
arXiv 2504.19874 TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate
paperarXivsources/arxiv-2504-19874-turboquant
verifiedhigh · 0.85
arXiv 2605.10453: SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding
paperarXivsources/w15-pap-slimspec
verifiedhigh · 0.88
arXiv API entry for 2510.09665 (LMCache v1/v2) - submission date makes an ICLR 2025 acceptance impossible
databasearXivsources/w6p-arxiv-api-lmcache-timing
verifiedhigh · 0.90
arXiv API id_list responses for the 16 paper records found duplicated under two slugs
databasearXivsources/w6p-arxiv-api-duplicate-id-confirmation
verifiedhigh · 0.90
arXiv API negative search: no paper for NVIDIA DeepGEMM (and a name-collision warning)
databasearXivsources/sco-arxiv-no-paper-search-deepgemm
verifiedhigh · 0.95
arXiv API negative search: no paper titled TensorRT-LLM
databasearXivsources/sco-arxiv-no-paper-search-trtllm
verifiedhigh · 0.95
arXiv API paper metadata query (export.arxiv.org/api/query)
databasearXivsources/sco-arxiv-api-paper-metadata
verifiedhigh · 0.95
arXiv API recheck: papers mentioning llama.cpp (70 results, all third-party uses)
databasearXivsources/sco-arxiv-llamacpp-negative-recheck
verifiedhigh · 0.90
arXiv:2104.08378 — Accelerating Sparse Deep Neural Networks
paperarXivsources/pap-quant-sparse-tensor-cores
verifiedhigh · 0.95
arXiv:2202.09368 — Mixture-of-Experts with Expert Choice Routing
paperarXivsources/pap-quant-expert-choice-routing
verifiedhigh · 0.95
arXiv:2206.01861 — ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
paperarXivsources/pap-quant-zeroquant
verifiedhigh · 0.95
arXiv:2208.07339 — LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
paperarXivsources/pap-quant-llmint8
verifiedhigh · 0.95
arXiv:2210.17323 — GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
paperarXivsources/pap-quant-gptq
verifiedhigh · 0.95
arXiv:2211.10438 — SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
paperarXivsources/pap-quant-smoothquant
verifiedhigh · 0.95
arXiv:2301.00774 — SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
paperarXivsources/pap-quant-sparsegpt
verifiedhigh · 0.95
arXiv:2303.08302 — ZeroQuant-V2: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation
paperarXivsources/pap-quant-zeroquant-v2
verifiedhigh · 0.95
arXiv:2304.12244 — WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions
paperarXivsources/pap-quant-wizardlm
verifiedhigh · 0.95
arXiv:2305.02301 — Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes
paperarXivsources/pap-quant-distilling-step-by-step
verifiedhigh · 0.95
arXiv:2305.11627 — LLM-Pruner: On the Structural Pruning of Large Language Models
paperarXivsources/pap-quant-llm-pruner
verifiedhigh · 0.95
arXiv:2305.17888 — LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
paperarXivsources/pap-quant-llm-qat
verifiedhigh · 0.95
arXiv:2306.00978 — AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
paperarXivsources/pap-quant-awq
verifiedhigh · 0.95
arXiv:2306.02707 — Orca: Progressive Learning from Complex Explanation Traces of GPT-4
paperarXivsources/pap-quant-orca
verifiedhigh · 0.95
arXiv:2306.03078 — SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
paperarXivsources/pap-quant-spqr
verifiedhigh · 0.95
arXiv:2306.07629 — SqueezeLLM: Dense-and-Sparse Quantization
paperarXivsources/pap-quant-squeezellm
verifiedhigh · 0.95
arXiv:2306.08543 — MiniLLM: On-Policy Distillation of Large Language Models
paperarXivsources/pap-quant-minillm
verifiedhigh · 0.95
arXiv:2306.11695 — A Simple and Effective Pruning Approach for Large Language Models
paperarXivsources/pap-quant-wanda
verifiedhigh · 0.95
arXiv:2306.13649 — On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
paperarXivsources/pap-quant-gkd
verifiedhigh · 0.95
arXiv:2307.13304 — QuIP: 2-Bit Quantization of Large Language Models With Guarantees
paperarXivsources/pap-quant-quip
verifiedhigh · 0.95
arXiv:2308.13137 — OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
paperarXivsources/pap-quant-omniquant
verifiedhigh · 0.95
arXiv:2310.02410 — Mixture of Quantized Experts (MoQE): Complementary Effect of Low-bit Quantization and Robustness
paperarXivsources/pap-quant-moqe
verifiedhigh · 0.95
arXiv:2310.02410 Mixture of Quantized Experts (MoQE): Complementary Effect of Low-bit Quantization and Robustness
paperarXivsources/qlab2-arxiv-moqe
verifiedhigh · 0.90
arXiv:2310.06694 — Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
paperarXivsources/pap-quant-sheared-llama
verifiedhigh · 0.95
arXiv:2310.07240 — CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving
paperarXivsources/pap-quant-cachegen
verifiedhigh · 0.95
arXiv:2310.10537 — Microscaling Data Formats for Deep Learning
paperarXivsources/pap-quant-mx-formats
verifiedhigh · 0.95
arXiv:2310.11453 — BitNet: Scaling 1-bit Transformers for Large Language Models
paperarXivsources/pap-quant-bitnet
verifiedhigh · 0.95
arXiv:2310.16795 - QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models
paperarXivsources/pap-qmoe-sub-1-bit-arxiv
verifiedhigh · 0.90
arXiv:2310.19102 — Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
paperarXivsources/pap-quant-atom
verifiedhigh · 0.95
arXiv:2311.03285 - S-LoRA: Serving Thousands of Concurrent LoRA Adapters
paperarXivsources/pap-w4p-s-lora
verifiedhigh · 0.95
arXiv:2312.05516 — Stateful Large Language Model Serving with Pensieve
paperarXivsources/pap-quant-pensieve
verifiedhigh · 0.95
arXiv:2312.11462 - Cascade Speculative Drafting for Even Faster LLM Inference
paperarXivsources/pap-w4p-cascade-spec-drafting
verifiedhigh · 0.95
arXiv:2312.17244 — The LLM Surgeon
paperarXivsources/pap-quant-llm-surgeon
verifiedhigh · 0.95
arXiv:2401.06118 — Extreme Compression of Large Language Models via Additive Quantization
paperarXivsources/pap-quant-aqlm
verifiedhigh · 0.95
arXiv:2401.14361 - MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
paperarXivsources/pap-moe-infinity-arxiv
verifiedhigh · 0.90
arXiv:2401.15024 — SliceGPT: Compress Large Language Models by Deleting Rows and Columns
paperarXivsources/pap-quant-slicegpt
verifiedhigh · 0.95
arXiv:2401.18079 — KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
paperarXivsources/pap-quant-kvquant
verifiedhigh · 0.95
arXiv:2402.02446 — LQER: Low-Rank Quantization Error Reconstruction for LLMs
paperarXivsources/pap-quant-lqer
verifiedhigh · 0.95
arXiv:2402.02750 — KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
paperarXivsources/pap-quant-kivi
verifiedhigh · 0.95
arXiv:2402.04396 — QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
paperarXivsources/pap-quant-quip-sharp
verifiedhigh · 0.95
arXiv:2402.07033 - Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
paperarXivsources/pap-w4p-fiddler
verifiedhigh · 0.95
arXiv:2402.17764 — The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
paperarXivsources/pap-quant-bitnet-b158
verifiedhigh · 0.95
arXiv:2404.00456 — QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
paperarXivsources/pap-quant-quarot
verifiedhigh · 0.95
arXiv:2404.09526 - LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism
paperarXivsources/pap-w4p-loongserve
verifiedhigh · 0.95
arXiv:2405.04532 — QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
paperarXivsources/pap-quant-qserve
verifiedhigh · 0.95
arXiv:2405.07135 — Post Training Quantization of Large Language Models with Microscaling Formats
paperarXivsources/pap-quant-mx-ftptq
verifiedhigh · 0.95
arXiv:2405.14256 — ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
paperarXivsources/pap-quant-zipcache
verifiedhigh · 0.95
arXiv:2405.14366 - MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
paperarXivsources/pap-w4p-minicache
verifiedhigh · 0.95
arXiv:2405.16406 — SpinQuant: LLM Quantization with Learned Rotations
paperarXivsources/pap-quant-spinquant
verifiedhigh · 0.95
arXiv:2406.02532 - SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices
paperarXivsources/pap-w4p-specexec
verifiedhigh · 0.95
arXiv:2406.08155 — QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts
paperarXivsources/pap-quant-quantmoe-bench
verifiedhigh · 0.95
arXiv:2406.08155 QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts
paperarXivsources/qlab2-arxiv-quantmoebench
verifiedhigh · 0.90
arXiv:2406.17565 - MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
paperarXivsources/pap-w4p-memserve
verifiedhigh · 0.95
arXiv:2406.19707 — InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management
paperarXivsources/pap-quant-infinigen
verifiedhigh · 0.95
arXiv:2407.00023 - Preble: Efficient Distributed Prompt Scheduling for LLM Serving
paperarXivsources/pap-w4p-preble
verifiedhigh · 0.95
arXiv:2407.10960 — Fast Matrix Multiplications for Lookup Table-Quantized LLMs
paperarXivsources/pap-quant-flute
verifiedhigh · 0.95
arXiv:2407.21783 — The Llama 3 Herd of Models
paperarXivsources/pap-quant-llama-3-herd
verifiedhigh · 0.95
arXiv:2410.07590 - TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text
paperarXivsources/pap-w4p-turborag
verifiedhigh · 0.95
arXiv:2410.16179 - MagicPIG: LSH Sampling for Efficient LLM Generation
paperarXivsources/pap-w4p-magicpig
verifiedhigh · 0.95
arXiv:2410.21465 — ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
paperarXivsources/pap-quant-shadowkv
verifiedhigh · 0.95
arXiv:2410.22134 - ProMoE: Fast MoE-based LLM Serving using Proactive Caching
paperarXivsources/pap-promoe-arxiv
verifiedhigh · 0.90
arXiv:2411.01433 - HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference
paperarXivsources/pap-hobbit-mixed-precision-expert-offload-arxiv
verifiedhigh · 0.90
arXiv:2411.10666 - SAM Decoding: Speculative Decoding via Suffix Automaton
paperarXivsources/pap-w4p-sam-decoding
verifiedhigh · 0.95
arXiv:2411.11217 - MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
paperarXivsources/pap-w4p-moelightning
verifiedhigh · 0.95
arXiv:2411.15100 - XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
paperarXivsources/pap-w4p-xgrammar
verifiedhigh · 0.95
arXiv:2412.08905 — Phi-4 Technical Report
paperarXivsources/pap-quant-phi-4
verifiedhigh · 0.95
arXiv:2501.12948 — DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
paperarXivsources/pap-quant-deepseek-r1
verifiedhigh · 0.95
arXiv:2502.15734 - Cache-Craft: Managing Chunk-Caches for Efficient Retrieval-Augmented Generation
paperarXivsources/pap-w4p-cachecraft
verifiedhigh · 0.95
arXiv:2504.02263 - MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
paperarXivsources/pap-w4p-megascale-infer
verifiedhigh · 0.95
arXiv:2504.03624 - Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
paperarXivsources/pap-w4p-nemotron-h
verifiedhigh · 0.95
arXiv:2504.03648 - AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
paperarXivsources/pap-w4p-aibrix
verifiedhigh · 0.95
arXiv:2504.05897 - HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference
paperarXivsources/pap-hybrimoe-hybrid-cpu-gpu-scheduling-arxiv
verifiedhigh · 0.85
arXiv:2505.03804 — MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
paperarXivsources/pap-quant-moequant
verifiedhigh · 0.95
arXiv:2505.03804 MoEQuant: Enhancing Quantization for Mixture-of-Experts LLMs via Expert-Balanced Sampling and Affinity Guidance
paperarXivsources/qlab2-arxiv-moequant
verifiedhigh · 0.90
arXiv:2505.05799 MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design
paperarXivsources/qlab2-arxiv-mxmoe
verifiedhigh · 0.90
arXiv:2506.13329 — EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization
paperarXivsources/pap-quant-eaquant
verifiedhigh · 0.95
arXiv:2506.13329 EAQuant: Enhancing PTQ for MoE Models via Expert-Aware Optimization
paperarXivsources/qlab2-arxiv-eaquant
verifiedhigh · 0.90
arXiv:2507.00418 — Serving LLMs in HPC Clusters: QAic 100 Ultra vs A100/V100/A6000/H200/MI300A (vLLM)
paperarXiv / UCSD (PEARC'25)sources/arxiv-2507-00418-qaic-vs-gpu-llm-serving
verifiedmedium · 0.80
arXiv:2507.13575 - Apple Intelligence Foundation Language Models: Tech Report 2025
paperarXivsources/pap-w4p-apple-ptmoe
verifiedhigh · 0.95
arXiv:2507.20534 - Kimi K2: Open Agentic Intelligence
paperarXivsources/pap-w4p-kimi-k2
verifiedhigh · 0.95
arXiv:2509.25149 — Pretraining Large Language Models with NVFP4
paperarXivsources/pap-quant-nvfp4-pretraining
verifiedhigh · 0.95
arXiv:2512.02556 - DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
paperarXivsources/pap-w4p-deepseek-v32
verifiedhigh · 0.95
arXiv:2512.10576 - ESS: An Offload-Centric Latent-Cache Management Architecture for DeepSeek-V3.2-Exp
paperarXivsources/pap-w4p-ess-deepseek
verifiedhigh · 0.95
arXiv:2601.04426 - XGrammar-2: Dynamic and Efficient Structured Generation Engine for Agentic LLMs
paperarXivsources/pap-w4p-xgrammar2
verifiedhigh · 0.95
arXiv:2606.04980 — AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization
paperarXivsources/pap-quant-alphaq
verifiedhigh · 0.95
arXiv:2606.04980 AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization
paperarXivsources/qlab2-arxiv-alphaq
verifiedhigh · 0.90
arXiv:2606.05688 — Value-and-Structure Alignment for Routing-Consistent Quantization of Mixture-of-Experts Models
paperarXivsources/pap-quant-vsraq
verifiedhigh · 0.95
arXiv:2606.05688 Value-and-Structure Alignment for Routing-Consistent Quantization of Mixture-of-Experts Models (VSRAQ)
paperarXivsources/qlab2-arxiv-vsraq
verifiedhigh · 0.90
arXiv:2606.21868 - WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware
paperarXivsources/pap-wisp-working-set-moe-arxiv
verifiedhigh · 0.85
arXiv:2607.24787 - SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models
paperarXivsources/pap-specprefetch-expert-prefetch-arxiv
verifiedhigh · 0.85
arXiv:2609.12978 - SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading
paperarXivsources/pap-seqmoe-graph-compatible-moe-offload-arxiv
verifiedhigh · 0.85
arXiv:2609.35465 — Tetra: Serving Leech-Lattice Quantized LLMs at 2.7 Bits per Parameter
paperarXivsources/pap-quant-tetra
verifiedhigh · 0.95
arXiv:2609.36120 — ThinQuant: Scalable Rotation Learning for Weight and Activation Quantization of LLMs
paperarXivsources/pap-quant-thinquant
verifiedhigh · 0.95
arXiv:2610.01950 - MoE-CORE: Coordinated Expert Offloading and Residency for Memory-Constrained MoE Inference
paperarXivsources/pap-moe-core-arxiv
verifiedhigh · 0.90
arXiv:2610.05123 - HiNa-MoE: High-Performance, Non-Intrusive MoE Inference on CPUs with Matrix Engines
paperarXivsources/pap-hina-moe-arxiv
verifiedmedium · 0.75
arXiv:2610.15417 - SpecFit: Not All Draft Tokens Cost the Same in Offloaded MoE Inference
paperarXivsources/pap-specfit-offloaded-moe-arxiv
verifiedhigh · 0.85
Atlas 300I Duo Inference Card User Guide - Specifications
spec-sheetHuawei Enterprisesources/cn-huawei-atlas-300i-duo-spec
verifiedhigh · 0.95
Atlas 300I Inference Card User Guide (Model 3010) - Basic Specifications
spec-sheetHuawei Enterprisesources/cn-huawei-atlas-300i-3010-spec
verifiedhigh · 0.95
Atlas 300I Pro Inference Card User Guide - Specifications
spec-sheetHuawei Enterprisesources/cn-huawei-atlas-300i-pro-spec
verifiedhigh · 0.95
Atlas 300V Pro Video Analysis Card User Guide - Specifications
spec-sheetHuawei Enterprisesources/cn-huawei-atlas-300v-pro-spec
verifiedhigh · 0.95
Atlas 650E AI Server product page and llms-content spec dump
spec-sheetHuawei HiSilicon / Ascend Communitysources/cn-huawei-atlas-650e-spec
verifiedhigh · 0.95
Atlas 800I A2 Inference Server - Technical Specifications
spec-sheetHuawei Enterprisesources/cn-huawei-atlas-800i-a2-spec
verifiedhigh · 0.95
Atlas 950 SuperPoD product page
spec-sheetHuawei HiSilicon / Ascend Communitysources/cn-huawei-atlas-950-superpod-spec
verifiedhigh · 0.95
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving (Zhao et al.)
paperarXivsources/qlab-atom-paper
verifiedhigh · 0.88
Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities (arXiv:2402.01831)
paperarXivsources/pap-mm-audio-flamingo
verifiedhigh · 0.90
AUDIT NEGATIVE: the oneDNN README cited by xpu-intel-dc-gpu-flex-170 and xpu-intel-dc-gpu-max-1550 contains NO TFLOPS figure at all - a citation that does not support its number
repooneapi-src (oneDNN) on GitHub - the same document as xpu-onednn-github-readmesources/w5a-part2-onednn-readme-contains-no-tflops-figure
verifiedhigh · 0.95
AUDIT: the H100 datasheet's 'H100 NVL' column is a 2-CARD aggregate (footnote 1), so the per-card NVL figures live on NVIDIA's H100/H200 product pages - the stored H100-NVL values match the product page, not this datasheet
spec-sheetNVIDIA (H100 Tensor Core GPU datasheet; mirror of the official PDF)sources/w5a-part2-h100-datasheet-nvl-column-is-a-2x-pair
verifiedhigh · 0.95
Automatic Prefix Caching - vLLM documentation
repovLLM project documentationsources/flop2-vllm-apc
verifiedhigh · 0.90
AWQ: Activation-aware Weight Quantization
repoAutoAWQsources/src5-awq-github
verifiedhigh · 0.90
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
paperarXivsources/quant-awq-paper
verifiedhigh · 0.90
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration (Lin et al., MLSys 2024)
paperarXivsources/bench-meth-awq
verifiedhigh · 0.90
AWS EC2 Data Transfer Out pricing - NEGATIVE: pricing table not accessible via static fetch
databaseAmazon Web Servicessources/ppl-dep-aws-egress-negative
verifiedhigh · 0.95
AWS EC2 Price List API - US East (N. Virginia), current
databaseAmazon Web Servicessources/sup-cloud-aws-ec2-price-list-use1
verifiedhigh · 0.98
AWS EC2 Price List API - US West (Oregon), current
databaseAmazon Web Servicessources/sup-cloud-aws-ec2-price-list-usw2
verifiedhigh · 0.98
AWS EC2 Price List API bulk JSON, us-east-1, OnDemand terms (publicationDate 2026-09-25)
databaseAWSsources/rent-src-aws-ec2-price-list-use1
verifiedhigh · 0.90
AWS EC2 Spot Instances Pricing page (up-to-90%-off statement, per-AZ spot table)
spec-sheetAWSsources/rent-src-aws-spot-pricing-page
verifiedhigh · 0.90
AWS EC2 User Guide - Capacity Blocks for ML: 8-week booking horizon, 64/256 instance caps
spec-sheetAmazon Web Servicessources/spl-aws-capacity-block-booking-horizon
verifiedhigh · 0.90
AWS Inferentia product page
spec-sheetAmazon Web Servicessources/asic-aws-inferentia-product
verifiedhigh · 0.90
AWS Inferentia product page (aws.amazon.com) - the 190 TFLOPS FP16 per-chip sentence, quoted with AWS's own precision wording
spec-sheetAmazon Web Services (aws.amazon.com, AWS's own product page)sources/w4h-aws-inferentia2-product-page-190tf
verifiedhigh · 0.90
AWS Neuron docs — Inf1 Inference Performance tables
benchmarkAWSsources/aws-neuron-inf1-inference-benchmarks
verifiedmedium · 0.70
AWS Neuron docs — Trn1/Trn1n Inference Performance tables
benchmarkAWSsources/aws-neuron-trn1-inference-benchmarks
verifiedmedium · 0.70
AWS Neuron documentation - Inferentia2 Architecture page (per-chip compute, memory, DMA, NeuronLink)
spec-sheetAWS (awsdocs-neuron.readthedocs-hosted.com, the AWS Neuron SDK documentation)sources/w7z-neuron-inferentia2-arch-page
verifiedhigh · 0.95
AWS Neuron documentation - Trainium2 Architecture page, including its per-chip Trainium (gen 1) comparison column
spec-sheetAWS (awsdocs-neuron.readthedocs-hosted.com, the AWS Neuron SDK documentation)sources/w7z-neuron-trainium2-arch-page
verifiedhigh · 0.95
AWS Neuron documentation: Inf2 Inference Performance tables
benchmarkAWSsources/aws-neuron-inf2-inference-performance
verifiedhigh · 0.85
AWS Trainium product page (Neuron SDK, Trainium3)
blogAmazon Web Servicessources/asic-aws-trainium-product
verifiedhigh · 0.90
AWS Trainium3 Architecture (Neuron Docs)
blogsources/aws-trainium3-architecture-neuron-docs
verifiedhigh · 0.85
AWS What's New: EC2 Trn3 UltraServers GA (Trainium3)
blogAWSsources/aws-trn3-ultraservers-whats-new-dec2025
verifiedhigh · 0.85
Axelera AI Metis AIPU and Server 150p / Embedded 110m Product Brief
spec-sheetAxelera AIsources/ainv-axelera-metis-specsheet
verifiedmedium · 0.80
Axelera Metis AIPU Product Page
spec-sheetAxelera AIsources/axelera-metis-aipu-product-page
verifiedhigh · 0.85
Ayar Labs TeraPHY Optical I/O Chiplet Product Page and Specifications
spec-sheetAyar Labssources/ayarlabs-teraphy-product-page
verifiedhigh · 0.90
Azure Managed Disks pricing (Premium SSD v2 / Ultra per-GiB-per-hour storage charge)
spec-sheetMicrosoftsources/rent-src-azure-managed-disks
verifiedhigh · 0.90
Azure OpenAI Service pricing page (per-1M-token tables by model and deployment type)
databaseMicrosoft Azuresources/svc-src-azure-openai-pricing-2026-10-14
verifiedhigh · 0.90
Azure Retail Prices API - ND96asr / ND96amsr A100 v4 (eastus)
databaseMicrosoftsources/sup-cloud-azure-retail-prices-a100
verifiedhigh · 0.98
Azure Retail Prices API - ND96isr H100 v5 (eastus)
databaseMicrosoftsources/sup-cloud-azure-retail-prices-h100
verifiedhigh · 0.98
Azure Retail Prices API - ND96isr H200 v5 (eastus2, westus2)
databaseMicrosoftsources/sup-cloud-azure-retail-prices-h200
verifiedhigh · 0.98
Azure Retail Prices API — full-catalogue dump, ND96isr H200/H100 v5 re-verification 2026-10-05
databaseMicrosoft Azuresources/w5s-azure-retail-prices-h200-recheck
verifiedhigh · 0.95
Azure Spot Virtual Machines documentation (eviction policy, 30-second notice, max price, ARG SpotResources)
spec-sheetMicrosoftsources/rent-src-azure-spot-vm-doc
verifiedhigh · 0.90
B&H Photo Video Radeon RX 9070 XT search results
databaseB&H Photo Videosources/noncuda-bhphoto-rx9070xt-search
verifiedhigh · 0.85
B&H Photo Video RTX 3090 search results
databaseB&H Photo Videosources/noncuda-bhphoto-rtx3090-search
verifiedhigh · 0.85
B&H Photo Video RTX 5090 search results
databaseB&H Photo Videosources/noncuda-bhphoto-rtx5090-search
verifiedhigh · 0.85
B&H Photo Video RTX PRO 6000 Blackwell search results
databaseB&H Photo Videosources/noncuda-bhphoto-rtxpro6000-search
verifiedhigh · 0.85
BAAI/bge-base-en-v1.5 config.json
repoHugging Facesources/hf-embed-bge-base-en-v1-5
verifiedhigh · 0.88
BAAI/bge-large-en-v1.5 config.json
repoHugging Facesources/hf-embed-bge-large-en-v1-5
verifiedhigh · 0.88
BAAI/bge-m3 config.json
repoHugging Facesources/hf-embed-bge-m3
verifiedhigh · 0.88
BAAI/bge-reranker-large config.json
repoHugging Facesources/hf-embed-bge-reranker-large
verifiedhigh · 0.88
BAAI/bge-reranker-v2-m3 config.json
repoHugging Facesources/hf-embed-bge-reranker-v2-m3
verifiedhigh · 0.88
BAAI/bge-small-en-v1.5 config.json
repoHugging Facesources/hf-embed-bge-small-en-v1-5
verifiedhigh · 0.88
Baseten blog - Introducing the Baseten Delivery Network: fast cold starts for big models
blogBasetensources/dep-baseten-bdn-cold-start-blog
verifiedhigh · 0.90
Baseten cloud pricing - GPU instances
databaseBasetensources/sup-cloud-baseten-pricing
verifiedhigh · 0.94
Baseten documentation - Cold starts (startup phases, startup time card)
whitepaperBasetensources/dep-baseten-cold-starts-docs
verifiedhigh · 0.95
Beam as cloud orchestrator - Per-second serverless, per-machine on-demand, BYOC
databaseBeamsources/ppl-orch-beam-billing-model
verifiedhigh · 0.90
Beam Cloud Pricing - Serverless per-second and On-demand per-machine GPU rates
databaseBeamsources/ppl-cloud-beam-pricing
verifiedhigh · 0.95
Beam Cloud vs raw cloud GPU pricing - Serverless and On-demand comparison
databaseBeamsources/ppl-cloud-beam-vs-cloud-price
verifiedhigh · 0.90
Ben Linville (bentech) - Intel Arc Pro B60 + B70 LLM benchmarks, most quants every backend
blogBen Linville / bentech.substack.comsources/bentech-arc-pro-b60-b70-llm-benchmarks
verifiedmedium · 0.70
Benchmark comparison on MacBook Pro M3 Max 128GB: Splash, Ollama (MLX), and Ollama (llama.cpp) across Qwen3.6-35B and Qwen3.8-27B
benchmarkincoai / communitysources/src-incoai-splash-issue-37
verifiedmedium · 0.80
Berkeley Lab 'Queued Up: 2026 Edition' - US transmission interconnection queue characteristics through end of 2025
databaseLawrence Berkeley National Laboratory / GridTrackersources/pwr2-lbnl-queued-up-2026
verifiedhigh · 0.95
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
paperarXiv (Devlin, Chang, Lee, Toutrainova; Google AI)sources/flop2-bert
verifiedhigh · 0.90
bespokelabs/Bespoke-Stratos-7B model repo
repoBespoke Labs / Hugging Facesources/hf-eco-bespoke-stratos-7b
verifiedhigh · 0.95
Best Buy search results for Radeon RX 9070 XT
databaseBest Buysources/noncuda-bestbuy-rx9070xt-search
verifiedmedium · 0.80
Best practices for competitive inference optimization on AMD Instinct MI300X GPUs (ROCm Blogs)
benchmarkAMDsources/bench-amd-rocm-llm-inference-best-practices
verifiedhigh · 0.85
Beyond Energy: When Sustainability Dimensions Reshape LLM Serving Decisions (arXiv 2609.35569)
paperarXiv (Tsinghua University)sources/pap-sys-prism-arxiv
verifiedhigh · 0.88
Biren (壁仞) BILI 166 series product pages: 166C, 166M, 166L
spec-sheetBiren Technology (壁仞科技)sources/cn-biren-bili-166
verifiedhigh · 0.95
Biren BILI 166C inference card product page (BirenTech's own site) - form factor and power published, NO compute or memory figure published
spec-sheetBiren Technology (birentech.com, the company's own site)sources/w4h-biren-166c-product-page-no-compute-figure
verifiedhigh · 0.85
Biren Technology Hot Chips 34 presentation 'BR100 GPGPU: Accelerating Datacenter Scale AI Computing'
whitepaperBiren Technologysources/net2-biren-hotchips-br100
verifiedmedium · 0.70
BIS final rule 91 FR 1684 - Revision to License Review Policy for Advanced Computing Commodities (2026-01-15)
release-notesUS Bureau of Industry and Security / Federal Registersources/spl-bis-2026-01-advanced-computing-case-by-case
verifiedhigh · 0.95
BIS guidance 2026-05-31 - license required for advanced computing items to D:5/Macau-headquartered entities regardless of location
release-notesUS Bureau of Industry and Securitysources/spl-bis-2026-05-d5-guidance
verifiedhigh · 0.95
BIS press release 2025-05-13 - rescission of the AI Diffusion Rule; strengthened chip export controls
release-notesUS Bureau of Industry and Securitysources/spl-bis-2025-05-ai-diffusion-rescission
verifiedhigh · 0.90
BitNet: Scaling 1-bit Transformers for Large Language Models (Ma et al., Microsoft)
paperarXivsources/qlab-bitnet-b1-paper
verifiedhigh · 0.88
bitsandbytes csrc/kernels.cu template instantiations (which blocksizes actually have compiled kernels)
repobitsandbytessources/qzgw-bnb-kernels-instantiations
verifiedhigh · 0.95
bitsandbytes functional.py quantize_4bit (blocksize default and valid values)
repobitsandbytessources/qzgw-bnb-functional
verifiedhigh · 0.95
Blackhole PCIe Cards (p100a/p150a/p150b) product guide
spec-sheetTenstorrentsources/asic-tenstorrent-blackhole-docs
verifiedhigh · 0.90
BLIP-2: Bootstrapping Language-Image Pre-training (arXiv:2301.12597)
paperarXivsources/blip-2-bootstrapping-language-image-pre-training-arxiv-2301-1259
verifiedmedium · 0.75
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models (arXiv:2301.12597)
paperarXivsources/pap-mm-blip2
verifiedhigh · 0.90
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models (BD3-LM)
paperarXivsources/pap-arch-2503-09573
verifiedhigh · 0.90
Blockwise Parallel Transformer for Large Context Models
paperarXivsources/pap-attn-blockwise-parallel-transformer
verifiedhigh · 0.85
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
paperarXiv (Fu, Bailis, Stoica, Zhang; UC Berkeley)sources/sd-lookahead-paper
verifiedhigh · 0.90
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding (arXiv:2402.02057)
blogsources/pap-eff-lookahead-decoding
verifiedhigh · 0.85
Broadcom BCM78919 102.4-Tb/s Multilayer CPO Switch Product Page
spec-sheetBroadcomsources/broadcom-bcm78919-cpo-product-page
verifiedhigh · 0.90
Burn GitHub repository (tracel Rust DL framework)
repoTracel AIsources/niche-burn-repo
verifiedhigh · 0.85
Bypassing LLM Watermarks with Color-Aware Substitutions
paperSelf Color Testing-based Substitution: recovers token 'colour' by prompting the watermarked model and comparing output token frequencies, then substitutes green tokens. Claims removal for arbitrarily long watermarked text with fewer edits than prior work.sources/sec-arxiv-2403-14719
verifiedhigh · 0.90
Bypassing Prompt Injection Detectors through Evasive Injections
paperShows hidden-layer activation-shift injection detectors are not robust to adaptive adversaries: a multi-probe attack appends a universal adversarially-optimised suffix that jointly fools all layer-wise drift detectors while preserving the injection.sources/sec-arxiv-2602-00750
verifiedhigh · 0.90
CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion (arXiv:2405.16444)
blogsources/pap-eff-cacheblend
verifiedmedium · 0.75
CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving (Zhang et al., UChicago/JCL)
paperarXivsources/qlab-cachegen-paper
verifiedhigh · 0.88
CachePrune: Privacy-Aware and Fine-Grained KV Cache Sharing for Efficient LLM Inference
paperArgues prompts are mostly privacy-irrelevant segments (system instructions, public material) and that token-level, sensitivity-masked cache sharing removes the direct reuse side channel while cutting TTFT 4.5x and raising hit rate 44% versus the coarse-grained state of the art.sources/sec-arxiv-2605-23640
verifiedhigh · 0.90
cadamcat: A second RX 7900 XT buys 1.1x at decode and 1.9x at prefill
benchmarkcadamcat (dual-radeon-vllm)sources/cadamcat-dual-radeon-a100-vs-two-radeons
verifiedhigh · 0.85
cadamcat: Eight ROCm kernel findings narrow to three on RDNA3
benchmarkcadamcat (dual-radeon-vllm)sources/cadamcat-dual-radeon-rdna3-second-class
verifiedhigh · 0.85
cadamcat: memory-busy counter orders the worth of faster memory, a second card, a slower card
benchmarkcadamcat (dual-radeon-vllm)sources/cadamcat-dual-radeon-mem-busy-five-settings
verifiedmedium · 0.70
Cambricon AIDC MLU370-S4/S8 product page
spec-sheetCambricon Technologiessources/asic-cambricon-mlu370-s4
verifiedhigh · 0.90
Cambricon MLU370 (Siyuan 370) chip overview
spec-sheetCambricon Technologiessources/asic-cambricon-mlu370-chip
verifiedhigh · 0.90
Cambricon MLU370-X8 AIDC accelerator card product page
spec-sheetCambricon Technologies (寒武纪)sources/cn-cambricon-mlu370-x8
verifiedhigh · 0.95
Cambricon MLU370-X8 AIDC accelerator card product page - full specification table (VERBATIM, Chinese)
spec-sheetCambricon Technologies (寒武纪)sources/vb-cambricon-mlu370-x8-product-page-spec-table
verifiedhigh · 0.95
Cambricon MLU370-X8 product page - MLU-Link 200 GB/s and its stated 3.1x PCIe 4.0 ratio (VERBATIM, Chinese)
spec-sheetCambricon Technologies (寒武纪)sources/vb-cambricon-mlu370-x8-mlu-link-200gbs-convention
verifiedhigh · 0.95
Cambricon Siyuan 370 (思元370) chip overview page
spec-sheetCambricon Technologies (寒武纪)sources/cn-cambricon-siyuan370-chip
verifiedhigh · 0.95
canary-1b-flash config.json (HuggingFace)
repoHuggingFace / NVIDIAsources/hf-mm-canary-1b-flash-config
verifiedhigh · 0.95
Candle GitHub repository (Hugging Face Rust ML framework)
repoHugging Facesources/niche-candle-repo
verifiedhigh · 0.85
Carbon Emissions and Large Neural Network Training (arXiv:2104.10350)
blogsources/pap-eff-carbon-nn-training
verifiedmedium · 0.75
Careless Whisper: Speech-to-Text Hallucination Harms (arXiv:2402.08021)
paperarXivsources/pap-mm-careless-whisper
verifiedhigh · 0.90
CDW product page: PNY NVIDIA RTX PRO 6000 96 GB GDDR7
databaseCDWsources/noncuda-cdw-rtxpro6000-pny-96gb
verifiedhigh · 0.85
CDW product pages - published lead-time ranges for GPU and AI server SKUs (observed 2026-10-04)
databaseCDWsources/spl-cdw-published-lead-times-gpu-2026-10
verifiedhigh · 0.90
CDW search results for NVIDIA H100 (catalog scope: PCIe/pro workstation cards, DGX, no H100 SXM)
spec-sheetCDWsources/sup-buy-cdw-h100-catalog
verifiedhigh · 0.85
CDW search results for RTX PRO 6000
databaseCDWsources/noncuda-cdw-rtxpro6000-search
verifiedhigh · 0.85
Cerebras blog 'CS-3: the world's fastest and most scalable AI accelerator' (2024-03-12) - MemoryX external-memory SKUs, and the Weight Streaming architecture that needs them
blogCerebras Systemssources/w8r-cerebras-cs3-blog-memoryx-external-memory
verifiedhigh · 0.85
Cerebras CS-3 / WSE-3 Datasheet - 125 petaFLOPS, FP16, shown as SPARSE
spec-sheetCerebras Systemssources/vb-cerebras-cs3-datasheet-125pf-sparse
verifiedhigh · 0.95
Cerebras CS-3 Datasheet - 44 GB SRAM, 21 PB/s, 214 Pb/s fabric, 1.2 Tb/s I/O, 27 kW, TSMC 5nm
spec-sheetCerebras Systemssources/vb-cerebras-cs3-datasheet-memory-power
verifiedhigh · 0.95
Cerebras CS-3 Wafer-Scale AI Supercomputer
spec-sheetCerebras Systemssources/asic-cerebras-cs3
verifiedhigh · 0.90
Cerebras CS-4 / WSE-3 Turbo
spec-sheetCerebras Systemssources/asic-cerebras-cs4
verifiedhigh · 0.90
Cerebras CS-4 page read in full - WSE-3 Turbo per-wafer figures, three wafers per system, Nexus platform, 2 us wafer-to-wafer latency
spec-sheetCerebras Systemssources/w7z-cerebras-cs4-page-full
verifiedhigh · 0.85
Cerebras GPT-5.6 Sol Ultrafast (750 tok/s)
blogCerebras Systemssources/alt-cerebras-ultrafast
verifiedhigh · 0.85
Cerebras Inference GPT OSS model page (first-party PayGo price and vendor speed)
databaseCerebrassources/svc-src-cerebras-gpt-oss-model-page-2026-10-17
verifiedhigh · 0.90
Cerebras Inference model catalog (shared-inference models, context, vendor speed figures)
databaseCerebrassources/svc-src-cerebras-model-catalog-2026-10-14
verifiedhigh · 0.85
Cerebras Inference pricing page - Developer Tier rate card recovered from the rendered DOM (static HTML extraction misses it)
spec-sheetCerebrassources/pd-cerebras-pricing-dom-rendered
verifiedhigh · 0.90
Cerebras Inference pricing page (Developer and Inference tiers)
spec-sheetCerebrassources/rent-src-cerebras-pricing
verifiedhigh · 0.90
Cerebras SDK Examples README (CSL)
repoCerebras Systemssources/alt-cerebras-sdk-examples
verifiedhigh · 0.90
Cerebras Systems (company and wafer-scale background)
reviewWikipediasources/asic-cerebras-wikipedia
verifiedhigh · 0.90
Cerebras WSE-3 Turbo (WSE-3T) chip page - 250 petaflops, 900,000 cores, 46,225 mm2
spec-sheetCerebras Systemssources/vb-cerebras-wse3t-250pf
verifiedhigh · 0.90
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (arXiv:2201.11903)
blogsources/pap-eff-cot-prompting
verifiedhigh · 0.85
Characterizing Contention-Induced Reliability Collapse in KV-Cache Timing Side Channels for Multi-Tenant LLM Serving
paperThe most important negative result in this area: on vLLM with DeepSeek-R1-Distill-Llama-8B, mean Cohen's d falls from 0.7789 with no synthetic workers to 0.2109 with two workers; AUROC falls from 0.650 (ambient) to 0.531 near 61% overlap. Reproduced on a real two-node two-GPU TP setup (d 3.418 -> 0.511). Two SGLang pilots were statistically inconclusive. Conclusion: measurements on quiet systems overestimate operational exploitability.sources/sec-arxiv-2609-06853
verifiedhigh · 0.90
Characterizing Performance-Energy Trade-offs of Large Language Models in Multi-Request Workflows (arXiv:2604.09611)
paperMd. Monzurul Amin Ifath, Israat Haquesources/pwr2-arxiv-multi-request-energy
verifiedmedium · 0.80
Chlience/SpecFit GitHub repository
repoHongliang Caosources/chlience-specfit-github-repository
verifiedmedium · 0.70
Claude models overview
spec-sheetAnthropicsources/model-fr-anthropic-models-overview
verifiedhigh · 0.90
Claude prompt caching documentation
spec-sheetAnthropicsources/model-fr-anthropic-prompt-caching
verifiedhigh · 0.90
CLIP-as-service README
repoJina AIsources/embed-clip-as-service-github
verifiedmedium · 0.80
CLIP: Learning Transferable Visual Models (arXiv:2103.00020)
paperarXivsources/clip-learning-transferable-visual-models-arxiv-2103-00020
verifiedhigh · 0.90
Clipper: A Low-Latency Online Prediction Serving System (arXiv 1612.03079)
paperarXiv (UC Berkeley)sources/pap-sys-clipper-arxiv
verifiedhigh · 0.90
Clone What You Can't Steal: Black-Box LLM Replication via Logit Leakage and Distillation
paperThe record for why logprobs on a public API are a model-extraction surface: reconstructs the output projection matrix from top-k logits collected in under 10,000 queries via SVD, then distils. A 6-layer student recovers 97.6% of the teacher's hidden-state geometry at +7.31% perplexity; a 4-layer variant gives 17.1% faster inference at 18.1% fewer parameters. The entire attack completes in under 24 GPU-hours.sources/sec-arxiv-2509-00973
verifiedhigh · 0.90
Cloud TPU Multislice Overview
spec-sheetGoogle Cloudsources/w7c-google-tpu-multislice-overview
verifiedhigh · 0.90
Cloud TPU performance guide
spec-sheetGoogle Cloudsources/alt-tpu-perf-guide
verifiedhigh · 0.95
Cloud TPU system architecture
spec-sheetGoogle Cloudsources/alt-tpu-system-arch
verifiedhigh · 0.95
Cloud TPU v3 system architecture
spec-sheetGoogle Cloudsources/asic-tpu-v3-specs
verifiedhigh · 0.90
Cloud TPU v3 system architecture
spec-sheetGoogle Cloudsources/w7c-google-tpu-v3-system-architecture
verifiedhigh · 0.90
Cloud TPU v4 system architecture
spec-sheetGoogle Cloudsources/asic-tpu-v4-specs
verifiedhigh · 0.90
Cloud TPU v5e system architecture
spec-sheetGoogle Cloudsources/asic-tpu-v5e-specs
verifiedhigh · 0.90
Cloud TPU v5p system architecture
spec-sheetGoogle Cloudsources/asic-tpu-v5p-specs
verifiedhigh · 0.90
Cloud TPU v6e (Trillium) system architecture
spec-sheetGoogle Cloudsources/asic-tpu-v6e-specs
verifiedhigh · 0.90
CNBC: U.S. curbs export of more AI chips, including Nvidia H800, to China (2023-10-17)
blogCNBCsources/acc-fill-cnbc-h800-export-ban
verifiedhigh · 0.85
CodeSOTA Embedded-AI register republishing Hailo Model Zoo FPS/LLM-tok/s tables (Apr 2026)
benchmarkCodeSOTAsources/codesota-hailo-model-zoo-register
verifiedlow · 0.50
cognitivecomputations/dolphin-2.9-llama3-8b model repo
repoCognitive Computationssources/hf-eco-dolphin-2-9-llama3-8b
verifiedhigh · 0.95
Cohere Embed Models Documentation
spec-sheetCoheresources/docs-cohere-embed
verifiedhigh · 0.85
Cohere pricing page (Command model per-1M-token rates)
spec-sheetCoheresources/rent-src-cohere-pricing
verifiedhigh · 0.90
Cohere Rerank Documentation
spec-sheetCoheresources/docs-cohere-rerank
verifiedhigh · 0.85
Cohere/Cohere-embed-english-v3.0 config.json
repoHugging Facesources/hf-embed-cohere-embed-english-v3
verifiedhigh · 0.88
Cohere/Cohere-embed-multilingual-v3.0 config.json
repoHugging Facesources/hf-embed-cohere-embed-multilingual-v3
verifiedhigh · 0.88
ColBERT GitHub repository
repoStanford Future Data Systemssources/niche-colbert-repo
verifiedhigh · 0.90
ColBERT paper (Khattab & Zaharia, SIGIR'20)
paperarXivsources/embed-colbert-paper
verifiedhigh · 0.95
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT (arXiv:2004.12832)
paperarXivsources/pap-mm-colbert
verifiedhigh · 0.90
ColBERTv2 paper (Santhanam et al.)
paperarXivsources/embed-colbertv2-paper
verifiedhigh · 0.95
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction (arXiv:2112.01488)
paperarXivsources/pap-mm-colbertv2
verifiedhigh · 0.90
Colocation pricing by power density tier - Air-cooled vs liquid-cooled deployment costs
databaseVantage / derived from existing repo recordssources/ppl-dep-colocation-tiers
verifiedhigh · 0.85
Command A W4A4 on vLLM: a performance breakdown on 2xH100 (capp-vllm-bench)
benchmarkSamMausbergsources/bench-capp-vllm-longctx-ttft
verifiedhigh · 0.90
compressed-tensors GitHub README
repovLLM project / Red Hat AIsources/qlab2-compressed-tensors-readme
verifiedhigh · 0.90
CompuCycle corporate IT asset disposal and remarketing services
databaseCompuCyclesources/sup-used-compucycle
verifiedlow · 0.60
Compute Express Link: About CXL
spec-sheetCXL Consortiumsources/link-cxl-about
verifiedhigh · 0.90
Computingforgeeks RTX Pro 4000 vs Pro 5000 Blackwell local AI benchmarks
reviewComputingforgeekssources/computingforgeeks-rtx-pro-4000-vs-5000-blackwell
verifiedlow · 0.60
ComputingForGeeks: Run Qwen3.8-27B locally, VRAM and 262K context measured on an RTX 4090
blogComputingForGeekssources/computingforgeeks-qwen38-27b-4090-262k
verifiedmedium · 0.72
Confidential Computing on NVIDIA Hopper GPUs: A Performance Benchmark Study
paperTEE overhead for LLM inference is minimal on-GPU; the penalty comes from CPU-GPU transfer over PCIe. For the majority of typical LLM queries overhead stays below 7%, and larger models and longer sequences approach zero overhead.sources/sec-arxiv-2409-03992
verifiedhigh · 0.90
config.json, deepseek-ai/DeepSeek-V2
repoHugging Facesources/arch-hf-config-deepseek-v2
verifiedhigh · 0.92
config.json, deepseek-ai/DeepSeek-V3
repoHugging Facesources/arch-hf-config-deepseek-v3
verifiedhigh · 0.92
config.json, deepseek-ai/DeepSeek-V3.2-Exp
repoHugging Facesources/arch-hf-config-deepseek-v32
verifiedhigh · 0.92
config.json, Dream-org/Dream-v0-Base-7B
repoHugging Facesources/arch-hf-config-dream
verifiedhigh · 0.92
config.json, GSAI-ML/LLaDA-8B-Base
repoHugging Facesources/arch-hf-config-llada
verifiedhigh · 0.92
config.json, ibm-granite/granite-4.0-h-tiny
repoHugging Facesources/arch-hf-config-granite4
verifiedhigh · 0.92
config.json, moonshotai/Kimi-Linear-48B-A3B-Instruct
repoHugging Facesources/arch-hf-config-kimi-linear
verifiedhigh · 0.92
config.json, nvidia/Nemotron-H-8B-Base-8K
repoHugging Facesources/arch-hf-config-nemotron-h
verifiedhigh · 0.92
config.json, openai/gpt-oss-20b
repoHugging Facesources/arch-hf-config-gpt-oss
verifiedhigh · 0.92
config.json, Qwen/Qwen3-Next-80B-A3B-Instruct
repoHugging Facesources/arch-hf-config-qwen3-next
verifiedhigh · 0.92
config.json, unsloth/Llama-4-Scout-17B-16E-Instruct (Llama-4 community mirror)
repoHugging Facesources/arch-hf-config-llama4-scout
verifiedhigh · 0.92
Conformer: Convolution-augmented Transformer for Speech Recognition (arXiv:2005.08100)
paperarXivsources/pap-mm-conformer
verifiedhigh · 0.90
Core ML Tools (coremltools) README
repoApplesources/apple-coremltools-readme
verifiedhigh · 0.90
CoreWeave Cloud pricing
databaseCoreWeavesources/sup-cloud-coreweave-pricing
verifiedhigh · 0.96
CreateAltDelete/intel-arc-llama: llama.cpp on Intel Arc Battlemage
repoCreateAltDeletesources/createaltdelete-intel-arc-llama-repo
verifiedmedium · 0.80
Crossref bibliographic query for 'Efficiently Modeling Long Sequences with Structured State Spaces' - returns NO JMLR entry (negative result)
databaseCrossrefsources/w6p-crossref-s4-no-jmlr-deposit
verifiedhigh · 0.90
Crossref deposit DOI 10.1145/3669940.3707267 - MoE-Lightning (ASPLOS '25 Vol. 1, pp. 715-730)
paperAssociation for Computing Machinery (ACM)sources/w6p-crossref-asplos25-moe-lightning
verifiedhigh · 0.90
Crossref deposit DOI 10.1145/3718958.3750506 - MegaScale-Infer, per-author affiliations
paperAssociation for Computing Machinery (ACM)sources/w6p-crossref-sigcomm25-megascale-infer-affiliations
verifiedhigh · 0.90
Crossref record for DOI 10.1145/3786335.3813124 - XGrammar-2
databaseCrossrefsources/sco-crossref-cais26-xgrammar2
verifiedhigh · 0.95
Crossref records for ColBERT (SIGIR'20), SPLADE (SIGIR'21), PLAID (CIKM'22), CacheGen (SIGCOMM'24)
databaseCrossrefsources/w3p-crossref-sigir-cikm-sigcomm-venues
verifiedhigh · 0.95
CUDA Graphs: Official Documentation
whitepaperNVIDIAsources/src5-cuda-graphs-docs
verifiedhigh · 0.90
CUDA Programming Guide (v13.4.2)
whitepaperNVIDIAsources/src5-cuda-programming-guide
verifiedhigh · 0.98
CUTLASS 3.x and CuTe documentation
repoNVIDIAsources/cutlass-3-x-and-cute-documentation
verifiedhigh · 0.85
CUTLASS: CUDA Templates and Python DSLs for High-Performance Linear Algebra
repoNVIDIAsources/src5-cutlass-github
verifiedhigh · 0.95
CXL: Compute Express Link
spec-sheetCXL Consortiumsources/src5-cxl-docs
verifiedhigh · 0.90
d-Matrix Corsair Full Production Announcement
blogsources/d-matrix-corsair-full-production-announcement
verifiedhigh · 0.85
d-Matrix Corsair Product Brief
blogsources/d-matrix-corsair-product-brief
verifiedhigh · 0.85
d-Matrix Corsair White Paper
blogsources/d-matrix-corsair-white-paper
verifiedhigh · 0.85
d-Matrix Corsair white paper read in full - per-card and per-server Capacity Memory figures, MXINT16 row, DIMC architecture
whitepaperd-Matrixsources/w7z-dmatrix-whitepaper-full
verifiedhigh · 0.85
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language (arXiv:2202.03555)
paperarXivsources/pap-mm-data2vec
verifiedhigh · 0.90
Database Mart Ollama 0.13.5 benchmark, RTX PRO 6000 Blackwell
benchmarkDatabase Martsources/databasemart-ollama-rtx-pro-6000-blackwell
verifiedlow · 0.60
Database Mart Ollama 0.5.11 benchmark, RTX A4000 16GB
benchmarkDatabase Martsources/databasemart-ollama-rtx-a4000
verifiedlow · 0.60
Database Mart Ollama benchmark, RTX PRO 2000 Blackwell (16 GB)
benchmarkDatabase Martsources/databasemart-ollama-rtx-pro-2000-blackwell
verifiedlow · 0.60
Database Mart RTX Pro 5000 Blackwell Ollama inference benchmark
benchmarkDatabase Martsources/databasemart-ollama-rtx-pro-5000-blackwell
verifiedlow · 0.60
Database Mart vLLM benchmark, A100 40GB PCIe, 50 concurrent
benchmarkDatabase Martsources/databasemart-vllm-a100-40gb
verifiedlow · 0.60
Database Mart vLLM benchmark, NVIDIA A40, 50 and 100 concurrent
benchmarkDatabase Martsources/databasemart-vllm-a40
verifiedlow · 0.60
Database Mart vLLM benchmark, RTX A6000, 50 concurrent
benchmarkDatabase Martsources/databasemart-vllm-rtx-a6000
verifiedlow · 0.60
Database Mart vLLM benchmark, RTX PRO 2000 Blackwell (16 GB)
benchmarkDatabase Martsources/databasemart-vllm-rtx-pro-2000-blackwell
verifiedlow · 0.60
Database Mart vLLM benchmark, RTX PRO 5000 Blackwell (48 GB)
benchmarkDatabase Martsources/databasemart-vllm-rtx-pro-5000-blackwell
verifiedlow · 0.60
Decomposing Predictive Kubernetes Autoscaling for Large Language Model Serving Under Long Startup Delays (arXiv 2609.20874)
paperarXiv (Huazhong University of Science and Technology)sources/pap-sys-k8s-autoscaling-arxiv
verifiedhigh · 0.88
DeepGEMM: DeepSeek's FP8 GEMM implementation
repoDeepSeeksources/src5-deepgemm-github
verifiedhigh · 0.90
DeepInfra Llama-3.3-70B-Instruct-Turbo model page (list price and Flex tier)
databaseDeepInfrasources/svc-src-deepinfra-llama33-turbo-page-2026-10-17
verifiedhigh · 0.90
DeepInfra OpenAI-compatible models list (live per-model pricing and context)
databaseDeepInfrasources/svc-src-deepinfra-models-api-2026-10-17
verifiedhigh · 0.95
DeepInfra pricing page (per-model per-1M-token table)
databaseDeepInfrasources/svc-src-deepinfra-pricing-page-2026-10-14
verifiedhigh · 0.90
DeepInfra pricing page (per-model per-1M-token table), re-read 2026-10-17
databaseDeepInfrasources/svc-src-deepinfra-pricing-page-2026-10-17
verifiedhigh · 0.90
DeepSeek API Models & Pricing (off-peak/peak, cache hit/miss)
spec-sheetDeepSeeksources/rent-src-deepseek-api-pricing
verifiedhigh · 0.90
deepseek-ai/DeepSeek-R1-Distill-Llama-70B model repo
repoDeepSeek-AI / Hugging Facesources/hf-eco-deepseek-r1-distill-llama-70b
verifiedhigh · 0.95
deepseek-ai/DeepSeek-R1-Distill-Llama-8B model repo
repoDeepSeek-AI / Hugging Facesources/hf-eco-deepseek-r1-distill-llama-8b
verifiedhigh · 0.95
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B model repo
repoDeepSeek-AI / Hugging Facesources/hf-eco-deepseek-r1-distill-qwen-1p5b
verifiedhigh · 0.95
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B model repo
repoDeepSeek-AI / Hugging Facesources/hf-eco-deepseek-r1-distill-qwen-7b
verifiedhigh · 0.95
deepseek-ai/DeepSeek-V3.2 · Hugging Face (benchmark chart assets/benchmark.png)
reposources/hf-deepseek-v3-2
verifiedmedium · 0.80
deepseek-ai/DeepSeek-V4-Flash (official card, 'Comparison across Modes' instruct table)
reposources/deepseek-v4-flash-hf-card
verifiedmedium · 0.80
deepseek-ai/DeepSeek-V4-Pro-0813 config.json
repoDeepSeeksources/hf-deepseek-v4-pro-0813-config
verifiedhigh · 0.90
deepseek-ai/DeepSeek-V4-Pro-0813 model card
repoDeepSeeksources/hf-deepseek-v4-pro-0813-card
verifiedhigh · 0.86
deepseek-ai/DeepSeek-V4.1-Flash-1017 model card and config.json
repoDeepSeeksources/hf-deepseek-v4-1-flash-1017
verifiedhigh · 0.88
DeepSeek-R1 and R1-Distill model card (huggingface.co/deepseek-ai/DeepSeek-R1)
release-notesDeepSeeksources/model-cn-r1-distill-card
verifiedhigh · 0.90
DeepSeek-R1-Distill-Llama-70B config.json
repoHugging Facesources/mbl-cfg-r1-distill-llama-70b
verifiedhigh · 0.90
DeepSeek-R1-Distill-Llama-8B config.json
repoHugging Facesources/mbl-cfg-r1-distill-llama-8b
verifiedhigh · 0.90
DeepSeek-R1-Distill-Qwen-1.5B config.json
repoHugging Facesources/mbl-cfg-r1-distill-qwen-1p5b
verifiedhigh · 0.90
DeepSeek-R1-Distill-Qwen-32B config.json
repoHugging Facesources/mbl-cfg-r1-distill-qwen-32b
verifiedhigh · 0.90
DeepSeek-R1-Distill-Qwen-7B config.json
repoHugging Facesources/mbl-cfg-r1-distill-qwen-7b
verifiedhigh · 0.90
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
paperDeepSeek-AIsources/hf-eco-deepseek-r1-paper
verifiedhigh · 0.95
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
paperDeepSeek-AI (arXiv)sources/arch-deepseek-v2-mla
verifiedhigh · 0.92
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
paperarXivsources/attn-deepseek-v2-mla-paper
verifiedhigh · 0.90
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
paperarXivsources/pap-arch-2405-04434
verifiedhigh · 0.90
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
paperarXivsources/pap-attn-deepseek-v2-mla
verifiedhigh · 0.90
DeepSeek-V3 config.json (huggingface.co/deepseek-ai/DeepSeek-V3)
spec-sheetDeepSeeksources/model-cn-deepseek-v3-config
verifiedhigh · 0.95
DeepSeek-V3 Technical Report
paperDeepSeek-AI (arXiv)sources/arch-deepseek-v3
verifiedhigh · 0.92
DeepSeek-V3 Technical Report
paperarXivsources/attn-deepseek-v3-paper
verifiedhigh · 0.90
DeepSeek-V3 Technical Report
paperarXivsources/pap-arch-2412-19437
verifiedhigh · 0.90
DeepSeek-V3 Technical Report
paperarXivsources/pap-attn-deepseek-v3-report
verifiedhigh · 0.90
DeepSeek-V3 Technical Report (arXiv 2412.19437)
paperarXivsources/sched-deepseek-v3-report
verifiedhigh · 0.90
DeepSeek-V3 Technical Report (arXiv:2412.19437)
whitepaperarXiv / DeepSeek-AIsources/model-cn-deepseek-v3-report
verifiedhigh · 0.95
DeepSeek-V3.2 Release (official DeepSeek API docs / release page, benchmark table)
blogsources/deepseek-v32-release
verifiedmedium · 0.80
DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
paperDeepSeek-AI (arXiv)sources/arch-deepseek-v32-dsa
verifiedhigh · 0.92
DeepSeek-V4 series model card (V4-Pro and V4-Flash)
release-notesDeepSeeksources/model-cn-deepseek-v4-card
verifiedhigh · 0.85
DeepSeek-V4-Flash config.json
repoHugging Facesources/mbl-cfg-deepseek-v4-flash
verifiedhigh · 0.90
DeepSeek-V4-Pro config.json
repoHugging Facesources/mbl-cfg-deepseek-v4-pro
verifiedhigh · 0.90
DeepSeek-V4-Pro model card (Instruct Model / DeepSeek-V4-Pro-Max vs Frontier Models)
reposources/hf-deepseek-v4-pro
verifiedmedium · 0.80
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence (Table 6, section 5.3)
papersources/arxiv-2606-19348
verifiedmedium · 0.80
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
paperDeepSeek-AI (arXiv)sources/arch-deepseekmoe
verifiedhigh · 0.92
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
paperarXivsources/pap-arch-2401-06066
verifiedhigh · 0.90
DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale (arXiv 2207.00032)
paperarXiv (Microsoft)sources/pap-sys-deepspeed-inference-arxiv
verifiedhigh · 0.90
DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference (arXiv 2401.08671)
paperarXiv (Microsoft)sources/pap-sys-fastgen-arxiv
verifiedhigh · 0.90
DeepSpeed-Inference Crossref record (SC22)
databaseIEEE SC22 (via Crossref)sources/pap-sys-deepspeed-inference-crossref
verifiedhigh · 0.90
DeepSpeed-MII GitHub repository (org moved from microsoft/)
repoDeepSpeed (formerly Microsoft)sources/niche-deepspeed-mii-repo
verifiedhigh · 0.85
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
paperarXiv (DeepSpeed team / Microsoft)sources/flop-deepspeed-moe
verifiedhigh · 0.90
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
paperarXivsources/pap-arch-2201-05596
verifiedhigh · 0.90
Defeating Nondeterminism in LLM Inference (Horace He et al., Thinking Machines Lab, 2025-09-10)
blogThinking Machines Labsources/nrg2-thinkingmachines-defeating-nondeterminism
verifiedhigh · 0.88
Defeating Prompt Injections by Design (CaMeL)
paperDebenedetti et al., Google DeepMind. Extracts control flow and data flow from the TRUSTED query so retrieved data can never influence program flow, and enforces security policy at tool calls via capabilities. 77% of AgentDojo tasks solved with provable security vs 84% undefended - the utility cost is measured, not asserted.sources/sec-arxiv-2503-18813
verifiedhigh · 0.90
Dense Passage Retrieval for Open-Domain Question Answering (arXiv:2004.04906)
paperarXivsources/pap-mm-dpr
verifiedhigh · 0.90
Deploying DeepSeek on GB200 NVL72 with PD and Large Scale EP (Part I), SGLang
blogSGLang project (LMSYS)sources/bench-nv-sglang-gb200-deepseek-pd-blog
verifiedhigh · 0.85
Deploying DeepSeek on GB300 NVL72: Big Wins in Long-Context Inference (LMSYS Blog)
blogLMSYS Org / NVIDIAsources/bench-lmsys-gb300-longctx-ttft
verifiedhigh · 0.90
Deploying DeepSeek with PD Disaggregation and Large-Scale Expert Parallelism on 96 H100 GPUs, SGLang
blogSGLang project (LMSYS)sources/bench-nv-sglang-h100-deepseek-ep-blog
verifiedhigh · 0.85
Design Patterns for Securing LLM Agents against Prompt Injections
paperSystematic analysis of agent design patterns with provable injection resistance, with explicit utility/security trade-offs rather than a single defence claim.sources/sec-arxiv-2506-08837
verifiedhigh · 0.90
Detecting Pretraining Data from Large Language Models (arXiv 2310.16789)
paperarXiv (University of Washington / Meta AI)sources/meth-detecting-pretraining-data-arxiv
verifiedhigh · 0.85
Dickmann et al. — Evaluating AMD Instinct MI300A APU: Performance Insights on LLM Training via Knowledge Distillation (CUG 2025)
paperCray User Group 2025 proceedings (Seedbox / HPE / HLRS / AMD)sources/cug2025-mi300a-kd-vllm-inference
verifiedmedium · 0.75
Differential Transformer
paperarXivsources/pap-attn-diff-transformer
verifiedhigh · 0.95
Diffusion-LM Improves Controllable Text Generation
paperLi et al. (arXiv)sources/arch-diffusion-lm
verifiedhigh · 0.92
Diffusion-LM Improves Controllable Text Generation
paperarXivsources/pap-arch-2205-14217
verifiedhigh · 0.90
DINOv2: Learning Robust Visual Features (arXiv:2304.07193)
paperarXivsources/dinov2-learning-robust-visual-features-arxiv-2304-07193
verifiedhigh · 0.90
DINOv2: Learning Robust Visual Features without Supervision (arXiv:2304.07193)
paperarXivsources/pap-mm-dinov2
verifiedhigh · 0.90
DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training
paperarXivsources/pap-attn-distflashattn
verifiedhigh · 0.85
DistServe (arXiv 2401.09670)
paperarXiv (Peking University / UC San Diego / StepFun)sources/pap-sys-distserve-arxiv
verifiedhigh · 0.90
DistServe GitHub repository (LLMServe/DistServe)
repoLLMServe (Peking University)sources/pd-distserve-repo
verifiedhigh · 0.85
DistServe OSDI '24 proceedings page (USENIX)
paperUSENIX Associationsources/pap-sys-distserve-usenix
verifiedhigh · 0.90
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving (OSDI 2024)
paperarXivsources/sched-distserve-osdi24
verifiedhigh · 0.92
DistServe: Disaggregating Prefill and Decoding for Goodput-optimized LLM Serving (OSDI 2024)
paperarXiv (Zhong, Liu, Chen, Hu, Zhu, Liu, Jin, Zhang; Peking Univ. / Tsinghua)sources/pd-distserve-osdi24-paper
verifiedhigh · 0.85
Dream 7B: Diffusion Large Language Models
paperYe et al. (arXiv)sources/arch-dream-7b
verifiedhigh · 0.92
Dream 7B: Diffusion Large Language Models
paperarXivsources/pap-arch-2508-15487
verifiedhigh · 0.90
dropbox/hqq GitHub README
repoDropbox (Mobius team)sources/qlab2-hqq-readme
verifiedhigh · 0.90
dudeperf3ct blog - Where vLLM cold-start time goes on GKE (phase-by-phase measurement)
blogdudeperf3ct (independent practitioner)sources/dep-dudeperf3ct-vllm-cold-start-gke
verifiedhigh · 0.88
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
paperarXivsources/pap-attn-duoattention
verifiedhigh · 0.85
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads (Yao et al., MIT Han Lab)
paperarXivsources/qlab-duoattention-paper
verifiedhigh · 0.88
DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification (arXiv:2106.02034)
paperarXivsources/pap-mm-dynamicvit
verifiedhigh · 0.90
Dynamo components/src/dynamo/common/backend/disagg.py
repoNVIDIAsources/pd-dynamo-disagg-py
verifiedhigh · 0.85
Dynamo components/src/dynamo/common/backend/metrics.py - bridging vendor engine registries into one /metrics
repoNVIDIAsources/w5e-dynamo-vendor-registry-bridge
verifiedhigh · 0.93
Dynamo issue #12463: vLLM disaggregated serving over InfiniBand returns garbage tokens; GPUDirect RDMA failure on PIX-adjacent passthrough NICs
forumai-dynamo/dynamosources/pd-gh-dynamo-12463-rdma-failure-silent-garbage
verifiedhigh · 0.85
Dynamo lib/backend-common/src/telemetry.rs - dynamic-name OTel spans under the engine.generate parent
repoNVIDIAsources/w5e-dynamo-backend-common-telemetry
verifiedhigh · 0.92
Dynamo lib/bindings/python/src/dynamo/prometheus_names.py - the generated metric-name vocabulary
repoNVIDIAsources/w5e-dynamo-prometheus-names
verifiedhigh · 0.93
Dynamo lib/llm/src/http/service/metrics.rs - frontend TTFT/ITL/request histograms and their env-configurable buckets
repoNVIDIAsources/w5e-dynamo-http-service-metrics
verifiedhigh · 0.94
Dynamo#12463: UCX_NET_DEVICES unset causes garbage tokens in P/D serving
forumNVIDIA Dynamosources/src5-gotcha-dynamo-12463-ucx-net-devices
verifiedhigh · 0.90
Eagle 7B announcement: Soaring past Transformers (RWKV-v5)
blogRWKV (Eugene Cheah)sources/rwkv-eagle-7b-announcement
verifiedmedium · 0.80
EAGLE GitHub repository
repoSafeAILabsources/niche-eagle-repo
verifiedhigh · 0.85
EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees
paperarXiv (Li, Wei, Zhang, Zhang; Peking University / Microsoft Research / University of Waterloo)sources/sd-eagle2-paper
verifiedhigh · 0.90
EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees (arXiv:2406.16858)
blogsources/pap-eff-eagle-2
verifiedhigh · 0.85
EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test
paperarXiv (Li, Wei, Zhang, Zhang; Peking University / Microsoft Research / University of Waterloo)sources/sd-eagle3-paper
verifiedhigh · 0.90
EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test (arXiv:2503.01840)
blogsources/pap-eff-eagle-3
verifiedhigh · 0.85
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
paperarXivsources/niche-eagle-paper
verifiedhigh · 0.90
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
paperarXiv (Li, Wei, Zhang, Zhang; Peking University / Microsoft Research / University of Waterloo)sources/sd-eagle1-paper
verifiedhigh · 0.90
eBay Graphics/Video Cards category, used condition, datacenter accelerators (A100/H100 search)
databaseeBaysources/sup-used-ebay-datacenter-gpu
verifiedmedium · 0.80
eBay Graphics/Video Cards, used Intel Arc B580 asking prices
databaseeBaysources/sup-used-ebay-b580
verifiedmedium · 0.80
eBay Graphics/Video Cards, used RTX 4090 asking prices
databaseeBaysources/sup-used-ebay-4090
verifiedmedium · 0.80
eBay listing: 32x NVIDIA A100 40GB AI inferencing rack (Core 4 Solutions IT Hardware)
databaseeBay / Core 4 Solutions IT Hardwaresources/sup-used-ebay-a100-rack
verifiedhigh · 0.85
eBay listing: NVIDIA A100 40GB SXM4 module, pre-owned (item 158338471596)
databaseeBay / Core 4 Solutions IT Hardwaresources/sup-used-ebay-a100-40-sxm
verifiedhigh · 0.85
eBay listing: NVIDIA H100 SXM5 80GB, pre-owned, tested (item 158372715590)
databaseeBay / frenchy2k1sources/sup-used-ebay-h100-sxm
verifiedmedium · 0.80
ECB euro reference rate via Frankfurter, EURUSD on 2026-10-16
databaseFrankfurter (European Central Bank reference rates)sources/svc-src-frankfurter-eurusd-2026-10-16
verifiedhigh · 0.95
ECCN 3A090 - advanced-computing integrated circuits (Commerce Control List thresholds)
databaseECCN Finder (editorial lookup of 15 CFR part 774 supplement no. 1)sources/spl-eccn-3a090-ccl
verifiedmedium · 0.80
eCFR 45 CFR 164.312 - Technical safeguards (HIPAA Security Rule)
databaseUS Government Publishing Office / HHSsources/sec-ecfr-164-312
verifiedhigh · 0.95
eCFR 45 CFR 164.316 - Policies and procedures and documentation requirements (HIPAA)
databaseUS Government Publishing Office / HHSsources/sec-ecfr-164-316
verifiedhigh · 0.95
Efficient Guided Generation for Large Language Models
paperarXiv (Willard, Louf; Outlines / Normal Computing)sources/flop2-guided-generation
verifiedhigh · 0.90
Efficient Memory Management for Large Language Model Serving with PagedAttention
paperarXivsources/attn-pagedattention-paper
verifiedhigh · 0.90
Efficient Memory Management for Large Language Model Serving with PagedAttention
paperarXiv (Kwon et al.; vLLM / UC Berkeley)sources/flop-pagedattention-vllm
verifiedhigh · 0.90
Efficient Memory Management for Large Language Model Serving with PagedAttention
paperarXivsources/pap-attn-pagedattention-vllm
verifiedhigh · 0.95
Efficient Memory Management for Large Language Model Serving with PagedAttention (SOSP 2023)
paperarXivsources/sched-vllm-pagedattention-sosp23
verifiedhigh · 0.92
Efficient Streaming Language Models with Attention Sinks
paperarXivsources/pap-attn-streamingllm
verifiedhigh · 0.95
Efficiently Modeling Long Sequences with Structured State Spaces
paperarXivsources/pap-attn-s4
verifiedhigh · 0.95
Efficiently Modeling Long Sequences with Structured State Spaces (S4)
paperarXivsources/pap-arch-2111-00396
verifiedhigh · 0.95
EfficientMoE/MoE-Infinity GitHub repository
repoUniversity of Edinburgh / EfficientMoEsources/src-moe-infinity-github
verifiedmedium · 0.80
Embedded LLM - Benchmarking LLM Inference on Intel Arc Pro B60 (4x B60 TP=4, vLLM vs LLM-Scaler)
benchmarkEmbedded LLM (Sparkle-provided 4xB60 workstation)sources/embeddedllm-arc-pro-b60-vllm-llmscaler-benchmark
verifiedmedium · 0.70
Embedded LLM - High throughput LLM inference with vLLM and AMD (MI210 vs A100 vs L40)
benchmarkEmbedded LLMsources/embeddedllm-vllm-rocm-mi210-vs-a100-l40-throughput
verifiedmedium · 0.70
Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition (arXiv:2010.10759)
paperarXivsources/pap-mm-emformer
verifiedhigh · 0.90
Empirically-calibrated H100 node power models for accurate AI training energy estimation (Newkirk et al., Environmental Research: Energy)
paperIOP Publishing / OSTIsources/nrg2-osti-h100-node-power-models
verifiedhigh · 0.90
Enhancing vLLM Inference on AMD GPUs (ROCm Blogs)
benchmarkAMDsources/bench-amd-vllm-rocm-optimize-fp8-gemm
verifiedmedium · 0.80
Envoy AI Gateway (Agent Router) - AIGatewayRoute + InferencePool guide
whitepaperEnvoy AI Gateway project (now Agentic AI Foundation)sources/dep-envoy-ai-gateway-inferencepool-guide
verifiedhigh · 0.90
Envoy AI Gateway internal/metrics/genai.go - OTel GenAI semconv metrics with explicit bucket boundaries
repoenvoyproxysources/w5e-envoy-ai-gateway-metrics-genai
verifiedhigh · 0.93
Envoy AI Gateway internal/tracing/ - per-endpoint OTel tracers with W3C autopropagation
repoenvoyproxysources/w5e-envoy-ai-gateway-tracing
verifiedhigh · 0.92
EquipNet auctions and IT asset disposition services
databaseEquipNetsources/sup-used-equipnet-auctions
verifiedlow · 0.60
Espressif ESP32-P4 SoC Product Page
spec-sheetEspressif Systemssources/espressif-esp32-p4-product-page
verifiedhigh · 0.85
Evaluating Llama 3.3 70B Inference on NVIDIA H100 and A100 GPUs (genai-perf)
blogSilex Data Solutionssources/bench-nv-silexdata-h100-a100-blog
verifiedmedium · 0.70
ExecuTorch GitHub Repository
repoPyTorch / Metasources/local-executorch-github
verifiedhigh · 0.85
ExLlamaV2 GitHub repo (archived)
repoturboderp-orgsources/cpuedge-exllamav2-github
verifiedhigh · 1.00
ExLlamaV2 Q4/FP8 KV cache evaluation (qcache_eval.md, Hadamard Q4)
repoturboderp-org / ExLlamaV2sources/exllamav2-qcache-eval-q4-fp8
verifiedmedium · 0.80
ExLlamaV2 README (EXL2 format description)
repoturboderpsources/quant-exl2-readme
verifiedhigh · 0.90
ExLlamaV2: Fast inference library for local LLMs (GitHub: turboderp-org/exllamav2)
repoturboderp-orgsources/qhw-src-exllamav2-repo
verifiedhigh · 0.95
ExLlamaV3 doc/convert.md (EXL3 trellis group size and codebook options)
repoturboderpsources/qzgw-exl3-convert
verifiedhigh · 0.85
ExLlamaV3 GitHub repo
repoturboderp-orgsources/cpuedge-exllamav3-github
verifiedhigh · 1.00
ExLlamaV3 README (EXL3 quantization, based on QTIP)
repoturboderpsources/qzgw-exl3-readme
verifiedhigh · 0.85
ExLlamaV3 README feature list and JIT build note (read 2026-10-04)
blogturboderpsources/ev-exllamav3-readme-feature-axes
verifiedhigh · 0.90
exo GitHub repository
repoexo labssources/niche-exo-repo
verifiedhigh · 0.85
Export control driven GPU price distortion - H20/H200/H800 as worked example
blogReuters / derived from multiple repo recordssources/ppl-dep-export-control-price-distortion
verifiedhigh · 0.85
Extending Context Window of Large Language Models via Positional Interpolation
paperarXivsources/pap-attn-position-interpolation
verifiedhigh · 0.90
Extreme Compression of Large Language Models via Additive Quantization / AQLM (Egiazarian et al.)
paperarXivsources/qlab-aqlm-paper
verifiedhigh · 0.88
Falcon Mamba: The First Competitive Attention-free 7B Language Model
paperTII (arXiv)sources/arch-falcon-mamba
verifiedhigh · 0.92
Falcon-H1 release blogpost
blogTII Falcon Teamsources/hf-eco-falcon-h1-blog
verifiedhigh · 0.95
falcon-h1-7B-base config.json
repoHugging Facesources/mbl-cfg-falcon-h1-7b-base
verifiedhigh · 0.90
Fast Distributed Inference Serving for Large Language Models (arXiv 2305.05920)
paperarXiv (Peking University)sources/pap-sys-fastserve-arxiv
verifiedhigh · 0.90
Fast Inference from Transformers via Speculative Decoding
paperarXiv (Leviathan, Kalman, Matias; Google Research)sources/flop-speculative-decoding
verifiedhigh · 0.90
Fast Matrix Multiplications for Lookup Table-Quantized LLMs / FLUTE (Elhoushi et al., Microsoft)
paperarXivsources/qlab-flute-paper
verifiedhigh · 0.88
Fast Transformer Decoding: One Write-Head is All You Need
paperarXivsources/pap-attn-multi-query-attention
verifiedhigh · 0.90
FastChat GitHub repository (lm-sys)
repoLMSYSsources/niche-fastchat-repo
verifiedhigh · 0.85
FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization (arXiv:2010.11148)
paperarXivsources/pap-mm-fastemit
verifiedhigh · 0.90
faster-whisper README (GitHub)
repoGitHub / SYSTRANsources/aud-src-faster-whisper-readme
verifiedhigh · 0.95
Federal Register 88 FR 73458 - Oct 2023 advanced computing export controls (Country Group D:5 / Macau, RS controls)
release-notesUS Bureau of Industry and Security / Federal Registersources/sup-buy-bis-2023-advanced-computing-controls
verifiedhigh · 0.85
FINAL-Bench/Darwin-180B-RSI config.json
repoVIDRAFT (FINAL-Bench)sources/hf-darwin-180b-rsi-config
verifiedhigh · 0.85
FINAL-Bench/Darwin-180B-RSI model card
repoVIDRAFT (FINAL-Bench)sources/hf-darwin-180b-rsi-card
verifiedmedium · 0.70
Fireworks AI pricing - On-Demand deployments
databaseFireworks AIsources/sup-cloud-fireworks-pricing
verifiedhigh · 0.96
Fireworks AI pricing page (serverless per-1M-token table + per-GPU-hour serverless GPU table)
spec-sheetFireworks AIsources/rent-src-fireworks-pricing
verifiedhigh · 0.90
Fireworks AI serverless pricing doc (per-1M-token Standard/Priority/Fast list prices)
databaseFireworks AIsources/svc-src-fireworks-serverless-pricing-2026-10-14
verifiedhigh · 0.90
Fireworks AI serverless pricing doc, re-read 2026-10-17
databaseFireworks AIsources/svc-src-fireworks-serverless-pricing-2026-10-17
verifiedhigh · 0.90
FlagEmbedding GitHub repository (BAAI BGE retrieval toolkit)
repoFlagOpen / BAAIsources/niche-flagembedding-repo
verifiedhigh · 0.85
Flamingo: a Visual Language Model (arXiv:2204.14198)
paperarXivsources/flamingo-a-visual-language-model-arxiv-2204-14198
verifiedhigh · 0.85
Flamingo: a Visual Language Model for Few-Shot Learning (arXiv:2204.14198)
paperarXivsources/pap-mm-flamingo
verifiedhigh · 0.90
Flash-Decoding for long-context inference
blogStanford CRFM / Tri Daosources/flop-flashdecoding
verifiedhigh · 0.90
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
paperarXivsources/attn-flashattention-2-paper
verifiedhigh · 0.90
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
paperarXiv (Tri Dao)sources/flop-flashattention-2
verifiedhigh · 0.90
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
paperarXivsources/pap-attn-flashattention-2
verifiedhigh · 0.90
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
paperarXivsources/attn-flashattention-3-paper
verifiedhigh · 0.90
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
paperarXiv (Shah, Bikshandi, Zhang, Thakkar, Ramani, Dao)sources/flop2-flashattention-3
verifiedhigh · 0.90
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
paperarXivsources/pap-attn-flashattention-3
verifiedhigh · 0.90
FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling
paperarXivsources/pap-attn-flashattention-4
verifiedhigh · 0.90
FlashAttention-4: Algorithm and Kernel Pipelining for Efficient Attention on Blackwell GPUs
paperarXivsources/attn-flashattention-4-paper
verifiedhigh · 0.90
FlashAttention: Fast and memory-efficient exact attention
repoDao-AILab (Tri Dao)sources/src5-flashattention-github
verifiedhigh · 0.95
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
paperarXivsources/attn-flashattention-paper
verifiedhigh · 0.90
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
paperarXiv (Dao, Fu, Wolf, Rudenstein, Smith; NeurIPS 2022)sources/flop-flashattention
verifiedhigh · 0.90
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
paperarXivsources/pap-attn-flashattention
verifiedhigh · 0.95
FlashDecoding: Splitting long sequences for parallel decoding
paperStanfordsources/src5-flashdecoding-paper
verifiedhigh · 0.90
FlashDecoding++: Faster Large Language Model Inference on GPUs
paperarXivsources/pap-attn-flashdecoding
verifiedhigh · 0.85
FlashInfer GitHub repository
repoflashinfer-aisources/engine-flashinfer-github
verifiedhigh · 0.95
FlashInfer GitHub repository
repoflashinfer-aisources/kern-flashinfer-github
verifiedhigh · 0.95
FlashInfer issue #4035: RFC on JIT/AOT package KPIs - the three-path artifact model and what 'cold' costs
forumFlashInfersources/ev-flashinfer-issue-4035-jit-aot-kpi
verifiedmedium · 0.80
FlashInfer issue #4110: '[Compilation] GDN decode cold kernel compilation time is too long on SM90/100/120/121' - 30-50 min per test on every arch
forumFlashInfersources/ev-flashinfer-issue-4110-gdn-cold-compile
verifiedhigh · 0.85
FlashInfer issue #4317: sm12x MoE CuTe-DSL kernels never disk-cached, 15-40 s MLIR recompile per kernel shape per engine start
forumFlashInfersources/ev-flashinfer-issue-4317-cute-dsl-no-cache
verifiedhigh · 0.90
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
paperarXivsources/attn-flashinfer-paper
verifiedhigh · 0.90
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
paperarXiv (FlashInfer team)sources/flop-flashinfer
verifiedhigh · 0.90
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
paperarXivsources/pap-attn-flashinfer-paper
verifiedhigh · 0.95
FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving (MLSys 2025)
paperarXivsources/sched-flashinfer-mlsys25
verifiedhigh · 0.88
FlashInfer: Kernel Library for LLM Serving
repoflashinfer-aisources/src5-flashinfer-github
verifiedhigh · 0.95
FlexAttention: A Programming Model for Generating Optimized Attention Kernels
paperarXivsources/pap-attn-flexattention
verifiedhigh · 0.90
FlexGen - PMLR v202 (ICML 2023) table of contents entry
paperPMLR (ICML 2023)sources/w3p-flexgen-icml23-pmlr
verifiedhigh · 0.92
Flip, Don't Shuffle: Watermarking LLMs at the Speed of Inference (Stateless Bernoulli Watermarking)
paperSBW determines green-list membership by a counter-based RNG comparison instead of a vocabulary permutation. States per-token membership complexity drops from O(V log V) for KGW to O(1) for SBW, with SynthID at O(k*m) for m=30 reweighting passes. Reports <1% end-to-end generation overhead at all batch sizes. Model Qwen3-8B (vocab 151,936) on a single RTX 3090 at temperature 1.0, pure sampling without top-p. Self-reported paper; the overhead and complexity figures are its own measurements.sources/sec-arxiv-2609-03844
verifiedhigh · 0.90
From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline (arXiv 2406.11939)
paperarXiv (UC Berkeley / LMSYS)sources/meth-arena-hard-benchbuilder-arxiv
verifiedhigh · 0.85
FrugalGPT OpenReview record — already used for TMLR; see notes on route/cascade adoption
databaseOpenReview (TMLR)sources/pap-sys-frugal-serving-note
verifiedhigh · 0.90
FrugalGPT OpenReview record (TMLR)
databaseOpenReview (TMLR)sources/pap-sys-frugalgpt-openreview
verifiedhigh · 0.90
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance (arXiv 2305.05176)
paperarXiv (Stanford)sources/pap-sys-frugalgpt-arxiv
verifiedhigh · 0.90
Furiosa RNGD PCIe product page: 48 GB HBM3, 1.5 TB/s, 180 W, 512 TFLOPS FP8
spec-sheetFuriosaAIsources/furiosa-rngd-product-page-2026-10
verifiedhigh · 0.85
FuriosaAI developer docs index (latest/en)
spec-sheetFuriosaAIsources/furiosaai-developer-docs-latest-en
verifiedmedium · 0.70
FuriosaAI developer documentation (furiosa-llm serving guide)
spec-sheetFuriosaAIsources/furiosaai-developer-documentation-furiosa-llm-serving-guide
verifiedlow · 0.60
FuriosaAI Hot Chips 2024 blog: RNGD GPT-J about 12 queries per second
blogFuriosaAIsources/furiosa-blog-hot-chips-2024-gptj-12qps
verifiedmedium · 0.65
FuriosaAI press release: RNGD unveiled at Hot Chips 2024
blogFuriosaAIsources/furiosa-blog-rngd-hot-chips-press-release
verifiedmedium · 0.70
FuriosaAI Warboy Developer Docs
blogsources/furiosaai-warboy-developer-docs
verifiedhigh · 0.85
FuriosaAI Warboy Specs
blogsources/furiosaai-warboy-specs
verifiedhigh · 0.85
FuriosaAI: LG AI Research EXAONE 3.5 on four RNGD cards
blogFuriosaAIsources/furiosa-blog-lg-exaone-4x-rngd-2025-07
verifiedmedium · 0.75
FuriosaAI: Qwen3-32B on four RNGD versus four RTX PRO 6000, SDK through 2026-03-13
blogFuriosaAIsources/furiosa-blog-qwen3-32b-vs-rtx-pro-6000-2026-04
verifiedmedium · 0.70
GamesBeat reprint of the LG and Furiosa RNGD EXAONE numbers
reviewGamesBeatsources/gamesbeat-lg-furiosa-exaone-4x-rngd-2025-07
verifiedmedium · 0.70
Gated Delta Networks: Improving Mamba2 with Delta Rule
paperarXivsources/pap-arch-2412-06464
verifiedhigh · 0.90
Gateway API Inference Extension - Introduction and concepts (Kubernetes SIGs)
whitepaperKubernetes SIGs (gateway-api-inference-extension)sources/dep-gateway-api-inference-extension-intro
verifiedhigh · 0.95
Gateway API Inference Extension README (inference gateway, Endpoint Picker, stated roadmap gaps)
repoKubernetes SIGssources/ops-gwie-inference-extension
verifiedhigh · 0.85
GDPR Article 17 - Right to erasure ('right to be forgotten')
databaseEUR-Lex (via gdpr-info.eu)sources/sec-gdpr-art-17
verifiedhigh · 0.95
GDPR Article 30 - Records of processing activities
databaseEUR-Lex (via gdpr-info.eu)sources/sec-gdpr-art-30
verifiedhigh · 0.95
GDPR Article 32 - Security of processing
databaseEUR-Lex (via gdpr-info.eu)sources/sec-gdpr-art-32
verifiedhigh · 0.95
GDPR Article 5 - Principles relating to processing of personal data
databaseEUR-Lex (via gdpr-info.eu)sources/sec-gdpr-art-5
verifiedhigh · 0.95
geerlingguy/ai-benchmarks issue #36 — RTX A4000 llama.cpp Vulkan llama-bench
benchmarkJeff Geerlingsources/geerling-ai-benchmarks-issue-36-rtxa4000
verifiedmedium · 0.80
geerlingguy/ai-benchmarks issue #39 — RTX 3080 Ti 12GB llama.cpp Vulkan llama-bench (build d82b7a7c1)
benchmarkJeff Geerlingsources/geerling-ai-benchmarks-issue-39-rtx3080ti
verifiedmedium · 0.80
geerlingguy/ai-benchmarks issue #40 — RTX 3060 12GB llama.cpp Vulkan llama-bench (build 933414c0b)
benchmarkJeff Geerlingsources/geerling-ai-benchmarks-issue-40-rtx3060
verifiedmedium · 0.80
geerlingguy/ai-benchmarks issue #45 — RTX 4070 Ti llama.cpp Vulkan llama-bench (build 933414c0b)
benchmarkJeff Geerlingsources/geerling-ai-benchmarks-issue-45-rtx4070ti
verifiedmedium · 0.80
geerlingguy/ai-benchmarks issue #46 — RTX 2080 Ti llama.cpp Vulkan and CUDA llama-bench (build f9ec8858e)
benchmarkJeff Geerlingsources/geerling-ai-benchmarks-issue-46-rtx2080ti
verifiedmedium · 0.80
Geizhals product page: ASRock Arc B580 Challenger 12GB OC
databaseGeizhalssources/noncuda-geizhals-b580-asrock-challenger
verifiedhigh · 0.85
Geizhals product page: ASUS ROG Astral GeForce RTX 5090 OC
databaseGeizhalssources/noncuda-geizhals-5090-rog-astral
verifiedhigh · 0.85
Geizhals product page: ASUS ROG Strix GeForce RTX 3090 OC
databaseGeizhalssources/noncuda-geizhals-3090-rog-strix
verifiedhigh · 0.85
Geizhals product page: GIGABYTE Radeon RX 9070 XT Gaming OC 16G
databaseGeizhalssources/noncuda-geizhals-9070xt-gb-gaming-oc
verifiedhigh · 0.85
Geizhals product page: NVIDIA GeForce RTX 4090 Founders Edition
databaseGeizhalssources/noncuda-geizhals-4090-founders
verifiedhigh · 0.85
Gemini Developer API pricing (per 1M tokens, Standard/Batch/Flex/Priority tiers)
spec-sheetGooglesources/rent-src-gemini-api-pricing
verifiedhigh · 0.90
Gemma 2 model card and HF config: alternating local/global attention, sliding_window 4096
repoGoogle / Hugging Facesources/gemma2-report-alternating-swa
verifiedhigh · 0.85
Gemma 2: Improving Open Language Models at a Practical Size
paperGoogle DeepMindsources/model-fr-gemma-2-report
verifiedhigh · 0.90
Gemma 3 Technical Report
paperGoogle DeepMind (arXiv)sources/arch-gemma3
verifiedhigh · 0.92
Gemma 3 Technical Report (Gemma Team, Google DeepMind, arXiv:2503.19786)
paperarXivsources/gemma3-report-swa-kv-table3
verifiedhigh · 0.90
Gemma 3n E2B config.json (unsloth mirror of google/gemma-3n-E2B-it)
repoHugging Facesources/hf-config-gemma3n-e2b-unsloth
verifiedmedium · 0.80
Gemma 3n model overview
spec-sheetGooglesources/model-fr-google-gemma-3n-doc
verifiedhigh · 0.90
Gemma 4 model overview
spec-sheetGooglesources/model-fr-google-gemma-4-doc
verifiedhigh · 0.90
gemma-2-9b config.json
repoHugging Face (unsloth mirror of Google weights)sources/model-fr-hf-config-gemma-2-9b
verifiedhigh · 0.90
gemma-3-12b-it config.json (mirror: unsloth/gemma-3-12b-it)
repoHuggingFace / unsloth mirror of google/gemma-3-12b-itsources/hf-mm-gemma-3-12b-it-config
verifiedhigh · 0.95
gemma-3-27b-it config.json
repoHugging Face (unsloth mirror of Google weights)sources/model-fr-hf-config-gemma-3-27b
verifiedhigh · 0.90
gemma-3-4b-it config.json (mirror: unsloth/gemma-3-4b-it)
repoHuggingFace / unsloth mirror of google/gemma-3-4b-itsources/hf-mm-gemma-3-4b-it-config
verifiedhigh · 0.95
gemma-3-4b-it config.json (unsloth mirror of google/gemma-3-4b-it)
repoHugging Facesources/hf-config-gemma3-4b-it-unsloth
verifiedmedium · 0.80
gemma-3n-e2b-it config.json
repoHugging Face (unsloth mirror of Google weights)sources/model-fr-hf-config-gemma-3n-e2b
verifiedhigh · 0.90
gemma-4-12B-it config.json
repoHugging Face (Google)sources/model-fr-hf-config-gemma-4-12b
verifiedhigh · 0.90
gemma-4-12B-it config.json (text_config)
repoHugging Facesources/mbl-cfg-gemma-4-12b
verifiedhigh · 0.90
gemma-4-26B-A4B-it config.json
repoHugging Face (Google)sources/model-fr-hf-config-gemma-4-26b-a4b
verifiedhigh · 0.90
gemma-4-26B-A4B-it config.json (text_config)
repoHugging Facesources/mbl-cfg-gemma-4-26b-a4b
verifiedhigh · 0.90
gemma-4-31B-it config.json
repoHugging Face (Google)sources/model-fr-hf-config-gemma-4-31b
verifiedhigh · 0.90
gemma-4-31B-it config.json (text_config)
repoHugging Facesources/mbl-cfg-gemma-4-31b
verifiedhigh · 0.90
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding
paperarXiv (Yi et al.)sources/sd-space-paper
verifiedhigh · 0.90
Getting Started with CUDA Graphs
blogNVIDIA Technical Blog (Alan Gray)sources/flop-nvidia-cuda-graphs
verifiedhigh · 0.90
gfx906 Discord server message export (3,007 messages, 17 channels, Aug 2025 - Oct 2026)
forumgfx906 Discord community (Chinese-language AMD ROCm community)sources/comm-gfx906-discord-server-log
verifiedmedium · 0.70
ggml benches/dgx-spark table, build 11fb327bf (7941)
benchmarkggml-org (ggerganov, discussion 16578)sources/ggml-dgx-spark-bench-build-7941
verifiedhigh · 0.85
ggml-common.h (block struct definitions for every GGUF quant type)
repoggml-orgsources/qlab2-ggml-common-header
verifiedhigh · 0.90
ggml.h (enum ggml_type)
repoggml-orgsources/quant-ggml-header
verifiedhigh · 0.90
Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings (arXiv:2608.23806)
paperarXivsources/pap-mm-giga-embeddings
verifiedhigh · 0.90
GitHub - QwenLM/Qwen3
reposources/github-qwen3
verifiedmedium · 0.80
GitHub REST API repository metadata endpoint (repos/{owner}/{repo})
databaseGitHubsources/niche-github-rest-api-repo-metadata
verifiedhigh · 0.95
GitHub REST API repository metadata for all 102 engine repos (batch pull, 2026-10-04)
databaseGitHubsources/ev-gh-api-repo-metadata-2026-10-04
verifiedhigh · 0.95
glm-4.1v-9b-Thinking config.json (HuggingFace)
repoHuggingFace / THUDMsources/hf-mm-glm-4-1v-9b-config
verifiedhigh · 0.95
GLM-4.5 and GLM-4.7 model cards (huggingface.co/zai-org)
release-notesZ.AI (Zhipu)sources/model-cn-glm4-card
verifiedhigh · 0.85
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models (arXiv:2508.06471), Tables 4 & 6
papersources/glm45-tech-report
verifiedmedium · 0.80
GLM-4.5: Reasoning, Coding, and Agentic Abililties (Z.ai official blog)
blogsources/zai-glm45-blog
verifiedmedium · 0.80
GLM-4.7-Flash config.json
repoHugging Facesources/mbl-cfg-glm-4-7-flash
verifiedhigh · 0.90
glm-4v-9b config.json (HuggingFace)
repoHuggingFace / THUDMsources/hf-mm-glm-4v-9b-config
verifiedhigh · 0.95
GLM-5.3 model card (Benchmark table)
reposources/hf-zai-org-glm-5-3
verifiedmedium · 0.80
GLM-5.3-Flash: Frontier Intelligence, Flash Cost (Z.ai official blog)
blogsources/zai-glm53flash-blog
verifiedmedium · 0.80
GLM-5.3: Frontier Coding with Emergent Cyber Capabilities
blogsources/zai-blog-glm-5-3
verifiedmedium · 0.80
Google 2025 Environmental Report (data center energy section, Figure 4 PUE)
paperGoogle LLCsources/nrg2-google-2025-environmental-report
verifiedhigh · 0.93
Google Cloud accelerator-optimized VM pricing
databaseGooglesources/sup-cloud-gcp-accelerator-optimized-pricing
verifiedhigh · 0.96
Google Cloud Compute Engine VM instance pricing
spec-sheetGooglesources/sup-cloud-gcp-compute-vm-pricing
verifiedhigh · 0.90
Google Cloud Spot VMs documentation (up-to-91% discount, preemption, no SLA, CUD exclusion)
spec-sheetGoogle Cloudsources/rent-src-gcp-spot-vm-doc
verifiedhigh · 0.90
Google Cloud Storage pricing (Standard/Nearline/Coldline/Archive per-GiB-hour, Class A/B operations)
spec-sheetGoogle Cloudsources/rent-src-gcp-cloud-storage-pricing
verifiedhigh · 0.90
Google Cloud TPU pricing
databaseGooglesources/sup-cloud-gcp-tpu-pricing
verifiedhigh · 0.97
Google Cloud Vertex AI generative AI pricing, open-model rows, fetched 2026-10-16
spec-sheetGoogle Cloudsources/svc-src-gcp-vertex-genai-pricing-2026-10-16
verifiedhigh · 0.85
Google Cloud Vertex AI generative-AI pricing page (first-party and partner-model per-1M tables)
databaseGoogle Cloudsources/svc-src-gcp-vertex-genai-pricing-2026-10-14
verifiedhigh · 0.90
Google Coral: Edge TPU performance benchmarks (official, ms/inference table)
benchmarkGooglesources/google-coral-edgetpu-benchmarks-official
verifiedmedium · 0.80
Google Research blog: TurboQuant extreme KV compression
blogGoogle Researchsources/google-research-turboquant-blog
verifiedmedium · 0.75
google/gemma-1-7b config.json (via unsloth/gemma-7b-it mirror; google/ is gated)
repoHugging Facesources/hf-edge-gemma-1-7b
verifiedhigh · 0.88
google/gemma-2-2b config.json (via unsloth/gemma-2-2b mirror; google/ is gated)
repoHugging Facesources/hf-edge-gemma-2-2b
verifiedhigh · 0.88
GPT-4.1 model page
spec-sheetOpenAIsources/model-fr-openai-gpt-4-1-docs
verifiedhigh · 0.90
gpt-oss-120b & gpt-oss-20b Model Card
spec-sheetOpenAIsources/model-fr-openai-gpt-oss-card
verifiedhigh · 0.90
gpt-oss-120b & gpt-oss-20b Model Card (arXiv:2508.10925)
papersources/gpt-oss-model-card-arxiv-2508-10925
verifiedmedium · 0.80
gpt-oss-120b & gpt-oss-20b Model Card (arXiv:2508.10925), Table 3
reposources/gpt-oss-120b-arxiv-modelcard
verifiedmedium · 0.80
gpt-oss-120b config.json
repoHugging Face / OpenAIsources/model-fr-hf-config-gpt-oss-120b
verifiedhigh · 0.90
gpt-oss-20b config.json
repoHugging Face / OpenAIsources/model-fr-hf-config-gpt-oss-20b
verifiedhigh · 0.90
GPTQ reference implementation (IST-DASLab/gptq GitHub repository README)
repoIST-DASLab on GitHubsources/qlab-gptq-github
verifiedhigh · 0.88
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
paperarXivsources/quant-gptq-paper
verifiedhigh · 0.90
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers (Frantar et al.)
paperarXivsources/qlab-gptq-paper
verifiedhigh · 0.88
GPTQ: Accurate Post-Training Quantization for GPT models
repoAutoGPTQsources/src5-gptq-github
verifiedhigh · 0.90
GPTQModel: LLM quantization toolkit (GitHub: ModelCloud/GPTQModel)
repoModelCloudsources/qhw-src-gptqmodel-repo
verifiedhigh · 0.95
GPU cloud billing granularity comparison - Per-second, per-minute, per-hour, per-millisecond
databaseDerived from multiple sources in this reposources/ppl-bench-billing-granularity
verifiedhigh · 0.90
GPU interconnect and cluster costs - NVLink, InfiniBand, and Ethernet options
whitepaperNVIDIA / derived from existing repo recordssources/ppl-dep-interconnect-cluster-costs
verifiedhigh · 0.85
GPU Quicklist - live consumer GPU price table scraped from Amazon.com
blogGPU Quicklist (reyem.dev)sources/sup-price-gpuquicklist-amazon
verifiedmedium · 0.70
GPU rack power density and cooling requirements - Air cooling ceiling and liquid cooling requirement
whitepaperVantage / derived from multiple repo recordssources/ppl-dep-power-density-cooling
verifiedhigh · 0.90
GPU rental vs purchase break-even - Cloud per-GPU-hour vs used hardware asking prices
databaseDerived from multiple sources in this reposources/ppl-dep-rental-vs-purchase-breakeven
verifiedmedium · 0.80
GPU.ai as cloud orchestrator - Per-second billing, zero markup claim, 12+ cloud aggregation
databaseGPU.aisources/ppl-orch-gpu-ai-billing-model
verifiedhigh · 0.85
GPU.ai as price benchmark - Cross-provider comparison and market range data
databaseGPU.aisources/ppl-bench-gpu-ai-price-benchmark
verifiedhigh · 0.85
GPU.ai GPU Cloud Price Index - Live floor prices across 12+ clouds, snapshot 2026-10-04
databaseGPU.aisources/ppl-cloud-gpu-ai-price-index
verifiedhigh · 0.90
GPU.ai pricing methodology - Per-second billing, zero markup, secure vs community tiers
databaseGPU.aisources/ppl-cloud-gpu-ai-methodology
verifiedhigh · 0.85
GPUDirect Storage Documentation
whitepaperNVIDIAsources/src5-gpudirect-storage-docs
verifiedhigh · 0.95
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
paperarXivsources/pap-attn-grouped-query-attention
verifiedhigh · 0.95
Granite 4.0 Language Models model card (H-Tiny spec table)
repoIBM Granitesources/hf-eco-granite-4-0-h-tiny-modelcard
verifiedhigh · 0.95
Graphcore Bow-2000 IPU-Machine Datasheet
spec-sheetGraphcoresources/asic-graphcore-bow-2000-datasheet
verifiedhigh · 0.95
GreenBench: Benchmarking Energy Efficiency and Carbon Footprint of Open-Source LLM Inference on Apple Silicon (arXiv:2608.28667)
paperarXivsources/nrg2-arxiv-greenbench-apple-silicon
verifiedmedium · 0.82
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models (arXiv:2402.19427)
paperGoogle DeepMindsources/pap-eff-hawk-griffin
verifiedhigh · 0.90
Groq Among the First to Bring NVIDIA Groq 3 LPX and Vera Rubin NVL72 to Market
blogGroqsources/asic-groq-nvidia-3lpx
verifiedhigh · 0.90
Groq console model list with per-1M-token prices
databaseGroqsources/rent-src-groq-model-pricing
verifiedhigh · 0.90
Groq LPU AI Inference Technology (architecture details)
blogGroqsources/alt-groq-lpu-arch
verifiedhigh · 0.90
Groq LPU AI Inference Technology (architecture overview)
blogGroqsources/asic-groq-lpu-technology
verifiedhigh · 0.90
Groq LPU architecture page - absence of any per-chip compute or SRAM capacity figure
blogGroqsources/vb-groq-lpu-no-perchip-figures
verifiedhigh · 0.85
Groq LPU architecture page - on-chip SRAM bandwidth upwards of 80 TB/s, 14 nm, no off-chip HBM
blogGroqsources/vb-groq-lpu-80tbs-14nm
verifiedhigh · 0.90
Groq LPU technology page - the 80 TB/s on-chip SRAM bandwidth sentence, and the CONFIRMED ABSENCE of any per-chip compute figure
spec-sheetGroq (groq.com, the company's own site)sources/w4h-groq-lpu-inference-engine-80tbs-no-perchip-figure
verifiedhigh · 0.90
GroqCloud Llama 3.3 70B Versatile model page (enterprise-gated, vendor speed)
databaseGroqsources/svc-src-groq-llama33-model-page-2026-10-17
verifiedhigh · 0.85
GroqCloud supported-models page (model ids, vendor speed figures, per-1M prices)
databaseGroqsources/svc-src-groq-models-page-2026-10-14
verifiedhigh · 0.90
GroqCloud supported-models page, re-read 2026-10-17 (production table: gpt-oss public, Llama sales-gated)
spec-sheetGroqsources/svc-src-groq-models-page-2026-10-17
verifiedhigh · 0.90
GroqFlow README
repoGroqsources/alt-groqflow-readme
verifiedhigh · 0.90
GSAI-ML/LLaDA-8B-Instruct model repo
repoGAIR / Ant Groupsources/hf-eco-llada-8b-instruct
verifiedhigh · 0.95
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
paperarXivsources/pap-arch-2006-16668
verifiedhigh · 0.90
Guidance GitHub repository
repoguidance-aisources/niche-guidance-repo
verifiedhigh · 0.85
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
paperarXivsources/pap-attn-h2o
verifiedhigh · 0.85
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models (Zhang et al., MBZUAI)
paperarXivsources/qlab-h2o-paper
verifiedhigh · 0.88
h2ogpt GitHub repository (ARCHIVED)
repoH2O.aisources/niche-h2ogpt-repo
verifiedhigh · 0.90
Hacker News: Launch HN: Magnitude (YC S25) - Self-optimizing inference engine for agents
forumHacker Newssources/sent-src-hn-magnitude-launch-49911995
verifiedmedium · 0.70
Hacker News: NVIDIA introduces TensorRT-LLM for accelerating LLM inference on H100/A100 GPUs
forumHacker Newssources/sent-src-hn-tensorrt-llm-launch-37439280
verifiedmedium · 0.70
Hacker News: Which GPU(s) to get for deep learning
forumHacker Newssources/sent-src-hn-which-gpu-34431056
verifiedmedium · 0.70
Hailo-10H Generative AI Processor Product Specification
spec-sheetHailo Technologiessources/ainv-hailo-10h-product-page
verifiedmedium · 0.75
Hailo-10H M.2 AI Acceleration Module Product Page
spec-sheetHailosources/hailo-10h-m2-product-page
verifiedhigh · 0.85
Hailo-15H AI Vision Processor Product Page
spec-sheetHailosources/hailo-15h-product-page
verifiedhigh · 0.85
Hailo-8 AI Processor for Edge Devices Product Page & Specification
spec-sheetHailo Technologiessources/ainv-hailo-8-product-page
verifiedmedium · 0.75
Half-Quadratic Quantization of large machine learning models
blogDropbox (Mobius team)sources/quant-hqq-blog
verifiedhigh · 0.90
Hardware Corner - Quadro RTX 8000 48GB local LLM test (llama.cpp and ExLlamaV2, June 2025)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-quadro-rtx-8000-llm-test
verifiedmedium · 0.70
Hardware Corner — GPU LLM Benchmarks per-GPU pages (llama.cpp, context sweep 4k-256k, March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-pages-2026-03
verifiedlow · 0.60
Hardware Corner — RTX 3060 12GB local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-3060-12gb
verifiedlow · 0.60
Hardware Corner — RTX 3080 Ti local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-3080-ti
verifiedlow · 0.60
Hardware Corner — RTX 4060 Ti 16GB local LLM context-tier tables (Qwen3 Q4_K + gpt-oss 20B MXFP4, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4060-ti-16gb
verifiedlow · 0.60
Hardware Corner — RTX 4070 local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4070
verifiedlow · 0.60
Hardware Corner — RTX 4070 SUPER local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4070-super
verifiedlow · 0.60
Hardware Corner — RTX 4070 Ti local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4070-ti
verifiedlow · 0.60
Hardware Corner — RTX 4070 Ti SUPER local LLM context-tier tables (Qwen3 Q4_K + gpt-oss 20B MXFP4, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4070-ti-super
verifiedlow · 0.60
Hardware Corner — RTX 4080 SUPER local LLM context-tier tables (Qwen3 Q4_K + gpt-oss 20B MXFP4, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-4080-super
verifiedlow · 0.60
Hardware Corner — RTX 5070 local LLM context-tier tables (Qwen3 Q4_K, March 2026)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-gpu-llm-bench-rtx-5070
verifiedlow · 0.60
Hardware Corner — RTX 5090 32GB local LLM llama-bench run (Qwen3 Q4_K_XL context sweep)
benchmarkHardware Corner (Allan Witt)sources/hardware-corner-rtx-5090-llm-benchmarks
verifiedlow · 0.50
Hardware Corner — We Tested Qwen3.8 27B (llama.cpp b10364, CUDA 12.8: RTX 3090/4090/5090, dual RTX 5060 Ti, M5 Max 128GB, NVIDIA GB10 pp/tg vs context)
benchmarkHardware Cornersources/hardware-corner-qwen38-27b-hardware-tests
verifiedmedium · 0.70
Hardware Corner per-GPU LLM pages (Qwen3 8B/14B Q4_K and gpt-oss 20B MXFP4, context sweep March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmark-pages
verifiedmedium · 0.70
Hardware Corner per-GPU local LLM benchmark pages (llama.cpp Qwen3 Q4_K and gpt-oss-20B MXFP4 context sweep, March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-q4k-context-sweep-2026
verifiedlow · 0.60
Hardware Corner RTX 3060 12GB local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-3060-12gb-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 3080 Ti local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-3080-ti-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 3090 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-rtx-3090-2026-03
verifiedmedium · 0.75
Hardware Corner RTX 3090 Ti local LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-3090-ti-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 4060 Ti 16GB local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-4060-ti-16gb-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 4070 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-4070-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 4070 SUPER local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-4070-super-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 4080 local LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-4080-llm-benchmarks
verifiedmedium · 0.70
Hardware Corner RTX 4090 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-rtx-4090-2026-03
verifiedmedium · 0.75
Hardware Corner RTX 5060 Ti 16GB local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-5060-ti-16gb-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 5070 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-5070-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 5070 Ti local LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-5070-ti-llm-benchmark-page-2026-03
verifiedmedium · 0.70
Hardware Corner RTX 5080 local LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-5080-llm-benchmarks
verifiedmedium · 0.70
Hardware Corner RTX 6000 Ada local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-rtx-6000-ada-2026-03
verifiedmedium · 0.75
Hardware Corner RTX 6000 Ada local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-6000-ada-llm-benchmark-page-2026-03
verifiedmedium · 0.75
Hardware Corner RTX A6000 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-gpu-llm-benchmarks-rtx-a6000-2026-03
verifiedmedium · 0.75
Hardware Corner RTX A6000 local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-a6000-llm-benchmark-page-2026-03
verifiedmedium · 0.75
Hardware Corner RTX PRO 5000 Blackwell local LLM benchmark page
benchmarkHardware Cornersources/hardware-corner-rtx-pro-5000-blackwell-llm-benchmarks
verifiedmedium · 0.70
Hardware Corner RTX PRO 6000 Blackwell local LLM benchmark page (March 2026)
benchmarkHardware Cornersources/hardware-corner-rtx-pro-6000-blackwell-llm-benchmark-page-2026-03
verifiedmedium · 0.75
Hardware Corner: gpt-oss-20B on an RTX 3090, Flash Attention context sweep
blogHardware Cornersources/hardware-corner-gptoss-20b-rtx3090-fa-sweep
verifiedmedium · 0.70
hazyresearch/based-1.3b config.json
repoHugging Facesources/mbl-cfg-based-1-3b
verifiedhigh · 0.90
Hermes 4 Technical Report (arXiv:2508.18255), Table 3 — 'Final downstream task evaluations for Hermes 4 405B and comparable open-weight models'
papersources/hermes-4-tech-report
verifiedmedium · 0.80
HeteGen - MLSys 2024 proceedings title listing
paperMLSys / proceedings.mlsys.orgsources/w3p-hetegen-mlsys24-proceedings
verifiedhigh · 0.95
HeteGen (arXiv 2403.01164) - arXiv API entry with 'MLSys 2024' comment
paperarXivsources/w3p-hetegen-arxiv-2403-01164
verifiedhigh · 0.90
HGRN2: Gated Linear RNNs with State Expansion
paperQin et al. (arXiv)sources/arch-hgrn2
verifiedhigh · 0.92
High Fidelity Neural Audio Compression (EnCodec) (arXiv:2210.13438)
paperarXivsources/pap-mm-encodec
verifiedhigh · 0.90
HIP runtime API README (ROCm/HIP)
repoAMD ROCmsources/amd-hip-readme
verifiedhigh · 0.90
HIPIFY README (ROCm/HIPIFY)
repoAMD ROCmsources/amd-hipify-readme
verifiedhigh · 0.92
Hob-forge/Kolibri-1-GGUF community quant repo
repoHob-forgesources/hf-hob-forge-kolibri-1-gguf
verifiedmedium · 0.75
Horizon Robotics Journey 5 (J5) — developer documentation overview
spec-sheetHorizon Robotics (地平线)sources/cn-horizon-journey5
verifiedhigh · 0.90
HOSTKEY RTX PRO 5000 Blackwell 72 GB Ollama benchmark
benchmarkHOSTKEYsources/hostkey-rtx-pro-5000-72gb-blackwell-ollama-bench
verifiedlow · 0.60
How Much Dense Attention is Necessary? Oracle-Guided Sparse Prefill for Full/GQA Layers in Hybrid Long-Context Models (arXiv:2606.07703) - the authors' own report behind the SOTA2/WizWand TTFT leaderboard
paperSOTA2 Research (formerly WizWand) - Hongxing Wang, Harenome Razanajato, Zhen Zhang, Yujie Yuan, Hongsheng Liusources/w8-src-arxiv-2606-07703-dense-attention-oracle
verifiedhigh · 0.85
HPE ProLiant Compute XD685 (NVIDIA or AMD Instinct GPU options)
spec-sheetHPEsources/sup-buy-hpe-xd685
verifiedhigh · 0.85
Huawei Ascend 910B (aggregated analyst and teardown figures)
reviewaiwiki.ai (aggregating SemiAnalysis, TechInsights, CSET)sources/asic-ascend-910b-secondary
verifiedhigh · 0.90
Huawei Atlas 300I A2 product page (e.huawei.com) - 技术规格 table publishing 560 TOPS INT8 / 280 TFLOPS FP16 (this SKU has NO record in data/accelerators)
spec-sheetHuawei Enterprise (e.huawei.com)sources/w5a-huawei-atlas-300i-a2-e-huawei-spec-table
verifiedhigh · 0.95
Huawei Atlas 300I Duo product page (e.huawei.com) - 技术规格 table publishing 280 TOPS INT8 / 140 TFLOPS FP16, which the record's empty flops array missed
spec-sheetHuawei Enterprise (e.huawei.com, Huawei's own enterprise product site)sources/w5a-huawei-atlas-300i-duo-e-huawei-spec-table
verifiedhigh · 0.95
Huawei Atlas 650E AI server product page - AI Performance and on-chip memory tables, SERVER-level figures only
spec-sheetHuawei Technologies (hiascend.com, Huawei Ascend's own hardware site)sources/w4h-huawei-atlas-650e-spec-table-server-level-only
verifiedhigh · 0.90
Huawei Atlas 650E page, Product Features prose bullet 'Provide 13.4 TB/s UB Link bandwidth per server (16-NPU FM)' - the vendor's own UNIDIRECTIONAL restatement of its own bidirectional table figure, which settles the UB Link direction convention without inference
spec-sheetHuawei (hiascend.com, the company's own site)sources/w7f-huawei-650e-prose-bullet-13-4tbs-proves-ublink-direction
verifiedhigh · 0.95
Huawei Atlas 950 SuperPoD product page - 64-NPU AI Performance and on-chip memory table, an INDEPENDENT second server figure for the same 950DT
spec-sheetHuawei Technologies (hiascend.com)sources/w4h-huawei-atlas-950-superpod-64npu-ai-performance
verifiedhigh · 0.85
Huawei CANN (Compute Architecture for Neural Networks) and MindSpore open-source AI framework
repoHuawei / MindSpore communitysources/cn-huawei-cann-mindspore
verifiedhigh · 0.85
Huawei CloudMatrix 384 (CM384) supernode — system architecture and specifications
whitepaperHuawei (arXiv:2506.12708v1, cited by China Research Collective and SemiAnalysis)sources/cn-huawei-cloudmatrix384
verifiedmedium · 0.75
HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition (arXiv:2204.06328)
paperarXivsources/pap-mm-hubert-ee
verifiedhigh · 0.90
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units (arXiv:2106.07447)
paperarXivsources/pap-mm-hubert
verifiedhigh · 0.90
Hugging Face antirez/deepseek-v4.1-flash-gguf model card
spec-sheetantirezsources/hf-antirez-deepseek-v41-flash-gguf
verifiedmedium · 0.80
Hugging Face config.json files for the long-context model families (fetched 2026-10-04)
databaseHugging Face / model vendorssources/ctx-src-hf-configs-longctx-models
verifiedhigh · 0.90
Hugging Face Hub — Pickle Scanning documentation
spec-sheetHugging Facesources/meth-huggingface-pickle-security
verifiedhigh · 0.95
Hugging Face Hub response for meta-llama/Llama-Guard-3-1B: 'Access to model ... is restricted. You must have access to it and be authenticated'
databaseHugging Facesources/sec-hf-llama-guard-gated-access
verifiedhigh · 0.95
Hugging Face Inference Endpoints (dedicated) - Hourly instance pricing across AWS and GCP
databaseHugging Facesources/ppl-cloud-huggingface-inference-endpoints-pricing
verifiedhigh · 0.95
Hugging Face Inference Endpoints as orchestrator - Per-minute billing, managed model hosting
databaseHugging Facesources/ppl-orch-huggingface-billing-model
verifiedhigh · 0.90
Hugging Face Inference Endpoints vs raw cloud GPU pricing - same hardware, different rates
databaseHugging Facesources/ppl-cloud-huggingface-vs-cloud-price
verifiedhigh · 0.90
Hugging Face text-generation-launcher argument reference (MAX_TOTAL_TOKENS, MAX_CONCURRENT_REQUESTS, MAX_BATCH_TOTAL_TOKENS, MAX_WAITING_TOKENS)
repoHugging Facesources/ops-tgi-launcher-arguments
verifiedhigh · 0.90
Hugging Face Transformers documentation: Bitsandbytes
repoHugging Facesources/qlab2-transformers-bnb-doc
verifiedhigh · 0.90
Hugging Face zai-org/GLM-5.3-Flash model card
spec-sheetZ.aisources/hf-zai-glm-5-3-flash-model-card
verifiedhigh · 0.85
HuggingFace config.json - LLaDA-8B-Instruct (GSAI-MML/LLaDA-8B-Instruct)
spec-sheetHugging Face (model repository raw file)sources/bk2ms-llada-8b-instruct-config
verifiedhigh · 0.90
HuggingFace config.json - Seed-OSS-36B-Instruct (ByteDance-Seed/seed-oss-36B)
spec-sheetHugging Face (model repository raw file)sources/bk2ms-seed-oss-36b-config
verifiedhigh · 0.90
HuggingFace model API: safetensors parameter metadata
repoHuggingFacesources/hf-mm-hf-api-safetensors-params
verifiedhigh · 0.95
HuggingFace model configs, model cards and safetensors metadata APIs for Chinese open-weight models
repoHuggingFacesources/model-cn-hf-configs-readme-apis
verifiedhigh · 0.90
HuggingFace Optimum README (accelerator export/runtime toolkit)
repoHuggingFacesources/embed-hf-optimum-github
verifiedhigh · 0.85
HuggingFace Text Embeddings Inference README
repoHuggingFacesources/embed-hf-tei-github
verifiedhigh · 0.90
HuggingFace Transformers reference implementations (glm4_moe, glm4_moe_lite, glm_moe_dsa)
repoHuggingFacesources/model-cn-hf-transformers-ref-impls
verifiedhigh · 0.90
HuggingFaceTB/SmolLM2-1.7B-Instruct config.json
repoHugging Facesources/hf-edge-smollm2-1-7b-instruct
verifiedhigh · 0.88
HuggingFaceTB/SmolLM2-1.7B-Instruct config.json
repoHugging Facesources/mbl-cfg-smollm2-1-7b-instruct
verifiedhigh · 0.90
HuggingFaceTB/SmolLM3-3B config.json
repoHugging Facesources/hf-edge-smollm3-3b
verifiedhigh · 0.88
HuggingFaceTB/SmolLM3-3B config.json
repoHugging Facesources/mbl-cfg-smollm3-3b
verifiedhigh · 0.90
HuggingFaceTB/SmolLM3-3B model repo
repoHugging Face TBsources/hf-eco-smollm3-3b
verifiedhigh · 0.95
HuggingFaceTB/SmolVLM2-2.2B-Instruct config.json
repoHugging Facesources/mbl-cfg-smolvlm2-2-2b-instruct
verifiedhigh · 0.90
Hunyuan-A13B model card and technical report link (huggingface.co/tencent)
release-notesTencentsources/model-cn-hunyuan-a13b-card
verifiedhigh · 0.85
Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing (arXiv:2610.22196)
paperarXivsources/arxiv-hy-memory-30b-a3b
verifiedhigh · 0.85
Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding
paperarXiv (Ankner, Parthasarathy, Nrusimha, Rinard, Ragan-Kelley, Brandon)sources/sd-hydra-paper
verifiedhigh · 0.90
Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding (arXiv:2402.05109)
paperarXivsources/mkt-hydra-draft-heads
verifiedhigh · 0.90
Hyena Hierarchy: Towards Larger Convolutional Language Models
paperarXivsources/pap-arch-2302-10866
verifiedhigh · 0.90
Hyena Hierarchy: Towards Larger Convolutional Language Models
paperarXivsources/pap-attn-hyena
verifiedhigh · 0.85
Hyperbolic AI token-API pricing via LiteLLM provider table (per-1M-token list prices)
databaseLiteLLM (BerriAI)sources/svc-src-hyperbolic-litellm-pricing-2026-10-15
verifiedmedium · 0.75
ibm-granite/granite-3.3-8b-instruct config.json
repoHugging Facesources/mbl-cfg-granite-3-3-8b-instruct
verifiedhigh · 0.90
ibm-granite/granite-3.3-8b-instruct model repo
repoIBM Granitesources/hf-eco-granite-3-3-8b-instruct
verifiedhigh · 0.95
ibm-granite/granite-4.0-h-tiny config.json
repoHugging Facesources/mbl-cfg-granite-4-0-h-tiny
verifiedhigh · 0.90
ibm-granite/granite-4.0-h-tiny model repo
repoIBM Granitesources/hf-eco-granite-4-0-h-tiny
verifiedhigh · 0.95
ICLR 2021 accepted-paper index (iclr.cc virtual)
databaseICLRsources/sco-iclr-accepted-index-2021
verifiedhigh · 0.95
ICLR 2024 accepted-paper index (iclr.cc virtual)
databaseICLRsources/sco-iclr-accepted-index-2024
verifiedhigh · 0.95
ICLR 2025 accepted-paper index (iclr.cc virtual)
databaseICLRsources/sco-iclr-accepted-index-2025
verifiedhigh · 0.95
ik_llama.cpp GitHub repo
repoikawrakowsources/cpuedge-ik-llama-cpp-github
verifiedhigh · 1.00
ikawrakow/ik_llama.cpp GitHub README
repoikawrakowsources/qlab2-ik-llama-cpp-readme
verifiedhigh · 0.90
Iluvatar CoreX BI-V100 (Tiangai 100) product page - vendor prints memory as '32 GB DRAM HBM2', a wording no other vendor uses and which must not be copied to the MR-V100
spec-sheetIluvatar CoreX (iluvatar.com, the company's own site)sources/w5a-iluvatar-bi-v100-vendor-says-32gb-dram-hbm2
verifiedhigh · 0.95
Iluvatar CoreX BI-V100 (Tiangai 100) product page publishes TWO 64 GB/s figures under one 接口 row - host-controller bandwidth AND inter-chip bandwidth - both labelled 双向; the chip-to-chip one is a real scale-up figure and had no interconnect record
spec-sheetIluvatar CoreX (iluvatar.com, the company's own site)sources/w7f-iluvatar-bi-v100-vendor-publishes-chip-to-chip-64gbs
verifiedhigh · 0.90
Iluvatar CoreX Tiangai 100 (BI-V100) and Zhikai 100 (MR-V100) product pages - memory/interface/TDP published, NO compute figure published
spec-sheetIluvatar CoreX (iluvatar.com, the company's own site)sources/w4h-iluvatar-tiangai100-zhikai100-spec-tables
verifiedhigh · 0.90
Iluvatar CoreX Tiangai 100 (BI-V100) training accelerator card product page
spec-sheetIluvatar CoreX (天数智芯)sources/cn-iluvatar-tianggai100
verifiedhigh · 0.95
Iluvatar CoreX Zhikai 100 / 50 (MR-V100 / MR-V50) inference accelerator card product page
spec-sheetIluvatar CoreX (天数智芯)sources/cn-iluvatar-zhikai100
verifiedhigh · 0.95
inclusionAI/Ling-3.0-flash · Hugging Face
reposources/ling-3-0-flash-hf
verifiedmedium · 0.80
inclusionAI/Ling-3.0-Flash config.json
repoHugging Facesources/mbl-cfg-ling-3-0-flash
verifiedhigh · 0.90
inclusionAI/Ling-3.1-flash config.json
repoinclusionAIsources/hf-ling-3-1-flash-config
verifiedhigh · 0.90
inclusionAI/Ling-3.1-flash model card
repoinclusionAIsources/hf-ling-3-1-flash-card
verifiedmedium · 0.80
inclusionAI/LLaDA2.2-mini model card and config.json
repoinclusionAI (Ant Group)sources/hf-llada2-2-mini
verifiedhigh · 0.88
INDETERMINATE, NOT DEAD: the blocked-but-valid citation set in data/sources/ (intel.com 403, docs.vllm.ai 429, Enflame WAF, and the retailers), with the probe that failed and how
databasecompiled by this passsources/w6s-unreachable-but-cited-2026-10-05
verifiedhigh · 0.90
Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads (arXiv 2401.11181)
paperarXiv (SUSTech / HKUST)sources/pap-sys-tetriinfer-arxiv
verifiedhigh · 0.90
InfiniBand Trade Association: InfiniBand Architecture Specification and FAQ
spec-sheetInfiniBand Trade Associationsources/link-ibta-specification
verifiedhigh · 0.90
InfiniBand Trade Association: What's new in Release 2.1, Volumes 1 and 2
spec-sheetInfiniBand Trade Associationsources/link-ibta-release-2-1
verifiedhigh · 0.90
InfiniBand: High-Performance Network Interconnect
spec-sheetNVIDIAsources/src5-infiniband-docs
verifiedhigh · 0.90
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management
paperarXiv (Lee, Lee, Seo, Sim; KAIST)sources/flop2-infinigen
verifiedhigh · 0.90
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (Liu et al.)
paperarXivsources/qlab-infini-gen-paper
verifiedhigh · 0.88
Infinity embedding/reranking server README
repomichaelfeilsources/embed-infinity-embeddings-github
verifiedhigh · 0.85
Infinity GitHub repository
repoMichael Feilsources/niche-infinity-repo
verifiedmedium · 0.80
Influence Factors on RAG Poisoning
paperFull-factorial study, 432 configurations. Retriever architecture, dataset and retrieval depth are the strongest factors affecting poisoning EXPOSURE; larger retrieval depth increases the chance of retrieving a poisoned passage; replicating poisoned content across databases amplifies adversarial influence.sources/sec-arxiv-2606-12469
verifiedhigh · 0.90
Inside NVIDIA Blackwell Ultra: The Chip Powering the AI Factory Era
blogNVIDIAsources/bw-nv-blackwell-ultra-blog
verifiedhigh · 0.85
Inside vLLM's New KV Offloading Connector (vLLM blog, 2026-01-08)
blogvLLM projectsources/pd-vllm-kv-offload-blog
verifiedhigh · 0.85
Intel Arc A750 Graphics ARK product specifications (SKU 227954)
spec-sheetIntelsources/consumer-intel-arc-a750-ark-specifications
verifiedhigh · 0.95
Intel Arc A770 Graphics (16GB) ARK product specifications (SKU 229151)
spec-sheetIntelsources/consumer-intel-arc-a770-16gb-ark-specifications
verifiedhigh · 0.95
Intel Arc B580 Graphics ARK product specifications (SKU 241598)
spec-sheetIntelsources/consumer-intel-arc-b580-ark-specifications
verifiedhigh · 0.85
Intel Arc Pro B50 GPU datasheet (v1.0)
spec-sheetIntelsources/consumer-intel-arc-pro-b50-datasheet
verifiedhigh · 0.90
Intel Arc Pro B60 GPU datasheet (v1.0)
spec-sheetIntelsources/consumer-intel-arc-pro-b60-datasheet
verifiedhigh · 0.90
Intel Arc Pro B70 ARK specifications
spec-sheetIntelsources/acc2-arc-pro-b70-ark
verifiedhigh · 0.95
Intel Arc Pro B70 Graphics ARK product specifications (SKU 245797)
spec-sheetIntelsources/acc-fill-intel-arc-pro-b70-ark-specs
verifiedhigh · 0.95
Intel Arc Pro B70 Graphics ARK specifications (SKU 245797) - verbatim rows, re-verified in a browser session 2026-10-04
spec-sheetIntelsources/vb-intel-arc-pro-b70-ark-spec-table-reverify
verifiedhigh · 0.95
Intel Ark Arc B-series page (B580 confirmed; B570 URL redirected)
spec-sheetIntelsources/intel-arc-b580-ark-page-b570-redirect-note
verifiedhigh · 0.90
Intel ARK specification pages - probe behaviour that made them look dead, and the browser-session re-verification that cleared them
spec-sheetIntelsources/w3s-intel-ark-spec-tables-served-to-browsers-not-static-probes
verifiedhigh · 0.85
Intel AutoRound step_by_step user guide
repoIntelsources/qlab2-autoround-step-by-step
verifiedhigh · 0.90
Intel Data Center GPU Flex 170, ARK specifications page (first-party)
spec-sheetIntel Corporation (intel.com ARK)sources/w4h-intel-dc-gpu-flex-170-ark-spec-table
verifiedhigh · 0.95
Intel Data Center GPU Flex Series product brief (Flex 140 / Flex 170 peak-compute table)
spec-sheetIntel Corporation (cdrdv2-public.intel.com, Intel's own document CDN)sources/w4h-intel-dc-gpu-flex-series-product-brief
verifiedhigh · 0.90
Intel Data Center GPU Max 1550, ARK specifications page (first-party)
spec-sheetIntel Corporation (intel.com ARK)sources/w4h-intel-dc-gpu-max-1550-ark-spec-table
verifiedhigh · 0.95
Intel Data Center GPU Max Series product brief (Max 1100 / 1450 / 1550 architecture table)
spec-sheetIntel Corporation (intel.com central-libraries, Intel's own document store)sources/w4h-intel-dc-gpu-max-series-product-brief
verifiedhigh · 0.90
Intel Extension for PyTorch (IPEX) - GitHub README
repoIntelsources/xpu-ipex-github-readme
verifiedhigh · 0.90
Intel Gaudi 3 AI Accelerator — Inference Model Performance Data (software 1.24, Optimum-Habana)
benchmarkIntelsources/intel-gaudi3-model-performance-1-24
verifiedlow · 0.50
Intel Gaudi 3 AI Accelerator Technical Paper - '1677 TFlops per MME chip' prose vs 1678 in the tables
whitepaperIntelsources/vb-intel-gaudi3-paper-mme-1677-vs-1678
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper - HL-325L OCP Accelerator Module TDP (VERBATIM)
whitepaperIntelsources/vb-intel-gaudi3-oam-hl325l-900w-tdp
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper - HL-338 PCIe Add-In Card TDP and CEM form factor (VERBATIM)
whitepaperIntelsources/vb-intel-gaudi3-pcie-hl338-600w-tdp
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper (July 2025, V1 Rev 3)
whitepaperIntelsources/asic-intel-gaudi3-tech-paper
verifiedhigh · 0.90
Intel Gaudi 3 AI Accelerator Technical Paper section 4 Host Interface - PCIe Gen5 bandwidth prose (VERBATIM)
whitepaperIntelsources/vb-intel-gaudi3-paper-host-interface-prose
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper Table 1 - Gaudi 2 vs Gaudi 3 feature comparison (VERBATIM, July 2025 V1 Rev 3)
whitepaperIntelsources/vb-intel-gaudi3-paper-table1-feature-comparison
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper Table 5 - peak TFLOP/s by datatype, MME vs TPC (VERBATIM)
whitepaperIntelsources/vb-intel-gaudi3-paper-table5-datatype-tflops
verifiedhigh · 0.95
Intel Gaudi 3 AI Accelerator Technical Paper Table 8 - Gaudi 2 vs Gaudi 3 OAM memory attributes incl. TDP (VERBATIM)
whitepaperIntelsources/vb-intel-gaudi3-paper-table8-oam-memory-attributes
verifiedhigh · 0.95
Intel Gaudi 3 technical paper Table 1 - 'Networking (bidirectional) 600 GB/s (Gaudi 2) / 1200 GB/s (Gaudi 3)', which is the only directional statement Intel makes for the aggregate and which reconciles exactly with the 24x 200 GbE port count
whitepaperIntelsources/w7f-intel-gaudi3-paper-table1-networking-1200-bidirectional
verifiedhigh · 0.95
Intel Gaudi 3 technical paper Table 4 (HL-338 PCIe card) - the ONLY place Intel states per-port scale-up and scale-out bandwidth separately: 21x 200 GbE card-to-card vs 3x 200 GbE scale-out
whitepaperIntelsources/w7f-intel-gaudi3-paper-t4-scaleup-vs-scaleout-port-split
verifiedhigh · 0.95
Intel Gaudi AI Accelerator products page
spec-sheetIntelsources/asic-intel-gaudi-product
verifiedhigh · 0.90
Intel Gaudi Optimizing Training Platform Guide
spec-sheetIntelsources/xpu-habana-optimization-guide
verifiedhigh · 0.90
Intel Gaudi PyTorch Bridge README
repoHabanaAIsources/xpu-gaudi-pytorch-bridge-readme
verifiedhigh · 0.88
Intel Level Zero Specification
spec-sheetIntelsources/src5-intel-level-zero-spec
verifiedhigh · 0.90
Intel Neural Compressor GitHub README
repoIntelsources/qlab2-neural-compressor-readme
verifiedhigh · 0.90
Intel Xeon 6787P specifications
spec-sheetIntelsources/intel-xeon-6787p-spec
verifiedhigh · 0.90
Intel Xeon 6788P specifications
spec-sheetIntelsources/intel-xeon-6788p-spec
verifiedhigh · 0.90
Intel Xeon 6972P specifications
spec-sheetIntelsources/intel-xeon-6972p-spec
verifiedhigh · 0.90
Intel Xeon 6980P specifications
spec-sheetIntelsources/intel-xeon-6980p-spec
verifiedhigh · 0.90
Intel: Accelerating LLM Inference on Intel Data Center GPUs using BigDL-LLM (ID 816988)
benchmarkIntelsources/intel-bigdl-llm-flex170-max-llm-inference
verifiedlow · 0.60
Intel: Performance Data for Intel Data Center GPU Flex Series 170 (OpenVINO/TF/PyTorch CV table)
benchmarkIntelsources/intel-flex170-ai-perf-table
verifiedmedium · 0.75
intel/ipex-llm issue #12991: Intel Arc B580 llama-bench Vulkan vs SYCL vs IPEX-LLM token-generation tables
forumIntel IPEX-LLM (GitHub, archived 2026-01-28)sources/gh-intel-ipex-llm-12991-arc-b580-llama-bench
verifiedmedium · 0.70
internlm/Intern-S2-397B config.json
repoShanghai AI Laboratory (InternLM)sources/hf-intern-s2-397b-config
verifiedhigh · 0.90
internlm/Intern-S2-397B model card
repoShanghai AI Laboratory (InternLM)sources/hf-intern-s2-397b-card
verifiedmedium · 0.84
InternVL-X: Advancing and Accelerating InternVL Series with Efficient Visual Token Compression (arXiv:2503.21307)
paperarXivsources/pap-mm-internvl-x
verifiedhigh · 0.90
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks (arXiv:2312.14238)
paperarXivsources/pap-mm-internvl
verifiedhigh · 0.90
InternVL2_5-8B config.json (HuggingFace)
repoHuggingFace / OpenGVLabsources/hf-mm-internvl2-5-8b-config
verifiedhigh · 0.95
InternVL3-14B config.json (HuggingFace)
repoHuggingFace / OpenGVLabsources/hf-mm-internvl3-14b-config
verifiedhigh · 0.95
InternVL3-8B config.json (HuggingFace)
repoHuggingFace / OpenGVLabsources/hf-mm-internvl3-8b-config
verifiedhigh · 0.95
intfloat/e5-base-v2 config.json
repoHugging Facesources/hf-embed-e5-base-v2
verifiedhigh · 0.88
intfloat/e5-large-v2 config.json
repoHugging Facesources/hf-embed-e5-large-v2
verifiedhigh · 0.88
intfloat/e5-mistral-7b-instruct config.json
repoHugging Facesources/hf-embed-e5-mistral-7b-instruct
verifiedhigh · 0.88
Introducing Gemma 3: The Developer Guide
blogGooglesources/model-fr-google-gemma-3-guide
verifiedhigh · 0.90
Introducing gpt-oss
blogOpenAIsources/model-fr-openai-gpt-oss-blog
verifiedhigh · 0.90
Introducing NVFP4 for Efficient and Accurate Low-Precision Inference
blogNVIDIAsources/bw-nv-nvfp4-inference-blog
verifiedhigh · 0.90
Introducing NVFP4 for Efficient and Accurate Low-Precision Inference
blogNVIDIAsources/quant-nvfp4-blog
verifiedhigh · 0.90
Introducing the AMD CDNA 2 Architecture (white paper)
whitepaperAMDsources/link2-amd-cdna2-whitepaper
verifiedhigh · 0.90
Introducing v0.5 of the AI Safety Benchmark from MLCommons (arXiv 2404.12241)
paperarXiv (MLCommons)sources/meth-ai-safety-benchmark-v05-arxiv
verifiedhigh · 0.85
IREE: Intermediate Representation Execution Environment
repoIREE Project / LF AI & Data Foundationsources/iree-intermediate-representation-execution-environment
verifiedhigh · 0.85
IST-DASLab/marlin: FP16xINT4 LLM inference kernel
repoIST-DASLabsources/quant-marlin-repo
verifiedhigh · 0.90
IST-DASLab/qmoe - CUDA kernels and compression code for QMoE
repoIST-DASLabsources/repo-ist-daslab-qmoe
verifiedhigh · 0.85
IT Creations NVIDIA GPU and accelerator catalogue
databaseIT Creationssources/sup-used-itcreations-gpu
verifiedlow · 0.60
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models (NeurIPS 2024 Datasets and Benchmarks)
paperStandardised jailbreak evaluation with a defined threat model, fixed system prompts and chat templates, 100 behaviours, and a leaderboard tracking attacks AND defences. Also ships an over-refusal dataset - the metric that makes the cost of an output filter measurable.sources/sec-arxiv-2404-01318
verifiedhigh · 0.90
Jamba-1.5-Large Q2_K GGUF header (mradermacher conversion)
repomradermacher (conversion of ai21labs/AI21-Jamba-Large-1.5)sources/gguf-jamba-1-5-large-q2k
verifiedhigh · 0.90
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
paperAI21 Labs (arXiv)sources/arch-jamba-15
verifiedhigh · 0.92
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
paperarXivsources/pap-arch-2408-12570
verifiedhigh · 0.90
Jamba: A Hybrid Transformer-Mamba Language Model
paperAI21 Labs (arXiv)sources/arch-jamba
verifiedhigh · 0.92
Jan GitHub repo
repoJan (janhq)sources/cpuedge-jan-github
verifiedhigh · 1.00
JetBrains/Mellum2.1-12B-A2.5B-Thinking config.json
repoJetBrainssources/hf-mellum2-1-12b-a2-5b-thinking-config
verifiedhigh · 0.95
JetBrains/Mellum2.1-12B-A2.5B-Thinking model card
repoJetBrainssources/hf-mellum2-1-12b-a2-5b-thinking-card
verifiedhigh · 0.90
JetStream README (archived notice)
repoGoogle AI Hypercomputersources/alt-jetstream-readme
verifiedhigh · 0.95
jinaai/jina-embeddings-v3 config.json
repoHugging Facesources/hf-embed-jina-embeddings-v3
verifiedhigh · 0.88
jinaai/jina-embeddings-v4 config.json
repoHugging Facesources/hf-embed-jina-embeddings-v4
verifiedhigh · 0.88
jinaai/jina-reranker-v2-base-multilingual config.json
repoHugging Facesources/hf-embed-jina-reranker-v2-base-multilingual
verifiedhigh · 0.88
jordanpaulee/local-agent-lab: RX 9070 XT ROCm vs Vulkan backend experiment (Ollama, qwen3:8b Q4_K_M)
repojordanpaulee (GitHub)sources/gh-jordanpaulee-rx9070xt-rocm-vs-vulkan
verifiedmedium · 0.80
JSONSchemaBench: A Rigorous Benchmark of Structured Outputs for Language Models (arXiv:2501.10868)
blogsources/pap-eff-jsonschemabench
verifiedmedium · 0.75
JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols
paperExtraction targeting an LLM used as a judge - the safety/moderation model itself is IP worth stealing. Reaches up to 73.3%, 87.0% and 71.6% accuracy for pointwise, pairwise and listwise protocols respectively, using cross-protocol agreement to manufacture extra supervision without extra victim queries.sources/sec-arxiv-2608-26982
verifiedhigh · 0.90
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (arXiv 2306.05685)
paperarXiv (UC Berkeley / LMSYS)sources/meth-llm-as-judge-mt-bench-arxiv
verifiedhigh · 0.90
K2-Horizon-MoVA-36B-A4B config.json
repoIFMsources/k2-horizon-mova-36b-a4b-config-json
verifiedhigh · 0.90
K2-Horizon-MoVA-36B-A4B model card
repoIFMsources/k2-horizon-mova-36b-a4b-model-card
verifiedmedium · 0.80
KEDA Scaling Deployments documentation
whitepaperKEDAsources/serve-keda-docs
verifiedhigh · 0.90
Kimi K2: Open Agentic Intelligence (arXiv:2507.20534)
whitepaperarXiv / Moonshot AIsources/model-cn-kimi-k2-paper
verifiedhigh · 0.95
Kimi K3 model card and nested text config (huggingface.co/moonshotai)
release-notesMoonshot AIsources/model-cn-kimi-k3-card
verifiedhigh · 0.85
Kimi Linear: An Expressive, Efficient Attention Architecture
paperMoonshot AI (arXiv)sources/arch-kimi-linear
verifiedhigh · 0.92
Kimi Linear: An Expressive, Efficient Attention Architecture
paperarXivsources/pap-arch-2510-26692
verifiedhigh · 0.90
Kimi Linear: An Expressive, Efficient Attention Architecture
paperarXivsources/pap-attn-kimi-linear
verifiedhigh · 0.90
Kimi Linear: An Expressive, Efficient Attention Architecture (arXiv:2510.26692)
papersources/kimi-linear-tech-report
verifiedmedium · 0.80
Kimi Linear: An Expressive, Efficient Attention Architecture (arXiv:2510.26692)
whitepaperarXiv / Moonshot AIsources/model-cn-kimi-linear-paper
verifiedhigh · 0.95
Kimi-Audio-7B-Instruct config.json (HuggingFace)
repoHuggingFace / Moonshot AIsources/hf-mm-kimi-audio-7b-config
verifiedhigh · 0.95
Kimi-K3 model card (Section 3: Evaluation Results)
reposources/hf-moonshotai-kimi-k3
verifiedmedium · 0.80
Kinara Inc Official Domain Probe (404 Not Found)
spec-sheetKinara Incsources/ainv-kinara-probe
verifiedmedium · 0.70
KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
paperarXivsources/flop2-kivi
verifiedhigh · 0.90
KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache (Yuan et al., LMSYS)
paperarXivsources/qlab-kivi-paper
verifiedhigh · 0.88
Knockoff Nets: Stealing Functionality of Black-Box Models
paperFunctionality stealing from query access alone, with no knowledge of training data, model internals or output semantics. Vision results, but the threat model - black-box query access is sufficient - is what transfers to a served LLM.sources/sec-arxiv-1812-02766
verifiedhigh · 0.90
KoboldCpp GitHub repo
repoLostRuins / KoboldAIsources/cpuedge-koboldcpp-github
verifiedhigh · 1.00
Koyeb GPU LLM Benchmarks (vLLM benchmarking cli)
benchmarkKoyebsources/koyeb-gpu-benchmarks-vllm-cli
verifiedmedium · 0.70
KServe documentation - LLMInferenceService overview (GenAI-first CRD built on llm-d)
whitepaperKServe (CNCF incubating as of 2025-11-11)sources/dep-kserve-llmisvc-overview
verifiedhigh · 0.93
KServe GitHub repository
repoKServesources/serve-kserve-github
verifiedhigh · 0.95
KServe KEDA autoscaling documentation
whitepaperKServesources/serve-kserve-keda-autoscaling
verifiedhigh · 0.85
KServe LLMInferenceService autoscaling with the Workload Variant Autoscaler (WVA)
repoKServesources/ops-kserve-llmisvc-autoscaling
verifiedhigh · 0.90
KServe LLMInferenceService documentation
whitepaperKServesources/serve-kserve-docs-llmisvc
verifiedhigh · 0.90
KServe v0.21.0 release notes
release-notesKServesources/serve-kserve-release-notes
verifiedhigh · 0.90
KTransformers GitHub repository
repokvcache-aisources/engine-ktransformers-github
verifiedhigh · 0.95
KTransformers README: prefix cache, GLM-5.3-flash multimodal on consumer GPUs (read 2026-10-04)
blogkvcache-aisources/ev-ktransformers-readme-feature-axes
verifiedhigh · 0.90
Kubernetes documentation - Schedule GPUs
whitepaperKubernetes projectsources/dep-k8s-schedule-gpus-docs
verifiedhigh · 0.96
Kubernetes documentation - Taints and Tolerations
whitepaperKubernetes projectsources/dep-k8s-taints-tolerations-docs
verifiedhigh · 0.96
Kubernetes Horizontal Pod Autoscaling documentation
whitepaperKubernetessources/serve-k8s-hpa-docs
verifiedhigh · 0.95
Kuhaku413/rocm-inference-bench — AMD MI250X / MI300X vs CUDA LLM inference table
repoKuhaku413 (GitHub)sources/kuhaku413-rocm-inference-bench
verifiedlow · 0.35
KVQuant HTML: nuq3-1% perplexity, passkey, and A6000 kernel latency (arXiv:2401.18079v6)
paperarXivsources/kvquant-html-nuq3-ppl-a6000
verifiedhigh · 0.90
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization (arXiv:2401.18079)
paperarXivsources/mkt-kvquant-neurips2024
verifiedhigh · 0.95
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization (Hooper et al.)
paperarXivsources/qlab-kvquant-paper
verifiedhigh · 0.88
kyuz0 AMD Strix Halo toolboxes — llama-bench results.json (pp512/tg128 across ROCm 6.4.4/7.2.3/7-nightlies + Vulkan AMDVLK/RADV)
benchmarkkyuz0 (Strix Halo community)sources/kyuz0-strix-halo-toolboxes-llamabench-results-json
verifiedlow · 0.50
kyuz0 amd-strix-halo-toolboxes building.md retained-PM4 measured llama-server flags
repoDonato Capitella (kyuz0)sources/kyuz0-strix-toolboxes-building-md-retained-pm4
verifiedmedium · 0.70
kyuz0 amd-strix-halo-toolboxes results.json — 554 llama-bench pp512/tg128 runs, 5 backend envs, builds 9187/9193, Ryzen AI Max+ 395 (gfx1151)
benchmarkkyuz0 / AMD Strix Halo toolboxessources/kyuz0-strix-halo-toolbox-results-json
verifiedmedium · 0.70
Lambda AI cloud pricing - GPU instances and 1-Click Clusters
databaseLambda AIsources/sup-cloud-lambda-gpu-pricing
verifiedhigh · 0.97
Lambda Inference API wind-down notice (lambda.ai/inference)
release-notesLambdasources/svc-src-lambda-inference-winddown-2026-10-15
verifiedhigh · 0.90
Large Language Diffusion Models (LLaDA)
paperNie et al. (arXiv)sources/arch-llada
verifiedhigh · 0.92
Large Language Diffusion Models (LLaDA)
paperarXivsources/pap-arch-2502-09992
verifiedhigh · 0.90
Large Language Models Cannot Self-Correct Reasoning Yet (arXiv:2310.01798)
blogsources/pap-eff-llms-cannot-self-correct
verifiedhigh · 0.85
Large Language Monkeys: Scaling Inference Compute with Repeated Sampling (arXiv:2407.21787)
paperarXivsources/mkt-large-language-monkeys
verifiedhigh · 0.90
LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding (arXiv:2404.16710)
blogsources/pap-eff-layerskip
verifiedhigh · 0.85
LeaderWorkerSet (LWS) and DisaggregatedSet - Kubernetes SIGs README
repoKubernetes SIGs (lws), co-designed with llm-d (CNCF sandbox)sources/dep-k8s-lws-readme
verifiedhigh · 0.93
Learnable Linguistic Watermarks for Tracing Model Extraction Attacks on Large Language Models
paperWatermarking aimed at TRACING the extractor rather than the reader: controlled noise in the token frequency distribution plus a KL-divergence test to tell original from modified distributions.sources/sec-arxiv-2405-01509
verifiedhigh · 0.90
Learning to Compress Prompts with Gist Tokens
paperarXivsources/pap-attn-gist-tokens
verifiedhigh · 0.95
Learning Transferable Visual Models From Natural Language Supervision (CLIP) (arXiv:2103.00020)
paperarXivsources/pap-mm-clip
verifiedhigh · 0.90
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
paperarXivsources/pap-attn-infini-attention
verifiedhigh · 0.85
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention (arXiv:2404.07143)
blogsources/pap-eff-infini-attention
verifiedmedium · 0.75
Lemonade API reference
repolemonade-sdk (AMD)sources/cpuedge-lemonade-api
verifiedhigh · 1.00
Lemonade GitHub repo
repolemonade-sdk (AMD)sources/cpuedge-lemonade-github
verifiedhigh · 1.00
Let's Verify Step by Step (arXiv:2305.20050)
blogsources/pap-eff-verify-step-by-step
verifiedhigh · 0.85
Level1Techs forum — Intel Arc Pro B70 x4 vs RTX 3090 x4, vLLM Qwen3.5-27B 50-concurrent-request throughput + TTFT
forumLevel1Techs forumsources/level1techs-intel-b70-vs-rtx3090-vllm-50req
verifiedmedium · 0.70
LFM2.5-24B-A2B: Built for Fast On-Device Agents
blogsources/lfm2-5-24b-a2b-blog
verifiedmedium · 0.80
lhl/strix-halo-testing llm-bench — context sweeps + DGX Spark vs Strix Halo comparison (ROCm rocWMMA / Vulkan AMDVLK-RADV)
repoLee Henderson (lhl) / Framework pre-production clustersources/lhl-strix-halo-testing-llm-bench
verifiedlow · 0.50
lhl/strix-halo-testing llm-bench — Vulkan AMDVLK long-context sweep on Strix Halo (gpt-oss-120b)
repolhl (Larry)sources/lhl-strix-halo-testing-llm-bench-amdvlk-longctx
verifiedmedium · 0.75
lhl/strix-halo-testing llm-bench summary tables — per-model pp512/tg128 on Framework Desktop (Ryzen AI Max+ 395, 128GB LPDDR5x-8000), best-backend-per-model
benchmarklhl (Framework pre-production unit)sources/lhl-strix-halo-llm-bench-summary-table
verifiedmedium · 0.70
lhl/strix-halo-testing README — Strix Halo vs DGX Spark gpt-oss-120b llama.cpp b6792 pp2048/tg32 depth sweep (Vulkan AMDVLK/RADV, ROCm rocWMMA + tuned)
repolhl (GitHub)sources/lhl-strix-halo-testing-strix-vs-spark-readme
verifiedmedium · 0.70
LightLLM GitHub repository
repoModelTCsources/niche-lightllm-repo
verifiedhigh · 0.90
Lightmatter Passage L20 Product Page and Technical Specifications
spec-sheetLightmattersources/lightmatter-passage-l20-spec
verifiedhigh · 0.90
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
paperarXivsources/pap-arch-2401-04658
verifiedhigh · 0.90
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
paperarXivsources/pap-attn-lightning-attention-2
verifiedhigh · 0.85
Linear Transformers Are Secretly Fast Weight Programmers
paperarXivsources/pap-arch-2102-11174
verifiedhigh · 0.90
Linformer: Self-Attention with Linear Complexity
paperarXivsources/pap-attn-linformer
verifiedhigh · 0.90
Ling-3.0-flash model card and config (huggingface.co/inclusionAI)
release-notesAnt Group / inclusionAIsources/model-cn-ling-3-card
verifiedhigh · 0.85
Link-health triage for data/sources/ on 2026-10-04 - live/redirected/blocked counts and the two-probe rule that kept 70 URLs out of the dead list
databaseNVIDIAsources/w3s-live-blocked-and-redirect-triage-2026-10-04
verifiedhigh · 0.90
LiquidAI/LFM2-1.2B config.json
repoHugging Facesources/hf-edge-lfm2-1-2b
verifiedhigh · 0.88
LiquidAI/LFM2-1.2B config.json
repoHugging Facesources/mbl-cfg-lfm2-1-2b
verifiedhigh · 0.90
LiquidAI/LFM2.5-1.2B-Instruct config.json
repoHugging Facesources/hf-edge-lfm2-5-1-2b-instruct
verifiedhigh · 0.88
LiquidAI/LFM2.5-24B-A2B · Hugging Face
reposources/lfm2-5-24b-a2b-hf
verifiedmedium · 0.80
LiquidAI/LFM2.5-24B-A2B model card and config.json
repoLiquid AIsources/hf-lfm2-5-24b-a2b
verifiedhigh · 0.90
LiquidStack - CDU-1MW and GigaModular CDU product pages (published rack-density ceilings for liquid cooling)
spec-sheetLiquidStacksources/pwr2-liquidstack-cdu
verifiedmedium · 0.80
LiteLLM GitHub repo
repoBerri AIsources/cpuedge-litellm-github
verifiedhigh · 1.00
LiteLLM issue #35582 - aresponses silently drops the stop param (no UnsupportedParamsError, no warning)
forumLiteLLM (reporter: gateway user)sources/dep-litellm-35582-responses-drops-stop
verifiedhigh · 0.95
LiteLLM issue #41913 - tool and instruction fields dropped in translation, HTTP 200, no signal to caller
forumLiteLLM (reporter: gateway user)sources/dep-litellm-41913-fields-dropped-in-translation
verifiedhigh · 0.95
LiteLLM LICENSE
repoBerri AIsources/cpuedge-litellm-license
verifiedhigh · 1.00
LiteLLM litellm/integrations/otel/model/spans.py - the declared span roles and hierarchy
repoBerriAIsources/w5e-litellm-otel-span-model
verifiedhigh · 0.92
LiteLLM Proxy - quick start documentation
whitepaperLiteLLM (Berri AI)sources/dep-litellm-proxy-quickstart-docs
verifiedhigh · 0.92
LiteLLM Proxy - Virtual keys, budgets and rate limits documentation
whitepaperLiteLLM (Berri AI)sources/dep-litellm-virtual-keys-docs
verifiedhigh · 0.92
LiteRT (TFLite successor) GitHub Repository
repoGooglesources/local-litert-github
verifiedhigh · 0.85
LLaDA project page
blogML-GSAIsources/hf-eco-llada-demo
verifiedhigh · 0.95
Llama 4 Scout model card
spec-sheetMetasources/model-fr-meta-llama-4-scout-card
verifiedhigh · 0.90
Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations
paperQuantised 440 MB guard (about 7x smaller than Llama Guard 3-1B) reaching at least 30 tokens/s and TTFT of 2.5 s or less on a commodity Android mobile CPU, with comparable or superior moderation scores. Useful as the LOW BOUND on guard-model cost: even the smallest published guard adds seconds, not milliseconds.sources/sec-arxiv-2411-17713
verifiedhigh · 0.90
Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations (arXiv:2411.17713)
blogsources/pap-eff-llama-guard-3-1b-int4
verifiedmedium · 0.75
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
paperThe canonical separate-guard-model design: one safety taxonomy, one model, applied to the prompt and to the response. Establishes that the guard is a second model in the request path, not a flag.sources/sec-arxiv-2312-06674
verifiedhigh · 0.90
Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations (arXiv:2312.06674)
blogsources/pap-eff-llama-guard
verifiedmedium · 0.75
Llama-2-13B Hugging Face config.json (raw)
repoMeta / Hugging Facesources/fct2-hf-config-llama2-13b
verifiedhigh · 0.90
Llama-2-70b-hf config.json (open mirror)
repoHugging Facesources/flop2-llama2-70b-config
verifiedhigh · 0.90
Llama-2-7b-hf config.json (open mirror)
repoHugging Face hub (NousResearch mirror of Meta Llama-2-7b-hf)sources/flop2-llama2-7b-config
verifiedhigh · 0.90
Llama-3.3-70B-Instruct config.json
repoHugging Face (unsloth mirror of Meta weights)sources/model-fr-hf-config-llama-3-3-70b
verifiedhigh · 0.90
Llama-4-Maverick-17B-128E-Instruct config.json
repoHugging Facesources/mbl-cfg-llama-4-maverick
verifiedhigh · 0.90
Llama-4-Maverick-17B-128E-Instruct config.json
repoHugging Face (unsloth mirror of Meta weights)sources/model-fr-hf-config-llama-4-maverick
verifiedhigh · 0.90
Llama-4-Scout-17B-16E-Instruct config.json
repoHugging Face (unsloth mirror of Meta weights)sources/model-fr-hf-config-llama-4-scout
verifiedhigh · 0.90
llama.cpp build documentation
repoggml-orgsources/engine-llamacpp-build
verifiedhigh · 0.95
llama.cpp Discussion #10879 — Performance of llama.cpp with Vulkan (community scoreboard)
forumGitHub / ggml-orgsources/llama-cpp-discussion-10879-vulkan-scoreboard
verifiedlow · 0.50
llama.cpp Discussion #12570: Current status of Intel Arc GPUs for llama.cpp
forumggml-org / llama.cppsources/llamacpp-discussion-12570-intel-arc
verifiedmedium · 0.80
llama.cpp Discussion #15013 — Performance of llama.cpp on Nvidia CUDA (community scoreboard)
forumGitHub / ggml-orgsources/llama-cpp-discussion-15013-nvidia-cuda-scoreboard
verifiedlow · 0.50
llama.cpp Discussion #15021 — Performance of llama.cpp on AMD ROCm/HIP (community scoreboard)
forumGitHub / ggml-orgsources/llama-cpp-discussion-15021-amd-rocm-scoreboard
verifiedlow · 0.50
llama.cpp discussion #19480: CPU/server inference thread (EPYC 9454P, Ryzen HX 370 rows)
forumllama.cpp communitysources/llama-cpp-discussion-19480-cpu-server-inference-thread-epyc-9454
verifiedlow · 0.60
llama.cpp ggml-quants.c dequantize_row_* kernels (authoritative scale-group sizes)
repoggml-orgsources/qzgw-ggml-quants-kernel
verifiedhigh · 0.95
llama.cpp GitHub repository README
repoggml-orgsources/engine-llamacpp-github
verifiedhigh · 0.95
llama.cpp has no paper - honest negative, verified against arXiv and OpenReview 2026-10-04
repoggml-org / llama.cppsources/w3p-llamacpp-no-paper-negative
verifiedhigh · 0.90
llama.cpp HTTP server README (embedding pooling + rerank)
repoggml-orgsources/embed-llamacpp-server-readme
verifiedhigh · 0.85
llama.cpp issue #11559: Vulkan Q4_K_M inference speed degradation
forumllama.cpp GitHub issuessources/gotcha-llamacpp-issue-11559-vulkan-q4km-regression
verifiedhigh · 0.90
llama.cpp issue #18808: totally broken for agentic use on Intel dGPUs (Arc Pro B50 Battlemage)
forumllama.cpp GitHub issuessources/gotcha-llamacpp-issue-18808-intel-dgpu-agentic-stall
verifiedhigh · 0.90
llama.cpp issue #20702: compile bug, c++: error: unrecognized command-line option '-fsycl'
forumllama.cpp GitHub issuessources/gotcha-llamacpp-issue-20702-fsycl-build-failure
verifiedhigh · 0.90
llama.cpp issue #21006: PR #20908 broke multi-host rpc-server tensor-split balancing - the client loads the model only on the RPC workers and nothing on the local machine
forumllama.cpp GitHub issuessources/comm-github-llamacpp-21006-rpc-tensor-split-regression
verifiedmedium · 0.75
llama.cpp issue #21517: Q8_0 and IQ4_NL decode 4x slower than Q4_0 on Intel Arc Pro B70
forumggml-org/llama.cppsources/noncuda-llamacpp-21517-sycl-q8-reorder
verifiedhigh · 0.85
llama.cpp issue #24168: SYCL gibberish output and ggml_sycl_op_mul_mat crash on hybrid models with Arc Pro B60
forumggml-org/llama.cppsources/noncuda-llamacpp-24168-sycl-b60-hybrid-crash
verifiedhigh · 0.85
llama.cpp issue #25207: unexpected massive performance drop with Vulkan Flash Attention
forumllama.cpp GitHub issuessources/gotcha-llamacpp-issue-25207-vulkan-fa-slowdown
verifiedhigh · 0.90
llama.cpp issue #25618: speculative decoding (draft-mtp / draft-dspark) greedy output diverges from vanilla on quantized targets
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-25618-spec-quant-greedy-divergence
verifiedhigh · 0.90
llama.cpp issue #26100: speculative draft-cache replay bypasses p_min, inflating repeated-prompt benchmarks ~10x and degrading mixed-traffic serving ~3x
forumllama.cppsources/ev-llamacpp-issue-26100-spec-benchmark-inflates-10x
verifiedhigh · 0.90
llama.cpp issue #26208: ROCm backend allocates host RAM instead of VRAM on gfx1201
forumggml-org/llama.cppsources/noncuda-llamacpp-26208-rocm-gfx1201-vram
verifiedhigh · 0.85
llama.cpp issue #26529: with the RPC backend active, llama-server aborts inside rpc_buffer_get_tensor the first time a slot prompt becomes eligible for prompt-cache save
forumllama.cpp GitHub issuessources/comm-github-llamacpp-26529-rpc-prompt-cache-abort
verifiedmedium · 0.80
llama.cpp issue #26663: Vulkan token generation 5-7x slower than HIP on gfx1201 for models with hidden_size >= 4096
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-26663-vulkan-hidden-size-cliff
verifiedhigh · 0.90
llama.cpp issue #27050: backend sampling (-bs) gives +48% throughput at 32 slots; default path copies the whole logits matrix D2H every decode step
forumggml-org/llama.cpp GitHub issuessources/flop3-llamacpp-issue-27050-backend-sampling
verifiedhigh · 0.90
llama.cpp issue #27097: Vulkan slow token generation with AMD dGPU Resizable BAR disabled
forumggml-org/llama.cppsources/noncuda-llamacpp-27097-rebar-vulkan-slow
verifiedhigh · 0.85
llama.cpp issue #27178: NVFP4-to-GGUF conversion drops most NVFP4 scales; model loads (or fails) then emits one repeated token
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-27178-nvfp4-gguf-scales-dropped
verifiedhigh · 0.90
llama.cpp issue #27198: SYCL --split-mode tensor crashes with DEVICE_LOST on dual Arc Pro B70
forumggml-org/llama.cppsources/noncuda-llamacpp-27198-sycl-dual-b70-device-lost
verifiedhigh · 0.85
llama.cpp issue #27506: ROCm backend severe PPL explosion starting from b10040
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-27506-rocm-ppl-explosion
verifiedhigh · 0.90
llama.cpp issue #27579: HIP/ROCm backend produces corrupted output on gfx1151 while Vulkan is correct with byte-identical flags
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-27579-hip-gfx1151-corrupt-output
verifiedhigh · 0.90
llama.cpp issue #27623: Qwen3.8-27B hybrid Gated DeltaNet decode collapses ~25x past ~80K context while pp stays fast
forumllama.cpp GitHub issuessources/gotcha-llamacpp-issue-27623-gated-deltanet-decode-collapse
verifiedhigh · 0.90
llama.cpp issue #27734: ~78% Vulkan decode cliff at 131072 context from suballocation fragmentation
forumggml-org/llama.cppsources/noncuda-llamacpp-27734-vulkan-suballoc-cliff
verifiedhigh · 0.85
llama.cpp issue #27761: ROCm flash-attention only works with q8_0/q8_0 and q4_0/q4_0 KV cache
forumggml-org/llama.cppsources/noncuda-llamacpp-27761-rocm-fa-kv-graph-splits
verifiedhigh · 0.85
llama.cpp issue #28107: llama-bench Metal OOM failure when model exceeds recommendedMaxWorkingSetSize on Apple Silicon
repoggml-org / communitysources/src-github-llamacpp-issue-28107
verifiedhigh · 0.85
llama.cpp issue #28134: SYCL backend aborts at model load when the device memory query fails
forumggml-org/llama.cppsources/noncuda-llamacpp-28134-sycl-lunar-lake-memquery
verifiedhigh · 0.85
llama.cpp issue #28211: HIP/ROCm on gfx1151 produces wrong logits (not a crash) for prompts longer than n_ubatch
forumllama.cpp GitHub issuessources/qgotcha-llamacpp-28211-hip-ubatch-wrong-logits
verifiedhigh · 0.90
llama.cpp issue #28515: SYCL device memory query aborts on Intel Arc Pro B60 (Battlemage)
forumggml-org/llama.cppsources/noncuda-llamacpp-28515-sycl-b60-memquery
verifiedhigh · 0.85
llama.cpp issue #28676: silent output corruption with HIP multi-GPU on Windows 11
forumggml-org/llama.cppsources/noncuda-llamacpp-28676-windows-hip-multigpu-corruption
verifiedhigh · 0.85
llama.cpp issue #29623: Vulkan ErrorDeviceLost on AMD Radeon AI PRO R9700 only when SAM/ReBAR is enabled
forumggml-org/llama.cppsources/noncuda-llamacpp-29623-vulkan-rebar-device-lost
verifiedhigh · 0.85
llama.cpp issue 28185: --tensor-split causes intermittent output degeneration on long-context MoE inference
repoggml-org/llama.cppsources/mgpu-llamacpp-28185-tensor-split-degeneration
verifiedhigh · 0.85
llama.cpp LICENSE — MIT License
repoggml-orgsources/meth-llamacpp-license-mit
verifiedhigh · 0.95
llama.cpp llama-arch.cpp architecture-class classification functions (recurrent / hybrid / diffusion / rs-rollback / sm-tensor)
repoggml-orgsources/mdl2-llamacpp-arch-class-registry
verifiedhigh · 0.90
Llama.cpp Meets Instinct: A New Era of Open-Source AI Acceleration (ROCm Blogs)
benchmarkAMDsources/bench-amd-llama-cpp-mi300x-deepseek
verifiedhigh · 0.85
llama.cpp MMQ kernel-family selection (ggml_cuda_mmq_get_config) and the GGML_CUDA_CC_BLACKWELL=1200 / BLACKWELL_MMA_AVAILABLE definitions: MXFP4/NVFP4 are WIDE-ARCH integer paths on CUDA and native FP4 only on sm120+
repoggml-org (llama.cpp)sources/w6q-llamacpp-mmq-fp4-blackwell-2026-10
verifiedhigh · 0.95
llama.cpp PR #15550: quantize --target-bpw, arguing that same-named quants are not a controlled comparison because bpw differs
repollama.cpp GitHubsources/qgotcha-llamacpp-15550-target-bpw-bpw-confound
verifiedhigh · 0.90
llama.cpp PR #25532: Backend sampling multi output (extends -bs to speculative decoding)
repoggml-org/llama.cppsources/flop3-llamacpp-pr-25532-backend-sampling
verifiedhigh · 0.85
llama.cpp server documentation
repoggml-orgsources/engine-llamacpp-server
verifiedhigh · 0.95
llama.cpp server README - --metrics default disabled, /metrics behaviour, and the /slots alternative
repoggml-orgsources/w3m-llamacpp-metrics-flag-default-off
verifiedhigh · 0.95
llama.cpp server-task.cpp to_metrics() - the hand-built counter/gauge tables
repoggml-orgsources/w3m-llamacpp-metrics-handbuilt-typing
verifiedhigh · 0.95
llama.cpp src/llama-arch.cpp model architecture registry (master branch)
repoggml-orgsources/pap-arch-llamacpp-arch-registry
verifiedhigh · 0.95
llama.cpp src/llama-grammar.cpp (master) - per-token grammar acceptance on the host
repoggml-org/llama.cppsources/flop3-llamacpp-grammar-source
verifiedhigh · 0.85
llama.cpp src/llama-quant.cpp (llama_ftype to tensor-type mapping and per-tensor promotion rules)
repoggml-orgsources/qzgw-llama-quant-cpp
verifiedhigh · 0.95
llama.cpp src/llama-quant.cpp (llama_tensor_get_type_impl)
repoggml-orgsources/qlab2-llama-quant-cpp
verifiedhigh · 0.90
llama.cpp src/llama-sampler.cpp (master) - host-side sampler chain and full-vocabulary candidate walk
repoggml-org/llama.cppsources/flop3-llamacpp-sampler-source
verifiedhigh · 0.85
llama.cpp src/llama-vocab.cpp (master) - token_to_piece and the per-token piece cache
repoggml-org/llama.cppsources/flop3-llamacpp-vocab-source
verifiedmedium · 0.80
llama.cpp SYCL backend documentation
repoggml-orgsources/llama-cpp-sycl-backend-doc
verifiedhigh · 0.85
llama.cpp SYCL Backend Documentation
spec-sheetggml-orgsources/xpu-llamacpp-sycl-docs
verifiedhigh · 0.90
llama.cpp tools/imatrix/README.md
repoggml-orgsources/qlab2-imatrix-readme
verifiedhigh · 0.90
llama.cpp tools/quantize README
repoggml-orgsources/quant-llamacpp-quantize-readme
verifiedhigh · 0.90
llama.cpp tools/quantize/quantize.cpp QUANT_OPTIONS table
repoggml-orgsources/qlab2-quantize-options-table
verifiedhigh · 0.90
llama.cpp tools/rpc/README.md: the RPC backend is labelled proof-of-concept, fragile and insecure
repollama.cpp upstream repositorysources/comm-llamacpp-rpc-upstream-readme
verifiedhigh · 0.90
llama.cpp tools/server/README.md: llama-server feature and flag surface (read 2026-10-04)
blogllama.cppsources/ev-llamacpp-server-readme-feature-axes
verifiedhigh · 0.90
llamabench.ai — crowd-sourced llama.cpp result database (per-model decode/prefill rows)
databasellamabench.ai (community submissions)sources/llamabench-ai-crowdsourced-llama-cpp-results
verifiedlow · 0.55
llamafile GitHub repo
repoMozilla AI (mozilla-ai)sources/cpuedge-llamafile-github
verifiedhigh · 1.00
llamafile Supported Systems docs
repoMozilla AI (mozilla-ai)sources/cpuedge-llamafile-support-docs
verifiedhigh · 1.00
llamafile Supported Systems docs (IQ-quants on NVIDIA section)
repoMozilla AI (mozilla-ai)sources/qlab2-llamafile-support-docs
verifiedhigh · 0.90
LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models (arXiv:2407.07895)
paperarXivsources/pap-mm-llava-next
verifiedhigh · 0.90
llava-onevision-qwen2-7b-ov-hf config.json (HuggingFace)
repoHuggingFace / llava-hfsources/hf-mm-llava-onevision-qwen2-7b-config
verifiedhigh · 0.95
LLaVA-OneVision: Easy Visual Task Transfer (arXiv:2408.03326)
paperarXivsources/pap-mm-llava-onevision
verifiedhigh · 0.90
LLM in a flash - ACL Anthology record 2024.acl-long.678
paperAssociation for Computational Linguisticssources/w3p-llm-in-a-flash-acl24
verifiedhigh · 0.92
LLM Inference Performance Engineering: Best Practices for Tuning Decoding
blogDatabricks (MosaicML engineering team)sources/bench-meth-databricks-inference-tuning
verifiedhigh · 0.85
LLM Inference Unveiled: Survey and Roofline Model Insights
paperarXiv (Yuan, Shang, Zhou et al.)sources/flop-llm-inference-roofline-survey
verifiedhigh · 0.90
LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
paperarXivsources/pap-attn-selfextend
verifiedhigh · 0.95
llm-d Autoscaling overview (WVA deprecation and capability gaps against KEDA + EPP)
repollm-dsources/ops-llmd-autoscaling-wva-deprecated
verifiedhigh · 0.90
llm-d Disaggregated Serving Operations (vLLM) - fault tolerance, KV leases, rollouts, known NIXL issues
repollm-dsources/ops-llmd-disaggregation-operations
verifiedhigh · 0.90
llm-d documentation - Deploying with Envoy AI Gateway (gateway + EPP topology)
whitepaperllm-d (CNCF sandbox)sources/dep-llmd-envoy-ai-gateway-guide
verifiedhigh · 0.90
llm-d EPP Flow Control reference (centralised queuing, saturation detectors, eviction, error mapping, what it does not solve)
repollm-dsources/ops-llmd-flow-control
verifiedhigh · 0.90
llm-d Experimental Token-Aware Autoscaling guide (prefill token velocity, decode KV occupancy, stale-series bug)
repollm-dsources/ops-llmd-autoscaling-token-aware
verifiedhigh · 0.85
llm-d GitHub repository (llm-d/llm-d)
repollm-d (CNCF sandbox project)sources/pd-llmd-repo
verifiedhigh · 0.85
llm-d Graceful Shutdown and Request Draining guide
repollm-dsources/ops-llmd-graceful-shutdown
verifiedhigh · 0.90
llm-d InferencePool architecture reference (endpoint discovery, failOpen/failClose, namespace scoping)
repollm-dsources/ops-llmd-inferencepool
verifiedhigh · 0.85
llm-d KEDA with EPP Metrics design (why utilisation fails, four demand signals, isolation, limitations)
repollm-dsources/ops-llmd-autoscaling-keda-epp
verifiedhigh · 0.90
llm-d Router Operations guide (EPP HA modes, fail-open, proxy and EPP sizing reference data)
repollm-dsources/ops-llmd-router-operations
verifiedhigh · 0.85
llm-d SLO-Aware Autoscaling with KEDA - the control law (saturation signal, hysteresis, in-flight credit, warmup)
repollm-dsources/ops-llmd-autoscaling-slo-control-law
verifiedhigh · 0.85
llm-d vLLM Model-Aware Readiness Probes guide
repollm-dsources/ops-llmd-readiness-probes
verifiedhigh · 0.90
LLM-FP4: 4-Bit Floating-Point Quantized Transformers (Li et al.)
paperarXivsources/qlab-llm-fp4-paper
verifiedhigh · 0.88
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models (Frantar et al., NVIDIA)
paperarXivsources/qlab-llm-qat-paper
verifiedhigh · 0.88
llm.c GitHub repository
repoAndrej Karpathysources/niche-llmc-repo
verifiedhigh · 0.90
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
paperarXivsources/quant-llmint8-paper
verifiedhigh · 0.90
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale (Dettmers et al.)
paperarXivsources/qlab-llmint8-paper
verifiedhigh · 0.88
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders (arXiv:2404.05961)
paperarXivsources/pap-mm-llm2vec
verifiedhigh · 0.90
LLMCheck Apple Silicon LLM benchmark dataset (CSV export)
benchmarkllmcheck.netsources/llmcheck-net-benchmarks-csv
verifiedhigh · 0.85
Llumnix: Dynamic Scheduling for Large Language Model Serving (arXiv 2406.03243)
paperarXivsources/w3p-llumnix-osdi24-arxiv
verifiedhigh · 0.88
lm-format-enforcer GitHub repository
reponoamgatsources/niche-lm-format-enforcer-repo
verifiedhigh · 0.90
LMCache documentation
repoLMCachesources/pd-lmcache-docs
verifiedhigh · 0.85
LMCache issue #4463: Silent KV cache corruption on vLLM 0.26 fused/packed KV layout
forumLMCache/LMCachesources/pd-gh-lmcache-4463-packed-kv-silent-corruption
verifiedhigh · 0.85
LMCache OpenReview record (ICLR 2025)
databaseOpenReview (ICLR)sources/pap-sys-lmcache-openreview
verifiedhigh · 0.90
LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference (arXiv 2510.09665)
paperarXiv (LMCache team / NUS)sources/pap-sys-lmcache-arxiv
verifiedhigh · 0.90
LMCache#4463: Silent KV cache corruption on vLLM 0.26 fused/packed layout
forumLMCachesources/src5-gotcha-lmcache-4463-fused-kv-corruption
verifiedhigh · 0.90
LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind (EuroSys 2027)
paperarXivsources/niche-lmdeploy-turbomind-paper
verifiedhigh · 0.85
LMDeploy GitHub repository
repoInternLM / Shanghai AI Labsources/niche-lmdeploy-repo
verifiedhigh · 0.85
LMDeploy metrics/loggers.py - PrometheusStatLogger, its bucket literals and label scheme
repoInternLM/lmdeploysources/w3m-lmdeploy-metrics-loggers-typing
verifiedhigh · 0.92
LMDeploy published INT8 and FP8 per-architecture availability lists (docs/en/quantization/w8a8.md) — INT8 from Volta up, FP8 Ada and Hopper only
repoInternLM (lmdeploy)sources/w6q-lmdeploy-int8-fp8-arch-lists-2026-10
verifiedhigh · 0.95
LMDeploy README feature and roadmap lines (read 2026-10-04)
blogInternLMsources/ev-lmdeploy-readme-feature-axes
verifiedhigh · 0.90
lmsys/vicuna-33b-v1.3 config.json
repoLMSYS / Hugging Facesources/hf-config-vicuna-33b-v1-3
verifiedhigh · 0.95
Local LLM Benchmarks R9700 episode CSV (Donato Capitella, r9700-episode.csv)
benchmarkDonato Capitella (kyuz0)sources/local-llm-benchmarks-r9700-episode-csv
verifiedmedium · 0.65
Local LLM Benchmarks speed dataset (Donato Capitella, results.json)
benchmarkDonato Capitella (kyuz0)sources/local-llm-benchmarks-speed-results-json
verifiedlow · 0.60
localscore.ai — measured llamafile/llama.cpp tok/s per accelerator page
databaseLocalScoresources/localscore-ai-accelerator-benchmark-pages
verifiedlow · 0.60
Loki: Low-rank Keys for Efficient Sparse Attention (arXiv:2406.02542)
paperarXivsources/mkt-loki-sparse-attention-neurips2024
verifiedhigh · 0.95
Long-Context Benchmarks: Who's Actually Fast at 128K Tokens? (GeneralCompute)
benchmarkGeneralComputesources/bench-generalcompute-128k-ttft
verifiedmedium · 0.75
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
paperarXivsources/pap-attn-longrope
verifiedhigh · 0.90
LongRoPE2: Near-Lossless LLM Context Window Scaling
paperarXivsources/pap-attn-longrope2
verifiedhigh · 0.85
LoongServe GitHub repository (elastic sequence parallelism, ASP 2024)
repoLoongServe team (Shanghai Jiao Tong / IPADS)sources/niche-loongserve-repo
verifiedhigh · 0.85
LQER: Low-Rank Quantization Error Reconstruction for LLMs (Zhang et al.)
paperarXivsources/qlab-lqer-paper
verifiedhigh · 0.88
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings (arXiv:2402.03216)
paperarXivsources/pap-mm-bge-m3
verifiedhigh · 0.90
MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding (arXiv:2408.11049)
blogsources/pap-eff-magicdec
verifiedhigh · 0.85
Magistral-Small-2509 config.json
repoHugging Face (Mistral AI)sources/model-fr-hf-config-magistral-small
verifiedhigh · 0.90
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
paperGu & Dao (arXiv)sources/arch-mamba
verifiedhigh · 0.92
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
paperarXivsources/pap-arch-2312-00752
verifiedhigh · 0.95
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
paperarXivsources/pap-attn-mamba
verifiedhigh · 0.95
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
repostate-spaces (Albert Gu, Tri Dao)sources/src5-mamba-ssm-github
verifiedhigh · 0.95
MambaVision: A Hybrid Mamba-Transformer Vision Backbone
paperarXivsources/pap-arch-2407-08083
verifiedhigh · 0.90
Managed service premium quantification - Same hardware, different providers, different rates
databaseDerived from multiple sources in this reposources/ppl-bench-managed-service-premium
verifiedhigh · 0.90
Mark My Words: Analyzing and Evaluating Language Model Watermarks
paperSystematic benchmark with three metrics: quality, size (tokens needed to detect), tamper resistance. Reports KGW watermarks Llama-2-7B-chat and Mistral-7B-Instruct with no perceivable quality loss on natural-language tasks, detection in fewer than 100 tokens, and poor performance on CODE generation.sources/sec-arxiv-2312-00273
verifiedhigh · 0.90
Markaicode: vLLM vs Ollama benchmark — Red Hat GuideLLM study on A100-PCIE-40GB
benchmarkMarkaicode (citing Red Hat Developer GuideLLM study, Aug 2025)sources/markaicode-vllm-vs-ollama-guidellm-a100-pcie
verifiedhigh · 0.85
MARLIN venue attribution - Semantic Scholar graph API batch response
databaseSemantic Scholarsources/w3p-marvin-ppopp24-venue
verifiedmedium · 0.80
Marlin: FP16xINT4 LLM inference kernel (GitHub: IST-DASLab/marlin)
repoIST-DASLabsources/qhw-src-marlin-repo
verifiedhigh · 0.95
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models
paperarXiv (Frantar et al.; IST-DASLab, ETH Zurich)sources/flop-marlin
verifiedhigh · 0.90
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models (arXiv 2408.11743)
paperarXivsources/w3p-marvin-2408-11743-arxiv
verifiedhigh · 0.90
Marvell Co-packaged Optics: Powering the Next Wave of AI Data Center Innovation
blogMarvell Technologysources/marvell-cpo-scaleup-blog
verifiedhigh · 0.85
Masked Autoencoders Are Scalable Vision Learners (arXiv:2111.06377)
paperarXivsources/pap-mm-mae
verifiedhigh · 0.90
Mastering LLM Techniques: Inference Optimization
blogNVIDIA Technical Blog (Verma, Vaidya)sources/flop-nvidia-inference-optimization
verifiedhigh · 0.90
Matryoshka Representation Learning (arXiv:2205.13147)
paperarXivsources/pap-mm-matryoshka
verifiedhigh · 0.90
MaxText README
repoGoogle AI Hypercomputersources/alt-maxtext-readme
verifiedhigh · 0.90
Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving (arXiv 2609.23085)
paperarXiv (Brookhaven / Stony Brook)sources/pap-sys-energyrouting-arxiv
verifiedhigh · 0.88
Measuring the Carbon Intensity of AI in Cloud Instances (arXiv:2206.05229)
blogsources/pap-eff-carbon-intensity-cloud
verifiedhigh · 0.85
MediaPipe GitHub repository (Google on-device ML)
repoGooglesources/niche-mediapipe-repo
verifiedhigh · 0.85
Medusa GitHub repository (stale)
repoFasterDecodingsources/niche-medusa-repo
verifiedhigh · 0.85
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
paperarXivsources/niche-medusa-paper
verifiedhigh · 0.90
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
paperarXiv (Cai, Li, Geng, Peng, Lee, Chen, Dao; Princeton / Together AI / UIUC / CMU / UConn)sources/sd-medusa-paper
verifiedhigh · 0.90
MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
paperarXiv (Gale, Narayanan, Young, Zaharia)sources/flop-megablocks
verifiedhigh · 0.90
MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
paperarXivsources/pap-arch-2211-15841
verifiedhigh · 0.90
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
paperarXivsources/flop2-megatron-lm
verifiedhigh · 0.90
Meta-Llama-3-8B config.json (open mirror)
repoHugging Face hub (NousResearch mirror of Meta-Llama-3-8B)sources/flop2-llama3-8b-config
verifiedhigh · 0.90
Meta-Llama-3.1-8B-Instruct config.json
repoHugging Face (NousResearch mirror of Meta weights)sources/model-fr-hf-config-llama-3-1-8b
verifiedhigh · 0.90
meta-llama/Llama-4-Maverick-17B-128E-Instruct (official Meta model card, Benchmarks section)
reposources/llama4-maverick-hf-card
verifiedmedium · 0.80
meta-llama/Llama-4-Scout-17B-16E-Instruct · Hugging Face
reposources/llama-4-scout-hf
verifiedmedium · 0.80
MetaX C550 OAM GPGPU product page (MetaX's own English site) - features published, NO compute figure published
spec-sheetMetaX Technologies (metax-tech.com, the company's own site)sources/w4h-metax-c550-oam-product-page
verifiedhigh · 0.90
MetaX C550 product page (OAM GPGPU)
spec-sheetMetaX (沐曦)sources/cn-metax-c550
verifiedhigh · 0.95
Method record: how source-record content was re-verified for silent revision on 2026-10-04 (spec sheets, MLPerf tables, pricing pages)
spec-sheetNVIDIAsources/w3s-silent-revision-class-vendor-spec-and-pricing-pages
verifiedhigh · 0.90
Micro Center refurbished GeForce RTX 3090 / RTX 3090 Ti listing pages
databaseMicro Centersources/sup-used-microcenter-refurb-3090
verifiedhigh · 0.85
Micro Center search results for Intel Arc B580
databaseMicro Centersources/noncuda-microcenter-arc-b580-search
verifiedhigh · 0.85
Micro Center search results for RTX PRO 6000
databaseMicro Centersources/noncuda-microcenter-rtxpro6000-search
verifiedhigh · 0.85
MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models
paperarXivsources/qlab-micromix-paper
verifiedhigh · 0.88
Microscaling Data Formats for Deep Learning
paperarXivsources/quant-mx-paper
verifiedhigh · 0.90
Microsoft Azure Linux Virtual Machines Pricing
databaseMicrosoftsources/sup-cloud-azure-vm-pricing-page
verifiedhigh · 0.90
Microsoft Olive GitHub README
repoMicrosoftsources/qlab2-olive-readme
verifiedhigh · 0.90
microsoft/Phi-3-mini-4k-instruct config.json
repoHugging Facesources/hf-edge-phi-3-mini-4k-instruct
verifiedhigh · 0.88
microsoft/Phi-3-mini-4k-instruct config.json
repoHugging Facesources/mbl-cfg-phi-3-mini-4k-instruct
verifiedhigh · 0.90
microsoft/Phi-3.5-mini-instruct config.json
repoHugging Facesources/hf-edge-phi-3-5-mini-instruct
verifiedhigh · 0.88
microsoft/Phi-4-mini-instruct config.json
repoHugging Facesources/hf-edge-phi-4-mini-instruct
verifiedhigh · 0.88
microsoft/Phi-4-mini-reasoning config.json
repoHugging Facesources/hf-edge-phi-4-mini-reasoning
verifiedhigh · 0.88
MindIE - Ascend inference engine product page
release-notesHuawei HiSilicon / Ascend Communitysources/cn-huawei-mindie
verifiedhigh · 0.95
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention
paperarXivsources/pap-attn-minference
verifiedhigh · 0.95
MiniCPM-o-2_6 config.json (HuggingFace)
repoHuggingFace / OpenBMBsources/hf-mm-minicpm-o-2-6-config
verifiedhigh · 0.95
MiniCPM-V-4_5 config.json (HuggingFace)
repoHuggingFace / OpenBMBsources/hf-mm-minicpm-v-4-5-config
verifiedhigh · 0.95
MiniCPM-V-4_6 config.json (HuggingFace)
repoHuggingFace / OpenBMBsources/hf-mm-minicpm-v-4-6-config
verifiedhigh · 0.95
MiniMax M2.7: Early Echoes of Self-Evolution
blogsources/minimax-m2-7-blog
verifiedmedium · 0.80
MiniMax Sparse Attention (arXiv:2606.13392, MiniMax-AI) - authors' own technical report for the MiniMax-M3 model card
paperMiniMax-AIsources/w8-src-arxiv-2606-13392-minimax-msa
verifiedhigh · 0.90
MiniMax-01: Scaling Foundation Models with Lightning Attention
paperMiniMax (arXiv)sources/arch-minimax-01
verifiedhigh · 0.92
MiniMax-01: Scaling Foundation Models with Lightning Attention
paperarXivsources/pap-arch-2501-08313
verifiedhigh · 0.90
MiniMax-AI/MiniMax-M1 README — 'Performance of MiniMax-M1 on core benchmarks' (MiniMax-M1-80K column)
reposources/minimax-m1-github-readme
verifiedmedium · 0.80
MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
paperarXivsources/pap-arch-2506-13585
verifiedhigh · 0.90
MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention (arXiv:2506.13585)
whitepaperarXiv / MiniMaxsources/model-cn-minimax-m1-paper
verifiedhigh · 0.95
MiniMax-M2 and M2.7 model cards and configs (huggingface.co/MiniMaxAI)
release-notesMiniMaxsources/model-cn-minimax-m2-card
verifiedhigh · 0.85
MiniMaxAI/MiniMax-M1 config.json
repoHugging Facesources/mbl-cfg-minimax-m1
verifiedhigh · 0.90
MiniMaxAI/MiniMax-M2 config.json
repoHugging Facesources/mbl-cfg-minimax-m2
verifiedhigh · 0.90
MiniMaxAI/MiniMax-M2.7 · Hugging Face
reposources/minimax-m2-7-hf
verifiedmedium · 0.80
Ministral-3-8B-Instruct-2512 config.json
repoHugging Face (Mistral AI)sources/model-fr-hf-config-mistral-3-8b
verifiedhigh · 0.90
Ministral-8B-Instruct-2410 config.json
repoHugging Face (Mistral AI)sources/model-fr-hf-config-ministral-8b
verifiedhigh · 0.90
mirrorfrog.com AI Compute Cards Wiki - Ascend 310P / Enflame T21 pages
blogmirrorfrog.comsources/cn-cn-ai-accelerator-wiki
verifiedmedium · 0.70
Mistral 7B (arXiv:2310.06825)
blogsources/pap-eff-mistral-7b
verifiedmedium · 0.75
Mistral AI — 'Cheaper, Better, Faster, Stronger' (Mixtral 8x22B release post, benchmark figures 2 and 4)
blogsources/mixtral-8x22b-release-blog
verifiedmedium · 0.80
Mistral AI pricing page (per-million-token statement and example rates)
spec-sheetMistral AIsources/rent-src-mistral-pricing
verifiedhigh · 0.90
Mistral-7B-v0.1 config.json: sliding_window 4096, GQA 8 kv heads
repoMistral AI / Hugging Facesources/hf-mistral-7b-v01-config-sliding-4096
verifiedhigh · 0.95
Mistral-7B-v0.1 Hugging Face config.json (raw)
repoMistral AI / Hugging Facesources/fct2-hf-config-mistral-7b
verifiedhigh · 0.90
mistral.rs GitHub repository
repoEricLBuehlersources/engine-mistralrs-github
verifiedhigh · 0.95
mistralai/Magistral-Small-2509 config.json
repoHugging Facesources/mbl-cfg-magistral-small-2509
verifiedhigh · 0.90
mistralai/Mamba-Codestral-7B-v0.1 config.json
repoHugging Facesources/mbl-cfg-mamba-codestral-7b
verifiedhigh · 0.90
mistralai/Mamba-Codestral-7B-v0.1 model repo
repoMistral AIsources/hf-eco-mamba-codestral-7b
verifiedhigh · 0.95
mistralai/Ministral-3-8B-Instruct-2512 config.json
repoHugging Facesources/mbl-cfg-ministral-3-8b-2512
verifiedhigh · 0.90
mistralai/Ministral-8B-Instruct-2410 config.json
repoHugging Facesources/mbl-cfg-ministral-8b
verifiedhigh · 0.90
mistralai/Mixtral-8x22B-Instruct-v0.1 config.json
repoHugging Facesources/mbl-cfg-mixtral-8x22b
verifiedhigh · 0.90
mistralai/Mixtral-8x7B-Instruct-v0.1 config.json
repoHugging Facesources/mbl-cfg-mixtral-8x7b
verifiedhigh · 0.90
mistralai/Voxtral-Mini-3B-2507 config.json
repoHugging Facesources/mbl-cfg-voxtral-mini-3b
verifiedhigh · 0.90
mit-han-lab/llm-awq GitHub README
repoMIT HAN Labsources/qlab2-awq-readme
verifiedhigh · 0.90
mixedbread-ai/mxbai-embed-large-v1 config.json
repoHugging Facesources/hf-embed-mxbai-embed-large-v1
verifiedhigh · 0.88
mixedbread-ai/mxbai-rerank-large-v1 config.json
repoHugging Facesources/hf-embed-mxbai-rerank-large-v1
verifiedhigh · 0.88
mixedbread-ai/mxbai-rerank-large-v2 config.json
repoHugging Facesources/hf-embed-mxbai-rerank-large-v2
verifiedhigh · 0.88
Mixtral 8x22B release post
blogMistral AIsources/model-fr-mistral-mixtral-8x22b-blog
verifiedhigh · 0.90
Mixtral of Experts
paperMistral AIsources/model-fr-arxiv-mixtral-8x7b
verifiedhigh · 0.90
Mixtral of Experts
paperarXivsources/pap-arch-2401-04088
verifiedhigh · 0.90
Mixtral-8x22B-Instruct-v0.1 config.json
repoHugging Face (Mistral AI)sources/model-fr-hf-config-mixtral-8x22b
verifiedhigh · 0.90
Mixtral-8x7B-Instruct-v0.1 config.json
repoHugging Face (Mistral AI)sources/model-fr-hf-config-mixtral-8x7b
verifiedhigh · 0.90
Mixture of Experts: Efficient Sparse Models
paperGooglesources/src5-moe-paper
verifiedhigh · 0.90
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models (arXiv:2404.02258)
blogsources/pap-eff-mixture-of-depths
verifiedmedium · 0.75
Mixture-of-Experts with Expert Choice Routing
paperarXivsources/pap-arch-2202-09368
verifiedhigh · 0.90
MLC LLM python/mlc_llm/quantization/quantization.py QUANTIZATION registry
repoMLC AIsources/qlab2-mlc-quantization-py
verifiedhigh · 0.90
MLC LLM README (read 2026-10-04): negative result on the feature axes
blogMLCsources/ev-mlc-llm-readme-feature-axes
verifiedhigh · 0.85
MLC-LLM GitHub repository
repomlc-aisources/engine-mlc-llm-github
verifiedhigh · 0.95
MLC-LLM quantization scheme definitions (GroupQuantize, BlockScaleQuantize) and their compile-time kernel availability conditions
repoMLC-AI (mlc-llm)sources/w6q-mlc-llm-quant-schemes-2026-10
verifiedhigh · 0.95
MLC-LLM quick start docs
repomlc-aisources/engine-mlc-llm-quickstart
verifiedhigh · 0.95
MLCommons Inference reference repo, language/llama2-70b/README.md - the Interactive scenario latency rule
repoMLCommonssources/bench-mlperf-llama2-70b-interactive-latency-rule
verifiedhigh · 0.95
MLCommons MLPerf Inference v6.1 results — official summary.xlsx (datacenter + edge, closed + open divisions)
benchmarkMLCommonssources/mlperf-inference-v6-1-summary-xlsx
verifiedmedium · 0.70
MLIR: Multi-Level Intermediate Representation
blogsources/mlir-multi-level-intermediate-representation
verifiedhigh · 0.85
MLPerf Inference benchmark invalidation history
benchmarkMLCommonssources/meth-mlperf-invalidation-context
verifiedhigh · 0.85
MLPerf Inference Benchmark Suite
repoMLCommonssources/src5-mlperf-inference-github
verifiedhigh · 0.95
MLPerf Inference Rules (official submission rules document)
whitepaperMLCommonssources/ev-mlperf-inference-rules-official
verifiedhigh · 0.95
MLPerf Inference v3.0 closed/Dell r7515_q4_pro-qaic-v1.8.3.7-aic100 — 4x Qualcomm Cloud AI 100 Pro, bert-99/99.9 Offline+Server raw logs
benchmarkMLCommons (Dell submission)sources/bench-mlperf-v3-0-dell-r7515-4xqaic-ai100-bert
verifiedhigh · 0.85
MLPerf Inference v3.1 Results
databaseMLCommonssources/src5-mlperf-inference-results-v3-1
verifiedhigh · 0.90
MLPerf Inference v4.0 — ASUSTeK ESC8000_E11 8x NVIDIA L4, BERT-99/99.9, TensorRT
benchmarkMLCommons / ASUSTeKsources/bench-mlperf-v4-0-asustek-8xl4-bert99
verifiedmedium · 0.70
MLPerf Inference v4.0 closed results: Intel-HabanaLabs HLS-Gaudi2-PT Llama2-70B Offline/Server logs and system definition
benchmarkMLCommons / Intelsources/bench-intel-gaudi2-mlperf-v4-0-llama2-70b
verifiedhigh · 0.95
MLPerf Inference v4.0 Results
databaseMLCommonssources/src5-mlperf-inference-results-v4-0
verifiedhigh · 0.90
MLPerf Inference v4.1 — Cisco C245M8 2x H100 PCIe 80GB, GPT-J 99%, TensorRT
benchmarkMLCommons / Ciscosources/bench-mlperf-v4-1-cisco-h100pcie-gptj
verifiedlow · 0.50
MLPerf Inference v4.1 — Dell R760 2x H100 PCIe 80GB, GPT-J 99%, TensorRT
benchmarkMLCommons / Dellsources/bench-mlperf-v4-1-dell-r760-h100pcie-gptj
verifiedlow · 0.50
MLPerf Inference v4.1 — Lenovo SR675 V3 8x H100 NVL, Llama-2-70B + GPT-J, TensorRT
benchmarkMLCommons / Lenovosources/bench-mlperf-v4-1-lenovo-8xh100nvl-llama2-70b
verifiedlow · 0.50
MLPerf Inference v4.1 (open) — HPE DL380a 4x H100 NVL, Mixtral-8x7B, TensorRT
benchmarkMLCommons / HPEsources/bench-mlperf-v4-1-hpe-4xh100nvl-mixtral
verifiedlow · 0.50
MLPerf Inference v4.1 closed results: AMD 8xMI300X system definition
benchmarkMLCommonssources/bench-amd-mlperf-v4-1-mi300x-system
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT (non-power MaxP) llama2-70b-99.9 Offline LoadGen summary
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxp-l70-offline-summary
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ llama2-70b-99.9 Offline LoadGen summary
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-l70-offline-summary
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ llama2-70b-99.9 Offline ranging-run power trace (idle baseline)
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-l70-offline-ranging-spl
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ llama2-70b-99.9 Offline run_1 power trace (Yokogawa WT333E, 1 Hz spl.txt)
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-l70-offline-spl
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ llama2-70b-99.9 Server LoadGen summary
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-l70-server-summary
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ llama2-70b-99.9 Server run_1 power trace
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-l70-server-spl
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ mixtral-8x7b Offline LoadGen summary
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-mixtral-offline-summary
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ mixtral-8x7b Offline run_1 power trace
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-mixtral-offline-spl
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA H200-SXM-141GBx8_TRT_MaxQ system description (TGP 700W, air-cooled, 8x H200-SXM-141GB)
spec-sheetMLCommons and NVIDIAsources/pwr-mlperf-v4-1-h200-maxq-system-json
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA Makefile.power - locked GPU clock (GPUCLK=1000) and per-host MaxQ power state
repoMLCommons and NVIDIAsources/pwr-mlperf-v4-1-nvidia-makefile-power
verifiedhigh · 0.95
MLPerf Inference v4.1 NVIDIA submission README - MaxQ power category and PTDaemon/Yokogawa WT333E methodology
benchmarkMLCommons and NVIDIAsources/pwr-mlperf-v4-1-nvidia-readme-maxq
verifiedhigh · 0.95
MLPerf Inference v4.1 Results
databaseMLCommonssources/src5-mlperf-inference-results-v4-1
verifiedhigh · 0.90
MLPerf Inference v5.0 — Cisco C245M8 2x H100 NVL 94GB, Llama-2-70B, TensorRT
benchmarkMLCommons / Ciscosources/bench-mlperf-v5-0-cisco-h100nvl-llama2-70b
verifiedlow · 0.50
MLPerf Inference v5.0 — Cisco UCS X215 M8 2x L40S gptj-99 submission (raw logs)
benchmarkMLCommons / Ciscosources/bench-mlperf-v5-0-cisco-x215m8-2xl40s-gptj99
verifiedlow · 0.50
MLPerf Inference v5.0 — Cisco X215M8 2x H100 NVL, Llama-2-70B Offline, TensorRT
benchmarkMLCommons / Ciscosources/bench-mlperf-v5-0-cisco-x215-h100nvl-llama2-70b
verifiedlow · 0.50
MLPerf Inference v5.0 HPE ProLiant DL380a Gen12 8x L40S llama2-70b-99.9 raw logs
benchmarkMLCommons / HPEsources/bench-mlperf-v5-0-hpe-dl380a-8xl40s-llama2-70b
verifiedhigh · 0.90
MLPerf Inference v5.0 open results — NVIDIA Jetson AGX Thor llama2-70b-99 Offline (raw log)
benchmarkMLCommons / NVIDIAsources/mlperf-v5-0-nvidia-thor-llama2-70b-offline
verifiedmedium · 0.80
MLPerf Inference v5.0 Results
databaseMLCommonssources/src5-mlperf-inference-results-v5
verifiedhigh · 0.90
MLPerf Inference v5.0 results — Dell XE7745 8xL40S llama2-70b-99.9 submission (raw logs)
benchmarkMLCommons / Dellsources/bench-mlperf-v5-0-dell-xe7745-l40sx8-llama2-70b
verifiedlow · 0.50
MLPerf Inference v5.0 summary_results.json — closed-division datacenter rows (NVIDIA H100-NVL-94GB, H100-PCIe-80GB, H200-NVL-141GB)
databaseMLCommonssources/mlperf-v5-0-summary-results-json
verifiedmedium · 0.80
MLPerf Inference v5.1 — Intel 1-node-4x Arc Pro B60 Dual, llama2-70b / llama3.1-8b(-edge), vLLM
benchmarkMLCommons / Intelsources/bench-mlperf-v5-1-intel-4x-bmg-pro-b60
verifiedlow · 0.50
MLPerf Inference v5.1 official results database, summary_results.json (1448 result rows, 24 power-measured)
databaseMLCommonssources/bench-mlperf-v5-1-summary-json
verifiedhigh · 0.95
MLPerf Inference v5.1 open results — NVIDIA Jetson AGX Thor llama3.1-8b-edge SingleStream (raw log)
benchmarkMLCommons / NVIDIAsources/mlperf-v5-1-nvidia-thor-llama31-8b-edge-singlestream
verifiedmedium · 0.80
MLPerf Inference v5.1 results — RedHat/IBM Cloud 1xL40S vLLM llama3.1-8b submission (raw logs)
benchmarkMLCommons / RedHatsources/bench-mlperf-v5-1-redhat-ibm-l40s-vllm-llama3-8b
verifiedlow · 0.50
MLPerf Inference v6.0 — Intel 1-node-4x Arc Pro B60 (BMG), llama2-70b / llama3.1-8b / gpt-oss-120b, vLLM
benchmarkMLCommons / Intelsources/bench-mlperf-v6-0-intel-4x-bmg-b60
verifiedlow · 0.50
MLPerf Inference v6.0 — Intel 1-node-4x Arc Pro B70 (BMG), llama2-70b / llama3.1-8b / gpt-oss-120b, vLLM
benchmarkMLCommons / Intelsources/bench-mlperf-v6-0-intel-4x-bmg-b70
verifiedlow · 0.50
MLPerf Inference v6.0 closed results: AMD 8xMI355X gpt-oss-120b Offline summary log
benchmarkMLCommonssources/bench-amd-mlperf-v6-0-raw-log-amd-gpt-oss-120b
verifiedhigh · 0.95
MLPerf Inference v6.0 closed results: AMD 8xMI355X Llama2-70B Offline summary log
benchmarkMLCommonssources/bench-amd-mlperf-v6-0-raw-log-amd-mi355x
verifiedhigh · 0.95
MLPerf Inference v6.0 closed results: Intel 4x Arc Pro B50 (BMG-B50), llama3.1-8b
benchmarkMLCommons / Intelsources/bench-mlperf-v6-0-intel-4x-bmg-b50
verifiedhigh · 0.85
MLPerf Inference v6.0 official results database, summary_results.json (520 result rows)
databaseMLCommonssources/bench-mlperf-v6-0-summary-json
verifiedhigh · 0.95
MLPerf Inference v6.0 open results — NVIDIA Jetson AGX Thor llama3.1-8b-edge Offline + SingleStream (raw logs)
benchmarkMLCommons / NVIDIAsources/mlperf-v6-0-nvidia-thor-llama31-8b-edge
verifiedmedium · 0.80
MLPerf Inference v6.0 summary_results.json — closed-division datacenter + edge rows (Arc Pro B60/B70, RTX PRO 4500 Blackwell, MI325X, H200-NVL, GB10)
databaseMLCommonssources/mlperf-v6-0-summary-results-json
verifiedmedium · 0.80
MLPerf Inference v6.1 closed results: Intel 4x Arc Pro B70 Llama2-70B Offline summary log
benchmarkMLCommons / Intelsources/bench-intel-arc-pro-b70-mlperf-v6-1-llama2-70b
verifiedhigh · 0.90
MLPerf Inference v6.1 official results database, summary.csv (492 result rows, closed + open divisions)
databaseMLCommonssources/bench-mlperf-v6-1-summary-csv
verifiedhigh · 0.95
MLPerf Inference v6.1 results summary.csv (all submissions)
benchmarkMLCommonssources/bench-mlperf-v6-1-summary-csv-llm-rows
verifiedlow · 0.50
MLPerf Inference v6.1 summary.csv CPU-only Xeon 6 rows
benchmarkMLCommonssources/mlperf-v6-1-summary-csv-xeon6-cpu
verifiedhigh · 0.85
MLPerf Inference: Datacenter benchmark suite description
benchmarkMLCommonssources/ev-mlperf-inference-datacenter-page
verifiedhigh · 0.95
MLPerf Results Change Log - invalidated and modified results
databaseMLCommonssources/ev-mlperf-results-change-log
verifiedhigh · 0.95
MLPerf v5.1 Supermicro AS-4126GS-NBR-LCC 8x B200-SXM-180GB llama3.1-8b Interactive run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v5-1-supermicro-b200-llama3-8b-interactive-log
verifiedhigh · 0.90
MLPerf v6.1 AMD 8xMI355X_2xEPYC_9575F llama2-70b-99.9 Interactive run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-amd-mi355x-llama2-interactive-log
verifiedhigh · 0.90
MLPerf v6.1 AMD 8xMI355X_2xEPYC_9575F llama2-70b-99.9 Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-amd-mi355x-llama2-offline-log
verifiedhigh · 0.90
MLPerf v6.1 AMD 8xMI355X_2xEPYC_9575F llama2-70b-99.9 Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-amd-mi355x-llama2-server-log
verifiedhigh · 0.90
MLPerf v6.1 Atlas_Inference agentic SingleStream: Strix Halo + DGX Spark GB10 on Qwen3.6-27B-NVFP4
benchmarkMLCommons / Atlas_Inferencesources/mlperf-v6-1-atlas-inference-strix-halo-dgx-spark-qwen36-27b
verifiedlow · 0.50
MLPerf v6.1 CoreWeave GB200 NVL72 (72x GB200-186GB aarch64) llama2-70b-99.9 Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-coreweave-gb200-nvl72-llama2-offline-log
verifiedhigh · 0.90
MLPerf v6.1 CoreWeave GB200 NVL72 (72x GB200-186GB aarch64) llama2-70b-99.9 Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-coreweave-gb200-nvl72-llama2-server-log
verifiedhigh · 0.90
MLPerf v6.1 CoreWeave GB300 NVL72 (72x GB300-288GB aarch64) llama2-70b-99.9 Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-coreweave-gb300-nvl72-llama2-offline-log
verifiedhigh · 0.90
MLPerf v6.1 CoreWeave GB300 NVL72 (72x GB300-288GB aarch64) llama2-70b-99.9 Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-coreweave-gb300-nvl72-llama2-server-log
verifiedhigh · 0.90
MLPerf v6.1 Dell XE9785L 8xMI355X llama3.1-8b Interactive run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-dell-mi355x-llama3-8b-interactive-log
verifiedhigh · 0.90
MLPerf v6.1 Dell XE9785L 8xMI355X llama3.1-8b Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-dell-mi355x-llama3-8b-offline-log
verifiedhigh · 0.90
MLPerf v6.1 Dell XE9785L 8xMI355X llama3.1-8b Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-dell-mi355x-llama3-8b-server-log
verifiedhigh · 0.90
MLPerf v6.1 NVIDIA DGX B300 (8x B300-SXM-270GB) llama2-70b-99.9 Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-nvidia-b300-llama2-offline-log
verifiedhigh · 0.90
MLPerf v6.1 NVIDIA DGX B300 (8x B300-SXM-270GB) llama2-70b-99.9 Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-nvidia-b300-llama2-server-log
verifiedhigh · 0.90
MLPerf v6.1 NVIDIA GB300 NVL72 slice, 8x GB300-288GB aarch64 across 2 nodes, llama2-70b-99.9 Offline run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-nvidia-gb300-8gpu-llama2-offline-log
verifiedhigh · 0.90
MLPerf v6.1 NVIDIA GB300 NVL72 slice, 8x GB300-288GB aarch64 across 2 nodes, llama2-70b-99.9 Server run_1 harness summary log
benchmarkMLCommonssources/bench-mlperf-v6-1-nvidia-gb300-8gpu-llama2-server-log
verifiedhigh · 0.90
MLSys 2025 proceedings index (proceedings.mlsys.org)
databaseMLSyssources/sco-mlsys-2025-proceedings
verifiedhigh · 0.95
MLSys 2026 proceedings index (proceedings.mlsys.org)
databaseMLSyssources/sco-mlsys-2026-proceedings
verifiedhigh · 0.95
MLX nn/layers/quantized.py (_defaults_for_mode per-mode group sizes and bits)
repoml-exploresources/qzgw-mlx-quantized-layer
verifiedhigh · 0.95
MLX-LM GitHub repository
repoml-exploresources/engine-mlx-lm-github
verifiedhigh · 0.95
mlx-lm issue #1047: Kimi K2.5 KV cache OOM crash on Mac Studio M3 Ultra 512GB under long prefill
repoml-explore / communitysources/src-github-mlx-lm-issue-1047
verifiedhigh · 0.85
mlx-lm issue #1573: RotatingKVCache.to_quantized() raises NotImplementedError, so --kv-bits crashes at first request
forumml-explore/mlx-lmsources/noncuda-mlxlm-1573-rotating-kv-quant-nyi
verifiedhigh · 0.85
MLX-LM server CLI source
repoml-exploresources/engine-mlx-lm-server
verifiedhigh · 0.95
mlx-lm's own merged benchmark table (mlx_lm/BENCHMARKS.md, added by PR #552 'LLM Benchmarks' by awni, merged 2025-10-15)
benchmarkml-explore (Apple)sources/w8-src-mlxlmm-552-benchmarks-merged
verifiedhigh · 0.90
MLX: An array framework for Apple silicon
repoApple Machine Learning Researchsources/src5-mlx-github
verifiedhigh · 0.95
MNN GitHub repository (Alibaba)
repoAlibabasources/niche-mnn-repo
verifiedhigh · 0.85
MoBA: Mixture of Block Attention for Long-Context LLMs
paperarXivsources/pap-attn-moba
verifiedhigh · 0.85
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases (arXiv:2402.14905)
blogsources/pap-eff-mobilellm
verifiedhigh · 0.85
Modal documentation - Cold start performance (scaledown_window, min_containers, buffer_containers)
whitepaperModalsources/dep-modal-cold-start-docs
verifiedhigh · 0.93
Modal documentation - Scaling out (autoscaler parameters, dynamic updates)
whitepaperModalsources/dep-modal-scale-docs
verifiedhigh · 0.93
Modal documentation - Storing model weights on Modal (Volume vs Image)
whitepaperModalsources/dep-modal-model-weights-docs
verifiedhigh · 0.93
Modal pricing - GPU resource costs
databaseModalsources/sup-cloud-modal-pricing
verifiedhigh · 0.97
Model2Vec GitHub repository (Minish static embeddings)
repoMinish Labsources/niche-model2vec-repo
verifiedhigh · 0.85
model2vec-rs GitHub repository (official Rust implementation)
repoMinish Labsources/niche-model2vec-rs-repo
verifiedhigh · 0.85
ModelOpt: NVIDIA Model Optimization Toolkit
repoNVIDIAsources/src5-modelopt-github
verifiedhigh · 0.90
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models (arXiv:2409.17146)
paperarXivsources/pap-mm-molmo
verifiedhigh · 0.90
Molmo-7B-D-0924 config.json (HuggingFace)
repoHuggingFace / Ai2sources/hf-mm-molmo-7b-d-config
verifiedhigh · 0.95
Molmo-7B-D-0924 modeling_molmo.py (vision backbone + 2D pooling)
repoHuggingFace / Ai2sources/hf-mm-molmo-7b-d-modeling
verifiedhigh · 0.95
Mooncake Crossref record (ACM Trans. Storage)
databaseACM Transactions on Storage (via Crossref)sources/pap-sys-mooncake-crossref
verifiedhigh · 0.90
Mooncake GitHub repository (kvcache-ai/Mooncake)
repokvcache-ai (Moonshot AI)sources/pd-mooncake-repo
verifiedhigh · 0.85
Mooncake issue #4209: TCP transport first transfer after an idle gap fails with queue-full rejections; PD decode hangs until timeout
forumkvcache-ai/Mooncakesources/pd-gh-mooncake-4209-tcp-queue-full-hang
verifiedhigh · 0.85
Mooncake supported communication protocols (Transfer Engine docs)
repokvcache-aisources/pd-mooncake-protocols-doc
verifiedhigh · 0.85
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
paperarXiv (Qin, Li, He, Zhang, Wu, Zheng, Xu; Moonshot AI / Tsinghua)sources/pd-mooncake-fast25-paper
verifiedhigh · 0.85
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving (arXiv 2407.00079)
paperarXiv (Moonshot AI / Tsinghua MIIL)sources/pap-sys-mooncake-arxiv
verifiedhigh · 0.90
Mooncake#4209: TCP transport queue-full after idle gap causes PD hang
forumMooncakesources/src5-gotcha-mooncake-4209-tcp-queue-full
verifiedhigh · 0.90
moonshotai/Kimi-Audio-7B-Instruct config.json
repoHugging Facesources/mbl-cfg-kimi-audio-7b-instruct
verifiedhigh · 0.90
moonshotai/Kimi-K2.6 config.json
repoMoonshot AIsources/hf-kimi-k2-6-config
verifiedhigh · 0.90
moonshotai/Kimi-K2.6 model card
repoMoonshot AIsources/hf-kimi-k2-6-card
verifiedhigh · 0.85
moonshotai/Kimi-K3 config.json
repoHugging Facesources/mbl-cfg-kimi-k3
verifiedhigh · 0.90
moonshotai/Kimi-Linear-48B-A3B-Instruct · Hugging Face
reposources/kimi-linear-48b-a3b-hf
verifiedmedium · 0.80
Moore Threads MTT S4000 product page - precisions and memory published, NO absolute compute figure published
spec-sheetMoore Threads (mthreads.com)sources/w4h-mthreads-s4000-product-page-no-figure
verifiedhigh · 0.90
Moore Threads MTT S4000 product specification table (docs.mthreads.com doc centre, 产品规格书) - PUBLISHES the compute rows the product page omits
spec-sheetMoore Threads (docs.mthreads.com, the vendor's own documentation centre)sources/w5a-mthreads-s4000-doccenter-spec-table-compute-rows
verifiedhigh · 0.95
Moore Threads MTT S5000 (PH100, Pinghu architecture) product page and architecture page - precisions named, NO absolute compute figure published
spec-sheetMoore Threads (mthreads.com, the company's own site)sources/w4h-mthreads-s5000-phi100-no-perf-figure
verifiedhigh · 0.90
Moore Threads MTT S5000 product page - the ONLY three TFLOPS figures on it are footnoted COMPETITOR baselines; the S5000's own compute, memory and power are never printed
spec-sheetMoore Threads (mthreads.com)sources/w5a-mthreads-s5000-page-989-is-competitor-baseline-not-this-card
verifiedhigh · 0.95
MTEB: Massive Text Embedding Benchmark (arXiv:2210.07316)
paperarXivsources/pap-mm-mteb
verifiedhigh · 0.90
MTT S4000 product page (Moore Threads)
spec-sheetMoore Threads (摩尔线程)sources/cn-mthreads-s4000
verifiedhigh · 0.95
MTT S5000 product page (Moore Threads)
spec-sheetMoore Threads (摩尔线程)sources/cn-mthreads-s5000
verifiedhigh · 0.95
Multimodalflow Jetson AGX Thor live LLM benchmark (SGLang + llama.cpp)
blogMultimodalflowsources/multimodalflow-jetson-agx-thor-llm-benchmark-2026
verifiedlow · 0.60
MuxServe OpenReview record (ICML 2024)
databaseOpenReview (ICML)sources/pap-sys-muxserve-openreview
verifiedhigh · 0.90
MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving (arXiv 2404.02015)
paperarXiv (Peking University)sources/pap-sys-muxserve-arxiv
verifiedhigh · 0.90
mx-llama.cpp: a maintained gfx906 fork of llama.cpp
repoGitHub (mxxm-t)sources/comm-mx-llama-cpp-repo
verifiedmedium · 0.70
Mythic M1108 Product Page
blogsources/mythic-m1108-product-page
verifiedhigh · 0.85
NaiveAI/Naive-N0.5-Flash config.json
repoNaiveAIsources/hf-naive-n0-5-flash-config
verifiedhigh · 0.90
NaiveAI/Naive-N0.5-Flash model card
repoNaiveAIsources/hf-naive-n0-5-flash-card
verifiedmedium · 0.80
NanoReview GPU specification pages (launch MSRP)
reviewNanoReviewsources/sup-price-nanoreview-msrp
verifiedmedium · 0.70
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
paperDeepSeek-AI (arXiv)sources/arch-nsa
verifiedhigh · 0.92
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
paperarXivsources/pap-attn-nsa-native-sparse
verifiedhigh · 0.90
NaViT: Patch n' Pack - any Aspect Ratio and Resolution (arXiv:2307.06304)
paperarXivsources/navit-patch-n-pack-any-aspect-ratio-and-resolution-arxiv-2307-06
verifiedmedium · 0.75
NCCL issue 1214: Cannot use P2P in Azure GPU cluster
repoNVIDIA/ncclsources/mgpu-nccl-1214-azure-t4-shm
verifiedhigh · 0.85
NCCL issue 1716: [feature request] Please add MIG support
repoNVIDIA/ncclsources/mgpu-nccl-1716-mig-support-request
verifiedhigh · 0.85
NCCL issue 231: Fail or report when using the same device multiple times in a communicator
repoNVIDIA/ncclsources/mgpu-nccl-231-duplicate-device
verifiedhigh · 0.85
NCCL issue 2379: Probabilistic multi-communicator init hang in the cuMem UDS fd exchange on single-node PCIe
repoNVIDIA/ncclsources/mgpu-nccl-2379-cumem-uds-hang
verifiedhigh · 0.85
NCCL issue 2428: NCCL_IGNORE_NET_MISMATCH turns a heterogeneous-HCA misconfiguration into a silent hang
repoNVIDIA/ncclsources/mgpu-nccl-2428-net-mismatch-hang
verifiedhigh · 0.85
NCCL issue 418: Multiple MPI ranks in the same GPU using Nvidia Multiprocess Service
repoNVIDIA/ncclsources/mgpu-nccl-418-duplicate-device-mps
verifiedhigh · 0.85
NCCL issue 582: OOM during init rank causes deadlock
repoNVIDIA/ncclsources/mgpu-nccl-582-init-oom-deadlock
verifiedhigh · 0.85
NCCL issue 949: Slow (~56%) inter-node all_reduce_perf performance on A100 Virtual Machine
repoNVIDIA/ncclsources/mgpu-nccl-949-vm-topology-perf
verifiedhigh · 0.85
NCCL: NVIDIA Collective Communications Library
repoNVIDIAsources/src5-nccl-github
verifiedhigh · 0.90
ncnn GitHub Repository
repoTencentsources/local-ncnn-github
verifiedhigh · 0.85
Nebius Token Factory public model catalog (per-model USD per 1M tokens), fetched 2026-10-16
databaseNebiussources/svc-src-nebius-token-factory-catalog-2026-10-16
verifiedhigh · 0.85
NEGATIVE: no accelerator OEM or major distributor publishes a lead time in weeks (checked 2026-10-04)
review(negative finding; probed Dell, Supermicro, HPE, QCT, CDW, Insight, Provantage, IT Creations, ServersDirect)sources/spl-negative-no-oem-publishes-lead-time
verifiedmedium · 0.75
Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
paperNVIDIA (arXiv)sources/arch-nemotron-h
verifiedhigh · 0.92
Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
paperNVIDIAsources/hf-eco-nemotron-h-paper
verifiedhigh · 0.95
neuralmagic/sparseml README (End of Life notice)
repoNeural Magic (Red Hat)sources/qlab2-sparseml-eol-readme
verifiedhigh · 0.90
NeurIPS 2021 proceedings index
databaseNeurIPSsources/sco-neurips-2021-proceedings
verifiedhigh · 0.95
NeurIPS 2024 proceedings index
databaseNeurIPSsources/sco-neurips-2024-proceedings
verifiedhigh · 0.95
NeurIPS 2024 proceedings index, full-text title sweep
databaseNeurIPSsources/sco-neurips-2024-index-extended
verifiedhigh · 0.95
Neuron Collective Communication
spec-sheetAmazon Web Servicessources/alt-neuron-collectives
verifiedhigh · 0.90
Neuron Graph Compiler (neuronx-cc)
spec-sheetAmazon Web Servicessources/alt-neuron-compiler
verifiedhigh · 0.90
NeuronX Runtime (NRT)
spec-sheetAmazon Web Servicessources/alt-neuron-runtime
verifiedhigh · 0.90
Newegg GPU category listing for Intel Arc B580
databaseNeweggsources/noncuda-newegg-arc-b580-search
verifiedhigh · 0.85
Newegg GPU category listing for RTX 3090
databaseNeweggsources/noncuda-newegg-rtx3090-search
verifiedhigh · 0.85
Newegg GPU category listing for RTX 4090
databaseNeweggsources/noncuda-newegg-rtx4090-search
verifiedhigh · 0.85
Newegg open-box and marketplace listings for Radeon RX 9070 XT 16GB
databaseNeweggsources/sup-used-newegg-rx-9070-xt
verifiedlow · 0.50
Newegg refurbished and marketplace listings for GeForce RTX 3090 24GB
databaseNeweggsources/sup-used-newegg-rtx-3090
verifiedlow · 0.50
Newegg refurbished and marketplace listings for GeForce RTX 3090 Ti 24GB
databaseNeweggsources/sup-used-newegg-3090-ti
verifiedlow · 0.50
Newegg refurbished and marketplace listings for GeForce RTX 4090 24GB
databaseNeweggsources/sup-used-newegg-rtx-4090
verifiedlow · 0.50
Newegg refurbished and marketplace listings for NVIDIA GeForce GTX 1080 Ti 11GB
databaseNeweggsources/sup-used-newegg-gtx-1080-ti
verifiedlow · 0.50
Newegg refurbished and marketplace listings for NVIDIA Tesla M40 24GB
databaseNeweggsources/sup-used-newegg-tesla-m40
verifiedlow · 0.50
Newegg refurbished and marketplace listings for NVIDIA Tesla P40 24GB
databaseNeweggsources/sup-used-newegg-tesla-p40
verifiedlow · 0.50
Newegg refurbished and open-box listings for Radeon RX 7900 XTX 24GB
databaseNeweggsources/sup-used-newegg-rx-7900-xtx
verifiedlow · 0.50
Newegg search, Intel Arc B580, including Newegg Refreshed refurbished tier
databaseNeweggsources/sup-used-newegg-refreshed-b580
verifiedhigh · 0.85
Newegg secondary and open-box listings for Intel Arc B580 12GB
databaseNeweggsources/sup-used-newegg-arc-b580
verifiedlow · 0.50
nlzy/vllm-gfx906 (archived) - the original community gfx906 vLLM fork
repoGitHub (nlzy)sources/comm-nlzy-vllm-gfx906-archived
verifiedmedium · 0.70
nlzy/vllm-gfx906 issue #4: W8A8-quantized models very slow prompt processing and token generation
forumGitHub (user vega20user)sources/comm-nlzy-vllm-gfx906-issue-4-w8a8
verifiedmedium · 0.70
Nomic Embed: Training a Reproducible Long Context Text Embedder (arXiv:2402.01613)
paperarXivsources/pap-mm-nomic-embed
verifiedhigh · 0.90
nomic-ai/nomic-embed-text-v1.5 config.json
repoHugging Facesources/hf-embed-nomic-embed-text-v1-5
verifiedhigh · 0.88
nomic-ai/nomic-embed-text-v2-moe config.json
repoHugging Facesources/hf-embed-nomic-embed-text-v2-moe
verifiedhigh · 0.88
nomic-ai/nomic-embed-text-v2-moe config.json
repoHugging Facesources/mbl-cfg-nomic-embed-text-v2-moe
verifiedhigh · 0.90
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
paperGreshake et al. The origin of the indirect-prompt-injection framing: LLM-integrated applications blur the line between data and instructions, so an attacker who never touches the user interface can inject by writing into data the application will retrieve.sources/sec-arxiv-2302-12173
verifiedhigh · 0.90
Notebookcheck: NVIDIA GeForce RTX 5090 Laptop specs
reviewNotebookchecksources/notebookcheck-rtx-5090-laptop-specs
verifiedmedium · 0.65
NousResearch/Hermes-3-Llama-3.1-8B config.json
repoHugging Facesources/mbl-cfg-hermes-3-llama-3-1-8b
verifiedhigh · 0.90
NousResearch/Hermes-3-Llama-3.1-8B model repo
repoNous Researchsources/hf-eco-hermes-3-llama-3-1-8b
verifiedhigh · 0.95
NousResearch/Hermes-4-405B config.json
repoHugging Facesources/mbl-cfg-hermes-4-405b
verifiedhigh · 0.90
NousResearch/Hermes-4-405B model repo
repoNous Researchsources/hf-eco-hermes-4-405b
verifiedhigh · 0.95
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO config.json
repoHugging Facesources/mbl-cfg-nous-hermes-2-mixtral-8x7b-dpo
verifiedhigh · 0.90
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO model repo
repoNous Researchsources/hf-eco-nous-hermes-2-mixtral-8x7b-dpo
verifiedhigh · 0.95
Novita AI Llama 3.3 70B Instruct model page (serverless price and context)
databaseNovita AIsources/svc-src-novita-llama33-model-page-2026-10-17
verifiedhigh · 0.90
Novita AI pricing page, Llama section re-read 2026-10-17
databaseNovita AIsources/svc-src-novita-pricing-page-2026-10-17
verifiedhigh · 0.90
Novita AI serverless-endpoints pricing table (per-1M-token list prices)
databaseNovita AIsources/svc-src-novita-pricing-page-2026-10-14
verifiedhigh · 0.85
NVFP4 Trains with Precision of 16-Bit and Speed and Efficiency of 4-Bit
blogNVIDIAsources/bw-nv-nvfp4-pretraining-blog
verifiedhigh · 0.85
NVFP4: Block-scaled FP4 for Blackwell (arXiv:2404.14469 - related work)
paperarXivsources/qhw-src-nvfp4-paper
verifiedhigh · 0.90
NVIDIA A10 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/nv-a10-datasheet
verifiedhigh · 0.90
NVIDIA A100 Tensor Core GPU Architecture white paper
whitepaperNVIDIAsources/link2-nvidia-ampere-architecture-whitepaper
verifiedhigh · 0.90
NVIDIA A100 Tensor Core GPU Architecture white paper (Ampere) - Table 4 Comparison of NVIDIA Data Center GPUs
whitepaperNVIDIAsources/a100canon-acc-fill-nvidia-ampere-whitepaper-a100-40gb
verifiedhigh · 0.95
NVIDIA A100 Tensor Core GPU Architecture white paper (Ampere) - Table 4 Comparison of NVIDIA Data Center GPUs
whitepaperNVIDIAsources/acc-fill-nvidia-ampere-whitepaper-a100-40gb
verifiedhigh · 0.95
NVIDIA A100 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/a100canon-nv-a100-datasheet
verifiedhigh · 0.90
NVIDIA A100 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/nv-a100-datasheet
verifiedhigh · 0.90
NVIDIA A100 Tensor Core GPU datasheet (SXM4 and PCIe)
spec-sheetNVIDIAsources/net2-nvidia-a100-datasheet
verifiedhigh · 0.93
NVIDIA A30 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/nv-a30-datasheet
verifiedhigh · 0.90
NVIDIA A40 datasheet (48GB GDDR6 ECC, 384-bit, 696 GB/s, 300W, Ampere GA102, passive DC card)
spec-sheetNVIDIAsources/nvidia-a40-datasheet
verifiedmedium · 0.70
NVIDIA Ada GPU Architecture whitepaper v2.02
whitepaperNVIDIAsources/consumer-nvidia-ada-gpu-architecture-whitepaper
verifiedhigh · 0.90
NVIDIA Blackwell Architecture (official product page)
spec-sheetNVIDIAsources/bw-nv-blackwell-architecture-page
verifiedhigh · 0.85
NVIDIA Blackwell Architecture product page
spec-sheetNVIDIAsources/vb-nvidia-blackwell-architecture-page
verifiedhigh · 0.95
NVIDIA Blackwell Architecture Technical Brief (HGX B300 / HGX B200 dense-sparse table)
whitepaperNVIDIA (first-party CDN, linked from resources.nvidia.com/en-us-blackwell-architecture)sources/vb-nvidia-blackwell-architecture-brief
verifiedhigh · 0.95
NVIDIA Blackwell datasheet (GB200 NVL72 / GB200 NVL4 / HGX B200 technical specifications)
spec-sheetNVIDIAsources/pwr2-nvidia-blackwell-datasheet
verifiedhigh · 0.95
NVIDIA Blackwell datasheet (GB200 NVL72 / GB200 NVL4 / HGX B200)
spec-sheetnor-tech.com (NVIDIA reseller) - NVIDIA-authored document, reseller hostsources/nv-blackwell-datasheet
verifiedmedium · 0.75
NVIDIA Blackwell datasheet (GB200 NVL72 / GB200 NVL4 / HGX B200) - every Tensor Core row printed sparse-only, retrieved and re-read row by row
spec-sheetNVIDIA-authored document, served from reseller CDN nor-tech.com (document footer '4204213. Oct 25' per the first-party copy already recorded as vb-nvidia-blackwell-datasheet-firstparty)sources/w4h-nvidia-blackwell-datasheet-fp4-sparse-footnote
verifiedhigh · 0.90
NVIDIA Blackwell datasheet, first-party copy (GB200 NVL72 / GB200 NVL4 / HGX B200)
spec-sheetNVIDIA (first-party CDN dam-cdn.nvd.orangelogic.com, linked from nvidia.com/en-us/data-center/gb200-nvl72)sources/vb-nvidia-blackwell-datasheet-firstparty
verifiedhigh · 0.95
NVIDIA Blackwell Ultra datasheet (GB300 NVL72 / HGX B300 technical specifications)
spec-sheetNVIDIAsources/pwr2-nvidia-blackwell-ultra-datasheet
verifiedhigh · 0.90
NVIDIA Blackwell Ultra datasheet (GB300 NVL72 / HGX B300)
spec-sheetnor-tech.com (NVIDIA reseller) - NVIDIA-authored document, reseller hostsources/nv-blackwell-ultra-datasheet
verifiedmedium · 0.75
NVIDIA Blackwell Ultra datasheet (GB300 NVL72 / HGX B300) - the FP4 Sparse|Dense PAIR row and its footnote, read on NVIDIA's own CDN
spec-sheetNVIDIA (first-party CDN dam-cdn.nvd.orangelogic.com, reached from resources.nvidia.com/en-us-blackwell-architecture/blackwell-ultra-datasheet)sources/w4h-nvidia-blackwell-ultra-datasheet-fp4-pair-footnote
verifiedhigh · 0.95
NVIDIA Blackwell Ultra datasheet doc 4169750 (OCT25) - GB300 NVL72 per-GPU and system specs, per-row sparse/dense footnotes
spec-sheetnor-tech.com (NVIDIA reseller) - NVIDIA-authored document, non-NVIDIA hostsources/w3a-nvidia-gb300-blackwell-ultra-datasheet-4169750
verifiedhigh · 0.90
NVIDIA Blackwell Ultra datasheet, first-party copy (GB300 NVL72 / HGX B300)
spec-sheetNVIDIA (first-party CDN dam-cdn.nvd.orangelogic.com, linked from resources.nvidia.com/en-us-blackwell-architecture/blackwell-ultra-datasheet)sources/vb-nvidia-blackwell-ultra-datasheet-firstparty
verifiedhigh · 0.95
NVIDIA BlueField DPU Product Page
spec-sheetNVIDIAsources/nic-nvidia-bluefield-page
verifiedhigh · 0.90
NVIDIA BlueField-3 Networking Platform User Guide
spec-sheetNVIDIAsources/nic-bluefield3-user-guide
verifiedhigh · 0.95
NVIDIA BlueField-4 DPU Product Page
spec-sheetNVIDIAsources/nic-bluefield4-product-page
verifiedhigh · 0.90
NVIDIA ConnectX-7 NDR 400G Adapters Datasheet
spec-sheetNVIDIAsources/nic-connectx7-datasheet
verifiedhigh · 0.95
NVIDIA ConnectX-8 SuperNIC Product Page
spec-sheetNVIDIAsources/nic-connectx8-product-page
verifiedhigh · 0.90
NVIDIA ConnectX-9 SuperNIC Product Page
spec-sheetNVIDIAsources/nic-connectx9-product-page
verifiedhigh · 0.90
NVIDIA developer blog 'NVIDIA Hopper Architecture In-Depth' (H100 / GH100, GTC22)
whitepaperNVIDIAsources/w7n-nvidia-hopper-architecture-in-depth-blog
verifiedhigh · 0.90
NVIDIA developer blog 'NVSwitch Accelerates NVIDIA DGX-2'
whitepaperNVIDIAsources/net2-nvidia-nvswitch1-dgx2-blog
verifiedhigh · 0.88
NVIDIA developer blog 'Upgrading Multi-GPU Interconnectivity with the Third-Generation NVIDIA NVSwitch' (GB200 NVL72)
whitepaperNVIDIAsources/net2-nvidia-nvswitch3-blog
verifiedhigh · 0.90
NVIDIA Developer Jetson Benchmarks — Jetson AGX Thor vLLM LLM table (ISL/OSL 2048/128)
benchmarkNVIDIAsources/nvidia-jetson-benchmarks-thor-vllm-table
verifiedmedium · 0.80
NVIDIA DGX GB Rack Scale Systems User Guide - Hardware (rack configuration, power shelves, liquid cooling)
spec-sheetNVIDIAsources/pwr2-nvidia-dgx-gb200-hardware
verifiedhigh · 0.95
NVIDIA DGX H100/H200 User Guide - Introduction (power and environmental specifications)
spec-sheetNVIDIAsources/pwr2-nvidia-dgx-h100-power-specs
verifiedhigh · 0.95
NVIDIA DGX Spark (GB10 Grace Blackwell superchip) product page — 128GB unified LPDDR5x, 273 GB/s, ~1 PFLOP FP4 sparse
spec-sheetNVIDIAsources/nvidia-dgx-spark-product-page
verifiedmedium · 0.70
NVIDIA Dynamo GitHub repository (ai-dynamo/dynamo)
repoNVIDIAsources/pd-dynamo-repo
verifiedhigh · 0.85
NVIDIA Form 10-Q Q2 FY2027 (filed 2026-08-26) - H200 China licence outcome, tariff on licensed chips
release-notesNVIDIA Corporation / SEC EDGARsources/spl-nvda-10q-fy2027q2-h200-licence-outcome
verifiedhigh · 0.95
NVIDIA FY2026 Form 10-K (filed 2026-02-25) - supply chain, purchase commitments, export controls
release-notesNVIDIA Corporation / SEC EDGARsources/spl-nvda-10k-fy2026-supply-commitments
verifiedhigh · 0.95
NVIDIA GB200 NVL72 Delivers Trillion-Parameter LLM Training and Real-Time Inference
blogNVIDIAsources/bw-nv-gb200-nvl72-blog
verifiedhigh · 0.90
NVIDIA GB200 NVL72 product page (spec table)
spec-sheetNVIDIAsources/nv-gb200-nvl72-product-page
verifiedhigh · 0.85
NVIDIA GB200 NVL72 product page spec table
spec-sheetNVIDIAsources/vb-nvidia-gb200-nvl72-spec-table
verifiedhigh · 0.95
NVIDIA GB300 NVL72 product page spec table
spec-sheetNVIDIAsources/vb-nvidia-gb300-nvl72-spec-table
verifiedhigh · 0.95
NVIDIA GeForce full specifications comparison table (RTX 50 series)
spec-sheetNVIDIAsources/consumer-nvidia-geforce-compare-specs
verifiedhigh · 0.85
NVIDIA GeForce GTX 1080 Ti launch article (11 GB GDDR5X, 3584 CUDA, 11 Gbps)
spec-sheetNVIDIAsources/nvidia-gtx-1080-ti-launch-article
verifiedhigh · 0.90
NVIDIA GeForce RTX 2070 SUPER product page (8 GB GDDR6, 448 GB/s, 215 W)
spec-sheetNVIDIAsources/nvidia-rtx-2070-super-product-page
verifiedhigh · 0.90
NVIDIA GeForce RTX 30 Series product pages / Ampere spec table (3060 12GB 360GB/s, 3070 8GB 448GB/s, 3080 10GB 760GB/s, 3080 Ti 12GB 912GB/s GDDR6X)
spec-sheetNVIDIAsources/nvidia-geforce-rtx-30-series-ampere-specs
verifiedmedium · 0.70
NVIDIA GeForce RTX 3060 Ti product page (8 GB GDDR6, 256-bit, 200 W)
spec-sheetNVIDIAsources/nvidia-rtx-3060-ti-product-page
verifiedhigh · 0.90
NVIDIA GeForce RTX 3090 / 3090 Ti family product page
spec-sheetNVIDIAsources/consumer-nvidia-rtx-3090-family-product-page
verifiedhigh · 0.85
NVIDIA GeForce RTX 40 Series product pages (4060 Ti 8/16GB 288GB/s, 4070 12GB 504GB/s, 4070 Super 504GB/s, 4070 Ti 504GB/s, 4070 Ti Super 16GB 672GB/s, 4080 Super 736GB/s GDDR6X)
spec-sheetNVIDIAsources/nvidia-geforce-rtx-40-series-ada-specs
verifiedmedium · 0.70
NVIDIA GeForce RTX 4090 product page
spec-sheetNVIDIAsources/consumer-nvidia-rtx-4090-product-page
verifiedhigh · 0.85
NVIDIA GeForce RTX 5060 Ti product page — 8/16GB GDDR7, 128-bit, 448 GB/s, 180W
spec-sheetNVIDIAsources/nvidia-geforce-rtx-5060-ti-specs
verifiedmedium · 0.70
NVIDIA GeForce RTX 5090 product page
spec-sheetNVIDIAsources/consumer-nvidia-rtx-5090-product-page
verifiedhigh · 0.85
NVIDIA GeForce RTX 5090 product page
spec-sheetNVIDIAsources/noncuda-nvidia-rtx5090-product-page
verifiedhigh · 0.85
NVIDIA Get DGX - official DGX acquisition and partner page
spec-sheetNVIDIAsources/sup-buy-nvidia-get-dgx
verifiedhigh · 0.85
NVIDIA GPU Operator - Time-Slicing GPUs in Kubernetes
whitepaperNVIDIAsources/dep-nvidia-gpu-operator-time-slicing
verifiedhigh · 0.95
NVIDIA GPU Operator documentation: Time-Slicing GPUs in Kubernetes, and the time-slicing vs MIG comparison
spec-sheetNVIDIAsources/sec-nvidia-gpu-operator-timeslicing
verifiedhigh · 0.95
NVIDIA Grace CPU product page
spec-sheetNVIDIAsources/link-grace-cpu-product-page
verifiedhigh · 0.90
NVIDIA H100 NVL GPU product brief PB-11773-001
spec-sheetNVIDIAsources/nv-h100-nvl-product-brief
verifiedhigh · 0.90
NVIDIA H100 PCIe GPU product brief PB-11133-001
spec-sheetNVIDIAsources/nv-h100-pcie-product-brief
verifiedhigh · 0.90
NVIDIA H100 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/pwr2-nvidia-h100-datasheet
verifiedhigh · 0.90
NVIDIA H100 Tensor Core GPU datasheet (H100 SXM / PCIe / NVL)
spec-sheetcdn.prod.website-files.com (third-party Webflow CDN) - NVIDIA-authored document, non-NVIDIA hostsources/nv-h100-datasheet
verifiedhigh · 0.85
NVIDIA H100 Tensor Core GPU datasheet (Mar 2023 revision)
spec-sheetNVIDIA (PDF hosted on a third-party Webflow CDN)sources/acc2-nv-h100-datasheet-2023
verifiedhigh · 0.95
NVIDIA H100 Tensor Core GPU product page
spec-sheetNVIDIAsources/link-h100-product-page
verifiedhigh · 0.90
NVIDIA H100 Tensor Core GPU product specifications
spec-sheetNVIDIAsources/flop-nvidia-h100-specs
verifiedhigh · 0.90
NVIDIA H20 96GB spec sheet (Flopper.io aggregation)
databaseFlopper.iosources/nv-h20-flopper-specsheet
verifiedlow · 0.50
NVIDIA H200 GPU product page (spec table)
spec-sheetNVIDIAsources/nv-h200-product-page
verifiedhigh · 0.85
NVIDIA HGX A100 datasheet
spec-sheetNVIDIAsources/a100canon-link2-nvidia-hgx-a100-datasheet
verifiedhigh · 0.90
NVIDIA HGX A100 datasheet
spec-sheetNVIDIAsources/link2-nvidia-hgx-a100-datasheet
verifiedhigh · 0.90
NVIDIA HGX H100 and HGX H200 datasheet
spec-sheetNVIDIAsources/pwr2-nvidia-hgx-h100-h200-datasheet
verifiedhigh · 0.90
NVIDIA HGX platform page
spec-sheetNVIDIAsources/sup-buy-nvidia-hgx-platform
verifiedhigh · 0.85
NVIDIA HGX Platform page (HGX specifications table)
spec-sheetNVIDIAsources/vb-nvidia-hgx-platform-page
verifiedhigh · 0.95
NVIDIA Inference Xfer Library (NIXL) GitHub repository
repoNVIDIA (ai-dynamo)sources/pd-nixl-repo
verifiedhigh · 0.85
NVIDIA InfiniBand Adapters Product Page
spec-sheetNVIDIAsources/nic-nvidia-infiniband-page
verifiedhigh · 0.90
NVIDIA Jetson AGX Thor developer kit page — 128GB LPDDR5x, 273 GB/s, Blackwell GPU
spec-sheetNVIDIAsources/nvidia-jetson-agx-thor-page
verifiedmedium · 0.70
NVIDIA L4 Tensor Core GPU product page (spec table)
spec-sheetNVIDIAsources/nv-l4-product-page
verifiedhigh · 0.85
NVIDIA L40 GPU datasheet
spec-sheetNVIDIAsources/nv-l40-datasheet
verifiedhigh · 0.90
NVIDIA L40 GPU datasheet (Ada) - the part the L40S record cited, retained with its true figures so the mismatch is visible
spec-sheetNVIDIA (L40 GPU datasheet)sources/w5a-part2-l40-ada-datasheet-vs-l40s-two-different-parts
verifiedhigh · 0.95
NVIDIA L40S GPU product page - where the L40S compute figures actually are, as opposed to the L40 datasheet the record cited
spec-sheetNVIDIA (nvidia.com, the vendor's own product page)sources/w5a-part2-nvidia-l40s-product-page-holds-the-l40s-figures
verifiedhigh · 0.95
NVIDIA L40S product page specification table
spec-sheetNVIDIAsources/acc2-nv-l40s-product-page
verifiedhigh · 0.95
NVIDIA Marketplace consumer GPU catalog (US)
databaseNVIDIAsources/noncuda-nvidia-marketplace-gpu-catalog
verifiedhigh · 0.85
NVIDIA MIG User Guide
whitepaperNVIDIAsources/serve-mig-nvidia-docs
verifiedhigh · 0.90
NVIDIA Multi-Instance GPU User Guide, Release 615
spec-sheetNVIDIAsources/mgpu-nvidia-mig-user-guide
verifiedhigh · 0.85
NVIDIA Multi-Instance GPU User Guide: Introduction
spec-sheetNVIDIAsources/sec-nvidia-mig-intro
verifiedhigh · 0.95
NVIDIA NCCL Documentation
spec-sheetNVIDIAsources/nic-nccl-docs
verifiedhigh · 0.95
NVIDIA NCCL GitHub Repository
repoNVIDIAsources/nic-nccl-github
verifiedhigh · 0.95
NVIDIA Nemotron 3.5 Super and Lightning technical report
whitepaperNVIDIAsources/nvidia-nemotron-3-5-super-lightning-tech-report
verifiedhigh · 0.86
NVIDIA NVLink and NVLink Switch product page and specification table
spec-sheetNVIDIAsources/link-nvlink-switch-spec
verifiedhigh · 0.90
NVIDIA NVLink-C2C product page
spec-sheetNVIDIAsources/link-nvlink-c2c-product-page
verifiedhigh · 0.90
NVIDIA Quadro RTX 6000 datasheet (March 2019 PDF)
spec-sheetNVIDIAsources/nv-quadro-rtx-6000-datasheet
verifiedhigh · 0.90
NVIDIA Quadro RTX 8000 datasheet (March 2019 PDF)
spec-sheetNVIDIAsources/nv-quadro-rtx-8000-datasheet
verifiedhigh · 0.90
NVIDIA Quantum-2 InfiniBand Platform Datasheet
spec-sheetNVIDIAsources/nic-quantum2-datasheet
verifiedhigh · 0.95
NVIDIA Quantum-X800 InfiniBand Platform
spec-sheetNVIDIAsources/nic-quantumx800-product-page
verifiedhigh · 0.90
NVIDIA RTX 4000 Ada Generation datasheet (20GB GDDR6 ECC, 160-bit, 360 GB/s, 130W, AD104)
spec-sheetNVIDIAsources/nvidia-rtx-4000-ada-datasheet
verifiedmedium · 0.70
NVIDIA RTX 5000 Ada Generation datasheet (32GB GDDR6 ECC, 256-bit, 576 GB/s, 250W, AD102)
spec-sheetNVIDIAsources/nvidia-rtx-5000-ada-datasheet
verifiedmedium · 0.70
NVIDIA RTX 6000 Ada Generation datasheet
spec-sheetNVIDIAsources/consumer-nvidia-rtx-6000-ada-datasheet
verifiedhigh · 0.85
NVIDIA RTX A2000 product page (6 GB or 12 GB GDDR6 ECC, 70 W)
spec-sheetNVIDIAsources/nvidia-rtx-a2000-product-page
verifiedhigh · 0.90
NVIDIA RTX A6000 datasheet (48GB GDDR6 ECC, 384-bit, 768 GB/s, 300W, Ampere GA102)
spec-sheetNVIDIAsources/nvidia-rtx-a6000-datasheet
verifiedmedium · 0.70
NVIDIA RTX Blackwell GPU Architecture whitepaper (GeForce RTX 50 series)
whitepaperNVIDIAsources/consumer-nvidia-rtx-blackwell-gpu-architecture-whitepaper
verifiedhigh · 0.90
NVIDIA RTX PRO 4500 Blackwell Workstation Edition datasheet - verbatim spec table (vendor re-fetch 2026-10-04)
spec-sheetNVIDIAsources/vb-nv-rtx-pro-4500-blackwell-datasheet-spec-table
verifiedhigh · 0.95
NVIDIA RTX PRO 4500 Blackwell Workstation Edition datasheet (NVIDIA-hosted PDF)
spec-sheetNVIDIAsources/aa-nv-rtx-pro-4500-blackwell-datasheet
verifiedhigh · 0.85
NVIDIA RTX PRO 5000 Blackwell product page (spec table)
spec-sheetNVIDIAsources/nv-rtx-pro-5000-blackwell-product-page
verifiedhigh · 0.85
NVIDIA RTX PRO 6000 Blackwell Workstation Edition datasheet
spec-sheetNVIDIAsources/consumer-nvidia-rtx-pro-6000-blackwell-datasheet
verifiedhigh · 0.85
NVIDIA RTX PRO 6000 Blackwell Workstation Edition datasheet - verbatim spec table (vendor re-fetch 2026-10-04)
spec-sheetNVIDIAsources/vb-nv-rtx-pro-6000-blackwell-datasheet-spec-table
verifiedhigh · 0.95
NVIDIA RTX PRO 6000 vs RTX PRO 4500 Blackwell datasheets - Compute/Graphics API rows compared (silent-documentation-revision evidence)
spec-sheetNVIDIAsources/w3s-nv-rtx-pro-6000-and-4500-api-row-stale-in-6000-sheet
verifiedhigh · 0.95
NVIDIA RULER repository README results table (Claimed Length vs Effective Length, updated)
repoNVIDIAsources/ctx-src-ruler-github-results-table
verifiedhigh · 0.92
NVIDIA Spectrum-X Ethernet Platform
spec-sheetNVIDIAsources/nic-nvidia-spectrumx-page
verifiedhigh · 0.90
NVIDIA System Management Interface (nvidia-smi) documentation - clock event reasons, power limits, module power readings
spec-sheetNVIDIAsources/pwr-nvidia-smi-docs
verifiedhigh · 0.95
NVIDIA System Management Interface (nvidia-smi) documentation - clock locking, power limit, and clocks throttle reasons
spec-sheetNVIDIAsources/pwr2-nvidia-smi-throttle-reasons
verifiedhigh · 0.95
NVIDIA technical blog: NVLink and NVSwitch supercharge large language model inference
whitepaperNVIDIAsources/link-nvlink-nvswitch-inference-blog
verifiedhigh · 0.90
NVIDIA TensorRT-LLM performance overview — trtllm-bench throughput tables (H100/H200/GH200/B200/GB200, Llama FP8/FP4)
benchmarkNVIDIAsources/nvidia-tensorrt-llm-perf-overview
verifiedmedium · 0.80
NVIDIA Tesla P100 datasheet (SXM2, 16 GB)
spec-sheetNVIDIAsources/net2-nvidia-p100-datasheet
verifiedhigh · 0.92
NVIDIA Tesla P100 whitepaper (GP100, WP-08019-001 v01.1) - memory interface, HBM2 stacks, NVLink links, process
whitepaperNVIDIAsources/w3a-nvidia-tesla-p100-whitepaper
verifiedhigh · 0.95
NVIDIA TITAN V product page (German store page, spec table)
spec-sheetNVIDIAsources/nvidia-titan-v-product-page
verifiedhigh · 0.85
NVIDIA V100 Tensor Core GPU datasheet
spec-sheetNVIDIAsources/nv-v100-datasheet
verifiedhigh · 0.85
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 model card and config.json
repoNVIDIAsources/hf-nemotron-3-5-bolt-74b-a9b
verifiedhigh · 0.88
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 config.json
repoNVIDIAsources/hf-nemotron-3-5-super-vl-120b-a12b-config
verifiedhigh · 0.90
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 model card
repoNVIDIAsources/hf-nemotron-3-5-super-vl-120b-a12b-card
verifiedhigh · 0.86
NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 model card and config.json
repoNVIDIAsources/hf-nemotron-labs-dory1-4b
verifiedhigh · 0.90
nvidia/Nemotron-H-8B-Base-8K model repo
repoNVIDIAsources/hf-eco-nemotron-h-8b-base-8k
verifiedhigh · 0.95
NVLink: NVIDIA High-Speed GPU Interconnect
spec-sheetNVIDIAsources/src5-nvlink-docs
verifiedhigh · 0.90
NVSHMEM: Parallel programming interface for NVIDIA GPU clusters
whitepaperNVIDIAsources/src5-nvshmem-developer-page
verifiedhigh · 0.95
NXP Discrete Neural Processing Units (Kinara Ara240)
spec-sheetNXP Semiconductors / Kinarasources/nxp-kinara-ara240-dnpu
verifiedhigh · 0.85
o3 model page
spec-sheetOpenAIsources/model-fr-openai-o3-docs
verifiedhigh · 0.90
obs-llamacpp-metrics-source
repoggml-orgsources/obs-llamacpp-metrics-source
verifiedhigh · 0.95
obs-llamacpp-server-readme-metrics
repoggml-orgsources/obs-llamacpp-server-readme-metrics
verifiedhigh · 0.95
obs-lmdeploy-metrics-doc
repoInternLMsources/obs-lmdeploy-metrics-doc
verifiedhigh · 0.95
obs-lmdeploy-metrics-loggers
repoInternLMsources/obs-lmdeploy-metrics-loggers
verifiedhigh · 0.95
obs-lmdeploy-monitoring-dir
repoInternLMsources/obs-lmdeploy-monitoring-dir
verifiedhigh · 0.95
obs-ollama-api-docs
repoollamasources/obs-ollama-api-docs
verifiedhigh · 0.95
obs-ollama-readme-observability
repoollamasources/obs-ollama-readme-observability
verifiedhigh · 0.95
obs-ollama-routes-go
repoollamasources/obs-ollama-routes-go
verifiedhigh · 0.95
obs-sglang-disaggregation-trace-test
reposgl-project/sglangsources/obs-sglang-disaggregation-trace-test
verifiedhigh · 0.95
obs-sglang-metrics-collector
reposgl-project/sglangsources/obs-sglang-metrics-collector
verifiedhigh · 0.95
obs-sglang-observability-trace-py
reposgl-project/sglangsources/obs-sglang-observability-trace-py
verifiedhigh · 0.95
obs-sglang-production-metrics-doc
reposgl-project/sglangsources/obs-sglang-production-metrics-doc
verifiedhigh · 0.95
obs-sglang-request-stage-enum
reposgl-project/sglangsources/obs-sglang-request-stage-enum
verifiedhigh · 0.95
obs-sglang-request-trace-doc
reposgl-project/sglangsources/obs-sglang-request-trace-doc
verifiedhigh · 0.95
obs-sglang-schedule-batch-retract
reposgl-project/sglangsources/obs-sglang-schedule-batch-retract
verifiedhigh · 0.95
obs-sglang-scheduler-retraction
reposgl-project/sglangsources/obs-sglang-scheduler-retraction
verifiedhigh · 0.95
obs-sglang-utilization-regression
reposgl-project/sglangsources/obs-sglang-utilization-regression
verifiedhigh · 0.95
obs-tgi-cli-tracing-flags
repohuggingfacesources/obs-tgi-cli-tracing-flags
verifiedhigh · 0.95
obs-tgi-metrics-doc
repohuggingfacesources/obs-tgi-metrics-doc
verifiedhigh · 0.95
obs-tgi-router-server-rs
repohuggingfacesources/obs-tgi-router-server-rs
verifiedhigh · 0.95
obs-tgi-tracing-py
repohuggingfacesources/obs-tgi-tracing-py
verifiedhigh · 0.95
obs-triton-metrics-doc
repotriton-inference-serversources/obs-triton-metrics-doc
verifiedhigh · 0.95
obs-triton-trace-doc
repotriton-inference-serversources/obs-triton-trace-doc
verifiedhigh · 0.95
obs-triton-trtllm-backend-metrics
repotriton-inference-serversources/obs-triton-trtllm-backend-metrics
verifiedhigh · 0.95
obs-trtllm-metrics-collector
repoNVIDIAsources/obs-trtllm-metrics-collector
verifiedhigh · 0.95
obs-trtllm-otel-readme
repoNVIDIAsources/obs-trtllm-otel-readme
verifiedhigh · 0.95
obs-trtllm-tracing-py
repoNVIDIAsources/obs-trtllm-tracing-py
verifiedhigh · 0.95
obs-vllm-block-pool-usage
repovllm-project/vllmsources/obs-vllm-block-pool-usage
verifiedhigh · 0.95
obs-vllm-metrics-design-doc
repovllm-project/vllmsources/obs-vllm-metrics-design-doc
verifiedhigh · 0.95
obs-vllm-observability-config
repovllm-project/vllmsources/obs-vllm-observability-config
verifiedhigh · 0.95
obs-vllm-otel-poc-readme
repovllm-project/vllmsources/obs-vllm-otel-poc-readme
verifiedhigh · 0.95
obs-vllm-per-request-metrics-doc
repovllm-project/vllmsources/obs-vllm-per-request-metrics-doc
verifiedhigh · 0.95
obs-vllm-production-metrics-doc
repovllm-project/vllmsources/obs-vllm-production-metrics-doc
verifiedhigh · 0.95
obs-vllm-scheduler-preemption
repovllm-project/vllmsources/obs-vllm-scheduler-preemption
verifiedhigh · 0.95
obs-vllm-v1-metrics-loggers
repovllm-project/vllmsources/obs-vllm-v1-metrics-loggers
verifiedhigh · 0.95
OCP Microscaling (MX) Data Formats Specification
spec-sheetOpen Compute Projectsources/qhw-src-mxfp-paper
verifiedhigh · 0.95
OCP Microscaling Formats (MX) Specification v1.0
spec-sheetOpen Compute Projectsources/quant-ocp-mx-spec
verifiedhigh · 0.90
Ollama GitHub repo
repoOllamasources/cpuedge-ollama-github
verifiedhigh · 1.00
Ollama hardware support docs
repoOllamasources/cpuedge-ollama-gpu-docs
verifiedhigh · 1.00
Ollama server/routes.go - the complete route table, with no /metrics handler
repoollama/ollamasources/w3m-ollama-no-metrics-route-table
verifiedhigh · 0.92
Olmo 3 model flow
spec-sheetAi2sources/model-fr-ai2-olmo-page
verifiedhigh · 0.90
Olmo-3-7B-Instruct config.json
repoHugging Face (Ai2)sources/model-fr-hf-config-olmo-3-7b
verifiedhigh · 0.90
OLMoE: Open Mixture-of-Experts Language Models
paperarXivsources/pap-arch-2409-02060
verifiedhigh · 0.90
OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models (Shi et al.)
paperarXivsources/qlab-omniquant-paper
verifiedhigh · 0.88
On Google's SynthID-Text LLM Watermarking System: Theoretical Analysis and Empirical Validation
paperFirst theoretical analysis of SynthID-Text. Proves the mean score degrades as tournament layers increase and designs a layer-inflation attack; shows the Bayesian score is more robust to layer count; shows the optimal Bernoulli detection parameter is 0.5.sources/sec-arxiv-2603-03410
verifiedhigh · 0.90
On the Reliability of Watermarks for Large Language Models
paperKirchenbauer et al. themselves. Finds watermarks remain detectable after human and machine paraphrasing; after strong human paraphrasing detection needed ~800 tokens on average at a 1e-5 false-positive threshold. Attributes this partly to paraphrases statistically leaking n-grams of the original. This is the PRO-watermark side of the contested paraphrase record.sources/sec-arxiv-2306-04634
verifiedhigh · 0.90
oneDNN - GitHub README
repouxlfoundationsources/xpu-onednn-github-readme
verifiedhigh · 0.90
ONNX Runtime documentation
blogsources/onnx-runtime-documentation
verifiedhigh · 0.85
ONNX Runtime documentation: Quantize ONNX Models
repoONNX Runtime (Microsoft)sources/qlab2-ort-quant-doc
verifiedhigh · 0.90
ONNX Runtime Execution Providers
repoMicrosoftsources/onnx-runtime-execution-providers
verifiedhigh · 0.85
ONNX Runtime GenAI GitHub repo
repoMicrosoftsources/cpuedge-onnxruntime-genai-github
verifiedhigh · 1.00
ONNX Runtime GenAI model builder README
repoMicrosoftsources/qlab2-ortgenai-model-builder
verifiedhigh · 0.90
ONNX Runtime Mobile GitHub Repository
repoMicrosoftsources/local-ort-mobile-github
verifiedhigh · 0.85
ONNX Runtime NNAPI Execution Provider doc (supported ops table)
repoONNX Runtime (Microsoft)sources/qlab2-ort-nnapi-ep-doc
verifiedhigh · 0.90
ONNX Runtime NNAPI Execution Provider documentation
whitepaperMicrosoft / ONNX Runtimesources/niche-ort-nnapi-ep-doc
verifiedhigh · 0.85
ONNX Runtime onnxruntime/python/tools/quantization README
repoONNX Runtime (Microsoft)sources/qlab2-ort-quant-tool-readme
verifiedhigh · 0.90
ONNX Runtime: Cross-platform inference engine
repoMicrosoftsources/src5-onnxruntime-github
verifiedhigh · 0.90
onnxruntime-genai README: generative-loop components, model architectures and EPU coverage (read 2026-10-04)
blogMicrosoftsources/ev-onnxruntime-genai-readme-feature-axes
verifiedhigh · 0.90
open-r1/OpenR1-Qwen-7B config.json
repoHugging Facesources/mbl-cfg-openr1-qwen-7b
verifiedhigh · 0.90
open-r1/OpenR1-Qwen-7B model repo
repoOpen-R1 project / Hugging Facesources/hf-eco-openr1-qwen-7b
verifiedhigh · 0.95
open-thoughts/OpenThinker3-7B model repo
repoOpenThoughts / Hugging Facesources/hf-eco-openthinker3-7b
verifiedhigh · 0.95
OpenAI API pricing (platform docs, Standard/Batch/Flex/Fast tables)
spec-sheetOpenAIsources/rent-src-openai-api-pricing
verifiedhigh · 0.90
OpenAI Enterprise privacy page (retention, training defaults, access to stored API data, compliance attestations)
blogOpenAIsources/sec-openai-enterprise-privacy
verifiedhigh · 0.95
openai/gpt-oss-120b · Hugging Face
reposources/gpt-oss-120b-hf
verifiedmedium · 0.80
openai/gpt-oss-20b · Hugging Face
reposources/gpt-oss-20b-hf-card
verifiedmedium · 0.80
openai/whisper GitHub repository
repoGitHub / OpenAIsources/aud-src-openai-whisper-github
verifiedhigh · 0.95
OpenBMB/MiniCPM-V — MiniCPM-V 4.7 docs
reposources/minicpm-v-4-7-github
verifiedmedium · 0.80
openbmb/MiniCPM-V-4_6 config.json
repoHugging Facesources/mbl-cfg-minicpm-v-4-6
verifiedhigh · 0.90
openbmb/MiniCPM-V-4.7-35B-A3B · Hugging Face
reposources/minicpm-v-4-7-35b-a3b-hf
verifiedmedium · 0.80
openbmb/MiniCPM-V-4.7-35B-A3B model card and config.json
repoOpenBMBsources/hf-minicpm-v-4-7-35b-a3b
verifiedhigh · 0.90
openbmb/MiniCPM5-2B config.json
repoOpenBMBsources/hf-minicpm5-2b-config
verifiedhigh · 0.95
openbmb/MiniCPM5-2B model card
repoOpenBMBsources/hf-minicpm5-2b-card
verifiedhigh · 0.85
OpenReview api2 /notes/search for 'LMCache' - returns the arXiv deposit only, no ICLR record
databaseOpenReviewsources/w6p-openreview-api2-lmcache-only-corr
verifiedhigh · 0.90
OpenReview api2 /notes/search responses for the 16 duplicate-slug papers (venue + venueid per forum)
databaseOpenReviewsources/w6p-openreview-api2-duplicate-venue-records
verifiedhigh · 0.90
OpenReview api2 note-search index (venue + venueid per forum, mirrors DBLP for older venues)
databaseOpenReviewsources/sco-openreview-venue-search
verifiedhigh · 0.95
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-14
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, fifth re-read 2026-10-17 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-17-r5
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, fourth re-read 2026-10-17 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-17-r4
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, re-read 2026-10-16 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-16
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, re-read 2026-10-17 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-17
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, second re-read 2026-10-17 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-17-r2
verifiedhigh · 0.90
OpenRouter provider table for meta-llama/llama-3.3-70b-instruct, third re-read 2026-10-17 (per-provider price, P50 latency, throughput, uptime)
databaseOpenRoutersources/svc-src-openrouter-provider-table-2026-10-17-r3
verifiedhigh · 0.90
OpenVINO documentation
blogsources/openvino-documentation
verifiedhigh · 0.85
OpenVINO GenAI GitHub repo
repoIntel / openvinotoolkitsources/cpuedge-openvino-genai-github
verifiedhigh · 1.00
OpenVINO GenAI README: speculative decoding, prefix caching and VLM support (read 2026-10-04)
blogIntelsources/ev-openvino-genai-readme-feature-axes
verifiedhigh · 0.90
OpenVINO: Intel's AI inference toolkit
repoIntelsources/src5-openvino-github
verifiedhigh · 0.90
OpenXLA project overview
repoOpenXLA / Googlesources/openxla-project-overview
verifiedhigh · 0.85
optimum-quanto GitHub README (design overview)
repoHugging Facesources/qlab2-optimum-quanto-readme
verifiedhigh · 0.90
optimum-quanto README
repoHugging Facesources/quant-quanto-readme
verifiedhigh · 0.90
Oracle Cloud Infrastructure Price List
databaseOraclesources/sup-cloud-oracle-cloud-pricelist
verifiedhigh · 0.96
Oracle OCI 'GPU - Accelerated Compute' price table, including AMD MI300X and MI355X per-GPU-hour rates
databaseOraclesources/w5s-oracle-gpu-accelerated-compute-table
verifiedhigh · 0.95
Orca OSDI '22 paper - NO arXiv preprint exists; the arXiv API returns zero results for this title
paperUSENIX Associationsources/w3p-orca-osdi22-arxiv-absent
verifiedhigh · 0.95
Orca OSDI '22 presentation page citation metadata (USENIX)
paperUSENIX Associationsources/w3p-orca-osdi22-usenix-meta
verifiedhigh · 0.95
Orca: A Distributed Serving System for Transformer-Based Generative Models
paperUSENIX OSDI 2022 (Yu, Jeong, Kim, Kim, Chun)sources/flop-orca-osdi22
verifiedhigh · 0.90
Orca: A Distributed Serving System for Transformer-Based Generative Models (OSDI 2022)
paperUSENIX Associationsources/sched-orca-osdi22
verifiedhigh · 0.92
ornith-ai/Ornith-1.5-35B-A3B config.json
repoOrnith AIsources/hf-ornith-1-5-35b-a3b-config
verifiedhigh · 0.90
ornith-ai/Ornith-1.5-35B-A3B model card
repoOrnith AIsources/hf-ornith-1-5-35b-a3b-card
verifiedmedium · 0.80
ornith-ai/Ornith-1.5-9B config.json
repoOrnith AIsources/hf-ornith-1-5-9b-config
verifiedhigh · 0.90
ornith-ai/Ornith-1.5-9B model card
repoOrnith AIsources/hf-ornith-1-5-9b-card
verifiedmedium · 0.80
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding
paperarXiv (Zhao et al.; Tsinghua University)sources/sd-ouroboros-paper
verifiedhigh · 0.90
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding (arXiv:2402.13720)
blogsources/pap-eff-ouroboros
verifiedhigh · 0.85
Outlines GitHub repository (dottxt-ai/outlines)
repodottxtsources/niche-outlines-repo
verifiedhigh · 0.90
Overclockers UK graphics card listings (new, and out-of-stock RTX 4090)
databaseOverclockers UKsources/sup-used-overclockers-uk
verifiedlow · 0.60
Overclockers UK search results for Intel Arc B580
databaseOverclockers UKsources/noncuda-overclockers-uk-arc-b580-search
verifiedhigh · 0.85
Overclockers UK search results for RTX 3090 / RTX 4090
databaseOverclockers UKsources/noncuda-overclockers-uk-rtx3090-search
verifiedhigh · 0.85
Overclockers UK search results for RTX 5090
databaseOverclockers UKsources/noncuda-overclockers-uk-rtx5090-search
verifiedmedium · 0.80
PackServe: SLO-Aware Request Scheduling for Agentic LLM Serving at Scale (arXiv 2609.33224)
paperarXiv (Microsoft Research Asia / Peking University)sources/pap-sys-packserve-arxiv
verifiedhigh · 0.88
PagedAttention: Efficient Memory Management for LLM Serving
paperUC Berkeleysources/src5-paged-attention-paper
verifiedhigh · 0.90
PaliGemma 3B mix 224 text-model Q4_K_M GGUF header (abetlen conversion of google/paligemma-3b-mix-224)
repoHugging Facesources/gguf-paligemma-3b-mqa-header
verifiedmedium · 0.72
PaliGemma 3B mix 224 text-model Q4_K_M GGUF header (abetlen conversion)
repoabetlen (conversion of google/paligemma-3b-mix-224)sources/gguf-paligemma-3b-mix-224-q4km
verifiedhigh · 0.90
PaliGemma-3b-mix-224 model card (gated repo)
repoHuggingFace / Google DeepMindsources/hf-mm-paligemma-3b-mix-224-card
verifiedhigh · 0.95
PaliGemma: A versatile 3B VLM for transfer (arXiv:2407.07726)
paperarXivsources/pap-mm-paligemma
verifiedhigh · 0.90
Pallas: a JAX kernel language (official JAX documentation)
whitepapersources/pallas-a-jax-kernel-dsl
verifiedhigh · 0.85
Pallas: Writing TPU kernels in JAX
repoGoogle / JAXsources/pallas-writing-tpu-kernels-in-jax
verifiedhigh · 0.85
Paperspace (DigitalOcean) Core GPU Pricing - Hourly dedicated GPU rates
databasePaperspace (DigitalOcean)sources/ppl-cloud-paperspace-pricing
verifiedhigh · 0.90
Paperspace as cloud orchestrator - Per-hour billing, Gradient platform, auto-shutdown
databasePaperspace (DigitalOcean)sources/ppl-orch-paperspace-billing-model
verifiedhigh · 0.90
Paperspace vs raw cloud GPU pricing - Dedicated GPU rates vs market
databasePaperspace (DigitalOcean)sources/ppl-cloud-paperspace-vs-cloud-price
verifiedhigh · 0.90
parakeet-ctc-1.1b config.json (HuggingFace)
repoHuggingFace / NVIDIAsources/hf-mm-parakeet-ctc-1-1b-config
verifiedhigh · 0.95
parakeet-tdt-0.6b-v2 model card (NVIDIA NeMo checkpoint)
spec-sheetHuggingFace / NVIDIAsources/hf-mm-parakeet-tdt-0-6b-v2-card
verifiedhigh · 0.95
Parrot: Efficient Serving of LLM-based Applications with Semantic Variable (arXiv 2405.19888)
paperarXiv (Shanghai Jiao Tong University / Microsoft Research)sources/pap-sys-parrot-arxiv
verifiedhigh · 0.90
PART 2 METHOD AND RESULTS: every accelerator flops citation checked against its cited document, 72 sources probed, 25 flagged and 20 of those cleared as dense/sparse artefacts
repon/a - this is an audit-method record, not a document; the url points at the repository whose README was the worst finding of the sweepsources/w5a-part2-full-sweep-method-and-cleared-artefacts
verifiedhigh · 0.90
PCI Security Standards Council document library: PCI DSS v4.0.1 (June 2024), Summary of Changes v4.0 to v4.0.1, Prioritized Approach
spec-sheetPCI Security Standards Councilsources/sec-pci-dss-v4-0-1-document-library
verifiedhigh · 0.95
PCI-SIG 'PCI Express 6.0 Specification' page
spec-sheetPCI-SIGsources/net2-pcisig-pcie6-spec
verifiedhigh · 0.93
PCI-SIG FAQ 'What bit rates does the PCIe 5.0 specification support and how does it compare to prior PCIe generations?'
spec-sheetPCI-SIGsources/net2-pcisig-pcie5-faq
verifiedhigh · 0.95
PCI-SIG FAQ 'What bit rates does the PCIe 5.0 specification support and how does it compare to prior PCIe generations?' - re-retrieved verbatim 2026-10-05 as the convention anchor for PCIe 1.0-5.0
spec-sheetPCI-SIGsources/w7p-pcisig-pcie5-faq-verified
verifiedhigh · 0.95
PCI-SIG FAQ, category 'PCI Express - 6.0' (bit rate, PAM4 rationale, Flit Mode, FEC)
spec-sheetPCI-SIGsources/w7p-pcisig-pcie6-faq
verifiedhigh · 0.95
PCI-SIG press release, 'PCI-SIG Releases PCIe 7.0 Specification to Support the Bandwidth Demands of Artificial Intelligence at 128.0 GT/s Transfer Rates' (11 June 2025)
spec-sheetPCI-SIG (distributed via Business Wire)sources/w7p-pcisig-pcie7-release-pr
verifiedhigh · 0.95
PCI-SIG specifications library index
spec-sheetPCI-SIGsources/link-pcisig-specifications
verifiedhigh · 0.90
PCIe: Peripheral Component Interconnect Express
spec-sheetPCI-SIGsources/src5-pcie-docs
verifiedhigh · 0.90
PD Serving of Qwen3.8-2.4T on GB300 NVL72 (vLLM)
blogvLLM projectsources/bench-nv-vllm-qwen38-pd-blog
verifiedhigh · 0.85
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone (arXiv:2404.14219)
blogsources/pap-eff-phi-3
verifiedmedium · 0.75
Phi-3.5-vision-instruct config.json (HuggingFace)
repoHuggingFace / Microsoftsources/hf-mm-phi-3-5-vision-config
verifiedhigh · 0.95
Phi-4-multimodal-instruct config.json (HuggingFace)
repoHuggingFace / Microsoftsources/hf-mm-phi-4-multimodal-config
verifiedhigh · 0.95
Phoronix: llama.cpp Vulkan, Arc B580 vs RX 9000 vs RTX 50 (b7083, Dec 2025)
benchmarkPhoronixsources/phoronix-llamacpp-vulkan-eoy2025-b7083
verifiedmedium · 0.75
PicClick eBay listing aggregator (asking prices)
benchmarkPicClicksources/sup-price-picclick-ebay-asking
verifiedmedium · 0.70
PicClick/eBay used-GPU asking-price refresh sweep (Oct-14 pull, Dec-2026 deltas)
forumPicClick (eBay mirror) / cron subagent capturesources/src-picclick-used-gpu-dec-refresh-oct14
verifiedmedium · 0.70
Pinghu (平湖) 4th-generation MUSA GPU architecture page (Moore Threads)
spec-sheetMoore Threads (摩尔线程)sources/cn-mthreads-pinghu
verifiedhigh · 0.95
Pipeline Parallelism in SGLang: Scaling to Million-Token Contexts and Beyond (LMSYS Blog)
blogLMSYS Orgsources/bench-lmsys-chunked-pipeline-ttft
verifiedhigh · 0.90
Pixtral 12B (arXiv:2410.07073)
paperarXivsources/pap-mm-pixtral
verifiedhigh · 0.90
Pixtral 12B (arXiv:2410.07073)
paperarXivsources/pixtral-12b-arxiv-2410-07073
verifiedmedium · 0.75
Pixtral-12B-2409 params.json (HuggingFace)
repoHuggingFace / Mistralsources/hf-mm-pixtral-12b-params
verifiedhigh · 0.95
PKU-SEC-Lab/HybriMoE - official implementation of HybriMoE
repoPKU-SEC-Labsources/repo-pku-sec-lab-hybrimoe
verifiedmedium · 0.80
PLAID: An Efficient Engine for Late Interaction Retrieval (arXiv:2205.09707)
paperarXivsources/pap-mm-plaid
verifiedhigh · 0.90
PLAID: An Efficient Engine for Late Interaction Retrieval (CIKM 2022)
paperarXivsources/niche-colbert-plaid-paper
verifiedhigh · 0.90
PMLR ICML 2021 proceedings (volume 139)
databasePMLRsources/sco-pmlr-icml-2021-v139
verifiedhigh · 0.95
PMLR ICML 2022 proceedings (volume 162)
databasePMLRsources/sco-pmlr-icml-2022-v162
verifiedhigh · 0.95
PMLR ICML 2023 proceedings (volume 202)
databasePMLRsources/sco-pmlr-icml-2023-v202
verifiedhigh · 0.95
PMLR ICML 2024 proceedings (volume 235)
databasePMLRsources/sco-pmlr-icml-2024-v235
verifiedhigh · 0.95
PMLR ICML 2025 proceedings (volume 267)
databasePMLRsources/sco-pmlr-icml-2025-v267
verifiedhigh · 0.95
Portkey AI Gateway - Load balancing (weighted, sticky) documentation
whitepaperPortkeysources/dep-portkey-load-balancing-docs
verifiedhigh · 0.92
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training (arXiv:2309.10400)
paperarXiv (ICLR 2024)sources/ctx-src-pose-positional-skip-training
verifiedhigh · 0.90
Post Training Quantization of Large Language Models with Microscaling Formats
paperarXivsources/quant-mx-ptq-paper
verifiedhigh · 0.85
Post Training Quantization of Large Language Models with Microscaling Formats (Tseng et al., 2024)
paperarXivsources/bench-meth-mxptq
verifiedhigh · 0.90
Power Aware Dynamic Reallocation For Inference / RAPID (arXiv:2601.12241)
paperYiwei Jiang, Sangeeta Chowdhary, Nathaniel Morris, Rutwik Jain, Srilatha Manne, Sam Baylisssources/pwr2-arxiv-power-aware-reallocation
verifiedmedium · 0.80
PowerInfer: Fast Large Language Model Inference with a Consumer-grade GPU (arXiv 2312.12456)
paperarXivsources/w3p-powerinfer-sosp24-arxiv
verifiedhigh · 0.88
Pre-gated MoE Crossref record (ISCA 2024)
databaseACM/IEEE ISCA 2024 (via Crossref)sources/pap-sys-pregatedmoe-crossref
verifiedhigh · 0.90
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert LLM Inference (arXiv 2308.12066)
paperarXiv (UT Austin)sources/pap-sys-pregatedmoe-arxiv
verifiedhigh · 0.90
Pre^3: Enabling Deterministic Pushdown Automata for Faster Structured LLM Generation (ACL 2025)
paperarXivsources/niche-lightllm-pre3-paper
verifiedhigh · 0.90
PrefixWall: Mitigating Prefix Caching Side Channels in Shared LLM Systems
paperCharacterises current defences as a sledgehammer - disable automatic prefix caching and cross-user cache sharing, isolating users at the cost of efficiency for regular users. That framing is the useful part for a serving engineer: the isolation/efficiency trade is explicit and currently resolved badly.sources/sec-arxiv-2603-10726
verifiedhigh · 0.90
Pretraining Large Language Models with NVFP4
paperarXivsources/quant-nvfp4-paper
verifiedhigh · 0.90
Pretraining Large Language Models with NVFP4 (arXiv 2509.25149)
paperarXivsources/bw-nv-nvfp4-paper
verifiedhigh · 0.90
Punica: Multi-Tenant LoRA Serving - MLSys 2024 proceedings index entry
paperMLSys / proceedings.mlsys.orgsources/w3p-punica-mlsys24-proceedings
verifiedhigh · 0.92
PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
paperarXivsources/pap-attn-pyramidkv-paper
verifiedhigh · 0.85
PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling (Fan et al.)
paperarXivsources/qlab-pyramidkv-paper
verifiedhigh · 0.88
PyTorch Inductor: torch/_inductor - ML compiler for PyTorch
repoPyTorch / Metasources/src5-pytorch-inductor-github
verifiedhigh · 0.95
QCT where-to-buy (distributor / reseller / SI list by country)
spec-sheetQCTsources/sup-buy-qct-where-to-buy
verifiedhigh · 0.85
Qdrant FastEmbed README
repoQdrantsources/embed-qdrant-fastembed-github
verifiedmedium · 0.80
QLoRA: Efficient Finetuning of Quantized LLMs
paperarXivsources/quant-torch-qlora-paper
verifiedhigh · 0.90
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving (Zhong et al., NYU/CoatNet)
paperarXivsources/qlab-qserve-paper
verifiedhigh · 0.88
Qualcomm Cloud AI 100 announcement deck (hardware architecture slide)
spec-sheetQualcomm Technologiessources/acc2-qcom-cloud-ai100-announcement-deck
verifiedhigh · 0.85
Qualcomm Cloud AI 100 product brief (five PCIe/M.2 form factors, spec table)
spec-sheetQualcomm Technologiessources/acc2-qcom-cloud-ai100-product-brief
verifiedhigh · 0.90
Qualcomm Cloud AI 100 Ultra LLM inference performance slide deck (April 2024)
benchmarkQualcommsources/qualcomm-cloud-ai100-ultra-llm-performance-apr2024
verifiedmedium · 0.70
Qualcomm Cloud AI 100 Ultra product brief
spec-sheetQualcomm Technologiessources/acc2-qcom-cloud-ai100-ultra-product-brief
verifiedhigh · 0.90
Qualcomm OnQ blog: 'Qualcomm AI200 Accelerator for Generative AI' (Feb 2023)
blogQualcomm Technologiessources/acc2-qcom-cloud-ai200-ondq
verifiedmedium · 0.80
QuaRot reference implementation (spcl/QuaRot GitHub repository README)
repospcl (Stanford / Sparsity in ML) on GitHubsources/qlab-quarot-github
verifiedhigh · 0.88
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (Ashkboos et al.)
paperarXivsources/qlab-quarot-paper
verifiedhigh · 0.88
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
paperarXivsources/pap-attn-quest
verifiedhigh · 0.95
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference (Tang et al., MIT Han Lab)
paperarXivsources/qlab-quest-paper
verifiedhigh · 0.88
QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks (Tseng et al.)
paperarXivsources/qlab-quip-sharp-paper
verifiedhigh · 0.88
Qwen docs — Speed Benchmark: Qwen3 family on NVIDIA H20 96GB (SGLang + HF Transformers)
benchmarkQwen Team / Alibabasources/qwen-docs-h20-speed-benchmark
verifiedmedium · 0.75
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, and Text Recognition (arXiv:2308.12966)
paperarXivsources/pap-mm-qwen-vl
verifiedhigh · 0.90
Qwen/Qwen2-Audio-7B-Instruct config.json
repoHugging Facesources/mbl-cfg-qwen2-audio-7b-instruct
verifiedhigh · 0.90
Qwen/Qwen2.5-72B-Instruct config.json
repoHugging Facesources/mbl-cfg-qwen2-5-72b
verifiedhigh · 0.90
Qwen/Qwen3-235B-A22B · Hugging Face
reposources/hf-qwen3-235b-a22b
verifiedmedium · 0.80
Qwen/Qwen3-235B-A22B config.json
repoHugging Facesources/mbl-cfg-qwen3-235b-a22b
verifiedhigh · 0.90
Qwen/Qwen3-30B-A3B · Hugging Face
reposources/qwen3-30b-a3b-card
verifiedmedium · 0.80
Qwen/Qwen3-30B-A3B config.json
repoHugging Facesources/mbl-cfg-qwen3-30b-a3b
verifiedhigh · 0.90
Qwen/Qwen3-8B config.json
repoHugging Facesources/mbl-cfg-qwen3-8b
verifiedhigh · 0.90
Qwen/Qwen3-Next-80B-A3B-Instruct · Hugging Face
reposources/qwen3-next-80b-a3b-instruct-card
verifiedmedium · 0.80
Qwen/Qwen3.5-122B-A10B config.json
repoQwen Team, Alibabasources/hf-qwen3-5-122b-a10b-config
verifiedhigh · 0.90
Qwen/Qwen3.5-122B-A10B model card
repoQwen Team, Alibabasources/hf-qwen3-5-122b-a10b-card
verifiedhigh · 0.85
Qwen/Qwen3.5-35B-A3B · Hugging Face
reposources/qwen35-35b-a3b-card
verifiedmedium · 0.80
Qwen/Qwen3.5-35B-A3B config.json
repoHugging Facesources/mbl-cfg-qwen3-5-35b-a3b
verifiedhigh · 0.90
Qwen/Qwen3.5-397B-A17B config.json
repoQwen Team, Alibabasources/hf-qwen3-5-397b-a17b-config
verifiedhigh · 0.90
Qwen/Qwen3.5-397B-A17B model card
repoQwen Team, Alibabasources/hf-qwen3-5-397b-a17b-card
verifiedhigh · 0.85
Qwen/Qwen3.6-35B-A3B config.json
repoQwen Team, Alibabasources/hf-qwen3-6-35b-a3b-config
verifiedhigh · 0.90
Qwen/Qwen3.6-35B-A3B model card
repoQwen Team, Alibabasources/hf-qwen3-6-35b-a3b-card
verifiedhigh · 0.85
Qwen/Qwen3.8-27B config.json
repoAlibaba Qwensources/hf-qwen3-8-27b-config
verifiedhigh · 0.95
Qwen/Qwen3.8-27B model card
repoAlibaba Qwensources/hf-qwen3-8-27b-card
verifiedhigh · 0.90
Qwen/Qwen3.8-Flash-Next · Hugging Face
reposources/qwen38-flash-next-card
verifiedmedium · 0.80
Qwen2-Audio Technical Report (arXiv:2407.10759)
paperarXivsources/pap-mm-qwen2-audio
verifiedhigh · 0.90
Qwen2-Audio-7B-Instruct config.json (HuggingFace)
repoHuggingFace / Qwensources/hf-mm-qwen2-audio-7b-config
verifiedhigh · 0.95
Qwen2-VL-7B-Instruct config.json (HuggingFace)
repoHuggingFace / Qwensources/hf-mm-qwen2-vl-7b-config
verifiedhigh · 0.95
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
paperarXivsources/pap-attn-qwen2-vl-mrope
verifiedhigh · 0.90
Qwen2.5-VL-7B-Instruct config.json (HuggingFace)
repoHuggingFace / Qwensources/hf-mm-qwen2-5-vl-7b-config
verifiedhigh · 0.95
Qwen3 Technical Report (arXiv:2505.09388, Qwen / Alibaba) - the authors' own evaluation tables for Qwen3-8B and the Qwen3 family
paperQwen (Alibaba)sources/w8-src-arxiv-2505-09388-qwen3-technical-report
verifiedhigh · 0.95
Qwen3 Technical Report (arXiv:2505.09388)
whitepaperarXiv / Alibaba Qwensources/model-cn-qwen3-report
verifiedhigh · 0.95
Qwen3 Technical Report (arXiv:2505.09388)
papersources/qwen3-tech-report-2505-09388
verifiedmedium · 0.80
Qwen3 Technical Report (arXiv:2505.09388), Table 11 — Qwen3-235B-A22B (Thinking)
papersources/qwen3-tech-report
verifiedmedium · 0.80
Qwen3-30B-A3B Hugging Face config.json (raw)
repoAlibaba / Hugging Facesources/fct2-hf-config-qwen3-30b-a3b
verifiedhigh · 0.90
Qwen3-32B Hugging Face config.json (raw)
repoAlibaba / Hugging Facesources/fct2-hf-config-qwen3-32b
verifiedhigh · 0.90
Qwen3-VL-8B-Instruct config.json (HuggingFace)
repoHuggingFace / Qwensources/hf-mm-qwen3-vl-8b-config
verifiedhigh · 0.95
Qwen3.5 and Qwen3.8-Flash-Next model cards and nested text configs (huggingface.co/Qwen)
release-notesAlibaba Qwensources/model-cn-qwen35-hybrid-card
verifiedhigh · 0.85
Qwen3.5-27B config.json (Hugging Face, Qwen/Qwen3.5-27B)
repoQwensources/mbl-cfg-qwen3-5-27b
verifiedhigh · 0.90
Qwen3.5-9B config.json (text_config, official repo)
repoHugging Facesources/hf-config-qwen3-5-9b
verifiedhigh · 0.90
r/LocalLLaMA 'Got P2P working with 4x 3090s' - community thread on making peer-to-peer work on GeForce Ampere
forumr/LocalLLaMAsources/comm-reddit-localllama-1c4gakl-p2p-4x3090
verifiedlow · 0.55
r/LocalLLaMA 'llama.cpp RPC Performance' - one user pools 56GB of VRAM across three machines and reports 4-5 tok/s decode
forumr/LocalLLaMAsources/comm-reddit-localllama-1hapq7e-llamacpp-rpc-perf
verifiedmedium · 0.70
r/LocalLLaMA 'Q4, Q5, Q8... why?' - community opinion on where the quantization quality cliff is, plus one user's own 3060 A/B test
forumr/LocalLLaMAsources/comm-reddit-localllama-1bltyis-q4-q5-q8
verifiedlow · 0.50
r/LocalLLaMA: '16x AMD MI50 32GB at 10 t/s (tg) & 2k t/s (pp) with Deepseek v3.2 (vllm-gfx906)'
forumr/LocalLLaMA (user u/ai-infos)sources/comm-reddit-mi50-deepseek-v32
verifiedmedium · 0.70
r/LocalLLaMA: 'Best LLM Inference engine for today?' thread
forumReddit / u/Double_Cause4609, u/ahstanin, u/b3081asources/sent-src-reddit-best-inference-engine-1kc4kv2
verifiedmedium · 0.70
r/LocalLLaMA: 'DGX Spark vs Ryzen AI 395' thread, comment by u/Eugr
forumReddit / u/Eugrsources/sent-src-reddit-spark-vs-strix-halo-1qb2p26
verifiedmedium · 0.70
r/LocalLLaMA: 'I spent 8+ hours benchmarking every MoE backend for Qwen3.5-397B NVFP4 on 4x RTX PRO 6000 (SM120)'
forumReddit / u/lawdawgattorneysources/sent-src-reddit-sm120-moe-backends-1rrfqlu
verifiedmedium · 0.70
r/LocalLLaMA: 'Llama.cpp vs vllm' thread, top answer by u/Tyme4Trouble
forumReddit / u/Tyme4Troublesources/sent-src-reddit-llamacpp-vs-vllm-1qexkwb
verifiedmedium · 0.70
r/LocalLLaMA: 'Local AI for a small/median accounting firm' thread, deployment writeup comment
forumReddit / u/Swoopleysources/sent-src-reddit-ollama-concurrency-ceiling-1led23c
verifiedmedium · 0.70
r/LocalLLaMA: 'PSA: NVIDIA DGX Spark has terrible CUDA & software compatibility' by u/goldcakes
forumReddit / u/goldcakessources/sent-src-reddit-dgx-spark-psa-1r569eb
verifiedmedium · 0.70
r/LocalLLaMA: 'Serving a large number of users with a custom 7b model' thread, TensorRT-LLM advocacy comment
forumRedditsources/sent-src-reddit-trtllm-is-king-191mylg
verifiedmedium · 0.70
r/LocalLLaMA: 'Talk me out of buying a 3rd Spark' thread
forumRedditsources/sent-src-reddit-3rd-spark-tensor-divisibility-1wfefc4
verifiedmedium · 0.70
r/LocalLLaMA: 'Talk me out of buying an RTX Pro 6000' by u/AvocadoArray
forumReddit / u/AvocadoArraysources/sent-src-reddit-rtx-pro-6000-talk-me-down-1ql9b7m
verifiedmedium · 0.70
r/LocalLLaMA: 'The vLLM team's daily life be like' thread, comment by u/Marksta
forumReddit / u/Markstasources/sent-src-reddit-vllm-quant-mess-1oia8fi
verifiedmedium · 0.70
r/LocalLLaMA: 'Thinking about grabbing 4x Ascend GX10s' thread
forumReddit / u/EasterElk, u/Erdeem, u/Serprotease, u/Guinnesssources/sent-src-reddit-ascend-gx10-cluster-1ukhw9n
verifiedmedium · 0.70
r/LocalLLaMA: 'What are the current go-to stacks in the industry' thread, answer by u/Tough_Palpitation331
forumReddit / u/Tough_Palpitation331sources/sent-src-reddit-goto-stacks-1dwarur
verifiedmedium · 0.70
r/LocalLLaMA: 'What is the best hardware under 10k to run local big models with over 200b parameters?'
forumReddit / u/MaxKruse96 and otherssources/sent-src-reddit-under-10k-200b-1otdr19
verifiedmedium · 0.70
r/LocalLLaMA: 'Why the Strix Halo is a poor purchase for most people' by u/NeverEnPassant
forumReddit / u/NeverEnPassantsources/sent-src-reddit-strix-halo-poor-purchase-1oonomc
verifiedmedium · 0.70
r/LocalLLaMA: M4 Max llama.cpp Qwen3.5-35B-A3B and 27B sweep (post 1rlyukb)
forumReddit r/LocalLLaMAsources/reddit-localllama-1rlyukb-m4-max-qwen35-llamacpp
verifiedlow · 0.60
r/LocalLLaMA: M5 Max 128GB mlx_lm.generate sweep (cryingneko, post 1rqnpvj)
forumReddit r/LocalLLaMAsources/reddit-localllama-1rqnpvj-m5-max-128gb-mlx-lm-sweep
verifiedlow · 0.60
r/LocalLLaMA: Qwen3.5 35B-A3B / 27B llama.cpp benches on R9700, W7900 and M5 Max (u/neuromacmd)
forumu/neuromacmd (r/LocalLLaMA)sources/reddit-localllama-1s4bggo-amd-qwen35-llamacpp
verifiedlow · 0.50
r/LocalLLaMA: three ~30B MoE models on M1 Max 64GB (post 1rdx2c7)
forumReddit r/LocalLLaMAsources/reddit-localllama-1rdx2c7-m1-max-30b-moe-llama-server
verifiedlow · 0.55
r/LocalLLaMA: vLLM vs SGLang on 2 Nvidia GPUs thread, answer by u/randomfoo2
forumReddit / u/randomfoo2sources/sent-src-reddit-vllm-vs-sglang-1jjl45h
verifiedmedium · 0.70
Radeon Pro W5700 row of the Radeon Pro W5000 series specification table (Wikipedia, citing AMD product page)
spec-sheetWikipedia, citing AMDsources/amd-radeon-pro-w5700-wikipedia-spec-table
verifiedmedium · 0.70
rapid-mlx eval scorecard: 17 MLX models on Apple M3 Ultra 256GB (2026-03-05)
benchmarkraullenchai (rapid-mlx)sources/rapid-mlx-scorecard-m3-ultra-2026-03-05
verifiedlow · 0.60
Ray Serve documentation
whitepaperRaysources/serve-ray-docs
verifiedhigh · 0.90
RBLN SDK (Rebellions compiler, runtime, vLLM)
spec-sheetRebellionssources/alt-rbln-sdk
verifiedhigh · 0.90
RCCL issue 2189: first ncclAllReduce aborts with HIP 'invalid device function' in a heterogeneous gfx1200+gfx1201 process
repoROCm/rcclsources/mgpu-rccl-2189-heterogeneous-arch
verifiedhigh · 0.85
RCCL issue 2191: Multi-communicator concurrent collectives deadlock on gfx90a (FSDP2+TP)
repoROCm/rcclsources/mgpu-rccl-2191-multicomm-deadlock
verifiedhigh · 0.85
RCCL PR 2187: Force Simple protocol for gfx12 single-node collectives to fix deadlock
repoROCm/rcclsources/mgpu-rccl-2187-gfx12-ll-deadlock
verifiedhigh · 0.85
RDMA: Remote Direct Memory Access
spec-sheetRDMA Consortiumsources/src5-rdma-docs
verifiedhigh · 0.90
ReAct: Synergizing Reasoning and Acting in Language Models (arXiv:2210.03629)
blogsources/pap-eff-react
verifiedhigh · 0.85
Reading Between the Lines: Towards Reliable Black-box LLM Fingerprinting via Zeroth-order Gradient Estimation (ZeroPrint)
paperArgues black-box fingerprinting from outputs is weak because non-linear output functions destroy parameter information, and estimates the input Jacobian by zeroth-order estimation over semantic-preserving word substitutions.sources/sec-arxiv-2510-06605
verifiedhigh · 0.90
Rebellions Rebel100 accelerator card brochure v1.6 (the document that prints the explicit '(Dense)' compute label)
spec-sheetRebellions, Inc. (rebellions.ai, the company's own WordPress uploads)sources/w4h-rebellions-rebel100-brochure-dense-label
verifiedhigh · 0.95
Rebellions Rebel100 brochure PDF v1.6 - the '16Gbps' sits in the 'Chiplet Interface (UCIe-A)' block, confirming it is NOT a DRAM pin rate
spec-sheetRebellions (rebellions.ai, the vendor's own brochure PDF)sources/w5a-rebellions-rebel100-brochure-16gbps-is-ucie-not-hbm
verifiedhigh · 0.95
Rebellions Rebel100 product page
spec-sheetRebellionssources/asic-rebellions-rebel100
verifiedhigh · 0.90
Recurrent Drafter for Fast Speculative Decoding in Large Language Models
paperarXiv (Cheng, Zhang, Zhang, Wang, Wang)sources/sd-redrafter-paper
verifiedhigh · 0.90
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
paperarXivsources/pap-arch-2404-07839
verifiedhigh · 0.90
Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement (arXiv:2402.14160)
blogsources/pap-eff-recursive-specdec
verifiedmedium · 0.75
ree2raz/inference-bench — reproducible head-to-head LLM serving benchmark on a single NVIDIA L4 (vLLM v0.8.5 / SGLang v0.4.6 / llama.cpp b5540, results/summary.csv)
benchmarkRituraj (ree2raz) / Modalsources/ree2raz-inference-bench-nvidia-l4-sweep
verifiedmedium · 0.65
Reflection: Beam is now available
blogReflectionsources/reflection-beam-available-2026-10-16
verifiedmedium · 0.70
reflection/Beam-1.0-501B-A23B config.json
repoReflectionsources/hf-beam-1-0-501b-a23b-config
verifiedhigh · 0.90
reflection/Beam-1.0-501B-A23B model card
repoReflectionsources/hf-beam-1-0-501b-a23b-card
verifiedmedium · 0.80
Replicate as cloud orchestrator - Per-second billing, model hosting, multi-GPU requires commitment
databaseReplicatesources/ppl-orch-replicate-billing-model
verifiedhigh · 0.90
Replicate multi-GPU tiers require committed spend contracts
databaseReplicatesources/ppl-cloud-replicate-committed-spend
verifiedhigh · 0.90
Replicate Pricing - Per-second hardware rates for CPU and GPU instances
databaseReplicatesources/ppl-cloud-replicate-pricing
verifiedhigh · 0.95
Replicate vs raw cloud GPU pricing - Per-second rates vs per-hour cloud rates
databaseReplicatesources/ppl-cloud-replicate-vs-cloud-price
verifiedhigh · 0.90
Reproducing the AMD MLPerf Inference v6.0 Submission Result (ROCm Blogs)
benchmarkAMDsources/bench-amd-mlperf-v6-0-repro-guide
verifiedhigh · 0.85
Request-Level Energy Attribution for Batched LLM Serving / JouleShare (arXiv:2608.00026)
paperQi Luo, Kunlin Li, Ziwen Wang, Dongsheng Wang, Yun Chensources/pwr2-arxiv-jouleshare
verifiedmedium · 0.80
REST: Retrieval-Based Speculative Decoding (arXiv:2311.08252)
blogsources/pap-eff-rest-speculative
verifiedhigh · 0.85
Retentive Network: A Successor to Transformer for Large Language Models
paperSun et al. / Microsoft Research (arXiv)sources/arch-retnet
verifiedhigh · 0.92
Retentive Network: A Successor to Transformer for Large Language Models
paperarXivsources/pap-arch-2307-08621
verifiedhigh · 0.90
Retentive Network: A Successor to Transformer for Large Language Models
paperarXivsources/pap-attn-retnet
verifiedhigh · 0.85
Rethinking Attention with Performers
paperarXivsources/pap-attn-performer
verifiedhigh · 0.95
Revisiting Lossy Verification in Speculative Decoding: Mechanisms, Trade-offs, and Failure Modes
paperTianyu Wang et al.sources/ev-lossy-verification-speculative-decoding
verifiedhigh · 0.85
Revisiting the Robustness of Watermarking to Paraphrasing Attacks
paperRastogi and Pruthi, Indian Institute of Science. Shows a limited number of black-box generations from a watermarked model suffices to reverse-engineer the scheme and make paraphrase evasion effective, including against schemes designed to be paraphrase-robust. DIRECTLY CONTRADICTS the robustness claims in the literature it surveys - see the contested paraphrase record.sources/sec-arxiv-2411-05277
verifiedhigh · 0.90
Ring Attention with Blockwise Transformers for Near-Infinite Context
paperarXivsources/flop2-ring-attention
verifiedhigh · 0.90
Ring Attention with Blockwise Transformers for Near-Infinite Context
paperarXivsources/pap-attn-ring-attention
verifiedhigh · 0.90
Robust Distortion-free Watermarks for Language Models (Kuditipudi et al.)
paperDistribution-preserving watermarks via inverse transform sampling and exponential minimum sampling. On OPT-1.3B and LLaMA-7B detects at p<=0.01 from 35 tokens after corrupting 40-50% of tokens. Crucially, the Alpaca-7B case study on RESPONSES to user instructions finds ~25% of responses undetectable because those responses are low-entropy.sources/sec-arxiv-2307-15593
verifiedhigh · 0.90
ROCm 'AMD Instinct MI100 microarchitecture' reference - 23 GT/sec fabric links and the host PCIe attach
whitepaperAMDsources/w7a-amd-mi100-microarch-if-23gt-and-host-pcie
verifiedhigh · 0.95
ROCm 'AMD Instinct MI250 microarchitecture' reference - 25 GT/sec links, die-to-die vs host PCIe, and the x8 caveat
whitepaperAMDsources/w7a-amd-mi250-microarch-if-25gt-and-per-gcd-host-pcie
verifiedhigh · 0.95
ROCm 'AMD Instinct MI300 Series microarchitecture' reference - host PCIe Gen 5 x16 attach and the 7-link mesh
whitepaperAMDsources/w7a-amd-mi300-microarch-host-pcie-gen5
verifiedhigh · 0.95
ROCm 10.0.0 Compatibility Matrix
spec-sheetAMDsources/src5-rocm-compatibility-matrix-10
verifiedhigh · 0.95
ROCm 10.0.0 compatibility matrix (GPU -> LLVM target)
release-notesAMDsources/amd-rocm-compatibility-matrix
verifiedhigh · 0.95
ROCm Examples README
repoAMD ROCmsources/amd-rocm-examples-readme
verifiedhigh · 0.90
ROCm issue #4625: rocBLAS 6.4.0 ships no TensileLibrary for gfx906
forumAMD (ROCm) / user ye-luosources/comm-rocm-issue-4625-tensile-gfx906
verifiedmedium · 0.70
ROCm issue #5215: [Feature] Add support for Instinct MI50/MI60 (gfx906)
forumAMD (ROCm) / user William-Droinsources/comm-rocm-issue-5215-mi50-support
verifiedmedium · 0.70
ROCm Linux install system requirements (supported GPU list)
release-notesAMDsources/amd-rocm-system-requirements
verifiedhigh · 0.90
ROCm MI100 microarchitecture reference (gfx908)
whitepaperAMDsources/amd-rocm-mi100-microarch
verifiedhigh · 0.95
ROCm MI300 series microarchitecture reference (gfx942, XCD)
whitepaperAMDsources/amd-rocm-mi300-microarch
verifiedhigh · 0.95
ROCm: Model quantization techniques (AMD Quark, GPTQ, bitsandbytes on Instinct)
repoAMDsources/quant-rocm-quant-doc
verifiedhigh · 0.90
ROCm/vllm#630: MXFP4 kernel dispatch fix for garbage output
forumAMD ROCmsources/src5-gotcha-rocm-vllm-630-mxfp4-dispatch
verifiedhigh · 0.90
rocmate: gfx1201 (Radeon RX 9070 / 9070 XT) ROCm support matrix
blogt0nd3 (rocmate)sources/t0nd3-rocmate-gfx1201
verifiedhigh · 0.85
Roofline: An Insightful Visual Performance Model for Floating-Point Programs and Multicore Architectures
paperACM Communications of the ACMsources/flop-roofline-williams-2008
verifiedhigh · 0.90
Route179 blog - Optimizing vLLM cold start with model streaming and compile caching (measured phase breakdown)
blogRoute179 (independent practitioner, project SafetyLens)sources/dep-route179-vllm-cold-start-phases
verifiedhigh · 0.88
RouteLLM GitHub repository (LMSYS LLM router)
repoLMSYS Org / UC Berkeley Sky Computing Labsources/niche-routellm-repo
verifiedhigh · 0.85
RouteLLM OpenReview record (ICLR 2025)
databaseOpenReview (ICLR)sources/pap-sys-routellm-openreview
verifiedhigh · 0.90
RouteLLM: Learning to Route LLMs with Preference Data (arXiv 2406.18665)
paperarXiv (Stanford / UC Berkeley / Together AI)sources/pap-sys-routellm-arxiv
verifiedhigh · 0.90
RULER paper (arXiv:2404.06654v3) Yi-34B model analysis section and per-category effective-length tables
paperarXiv / NVIDIAsources/ctx-src-ruler-paper-yi-ablation
verifiedhigh · 0.90
RULER: What's the Real Context Size of Your Long-Context Language Models? (arXiv:2404.06654)
paperarXivsources/mkt-ruler-long-context-benchmark
verifiedhigh · 0.95
Run inference on Cloud TPU
spec-sheetGoogle Cloudsources/alt-tpu-inference
verifiedhigh · 0.90
Runpod GPU Cloud pricing
databaseRunpodsources/sup-cloud-runpod-gpu-pricing
verifiedhigh · 0.97
RunPod on-demand GPU cloud price list
benchmarkRunPodsources/sup-price-runpod-on-demand
verifiedmedium · 0.70
RWKV: Reinventing RNNs for the Transformer Era
paperPeng et al. / EleutherAI (arXiv)sources/arch-rwkv
verifiedhigh · 0.92
RWKV: Reinventing RNNs for the Transformer Era
paperarXivsources/pap-arch-2305-13048
verifiedhigh · 0.90
RWKV: Reinventing RNNs for the Transformer Era
paperarXivsources/pap-attn-rwkv
verifiedhigh · 0.85
RWKV/v5-Eagle-7B-HF config.json
repoHugging Facesources/mbl-cfg-rwkv5-eagle-7b
verifiedhigh · 0.90
RWKV/v5-Eagle-7B-HF model repo
repoRWKV / BlinkDLsources/hf-eco-rwkv5-eagle-7b
verifiedhigh · 0.95
s1: Simple test-time scaling (arXiv:2501.19393)
blogsources/pap-eff-s1-budget-forcing
verifiedhigh · 0.85
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding (ACL 2024)
paperXu et al., University of Washington / Penn State / AI2. Safety-disclaimer tokens remain in the top of the sorted token distribution even under attack; the defence amplifies them and attenuates attacker-goal tokens. Author-reported as incurring 'negligible' computation overhead, and applied only to the first m decode steps rather than every step. Their own ATGR metric (avg token generation time with/without defence) is the reported efficiency number; no absolute ms or throughput figure appears in the abstract.sources/sec-arxiv-2402-08983
verifiedhigh · 0.90
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
paperarXivsources/pap-attn-sageattention
verifiedhigh · 0.95
SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
paperarXivsources/pap-attn-sageattention2
verifiedhigh · 0.95
SALMONN: Towards Generic Hearing Abilities for Large Language Models (arXiv:2310.13289)
paperarXivsources/pap-mm-salmonn
verifiedhigh · 0.90
Salus: Fine-Grained GPU Sharing Primitives for Deep Learning Applications (arXiv 1902.04610)
paperarXiv (University of Michigan)sources/pap-sys-salus-arxiv
verifiedhigh · 0.90
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
paperMicrosoft (arXiv)sources/arch-samba
verifiedhigh · 0.92
SambaNova Cloud plans pricing table, fetched 2026-10-16
spec-sheetSambaNovasources/svc-src-sambanova-cloud-pricing-2026-10-16
verifiedhigh · 0.90
SambaNova Cloud pricing page, second read 2026-10-17 (list prices unchanged; OpenRouter shows a 25% off badge)
spec-sheetSambaNovasources/svc-src-sambanova-cloud-pricing-2026-10-17-reread
verifiedhigh · 0.90
SambaNova Cloud pricing table (per-1M-token list prices)
databaseSambaNovasources/svc-src-sambanova-cloud-pricing-2026-10-14
verifiedhigh · 0.85
SambaNova Cloud pricing table, re-read 2026-10-17
databaseSambaNovasources/svc-src-sambanova-cloud-pricing-2026-10-17
verifiedhigh · 0.90
SambaNova SN40L RDU Datasheet & Architecture Specifications
spec-sheetSambaNova Systemssources/asic-sambanova-sn40l
verifiedhigh · 0.95
SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts (arXiv:2405.07518)
whitepaperSambaNova Systemssources/ainv-sambanova-sn40l-paper
verifiedhigh · 0.85
SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills
paperarXivsources/flop2-sarathi
verifiedhigh · 0.90
Scaleway Generative APIs serverless pricing (Paris, EUR per million tokens), fetched 2026-10-16
spec-sheetScalewaysources/svc-src-scaleway-generative-apis-pricing-2026-10-16
verifiedhigh · 0.90
Scaling AI Inference Performance with vLLM on AMD Instinct MI355X GPUs (ROCm Blogs)
benchmarkAMDsources/bench-amd-mi355x-vs-b200-vllm
verifiedmedium · 0.75
Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time
paperarXivsources/pap-attn-scissorhands
verifiedhigh · 0.85
SecAlign: Defending Against Prompt Injection with Preference Optimization
paperTrains the served model to prefer secure over insecure responses on injected inputs. Reports reducing injection success rates to under 10% against attacks more sophisticated than those seen in training. This is a MODEL change, not a serving-layer change - it only exists if you retrain.sources/sec-arxiv-2410-05451
verifiedhigh · 0.90
See Hiong: Running Llama.cpp on AMD Strix Halo (Radeon 8060S, gfx1151)
blogSee Hiong's Blogsources/seehiong-strix-halo-llama-cpp
verifiedhigh · 0.90
Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference (SafeKV)
paperTreats global KV-cache sharing as the cause and builds detection plus isolation into the runtime. Reports up to 40.58% lower TTFT than full isolation and up to 2.66x throughput. Its stated threat model is the scope limit on the whole isolate-everything approach.sources/sec-arxiv-2508-08438
verifiedhigh · 0.90
Self-Consistency Improves Chain of Thought Reasoning in Language Models (arXiv:2203.11171)
blogsources/pap-eff-self-consistency
verifiedhigh · 0.85
Self-Guard: Empowering the LLM to Safeguard Itself
paperNames the two families precisely: safety training (cannot adapt to new attack types, drops performance) versus safeguards (external models or filters, 'of limited help').sources/sec-arxiv-2310-15851
verifiedhigh · 0.90
Semantic Chameleon: Corpus-Dependent Poisoning Attacks and Defenses in RAG Systems
paperGradient-guided (GCG) corpus poisoning on Security Stack Exchange, 67,941 documents, 50 attacks: 38.0% co-retrieval under pure vector retrieval. Hybrid BM25+vector retrieval reduces attack success from 38% to 0% with no model change; when the attacker jointly optimises payloads for both sparse and dense signals it partially recovers, to 20-44%.sources/sec-arxiv-2603-18034
verifiedhigh · 0.90
Semi-PD GitHub repository (infinigence/Semi-PD)
repoInfinigence AIsources/pd-semipd-repo
verifiedhigh · 0.85
Senn Tech: vLLM prefix caching measured on self-hosted Qwen3.8-27B
blogSenn Techsources/senn-tech-vllm-prefix-caching-qwen38-5090
verifiedlow · 0.62
Sentence Transformers README (embeddings, retrieval, reranking)
repoUKP Labsources/embed-sbert-github
verifiedhigh · 0.85
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
paperarXiv (Reimers, Gurevych; TU Darmstadt), EMNLP 2019sources/flop2-sbert
verifiedhigh · 0.90
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks (arXiv:1908.10084)
paperarXivsources/pap-mm-sbert
verifiedhigh · 0.90
sentence-transformers/all-MiniLM-L6-v2 config.json
repoHugging Facesources/hf-embed-all-minilm-l6-v2
verifiedhigh · 0.88
sentence-transformers/all-mpnet-base-v2 config.json
repoHugging Facesources/hf-embed-all-mpnet-base-v2
verifiedhigh · 0.88
Sequoia GitHub repository (tree-based speculative decoding, Infini-AI-Lab)
repoInfini AI Labsources/niche-sequoia-repo
verifiedhigh · 0.85
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding (arXiv:2402.12374)
blogsources/pap-eff-sequoia
verifiedmedium · 0.75
ServerPartDeals refurbished Dell XE9680 8x H100 SXM5 listing
benchmarkServerPartDealssources/sup-price-serverpartdeals-h100
verifiedmedium · 0.70
Servers Direct AI infrastructure shop (build-to-order, publish base config prices)
spec-sheetServers Directsources/sup-buy-servers-direct
verifiedhigh · 0.85
Serving DNNs like Clockwork: Performance Predictability from the Bottom Up (arXiv 2006.02464)
paperarXiv (Google / University of Washington)sources/pap-sys-clockwork-arxiv
verifiedhigh · 0.90
sgl-model-gateway WASM rate-limit example README and its documented limitations
repoSGLang projectsources/ops-sglang-wasm-ratelimit-example
verifiedhigh · 0.90
sgl-router monitoring reference (router metric names, circuit breaker state, in-flight gauges)
repoSGLang projectsources/ops-sglang-router-monitoring
verifiedhigh · 0.90
sgl-router README (worker discovery, PD version grouping, KV bootstrap, API-key handling)
repoSGLang projectsources/ops-sglang-router-readme
verifiedhigh · 0.90
SGLang add_prometheus_middleware() - the /metrics mount and the flag that gates it
reposgl-project/sglangsources/w3m-sglang-prometheus-middleware
verifiedhigh · 0.93
SGLang Crossref record (NeurIPS 2024)
databaseAdvances in Neural Information Processing Systems (via Crossref)sources/pap-sys-sglang-crossref
verifiedhigh · 0.90
SGLang data_parallel_controller.py source code
repoSGLangsources/serve-sglang-dp-controller
verifiedhigh · 0.90
SGLang docs: PD Disaggregation
reposgl-project (SGLang)sources/pd-sglang-pd-disagg-docs
verifiedhigh · 0.85
SGLang documentation index (llms.txt) plus supported-models page set
repoSGLang projectsources/mdl2-sglang-supported-models-index
verifiedhigh · 0.90
SGLang GitHub repository
repoSGLangsources/engine-sglang-github
verifiedhigh · 0.95
SGLang GitHub repository
repoSGLangsources/serve-sglang-github
verifiedhigh · 0.95
SGLang installation docs
repoSGLangsources/engine-sglang-install
verifiedhigh · 0.95
sglang issue #3361 — community-measured DeepSeek-V3 FP8 on 2x8 NVIDIA H800 (TP16)
forumsgl-project (GitHub issue, reporter @aooxin)sources/sglang-issue-3361-h800-deepseek-v3-fp8
verifiedlow · 0.55
SGLang issue #36140: DFLASH speculative decoding unsupported under PD disaggregation (spec_info None crash, then watchdog self-kill)
forumsgl-project/sglangsources/pd-gh-sglang-36140-dflash-spec-under-pd
verifiedhigh · 0.85
SGLang issue #39147: HiCacheFile reports an unrestorable prefix for hybrid cache pools
forumsgl-project/sglangsources/pd-gh-sglang-39147-hicache-false-prefix-hit
verifiedhigh · 0.85
SGLang issue #40877: '[SM120] Field report: DeepSeek-V4.1-Flash in production on 8x RTX PRO 6000 (PCIe, no NVLink) - working config, measured throughput, rejected topologies'
forumSGLangsources/ev-sglang-issue-40877-production-deepseek-v41-flash
verifiedhigh · 0.85
SGLang issue 25670: init_process_group crashes with cudaErrorNotSupported on single-GPU virtualized/MIG slices
reposgl-project/sglangsources/mgpu-sglang-25670-mig-eager-init
verifiedhigh · 0.85
SGLang issue 36943: --enable-symm-mem all TP schedulers deadlock in ncclCommWindowRegister
reposgl-project/sglangsources/mgpu-sglang-36943-symm-mem-deadlock
verifiedhigh · 0.85
SGLang issue 40723: Leaked sgl_shm_mm_* segments fill /dev/shm -> permanent crashloop
reposgl-project/sglangsources/mgpu-sglang-40723-devshm-leak
verifiedhigh · 0.85
SGLang issue 40877: [SM120] DeepSeek-V4.1-Flash field report on 8x RTX PRO 6000 (PCIe, no NVLink)
reposgl-project/sglangsources/mgpu-sglang-40877-sm120-pcie-field-report
verifiedhigh · 0.85
SGLang metrics_reporter._calculate_utilization - the in-source TODO that pins sglang:utilization at 0
reposgl-project/sglangsources/w3m-sglang-metrics-reporter-dead-utilization
verifiedhigh · 0.93
SGLang Model Gateway (sgl-model-gateway / sgl-router) README - control plane and data plane
repoSGLang projectsources/dep-sgl-model-gateway-readme
verifiedhigh · 0.93
SGLang observability server-arg field defaults (enable_metrics and friends)
reposgl-project/sglangsources/w3m-sglang-observability-arg-defaults
verifiedhigh · 0.93
SGLang PR 40726: Reclaim leaked /dev/shm segments at scheduler startup
reposgl-project/sglangsources/mgpu-sglang-40726-devshm-reclaim
verifiedhigh · 0.85
SGLang PR 41479: Let multi-node custom all-reduce v2 pass on topology alone
reposgl-project/sglangsources/mgpu-sglang-41479-multi-node-custom-ar
verifiedhigh · 0.85
SGLang PR 6651: Add PCIe device cross-NUMA node detection to prevent model output corruption
reposgl-project/sglangsources/mgpu-sglang-6651-cross-numa-allreduce
verifiedhigh · 0.85
SGLang Quantization Documentation
repoSGLangsources/qhw-src-sglang-quant-docs
verifiedhigh · 0.95
SGLang quantization kernel selection source (fp4_utils.py, fp8_utils.py, marlin_utils.py, modelopt_quant.py, utils/common.py arch predicates) read from main @ v0.5.21
repoSGLang projectsources/w6q-sglang-quant-kernel-gates-2026-10
verifiedhigh · 0.95
SGLang RFC #33394 - Recoverable KV Placement State with Snapshots and Event Replay (sgl-router)
forumSGLang projectsources/dep-sgl-router-33394-kv-placement-recovery-rfc
verifiedhigh · 0.93
SGLang server arguments reference (queueing, memory, scheduling, watchdog, retraction policy)
repoSGLang projectsources/ops-sglang-server-arguments
verifiedhigh · 0.95
SGLang sgl-model-gateway/src/middleware.rs - the http_request span and its request_id correlation
reposgl-projectsources/w5e-sglang-gateway-middleware-spans
verifiedhigh · 0.93
SGLang sgl-model-gateway/src/observability/otel_trace.rs - the Rust gateway's OTLP tracing setup and target filter
reposgl-projectsources/w5e-sglang-model-gateway-otel
verifiedhigh · 0.93
SGLang supported models: Diffusion language models
repoSGLang projectsources/mdl2-sglang-diffusion-language-models
verifiedhigh · 0.90
SGLang supported models: embedding, rerank, classify and reward pages
repoSGLang projectsources/mdl2-sglang-embedding-rerank-models
verifiedhigh · 0.90
SGLang supported models: Large Language Models (generative)
repoSGLang projectsources/mdl2-sglang-generative-models
verifiedhigh · 0.90
SGLang supported models: Multimodal Language Models
repoSGLang projectsources/mdl2-sglang-multimodal-language-models
verifiedhigh · 0.90
SGLang: Efficient Execution of Structured Language Model Programs
paperarXiv (SGLang team)sources/flop-sglang
verifiedhigh · 0.90
SGLang: Efficient Execution of Structured Language Model Programs (arXiv 2312.07104)
paperarXiv (Stanford / LMSYS)sources/pap-sys-sglang-arxiv
verifiedhigh · 0.90
SGLang: Fast inference for LLMs and multimodal models
reposgl-project (LMSYS)sources/src5-sglang-github
verifiedhigh · 0.95
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference (Li et al., ByteDance)
paperarXivsources/qlab-shadowkv-paper
verifiedhigh · 0.88
shenh10/DeepSeek_Simulator — measured-kernel DeepSeek V3/R1 decode throughput on H800/H20
repoHan Shen (GitHub)sources/deepseek-simulator-h800-h20-results
verifiedlow · 0.45
ShieldGemma: Generative AI Content Moderation Based on Gemma
paperSeparate moderation models over four harm types for both input and output. Reports +10.8% AU-PRC over Llama Guard and +4.3% over WildCard on public benchmarks - a usable head-to-head when choosing a guard.sources/sec-arxiv-2407-21772
verifiedhigh · 0.90
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect (arXiv:2403.03853)
blogsources/pap-eff-shortgpt
verifiedmedium · 0.75
SigLIP: Sigmoid Loss for Language Image Pre-Training (arXiv:2303.15343)
paperarXivsources/siglip-sigmoid-loss-for-language-image-pre-training-arxiv-2303-1
verifiedhigh · 0.90
Sigmoid Loss for Language Image Pre-Training (SigLIP) (arXiv:2303.15343)
paperarXivsources/pap-mm-siglip
verifiedhigh · 0.90
SignRound: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs (arXiv:2309.05516)
paperarXivsources/qhw-src-signround-paper
verifiedhigh · 0.95
Silicon Box Semiconductor Integration & Packaging Profile
spec-sheetSilicon Boxsources/ainv-silicon-box-about
verifiedmedium · 0.80
Silicon Score — Apple Silicon LLM benchmark audit surface (benchmarks.json, 432 rows)
databaseSilicon Scoresources/siliconscore-benchmarks-json-apple-silicon
verifiedlow · 0.50
Silicon Score — M3 Ultra chip page benchmark rows (26 rows, 15 models; evidence class labelled per row)
benchmarkSilicon Scoresources/siliconscore-m3-ultra-benchmark-table
verifiedmedium · 0.70
SiMa.ai MLSoC Modalix Product Page
spec-sheetSiMa.aisources/sima-ai-mlsoc-product-page
verifiedhigh · 0.85
SimCSE: Simple Contrastive Learning of Sentence Embeddings (arXiv:2104.08821)
paperarXivsources/pap-mm-simcse
verifiedhigh · 0.90
Simple linear attention language models balance the recall-throughput tradeoff
paperarXivsources/pap-attn-simple-linear-attention
verifiedhigh · 0.85
Simple linear attention language models balance the recall-throughput tradeoff (Based)
paperarXivsources/pap-arch-2402-18668
verifiedhigh · 0.90
SkyPilot as cloud orchestrator - Open-source, per-hour billing, 20+ cloud coverage
databaseSkyPilotsources/ppl-orch-skypilot-billing-model
verifiedhigh · 0.90
SkyPilot as price benchmark - Open-source multi-cloud GPU price comparison
databaseSkyPilotsources/ppl-bench-skypilot-price-benchmark
verifiedhigh · 0.90
SkyPilot Catalog - Automated multi-cloud GPU price database, refreshed every 7 hours
databaseSkyPilotsources/ppl-cloud-skypilot-catalog
verifiedhigh · 0.95
SkyPilot Catalog AWS GPU instances extract - Key instance types with per-hour rates
databaseSkyPilotsources/ppl-cloud-skypilot-aws-gpu-extract
verifiedhigh · 0.90
SkyPilot Catalog Azure GPU instances extract - ND series with per-hour rates
databaseSkyPilotsources/ppl-cloud-skypilot-azure-gpu-extract
verifiedhigh · 0.90
SkyPilot Catalog GCP GPU instances extract - A2/A3/A4 instance types with per-hour rates
databaseSkyPilotsources/ppl-cloud-skypilot-gcp-gpu-extract
verifiedhigh · 0.90
sm_120 (consumer/workstation Blackwell) FP8 status: NVIDIA's own kernels do not serve tensor/token-scaled FP8 GROUPED/MoE GEMM on SM_120 - a library-routing gap, not an absent FP8 path
repovLLM project / NVIDIA CUTLASS upstreamsources/vb-sm120-fp8-no-cuda-path-cutlass-unvalidated
verifiedmedium · 0.80
smcleod.net: patching the NVIDIA open GPU kernel modules to force BAR1 P2P on consumer cards, and retuning vLLM's fused MoE for RTX 3090
blogsmcleod.net (individual practitioner blog)sources/comm-blog-smcleod-p2p-patched-driver
verifiedlow · 0.60
SmolVLM-Instruct config.json (HuggingFace)
repoHuggingFace / HuggingFaceTBsources/hf-mm-smolvlm-instruct-config
verifiedhigh · 0.95
SmolVLM2-2.2B-Instruct config.json (HuggingFace)
repoHuggingFace / HuggingFaceTBsources/hf-mm-smolvlm2-2-2b-config
verifiedhigh · 0.95
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
paperarXivsources/quant-smoothquant-paper
verifiedhigh · 0.90
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models (Xiao et al., ICML 2023)
paperarXiv / ICML 2023sources/bench-meth-smoothq
verifiedhigh · 0.90
SnapKV: LLM Knows What You are Looking for Before Generation
paperarXivsources/pap-attn-snapkv-paper
verifiedhigh · 0.85
SnapKV: LLM Knows What You are Looking for Before Generation (Li et al.)
paperarXivsources/qlab-snapkv-paper
verifiedhigh · 0.88
Snowflake/snowflake-arctic-embed-l config.json
repoHugging Facesources/hf-embed-snowflake-arctic-embed-l
verifiedhigh · 0.88
Solar Open 2 config.json
repoUpstagesources/solar-open2-250b-config-json
verifiedhigh · 0.90
Solar Open 2 model card
repoUpstagesources/solar-open2-250b-model-card
verifiedmedium · 0.80
Sonar (ex-Aphrodite Engine) GitHub repository
repoDolphin Inference Networksources/niche-aphrodite-sonar-repo
verifiedhigh · 0.90
SOTA2 Research TTFT measurement on context sequences 32K-256K (vLLM 0.18.0/0.20.0)
benchmarkSOTA2 Research (formerly WizWand)sources/bench-sota2-wizwand-vllm-ttft-32k-256k
verifiedmedium · 0.80
SOTAAZ: KV cache, measured — Qwen3.5-9B hybrid vs Qwen3-8B on one A100
blogSOTAAZ Blogsources/sotaaz-kv-measured-qwen35-9b-a100
verifiedmedium · 0.80
SOTAAZ: llama.cpp KV cache quantization measured on one A100, Qwen3-8B
benchmarkSOTAAZ Blogsources/sotaaz-llamacpp-kv-quant-qwen3-8b-a100
verifiedmedium · 0.82
SoundStream: An End-to-End Neural Audio Codec (arXiv:2107.03312)
paperarXivsources/pap-mm-soundstream
verifiedhigh · 0.90
Sparse Attention with Linear Units
paperarXivsources/pap-attn-sau
verifiedhigh · 0.95
SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference (arXiv:2410.04417)
paperarXivsources/pap-mm-sparsevlm
verifiedhigh · 0.90
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification (arXiv:2305.09781)
blogsources/pap-eff-specinfer
verifiedhigh · 0.85
Speculative Decoding: Fast Inference with Speculative Sampling
paperGooglesources/src5-speculative-decoding-paper
verifiedhigh · 0.90
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities (arXiv:2305.11000)
paperarXivsources/pap-mm-speechgpt
verifiedhigh · 0.90
SpinQuant: LLM quantization with learned rotations
paperarXivsources/quant-spinquant-paper
verifiedhigh · 0.90
SpinQuant: LLM Quantization with Learned Rotations (Liu et al., ICLR 2025)
paperarXiv / ICLR 2025sources/bench-meth-spin
verifiedhigh · 0.90
SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking (arXiv:2107.05720)
paperarXivsources/pap-mm-splade
verifiedhigh · 0.90
Splitwise Crossref record (ISCA 2024)
databaseACM/IEEE ISCA 2024 (via Crossref)sources/pap-sys-splitwise-crossref
verifiedhigh · 0.90
Splitwise: Efficient generative LLM inference using phase splitting
paperarXivsources/flop2-splitwise
verifiedhigh · 0.90
Splitwise: Efficient generative LLM inference using phase splitting (arXiv 2311.18677)
paperarXiv (Microsoft / University of Washington)sources/pap-sys-splitwise-arxiv
verifiedhigh · 0.90
Splitwise: Efficient generative LLM inference using phase splitting (Microsoft)
paperarXiv (Patel, Choukse, Zhang, Shah, Goiri, Maleki, Bianchini; Microsoft)sources/pd-splitwise-msr-paper
verifiedhigh · 0.85
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression (arXiv:2306.03078)
paperarXivsources/qhw-src-spqr-paper
verifiedhigh · 0.95
SqueezeLLM: Dense-and-Sparse Quantization (Kim et al.)
paperarXivsources/qlab-squeezellm-paper
verifiedhigh · 0.88
Stanford ColBERT README (late interaction reference implementation)
repoStanford FutureData Systemssources/embed-colbert-github
verifiedmedium · 0.80
Stateful Large Language Model Serving with Pensieve (Shi et al., Microsoft)
paperarXivsources/qlab-pensieve-paper
verifiedhigh · 0.88
Step 3.5 Flash: Fast Enough to Think. Reliable Enough to Act.
blogsources/step-3-5-flash-blog
verifiedmedium · 0.80
Step-3.5-Flash model card and config (huggingface.co/stepfun-ai)
release-notesStepFunsources/model-cn-step-3-5-card
verifiedhigh · 0.85
StepFun Step 5 Preview model page
blogStepFunsources/stepfun-step-5-preview-page
verifiedmedium · 0.75
stepfun-ai/Step-3.5-Flash-Base · Hugging Face
reposources/step-3-5-flash-hf-base
verifiedmedium · 0.80
stepfun-ai/Step-5-Preview config.json
repoStepFunsources/hf-step-5-preview-config
verifiedhigh · 0.90
stepfun-ai/Step-5-Preview model card
repoStepFunsources/hf-step-5-preview-card
verifiedmedium · 0.80
Stoa Markets public hardware index levels (marketing page)
blogStoa Markets, Inc.sources/sup-price-stoa-index
verifiedmedium · 0.70
Stoa research: How the secondary GPU market works
blogStoa Markets, Inc.sources/sup-price-stoa-secondary-market
verifiedmedium · 0.70
Striped Attention: Faster Ring Attention for Causal Transformers
paperarXivsources/pap-attn-striped-attention
verifiedhigh · 0.85
Strix Halo Home Lab llama.cpp performance page: Qwen3-30B-A3B UD-Q4_K_XL depth sweep (ROCm 7.10 vs Vulkan)
benchmarkStrix Halo Home Lab (deseven)sources/strix-halo-homelab-llamacpp-performance-qwen3-30b-a3b-depth-sweep
verifiedmedium · 0.70
Strix Halo homelab wiki — llama.cpp performance: Qwen3-30B-A3B UD-Q4_K_XL depth sweep (HIP / Vulkan RADV / Vulkan AMDVLK)
benchmarkstrixhalo-homelab (deseven wiki, lhl measurements)sources/strix-halo-homelab-wiki-qwen3-30b-a3b-depth-sweep
verifiedmedium · 0.72
Structured Denoising Diffusion Models in Discrete State-Spaces (SEDD)
paperarXivsources/pap-arch-2107-03006
verifiedhigh · 0.90
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
paperarXivsources/pap-arch-2101-03961
verifiedhigh · 0.95
sycl_ext_oneapi_matrix joint_matrix extension specification
spec-sheetIntelsources/sycl-ext-oneapi-matrix-joint-matrix-spec
verifiedhigh · 0.90
SyFI Lab (UW) — VibeSys Builds a Qwen3.5-397B Engine on MI300A, 2.3x Tuned SGLang
blogSyFI Lab, University of Washingtonsources/syfi-qwen35-397b-mi300a-vibesys
verifiedmedium · 0.80
SynapseAI Core README (archived, not maintained)
repoHabanaAIsources/xpu-synapseai-core-readme
verifiedhigh · 0.95
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve (arXiv 2403.02310)
paperarXiv (Microsoft Research India)sources/pap-sys-sarathi-arxiv
verifiedhigh · 0.90
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve (OSDI 2024)
paperarXivsources/sched-sarathi-osdi24
verifiedhigh · 0.90
TechInsights: Enflame S60 AI Accelerator Processor Floorplan Analysis
reviewTechInsightssources/cn-enflame-techinsights
verifiedmedium · 0.70
TEI router/src/http/server.rs - per-route OTel spans with parent-context propagation
repohuggingfacesources/w5e-tei-router-server-rs-spans
verifiedhigh · 0.94
TEI router/src/prometheus.rs - metric bucket construction for the text-embeddings-inference router
repohuggingfacesources/w5e-tei-prometheus-rs
verifiedhigh · 0.94
teknium/OpenHermes-2.5-Mistral-7B config.json
repoHugging Facesources/mbl-cfg-openhermes-2-5-mistral-7b
verifiedhigh · 0.90
teknium/OpenHermes-2.5-Mistral-7B model repo
repotekniumsources/hf-eco-openhermes-2-5-mistral-7b
verifiedhigh · 0.95
tencent/Hy-Memory-30B-A3B · Hugging Face
reposources/hy-memory-30b-a3b-hf
verifiedmedium · 0.80
tencent/Hy-Memory-30B-A3B model card and config.json
repoTencent Hunyuansources/hf-hy-memory-30b-a3b
verifiedhigh · 0.90
Tensorfuse docs blog - Reduce vLLM GPU cold start time on Kubernetes (Sept 2025 case study)
blogTensorfusesources/dep-tensorfuse-vllm-cold-start-case-study
verifiedhigh · 0.85
TensorRT-LLM architecture overview docs
repoNVIDIAsources/engine-trtllm-architecture
verifiedhigh · 0.95
TensorRT-LLM docs/source/installation/build-from-source.md
blogNVIDIAsources/ev-trtllm-build-from-source-doc
verifiedhigh · 0.90
TensorRT-LLM GitHub repository
repoNVIDIAsources/engine-trtllm-github
verifiedhigh · 0.95
TensorRT-LLM issue #17665: NIXL cache-transceiver hangs forever if a single completion notification is dropped
forumNVIDIA/TensorRT-LLMsources/pd-gh-trtllm-17665-nixl-notify-hang
verifiedhigh · 0.85
TensorRT-LLM issue #5581: 'Unsupported SM version for FP8 block scaling GEMM' on 8x RTX 6000 PRO; contains an NVIDIA engineer's arch explanation and a community counter-measurement
forumTensorRT-LLM GitHub issuessources/comm-github-trtllm-5581-8x-rtx6000pro-deepseek
verifiedhigh · 0.85
TensorRT-LLM issue #8286: '[Usage]: how long the build stage takes for deepseek-r1 models' - 2+ hours observed
forumNVIDIAsources/ev-trtllm-issue-8286-ds-r1-build-2h
verifiedmedium · 0.80
TensorRT-LLM Linux pip installation docs
repoNVIDIAsources/engine-trtllm-install
verifiedhigh · 0.95
TensorRT-LLM llm_args.py - return_perf_metrics default and PrometheusMetricsConfig
repoNVIDIA/TensorRT-LLMsources/w3m-trtllm-return-perf-metrics-default
verifiedhigh · 0.90
TensorRT-LLM Marlin NVFP4 W4A16 kernel and its own arch predicate isMarlinNvfp4DenseSmSupported (SM89, SM90-99, SM120/121 only)
repoNVIDIA TensorRT-LLMsources/w6q-trtllm-marlin-nvfp4-2026-10
verifiedhigh · 0.95
TensorRT-LLM metrics/collector.py - zero preemption metrics, confirmed by search
repoNVIDIA/TensorRT-LLMsources/w3m-trtllm-metrics-no-preempt-search
verifiedhigh · 0.90
TensorRT-LLM parallelism docs
repoNVIDIAsources/engine-trtllm-parallel
verifiedhigh · 0.95
TensorRT-LLM performance overview tables (Total Output Throughput, trtllm-bench)
benchmarkNVIDIAsources/bench-nv-trtllm-perf-overview
verifiedhigh · 0.90
TensorRT-LLM PR #11250: engine build time improved, 'Nemotron Super V3 fp8 model : 290 sec to 260 sec for tp=8'
release-notesNVIDIAsources/ev-trtllm-pr-11250-engine-build-time
verifiedhigh · 0.85
TensorRT-LLM PR #18542: FMHA NVRTC JIT warmup sits on the cold-start critical path (5-11 s per kernel, 80-160 s total)
release-notesNVIDIAsources/ev-trtllm-pr-18542-fmha-jit-warmup
verifiedhigh · 0.85
TensorRT-LLM PR #7633: '[None][infra] Disable CU12 build to save build time (cost > 5 hours on SBSA)'
release-notesNVIDIAsources/ev-trtllm-pr-7633-cu12-build-over-5h
verifiedhigh · 0.85
TensorRT-LLM quantization - Hardware Support Matrix (per-GPU-arch Y/. cells)
repoNVIDIAsources/qzgw-trtllm-hardware-matrix
verifiedhigh · 0.90
TensorRT-LLM Quantization docs (model + hardware support matrices)
repoNVIDIAsources/quant-trtllm-quantization
verifiedhigh · 0.90
TensorRT-LLM quantization documentation (versioned 1.3.0rc29 site, read 2026-10-04)
blogNVIDIAsources/ev-trtllm-quantization-doc
verifiedhigh · 0.85
TensorRT-LLM serve/openai_server.py - the /prometheus/metrics route and the flag that mounts it
repoNVIDIA/TensorRT-LLMsources/w3m-trtllm-prometheus-endpoint-gate
verifiedhigh · 0.90
TensorRT-LLM supported models and feature matrices (PyTorch backend)
repoNVIDIAsources/mdl2-trtllm-supported-models
verifiedhigh · 0.92
TensorRT-LLM: LLM inference on NVIDIA GPUs
repoNVIDIAsources/src5-tensorrt-llm-github
verifiedhigh · 0.95
TensorRT: NVIDIA's inference optimizer and runtime
repoNVIDIAsources/src5-tensorrt-github
verifiedhigh · 0.90
Tenstorrent Blackhole PCIe Cards (p100a/p150a/p150b) - official card comparison table
spec-sheetTenstorrentsources/vb-tt-blackhole-p150-spec-table
verifiedhigh · 0.95
Tenstorrent cards storefront and comparison table
spec-sheetTenstorrentsources/asic-tenstorrent-cards-shop
verifiedhigh · 0.90
Tenstorrent documentation (TT-Forge, TT-NN, TT-Metalium)
spec-sheetTenstorrentsources/alt-tenstorrent-docs
verifiedhigh · 0.90
Tenstorrent Grayskull e75/e150 specifications page - cores, SRAM, LPDDR4, bandwidth, TFLOPS, TBP, and the software-support-discontinued notice
spec-sheetTenstorrent (docs.tenstorrent.com)sources/w7z-tenstorrent-grayskull-specs
verifiedhigh · 0.90
Tenstorrent Warp 100 Bridge documentation
spec-sheetTenstorrentsources/link2-tenstorrent-warp100-bridge
verifiedhigh · 0.85
Tenstorrent Wormhole PCIe Cards (n150d/n150s/n300d/n300s) - official card comparison table
spec-sheetTenstorrentsources/vb-tt-wormhole-n150-spec-table
verifiedhigh · 0.95
Tetrate - Envoy AI Gateway and Tetrate Agent Router performance benchmarks (2026 living reference)
blogTetrate (Envoy AI Gateway co-creator; competitor of the gateways it compares)sources/dep-tetrate-envoy-ai-gateway-benchmarks
verifiedhigh · 0.85
Text Embeddings by Weakly-Supervised Contrastive Pre-training (E5) (arXiv:2212.03533)
paperarXivsources/pap-mm-e5
verifiedhigh · 0.90
Text Embeddings Inference GitHub repository
repoHugging Facesources/niche-tei-repo
verifiedhigh · 0.90
Text Embeddings Inference OpenAPI spec (docs/openapi.json)
spec-sheetHuggingFacesources/embed-hf-tei-openapi
verifiedhigh · 0.85
Text Generation Inference Gaudi backend quantization dispatch: the closed set of quantize values get_loader() accepts and the HybridFP8UnquantLoader default
repoHugging Face (text-generation-inference)sources/w6q-tgi-gaudi-quant-dispatch-2026-10
verifiedhigh · 0.95
TGI backend queue implementation (unbounded mpsc channel into the batching task)
repoHugging Facesources/ops-tgi-queue-unbounded
verifiedhigh · 0.90
TGI backends/v3/src/backend.rs - batch-level metrics, their method labels, and the absence of TTFT/KV usage
repohuggingface/text-generation-inferencesources/w3m-tgi-v3-backend-metrics
verifiedhigh · 0.92
TGI metrics reference (queue size, queue duration, batch size and failure counters)
repoHugging Facesources/ops-tgi-metrics
verifiedhigh · 0.90
TGI router design note (continuous batching, prefill/decode asymmetry, latency-throughput tradeoff)
repoHugging Facesources/ops-tgi-router
verifiedhigh · 0.90
TGI router InferError::Overloaded to HTTP 429 mapping and the max_concurrent_requests semaphore
repoHugging Facesources/ops-tgi-infer-overloaded-429
verifiedhigh · 0.95
TGI router/src/server.rs - PrometheusBuilder bucket config and prometheus_port
repohuggingface/text-generation-inferencesources/w3m-tgi-prometheus-buckets-and-port
verifiedhigh · 0.92
The Early Bird Catches the Leak: Unveiling Timing Side Channels in LLM Serving Systems
paperFirst demonstration that shared caches and GPU memory allocations create timing side channels from which an API caller can infer confidential SYSTEM PROMPTS and other users' requests.sources/sec-arxiv-2409-20002
verifiedhigh · 0.90
The Embedder's Dilemma: LLMs Are Better, but at What Cost? (arXiv:2608.12875)
paperarXivsources/pap-mm-embedder-dilemma
verifiedhigh · 0.90
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
paperarXivsources/quant-bitnet-paper
verifiedhigh · 0.90
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
paperHugging Facesources/ev-fineweb-dataset-paper
verifiedmedium · 0.80
The Joule Point: an Energy-Optimal Operating Point for AI Inference (arXiv:2609.27926)
paperAlexander Apartsin, Yehudit Apersteinsources/pwr2-arxiv-joule-point
verifiedhigh · 0.85
The State of FP8 KV-Cache and Attention Quantization in vLLM (vLLM project blog, 2026-04-22)
blogvLLM projectsources/ctx-src-vllm-fp8-kvcache-2026-04
verifiedhigh · 0.88
thenlper/gte-large config.json
repoHugging Facesources/hf-embed-gte-large
verifiedhigh · 0.88
tiiuae/Falcon-H1-7B-Base model repo
repoTII / Hugging Facesources/hf-eco-falcon-h1-7b-base
verifiedhigh · 0.95
tiiuae/falcon3-7B-Instruct config.json
repoHugging Facesources/mbl-cfg-falcon3-7b
verifiedhigh · 0.90
tiiuae/Falcon3-7B-Instruct model repo
repoTII / Hugging Facesources/hf-eco-falcon3-7b-instruct
verifiedhigh · 0.95
TinyLlama/TinyLlama-1.1B-Chat-v1.0 config.json
repoHugging Facesources/hf-edge-tinyllama-1-1b-chat
verifiedhigh · 0.88
TinyLlama/TinyLlama-1.1B-Chat-v1.0 config.json
repoHugging Facesources/mbl-cfg-tinyllama-1-1b-chat
verifiedhigh · 0.90
Titans: Learning to Memorize at Test Time
paperarXivsources/pap-arch-2501-00663
verifiedhigh · 0.90
Titans: Learning to Memorize at Test Time
paperarXivsources/pap-attn-titans
verifiedhigh · 0.85
Together AI as cloud orchestrator - Per-GPU-hour, per-token, and PTU billing models
databaseTogether AIsources/ppl-orch-together-billing-model
verifiedhigh · 0.90
Together AI Dedicated Inference - Per-GPU-hour single-tenant pricing
databaseTogether AIsources/ppl-cloud-together-dedicated-inference
verifiedhigh · 0.95
Together AI Llama 3.3 70B model page (endpoint id; price not on the extracted page)
databaseTogether AIsources/svc-src-together-llama33-model-page-2026-10-17
verifiedmedium · 0.70
Together AI pricing - GPU Clusters
databaseTogether AIsources/sup-cloud-together-gpu-clusters-pricing
verifiedhigh · 0.94
Together AI Pricing - GPU Clusters on-demand/preemptible/reserved + Dedicated Inference
databaseTogether AIsources/ppl-cloud-together-ai-full-pricing
verifiedhigh · 0.95
Together AI pricing page — GPU Clusters on-demand, Preemptible Compute and reserved tier table (re-read 2026-10-05)
databaseTogether AIsources/w5s-together-gpu-clusters-tiers-2026-10-05
verifiedhigh · 0.90
Together AI pricing page (serverless model table + GPU clusters)
spec-sheetTogether AIsources/rent-src-together-pricing
verifiedhigh · 0.90
Together AI serverless inference pricing table (per-1M-token list prices)
databaseTogether AIsources/svc-src-together-serverless-pricing-2026-10-14
verifiedhigh · 0.90
Token Latency Fairness: Performance Isolation for Multi-Tenant LLM Serving (arXiv 2609.18112)
paperarXiv (University of California, Berkeley)sources/pap-sys-fairinference-arxiv
verifiedhigh · 0.88
torch.compile documentation
repoPyTorch / Metasources/torch-compile-documentation
verifiedhigh · 0.85
torch.compile FAQ and troubleshooting
repoPyTorch / Metasources/torch-compile-faq-and-troubleshooting
verifiedhigh · 0.85
TorchServe GitHub repository (PyTorch Serve)
repoPyTorch / Linux Foundationsources/niche-torchserve-repo
verifiedhigh · 0.90
Towards General Text Embeddings with Multi-stage Contrastive Learning (arXiv:2308.03281)
paperarXivsources/pap-mm-gte
verifiedhigh · 0.90
Towards Load-Aware Prefill Deflection for Disaggregated LLM Serving (arXiv 2607.02043)
paperarXivsources/sched-kairos-arxiv
verifiedhigh · 0.88
Towards Load-Aware Prefill Deflection for Disaggregated LLM Serving (Kairos, arXiv:2607.02043)
paperMicrosoft Researchsources/paper-kairos-prefill-deflection-ttft-breakdown
verifiedhigh · 0.85
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings
paperGoogle / arXivsources/asic-tpu-v4-paper
verifiedhigh · 0.90
TPU7x (Ironwood) performance optimizations
spec-sheetGoogle Cloudsources/alt-tpu-ironwood-perf
verifiedhigh · 0.95
TPU7x (Ironwood) system architecture
spec-sheetGoogle Cloudsources/alt-tpu7x-ironwood
verifiedhigh · 0.95
Trainium3 UltraServers Now Available (AWS Press Release)
blogsources/trainium3-ultraservers-now-available-aws-press-release
verifiedhigh · 0.85
Transformer Engine NVFP4 documentation
repoNVIDIAsources/quant-nvfp4-te-docs
verifiedhigh · 0.90
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
paperarXivsources/pap-attn-linear-transformers
verifiedhigh · 0.95
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
paperDao & Gu (arXiv)sources/arch-mamba2-ssd
verifiedhigh · 0.92
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
paperarXivsources/pap-arch-2405-21060
verifiedhigh · 0.90
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
paperarXivsources/pap-attn-mamba-2
verifiedhigh · 0.95
TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer
paperarXivsources/pap-attn-transnormerllm
verifiedhigh · 0.85
Triton Inference Server GitHub repository
repoNVIDIAsources/niche-triton-repo
verifiedhigh · 0.85
Triton Inference Server README
repoNVIDIAsources/embed-triton-inference-server-github
verifiedhigh · 0.85
Triton metrics doc - default endpoint :8002, the disable flags, and per-family type selection
repoNVIDIA Triton Inference Serversources/w3m-triton-metrics-defaults-port
verifiedhigh · 0.92
Triton paper: An intermediate language and compiler for tiled neural network computation
paperACM MAPL 2019sources/triton-paper-an-intermediate-language-and-compiler-for-tiled-neu
verifiedhigh · 0.85
Triton TensorRT-LLM backend README - the six nv_trt_llm_* label-switched metric families
repotriton-inference-server/tensorrtllm_backendsources/w3m-triton-trtllm-backend-metric-families
verifiedhigh · 0.90
TT-Metal / TT-NN GitHub repository
repoTenstorrentsources/niche-tt-metal-repo
verifiedhigh · 0.85
tt-metal models README + model matrix (vendor measured)
benchmarkTenstorrentsources/tt-metal-models-readme-model-matrix-vendor-measured
verifiedmedium · 0.80
tt-metal README featured-models performance table (Tenstorrent vendor, 2025-2026 releases)
benchmarkTenstorrentsources/tt-metal-readme-model-matrix-2026
verifiedmedium · 0.80
TT-Metal tech report: FlashAttention on Wormhole (Colman Glagovich)
whitepaperTenstorrentsources/tt-metal-flashattention-wormhole-report
verifiedmedium · 0.80
TT-NN scaled-dot-product attention decode API
repoTenstorrentsources/ttnn-sdpa-decode-api
verifiedmedium · 0.80
Turbocharging Llama 2 70B with NVIDIA H100 (Perplexity)
blogPerplexitysources/bench-nv-perplexity-h100-llama2-blog
verifiedmedium · 0.80
Turning Whisper into Real-Time Transcription System (arXiv 2307.14743)
paperarXivsources/aud-src-whisper-streaming-paper
verifiedhigh · 0.95
Tutel: Adaptive Mixture-of-Experts at Scale
paperarXivsources/pap-arch-2206-03382
verifiedhigh · 0.90
UALink Consortium specifications index
spec-sheetUALink Consortiumsources/link-ualink-specification-index
verifiedhigh · 0.90
UALink white paper (TASK Consultancy)
whitepaperUALink Consortium / TASK Consultancysources/link-ualink-whitepaper
verifiedhigh · 0.90
UCX: Unified Communication X framework
repoOpenUCXsources/src5-ucx-github
verifiedhigh · 0.90
UEFI Forum specifications index
spec-sheetUEFI Forumsources/link-uefi-specifications
verifiedhigh · 0.90
Ultra Ethernet Consortium: UE Specification 1.0.3 and 1.0 white paper
spec-sheetUltra Ethernet Consortiumsources/link-uec-specification-1-0-3
verifiedhigh · 0.90
United States Data Center Energy Usage Report (LBNL, Shehabi et al. 2016)
paperLawrence Berkeley National Laboratorysources/nrg2-lbnl-2016-us-dc-energy-report
verifiedhigh · 0.95
United States Data Center Energy Usage Report: 2025 Update (LBNL / DOE, Shehabi et al.)
paperLawrence Berkeley National Laboratorysources/nrg2-lbnl-2025-us-dc-energy-report
verifiedhigh · 0.95
Unlocking Efficiency in LLM Inference: A Comprehensive Survey of Speculative Decoding (ACL 2024)
paperHeming Xia et al. (Peking University)sources/ev-speculative-decoding-survey
verifiedhigh · 0.85
Unlocking Longer Generation with Key-Value Cache Quantization (Hugging Face blog, 2024-05-16)
blogHugging Facesources/hf-blog-kv-cache-quantization-quanto
verifiedmedium · 0.70
Unsloth Dynamic 2.0 GGUF documentation
blogUnslothsources/hf-eco-unsloth-dynamic-gguf-doc
verifiedhigh · 0.95
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF repo (GGUF file tree)
repoUnsloth / Hugging Facesources/hf-eco-unsloth-deepseek-r1-distill-llama-8b-gguf
verifiedhigh · 0.95
unsloth/Hermes-4-405B-GGUF config.json
repoHugging Facesources/mbl-cfg-hermes-4-405b-gguf
verifiedhigh · 0.90
unsloth/Hermes-4-405B-GGUF repo (GGUF file tree)
repoUnsloth / Hugging Facesources/hf-eco-hermes-4-405b-gguf
verifiedhigh · 0.95
Unsupervised Dense Information Retrieval with Contrastive Learning (Contriever) (arXiv:2112.09118)
paperarXivsources/pap-mm-contriever
verifiedhigh · 0.90
Uptime Institute Global Data Center Survey Results 2026 - 16th annual survey, published July 2026
whitepaperUptime Institutesources/ppl-dep-uptime-institute-2026-survey
verifiedhigh · 0.85
US EIA Electric Power Annual Table 2.2 - Sales of Electricity to Ultimate Customers by Sector (MWh)
benchmarkUS Energy Information Administrationsources/pwr-eia-epa-table-2-2
verifiedhigh · 0.95
US EIA Electric Power Annual Table 2.3 - Revenue from Sales of Electricity to Ultimate Customers by Sector
benchmarkUS Energy Information Administrationsources/pwr-eia-epa-table-2-3
verifiedhigh · 0.95
US EIA Electric Power Annual Table 2.4 - Average Price of Electricity to Ultimate Customers by End-Use Sector (Cents per kWh)
databaseUS Energy Information Administrationsources/pd-eia-epa-table-2-4
verifiedhigh · 0.95
US EIA Electric Power Monthly Table 5.3 - Average Price of Electricity to Ultimate Customers by End-Use Sector, monthly series through July 2026
databaseUS Energy Information Administrationsources/pd-eia-epm-table-5-3
verifiedhigh · 0.95
USENIX NSDI '17 technical sessions (full program page)
databaseUSENIX Associationsources/pap-sys-nsdi17-proceedings
verifiedhigh · 0.90
USENIX OSDI '20 technical sessions (full program page)
databaseUSENIX Associationsources/pap-sys-osdi20-proceedings
verifiedhigh · 0.90
USENIX OSDI '23 technical sessions (full program page)
databaseUSENIX Associationsources/pap-sys-osdi23-proceedings
verifiedhigh · 0.90
USENIX OSDI '24 technical sessions (full program page)
databaseUSENIX Associationsources/pap-sys-osdi24-proceedings
verifiedhigh · 0.90
Vantage Data Centers - Cooling features page (air-cooled chiller model, liquid-to-the-chip posture)
spec-sheetVantage Data Centerssources/pwr2-vantage-cooling
verifiedhigh · 0.85
Vantage Data Centers - Power features page (published rack power-density limits)
spec-sheetVantage Data Centerssources/pwr2-vantage-power-density
verifiedhigh · 0.90
Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention
paperQin et al. (arXiv)sources/arch-lightning-attention
verifiedhigh · 0.92
Vast.ai GPU pricing
databaseVast.aisources/sup-cloud-vast-ai-pricing
verifiedmedium · 0.70
VAST.ai public offers API (console.vast.ai/api/v0/bundles)
benchmarkVAST.aisources/sup-price-vast-rental-api
verifiedmedium · 0.70
vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention
paperarXivsources/pap-attn-vattention
verifiedhigh · 0.90
velaia/Kolibri-1-MLX-2bit community quant repo
repovelaiasources/hf-velaia-kolibri-1-mlx-2bit
verifiedmedium · 0.75
Vendor spec-table host-interface (PCI Express generation) readings: NVIDIA GeForce RTX 30/40/50 product spec tables, RTX 6000 ADA + RTX PRO 6000 datasheets, Intel Arc B580 ARK + Arc Pro B60 datasheet
spec-sheetNVIDIA and Intel (mixed - see notes; each reading is attributed to its own vendor page)sources/w3a-pcie-generation-host-interface-spec-tables
verifiedhigh · 0.90
VERIFIED NEGATIVE (methodological): the Azure Retail Prices API silently ignores the $filter parameter
databaseMicrosoft Azuresources/w5s-azure-api-ignores-filter-negative
verifiedhigh · 0.95
VERIFIED NEGATIVE: Cambricon has published no MLU590 product page, datasheet or specification table - site search and targeted query both return nothing
spec-sheetCambricon (cambricon.com, the company's own site - the root, which is where a missing product page would have to hang)sources/w5a-cambricon-mlu590-no-vendor-document-exists
verifiedhigh · 0.85
VERIFIED NEGATIVE: Iluvatar's own BI-V150 (Tiangai 150) product page exists, returns HTTP 200, and contains NO specification table and no interconnect figure of any kind - not a blank field, an absent section
spec-sheetIluvatar CoreX (iluvatar.com, the company's own site)sources/w7f-iluvatar-bi-v150-vendor-page-has-no-spec-table
verifiedhigh · 0.90
VERIFIED NEGATIVE: MetaX publishes no compute figure for C500, C500X, C550 or N100 - vendor site unreadable AND no figure in the one readable MetaX-citing source
reviewWikipedia (the same document as cn-metax-wikipedia, the only MetaX source in this repo that can be read)sources/w5a-metax-no-compute-figure-confirmed-two-methods
verifiedmedium · 0.80
VERIFIED NEGATIVE: NVIDIA has published no H20 datasheet, product page or developer-blog specification - six independent searches and four first-party URL probes, all negative
spec-sheetNVIDIA (nvidia.com - the canonical H20 product URL, which does not resolve)sources/w5a-nvidia-h20-no-nvidia-document-exists-verified-negative
verifiedhigh · 0.90
VeriLoop E2 config.json
repoTsinghua SIGS Robot Labsources/veriloop-e2-config-json
verifiedhigh · 0.90
VeriLoop E2 evaluation evidence
benchmarkTsinghua SIGS Robot Labsources/veriloop-e2-evaluation-evidence
verifiedmedium · 0.80
VeriLoop E2 model card
repoTsinghua SIGS Robot Labsources/veriloop-e2-model-card
verifiedhigh · 0.90
Vertiv - 800 VDC: the next evolution of AI power architecture (vendor learning-center resource index entry)
blogVertivsources/pwr2-vertiv-800vdc
verifiedlow · 0.60
VideoCardz: NVIDIA launches GeForce RTX 4090D (NVIDIA China spec table)
reviewVideoCardzsources/videocardz-rtx-4090d-launch
verifiedmedium · 0.70
VisionZip: Longer is Better but Not Necessary in Vision Language Models (arXiv:2412.04467)
paperarXivsources/pap-mm-visionzip
verifiedhigh · 0.90
Visual Instruction Tuning (LLaVA) (arXiv:2304.08485)
paperarXivsources/pap-mm-llava
verifiedhigh · 0.90
ViT: An Image is Worth 16x16 Words (arXiv:2010.11929)
paperarXivsources/vit-an-image-is-worth-16x16-words-arxiv-2010-11929
verifiedhigh · 0.90
vLLM 0.9.x ROCm optimizations: AITER block-scaled GEMM, fused MoE, MLA
benchmarkAMD ROCm Blogssources/amd-vllm-09x-rocm
verifiedhigh · 0.85
vLLM Ascend plugin GitHub repository
repovLLM project (community)sources/niche-vllm-ascend-repo
verifiedhigh · 0.90
vLLM Ascend vllm_ascend/observability/ - an MS Service Metric provider, not an OTel or Prometheus surface
repovllm-projectsources/w5e-vllm-ascend-observability-provider
verifiedhigh · 0.90
vLLM AsyncEngineArgs defaults for the ops-relevant engine and scheduler knobs
repovLLM projectsources/ops-vllm-engine-arg-defaults
verifiedhigh · 0.90
vLLM AsyncLLM.check_admission() source (max_num_queued_reqs / max_num_queued_tokens admission path)
repovLLM projectsources/ops-vllm-async-llm-admission
verifiedhigh · 0.95
vLLM automatic prefix caching docs
repovLLMsources/engine-vllm-prefix-caching
verifiedhigh · 0.95
vLLM compressed-tensors W4A8 dispatch code (compressed_tensors.py, schemes/compressed_tensors_w4a8_int.py, kernels/linear/mixed_precision/*): how a W4A8 checkpoint is routed and where it fails
repovLLM projectsources/w4q-vllm-w4a8-dispatch-code
verifiedhigh · 0.95
vLLM custom logits processors documentation (docs/features/custom_logitsprocs.md) and vllm/v1/sample/logits_processor/interface.py
repovLLM projectsources/sec-vllm-logits-processor-interface
verifiedhigh · 0.95
vLLM CUTLASS capability gates (csrc/.../w8a8/cutlass/scaled_mm_entry.cu and fp4/nvfp4_scaled_mm_entry.cu): cutlass_scaled_mm_supports_fp8 / _block_fp8 / _fp4
repovLLM projectsources/w4q-vllm-cutlass-capability-gates
verifiedhigh · 0.95
vLLM CUTLASS/quantization C++ capability gates re-read from main @ 528772a4 (2026-10-05), including the previously unrecorded cutlass_group_gemm_supported MoE gate
repovLLM projectsources/w6q-vllm-cutlass-gate-reverify-2026-10
verifiedhigh · 0.95
vLLM docs engine arguments: --enable-log-requests, --max-log-len, --disable-log-stats
repovLLM projectsources/sec-vllm-engine-args-logging
verifiedhigh · 0.95
vLLM docs: Disaggregated Prefilling (experimental)
repovLLM projectsources/pd-vllm-disagg-prefill-docs
verifiedhigh · 0.85
vLLM docs: KV Offloading Usage Guide (OffloadingConnector)
repovLLM projectsources/pd-vllm-kv-offloading-docs
verifiedhigh · 0.85
vLLM docs: NixlConnector Usage Guide
repovLLM projectsources/pd-vllm-nixl-connector-docs
verifiedhigh · 0.85
vLLM docs: speculative decoding, quantization x hardware, structured outputs, disaggregated prefilling, multimodal inputs (five feature pages read 2026-10-04)
blogvLLMsources/ev-vllm-docs-feature-matrix-axes
verifiedhigh · 0.90
vLLM documentation - Engine arguments, LoadConfig (load-format and safetensors-load-strategy)
whitepapervLLM projectsources/dep-vllm-engine-args-load-config
verifiedhigh · 0.95
vLLM documentation: Batch Invariance (docs/features/batch_invariance.md, read from the vllm repo at main)
repovLLM projectsources/nrg2-vllm-docs-batch-invariance
verifiedhigh · 0.93
vLLM documentation: GGUF quantization support
papervLLM projectsources/bench-meth-vllm
verifiedmedium · 0.70
vLLM documentation: Security (docs/usage/security.md)
repovLLM projectsources/sec-vllm-security-doc
verifiedhigh · 0.95
vLLM engine.arg_utils --disable-log-stats default (stats collection is on by default)
repovllm-project/vllmsources/w3m-vllm-observe-latency-declaration
verifiedhigh · 0.95
vLLM EngineCore source (_handle_shutdown, SIGTERM handling, abort vs drain)
repovLLM projectsources/ops-vllm-engine-core-shutdown
verifiedhigh · 0.95
vLLM feature compatibility matrix
repovLLMsources/engine-vllm-feature-matrix
verifiedhigh · 0.95
vLLM FrontendArgs / cli_args: api_key field ('If provided, the server will require one of these keys to be presented in the header')
repovLLM projectsources/sec-vllm-api-key-flag
verifiedhigh · 0.95
vLLM Gaudi Plugin System Architecture
spec-sheetvllm-projectsources/xpu-vllm-gaudi-plugin-system
verifiedhigh · 0.90
vLLM Gaudi Quickstart Guide
spec-sheetvllm-projectsources/xpu-vllm-gaudi-quickstart
verifiedhigh · 0.90
vLLM GGUF documentation
repovllm-projectsources/quant-vllm-gguf-doc
verifiedhigh · 0.90
vLLM GitHub repository
repovLLMsources/engine-vllm-github
verifiedhigh · 0.95
vLLM GPU installation docs
repovLLMsources/engine-vllm-install-gpu
verifiedhigh · 0.95
vLLM GPU installation docs: build-from-source cost, caching, and parallel-job controls
blogvLLMsources/ev-vllm-docs-gpu-install-build-cost
verifiedhigh · 0.90
vLLM Hardware Plugin for Intel Gaudi - GitHub README
repovllm-projectsources/xpu-vllm-gaudi-readme
verifiedhigh · 0.90
vLLM issue #12529: V1 engine has higher memory usage, context length collapses from 12K to 3K on 4x RTX 3070
forumvLLM GitHub issuessources/gotcha-vllm-issue-12529-v1-higher-memory
verifiedhigh · 0.90
vLLM issue #13247: with tp=1 and penalty parameters, TPOT becomes very slow for batch sizes > 20
forumvllm-project/vllm GitHub issuessources/flop3-vllm-issue-13247-penalties-tpot
verifiedhigh · 0.85
vLLM issue #13281: '[Installation]: Compiling and installing from source code is too slow, taking at least 3 hours.'
forumvLLMsources/ev-vllm-issue-13281-source-build-3h
verifiedmedium · 0.80
vLLM issue #13608: ImportError, vllm/_C.abi3.so undefined symbol _ZN5torch3jit17parseSchemaOrNameERKSsb
forumvLLM GitHub issuessources/gotcha-vllm-issue-13608-torch-abi-mismatch
verifiedhigh · 0.90
vLLM issue #14452: how to run vLLM on RTX 5080/5090 (139 comments, community build-from-source recipe, FA3 does not work on Blackwell, no official prebuilt wheels)
forumvLLM GitHub issuessources/comm-github-vllm-14452-rtx50xx-support-thread
verifiedhigh · 0.85
vLLM issue #14628: two RTX 5090s cannot run tensor parallelism because P2P is driver-disabled; fixed by an NCCL commit that falls back to shared memory
forumvLLM GitHub issuessources/comm-github-vllm-14628-2x5090-tp-p2p
verifiedhigh · 0.90
vLLM issue #2248: recent vLLMs ask for too much memory, ValueError: No available memory for the cache blocks
forumvLLM GitHub issuessources/gotcha-vllm-issue-2248
verifiedmedium · 0.75
vLLM issue #24885 [RFC] Clarifying vLLM Shutdown Semantics
forumvLLM projectsources/ops-vllm-shutdown-rfc-24885
verifiedmedium · 0.80
vLLM issue #30931: Prefix Cache Corruption with LoRA adapters sharing a name but differing in id
forumvllm-project/vllmsources/pd-gh-vllm-30931-lora-prefix-cache-corruption
verifiedhigh · 0.85
vLLM issue #34694: BF16 NVFP4 Marlin produces garbled output on GPUs without native FP4 support
forumvLLM GitHub issuessources/gotcha-vllm-issue-34694-nvfp4-bf16-marlin
verifiedhigh · 0.90
vLLM issue #34694: NVFP4 checkpoints produce garbled output with --dtype bfloat16 on GPUs without native FP4 (SM 89 RTX 4090, SM 70 V100)
forumvLLM GitHub issuessources/comm-github-vllm-34694-nvfp4-marlin-garbled
verifiedhigh · 0.85
vLLM issue #35387: MTP causes a 76.5% latency regression on Qwen3-Next-80B-A3B-Instruct-FP8 (TP=4, 4x H100)
forumvLLMsources/ev-vllm-issue-35387-mtp-latency-regression
verifiedhigh · 0.85
vLLM issue #37242: CUDA graphs DO work on RTX 5090 (sm_120) under WSL2 2.7.0, contrary to community consensus that it is a permanent WSL2/Blackwell limitation
forumvLLM GitHub issuessources/comm-github-vllm-37242-5090-wsl2-cudagraphs
verifiedmedium · 0.75
vLLM issue #38967: vLLM >= 0.18.0 segfaults in NCCL cuMemCreate with TP>1 on RTX 4090 (SM 89)
forumvLLM GitHub issuessources/comm-github-vllm-38967-4090-tp-cumem-segfault
verifiedmedium · 0.70
vLLM issue #40124: TurboQuant KV cache (k8v4) + hybrid MoE does not work on Ampere (SM 80-86); reporter ships 13 runtime monkey-patches
forumvLLM GitHub issuessources/comm-github-vllm-40124-turboquant-ampere
verifiedmedium · 0.70
vLLM issue #40677: Gemma-4 fails when forcing FLASHINFER attention backend on Blackwell SM120 (head_size not supported)
forumvLLM GitHub issuessources/gotcha-vllm-issue-40677-flashinfer-head-size
verifiedhigh · 0.90
vLLM issue #40896: v1 prefix caching - first request differs from subsequent identical requests at temperature=0
forumvllm-project/vllmsources/pd-gh-vllm-40896-prefix-cache-cold-vs-warm
verifiedhigh · 0.85
vLLM issue #43559: accuracy drops ~20% with --enable-prefix-caching together with MTP speculative decoding
forumvLLM GitHub issuessources/gotcha-vllm-issue-43559-mtp-prefix-caching-accuracy
verifiedhigh · 0.90
vLLM issue #47159: triton_w4a16_gemm asserts qzeros.shape == (K // group_size, N // 8) on GPTQ models
forumvLLM GitHub issuessources/gotcha-vllm-issue-47159-triton-w4a16-qzeros
verifiedhigh · 0.90
vLLM issue #47847: disable_flashinfer_q_quantization + fp8 KV + spec decode silently corrupts sliding-window models on SM100
forumvLLM GitHub issuessources/qgotcha-vllm-47847-flashinfer-bf16q-fp8kv-spec-swa
verifiedhigh · 0.90
vLLM issue #48031: VLLM_ENGINE_READY_TIMEOUT_S default 600 s insufficient for large MoE with a cold FlashInfer JIT cache
forumvLLMsources/ev-vllm-issue-48031-flashinfer-jit-cold-start
verifiedhigh · 0.90
vLLM issue #49546: VLLM_MARLIN_INPUT_DTYPE=fp8 (Marlin W4A8-FP8) silently corrupts output on GB10/sm_121a
forumvLLM GitHub issuessources/qgotcha-vllm-49546-marlin-w4a8-fp8-sm121a
verifiedhigh · 0.90
vLLM issue #49547: FlashInfer + spec-decode silently downgrades to PIECEWISE cudagraphs (-16% measured)
forumvLLM GitHub issuessources/gotcha-vllm-issue-49547-spec-decode-cudagraph-downgrade
verifiedhigh · 0.90
vLLM issue #50264: hybrid-Mamba models fall back to Triton paged attention on RDNA and decode collapses
forumvLLM GitHub issuessources/gotcha-vllm-issue-50264-rdna-triton-paged-attn
verifiedhigh · 0.90
vLLM issue #50881: MiniMax-M3 fp8 KV cache on SM80 is coherent with --enforce-eager and garbage under CUDA graphs
forumvLLM GitHub issuessources/qgotcha-vllm-50881-fp8kv-cudagraph-scatter
verifiedhigh · 0.90
vLLM issue #51136: AITER is not enabled on RDNA3 (gfx1100)
forumvLLM GitHub issuessources/gotcha-vllm-issue-51136-aiter-rdna3
verifiedhigh · 0.90
vLLM issue #52617: LMCache P/D receiver reports a full KV-cache hit but decoding diverges from the monolithic baseline at token 0
forumvllm-project/vllmsources/pd-gh-vllm-52617-lmcache-pd-hit-diverges
verifiedhigh · 0.85
vLLM issue #52627: Kimi-K3 silent output corruption in 1P1D NIXL Direct-PD disaggregated deployment
forumvllm-project/vllmsources/pd-gh-vllm-52627-kimi-k3-pd-silent-corruption
verifiedhigh · 0.85
vLLM issue #52663: FP8 on RDNA3/gfx1100 exceeds the 600 s engine-ready timeout on first start
forumvLLM GitHub issuessources/gotcha-vllm-issue-52663-rocm-fp8-cold-start
verifiedhigh · 0.90
vLLM issue #53328: prepare_nvfp4_moe_layer_for_marlin warns 'Your GPU does not have native support for FP4' when the checkpoint is merely weight-only
forumvLLM GitHub issuessources/qgotcha-vllm-53328-fp4-warning-blames-silicon
verifiedhigh · 0.90
vLLM issue #53670: EAGLE/MTP prefix-cache last-block drop causes a 1,648-token recompute per hit on hybrid GDN layouts
forumvLLM GitHub issuessources/gotcha-vllm-issue-53670-eagle-last-block-drop
verifiedhigh · 0.90
vLLM issue #53796: PD-disaggregation cannot use PCIe P2P for KV transfer on Intel Arc Pro B60
forumvllm-project/vllmsources/noncuda-vllm-53796-b60-p2p-kv
verifiedhigh · 0.85
vLLM issue #54974: modelopt NVFP4 MoE mismatched w1/w3 global scales are detected, warned about, and then used anyway
forumvLLM GitHub issuessources/qgotcha-vllm-54974-nvfp4-w13-global-scale
verifiedhigh · 0.90
vLLM issue #55131: Batch-invariant matmul is not actually batch-invariant, and TF32 causes precision degradation
forumvLLM projectsources/nrg2-gh-vllm-55131-tf32-breaks-invariance
verifiedhigh · 0.90
vLLM issue #56535: FlashInfer flashinfer_b12x MoE backend runs W4A16 checkpoints as W4A4
forumvLLM GitHub issuessources/qgotcha-vllm-56535-flashinfer-b12x-w4a16-as-w4a4
verifiedhigh · 0.90
vLLM issue #56700: 3-day bring-up of DeepSeek-V4.1-Flash (769B, MXFP4 experts) on 8x RTX PRO 6000 SM120
forumvLLMsources/ev-vllm-issue-56700-production-deepseek-v41-flash
verifiedhigh · 0.85
vLLM issue #56770: compressed-tensors MXFP4 W4A16 is misclassified as W4A4 and dispatched to a W4A4 kernel on SM100+
forumvLLM GitHub issuessources/qgotcha-vllm-56770-mxfp4-w4a16-as-w4a4
verifiedhigh · 0.90
vLLM issue #56828: KV Offload P2P peer-down on one rank does not fail loads or block new loads to sibling ranks
forumvllm-project/vllmsources/pd-gh-vllm-56828-p2p-peer-down-no-fail
verifiedhigh · 0.85
vLLM issue #57016: VLLM_BATCH_INVARIANT=1 is not batch-invariant for fused-MoE experts with no warning
forumvLLM projectsources/nrg2-gh-vllm-57016-fused-moe-not-invariant
verifiedhigh · 0.90
vLLM issue #57224: silent garbage output on GPUs in Confidential Computing mode with the V2 model runner
forumvLLM GitHub issuessources/gotcha-vllm-issue-57224-cc-mode-garbage-output
verifiedhigh · 0.90
vLLM issue #57838: RowWiseTorchFP8ScaledMMLinearKernel auto-selected on RDNA4 costs 5-24% decode
forumvllm-project/vllmsources/noncuda-vllm-57838-rdna4-rowwise-fp8
verifiedhigh · 0.85
vLLM issue #58241: cutlass_scaled_mm_supports_block_fp8() returns False on SM89 Ada despite native FP8 tensor cores, silently routing block-FP8 checkpoints to Marlin
forumvLLM GitHub issuessources/comm-github-vllm-58241-sm89-block-fp8-excluded
verifiedmedium · 0.75
vLLM issue #58263: Bind batch-invariant mode into KV-offload namespaces and KV-connector compatibility checks
forumvllm-project/vllmsources/pd-gh-vllm-58263-batch-invariant-not-in-kv-namespace
verifiedhigh · 0.85
vLLM issue #59086: VLLM_BATCH_INVARIANT=1 is not batch-invariant for AWQ models on sm8x in the default mode
forumvLLM projectsources/nrg2-gh-vllm-59086-awq-not-invariant
verifiedhigh · 0.90
vLLM issue #59203: DeepSeek-V4.1-Flash cannot run on SM120, compressed-layer page_block_size=32 has no FlashInfer sparse-MLA decode kernel
forumvLLM GitHub issuessources/gotcha-vllm-issue-59203-sm120-sparse-mla-block-size
verifiedhigh · 0.90
vLLM issue #59362: FA4 ignores num_splits on SM90 in v0.30.0, up to 48% slower decode
forumvLLM GitHub issuessources/gotcha-vllm-issue-59362-fa4-num-splits-sm90
verifiedhigh · 0.90
vLLM issue 28498: [Bug][RL]: Port Conflict
repovllm-project/vllmsources/mgpu-vllm-28498-zmq-port-conflict
verifiedhigh · 0.85
vLLM issue 40980: TP=2 deadlock on dual AMD R9700 (gfx1201/RDNA4) - GPUs spin at 100%
repovllm-project/vllmsources/mgpu-vllm-40980-rocm-tp2-deadlock
verifiedhigh · 0.85
vLLM issue 4232: Total number of attention heads (40) must be divisible by tensor parallel size (6)
repovllm-project/vllmsources/mgpu-vllm-4232-head-divisibility
verifiedhigh · 0.85
vLLM issue 51677: NVML UUID resolution fails for NVIDIA's documented short-form CUDA_VISIBLE_DEVICES UUIDs
repovllm-project/vllmsources/mgpu-vllm-51677-short-uuid
verifiedhigh · 0.85
vLLM issue 52435: AssertionError n_physical_experts=256 must be divisible by ep_size=3
repovllm-project/vllmsources/mgpu-vllm-52435-ep-divisibility
verifiedhigh · 0.85
vLLM issue 58290: Multi-node TP=8 (2 nodes x 4 H200) hangs in ncclCommInitRank during startup
repovllm-project/vllmsources/mgpu-vllm-58290-multinode-init-hang
verifiedhigh · 0.85
vLLM issue 59185: B200 cross-node TP=4 startup hangs without MNNVL during communicator initialization
repovllm-project/vllmsources/mgpu-vllm-59185-b200-cross-node-hang
verifiedhigh · 0.85
vLLM LICENSE — Apache License 2.0
repovLLM Projectsources/meth-vllm-license-apache2
verifiedhigh · 0.95
vLLM linear kernel registry ordering (_POSSIBLE_* dicts in vllm/model_executor/kernels/linear/__init__.py) as read 2026-10-05: Marlin precedes Emulation on the MX and NVFP4 paths
repovLLM projectsources/w6q-vllm-kernel-registry-ordering-2026-10
verifiedhigh · 0.95
vLLM NVFP4 registry contains two kernels whose is_supported() tests only has_flashinfer() and has no compute-capability gate at all (FlashInferTrtllmNvFp4LinearKernel, FlashInferCudnnNvFp4LinearKernel)
repovLLM projectsources/w6q-vllm-nvfp4-ungated-flashinfer-2026-10
verifiedhigh · 0.95
vLLM online serving documentation (embedding + rerank APIs)
spec-sheetvLLM projectsources/embed-vllm-online-serving-docs
verifiedhigh · 0.85
vLLM pooling models documentation
spec-sheetvLLM projectsources/embed-vllm-pooling-models-docs
verifiedhigh · 0.90
vLLM PR #30351: cache added_vocab to avoid per-token overhead (DeepSeek-V3.2 tokenizer mode)
repovllm-project/vllmsources/flop3-vllm-pr-30351-detokenizer-added-vocab
verifiedhigh · 0.85
vLLM PR #40459: RFC - Rust-accelerated control plane (scheduler + KV cache manager), PoC
repovllm-project/vllmsources/flop3-vllm-pr-40459-rust-control-plane
verifiedmedium · 0.80
vLLM PR #51281: optimize DecodeStream priming with a bounded prompt tail
repovllm-project/vllmsources/flop3-vllm-pr-51281-bounded-tail-detok
verifiedhigh · 0.85
vLLM PR #54454: O(1) prefilter for the reasoning-end hot path (structured output)
repovllm-project/vllmsources/flop3-vllm-pr-54454-reasoning-end-quadratic
verifiedhigh · 0.85
vLLM PR #56085: add RTX 4090 (SM89) W8A8 block-FP8 Triton GEMM configs - without them lookup falls back to a stock config
repovLLM GitHub GitHub pull requestssources/comm-github-vllm-56085-4090-block-fp8-configs
verifiedmedium · 0.80
vLLM PR 41776: fix support MIG UUIDs in CUDA_VISIBLE_DEVICES
repovllm-project/vllmsources/mgpu-vllm-41776-mig-uuid
verifiedhigh · 0.85
vLLM PR 44813: Replace sequential port scan with atomic port=0 in get_open_ports_list
repovllm-project/vllmsources/mgpu-vllm-44813-port-fix
verifiedhigh · 0.85
vLLM PR 51241: Add /dev/shm size calculator for tensor parallel deployment
repovllm-project/vllmsources/mgpu-vllm-51241-shm-calculator
verifiedhigh · 0.85
vLLM PR 52535: Make the attention-head / TP divisibility error actionable
repovllm-project/vllmsources/mgpu-vllm-52535-divisibility-actionable
verifiedhigh · 0.85
vLLM PR 52555: Add opt-in custom all-reduce max-size override
repovllm-project/vllmsources/mgpu-vllm-52555-custom-ar-nvlink
verifiedhigh · 0.85
vLLM Production Stack - Prefix Aware Routing tutorial (docs)
whitepapervLLM projectsources/dep-vllm-prodstack-prefix-aware-tutorial
verifiedhigh · 0.90
vLLM Production Stack - vllm_router README (request router)
repovLLM projectsources/dep-vllm-prodstack-router-readme
verifiedhigh · 0.90
vLLM Production Stack GitHub repository
repovLLM projectsources/niche-vllm-production-stack-repo
verifiedhigh · 0.90
vLLM Production Stack issue #1073 - PrefixAwareRouter below-threshold fallback uses stale QPS and starves one backend
forumvLLM project (reporter: production operator)sources/dep-vllm-prodstack-1073-prefixaware-stale-qps-latch
verifiedhigh · 0.95
vLLM Production Stack issue #1074 - unrecognized metric names yield an all-zero EngineStats that looks healthy
forumvLLM project (reporter: production operator)sources/dep-vllm-prodstack-1074-metric-prefix-parse-miss
verifiedhigh · 0.95
vLLM Production Stack issue #687 - router crashes from OOM, prefix cache HashTrie memory usage is unbounded
forumvLLM projectsources/dep-vllm-prodstack-687-router-hashtrie-oom
verifiedhigh · 0.90
vLLM prometheus.py multiprocess-registry source and its stale-directory warning
repovLLM projectsources/ops-vllm-prometheus-multiproc
verifiedhigh · 0.90
vLLM quantization docs - Supported Hardware table (Implementation x architecture)
repovLLM projectsources/qzgw-vllm-supported-hardware-table
verifiedhigh · 0.90
vLLM Quantization Documentation (docs.vllm.ai)
repovLLMsources/qhw-src-vllm-quant-docs
verifiedhigh · 0.95
vLLM quantization hardware matrix
repovLLMsources/engine-vllm-quant-matrix
verifiedhigh · 0.95
vLLM quantization kernel source (vllm/model_executor/kernels/linear/*) - per-format is_supported()/can_implement() capability gates
repovLLM projectsources/w4q-vllm-quant-kernel-source
verifiedhigh · 0.95
vLLM quantized KV cache architecture gates (vllm/config/cache.py CacheDType, vllm/v1/attention/backends/flashinfer.py NVFP4 KV cache gate)
repovLLM projectsources/w4q-vllm-kv-cache-arch-gates
verifiedhigh · 0.90
vLLM Reaches 25K Total TPS/GPU on Qwen3.5 (GB200 NVL72 PD serving)
blogvLLM projectsources/bench-nv-vllm-qwen35-25k-tps-blog
verifiedhigh · 0.85
vLLM RFC #17419: 'Kernel Library Restructure / Packaging Split (addressing long build times)'
forumvLLMsources/ev-vllm-rfc-17419-build-time
verifiedhigh · 0.90
vLLM ROCm attention backends: 7 backends, 3-path routing, and measured speedups
benchmarkvLLM Blog (AMD AI Framework team)sources/amd-vllm-rocm-attn-backends
verifiedhigh · 0.90
vLLM Security documentation (API Key Authentication Limitations, cache salting, media UUIDs, gRPC, media limits)
repovLLM projectsources/ops-vllm-security-api-key
verifiedhigh · 0.95
vLLM SharedAdmissionStats source (lock-free cross-process admission counters)
repovLLM projectsources/ops-vllm-shared-admission-stats
verifiedhigh · 0.90
vLLM supported models documentation
repovLLM projectsources/pap-arch-vllm-supported-models
verifiedhigh · 0.95
vLLM supported models documentation, re-read for architecture-class and encoder-decoder statements
repovLLM projectsources/mdl2-vllm-supported-models-2026-10
verifiedhigh · 0.93
vLLM TPU inference plugin (tpu-inference) - GitHub README
repovllm-projectsources/alt-tpu-vllm-inference-readme
verifiedhigh · 0.90
vLLM v1 metrics loggers source (Prometheus metric names and documentation strings)
repovLLM projectsources/ops-vllm-metrics-loggers
verifiedhigh · 0.95
vLLM V1 scheduler source (_preempt_request and the running-queue eviction loop)
repovLLM projectsources/ops-vllm-scheduler-preemption
verifiedhigh · 0.95
vLLM v1/metrics/buckets.py - default Prometheus histogram bucket boundaries
repovllm-project/vllmsources/w3m-vllm-buckets-module
verifiedhigh · 0.95
vLLM v1/utils.py shutdown() and the engine-process shutdown-timeout helpers
repovLLM projectsources/ops-vllm-process-shutdown-timeout
verifiedhigh · 0.90
vLLM vllm/compilation/backends.py - where the torch.compile cache directory is resolved
repovllm-projectsources/w5e-vllm-compilation-backends-cache-dir
verifiedhigh · 0.95
vLLM vllm/entrypoints/serve/utils/request_logger.py source (RequestLogger)
repovLLM projectsources/sec-vllm-request-logger-source
verifiedhigh · 0.95
vLLM vllm/exceptions.py - the HTTP status carried by each admission-rejection exception
repovllm-projectsources/w5e-vllm-exceptions-503-mapping
verifiedhigh · 0.95
vLLM vllm/v1/core/kv_cache_utils.py: prefix-cache block hashing, cache_salt, DEFAULT_NONE_HASH_SEED
repovLLM projectsources/sec-vllm-kv-block-hash-source
verifiedhigh · 0.95
vLLM vllm/v1/engine/detokenizer.py (main)
repovllm-project/vllmsources/flop3-vllm-detokenizer-source
verifiedhigh · 0.85
vLLM vllm/v1/sample/logits_processor/builtin.py (main) - min_p, logit bias, min_tokens processors
repovllm-project/vllmsources/flop3-vllm-logits-processor-builtin
verifiedhigh · 0.85
vLLM vllm/v1/sample/ops/penalties.py (main)
repovllm-project/vllmsources/flop3-vllm-penalties-source
verifiedhigh · 0.85
vLLM vllm/v1/sample/rejection_sampler.py (main)
repovllm-project/vllmsources/flop3-vllm-rejection-sampler-source
verifiedhigh · 0.85
vLLM vllm/v1/sample/sampler.py (main) - the per-step sampler chain and its logit dtype conversions
repovllm-project/vllmsources/flop3-vllm-sampler-source
verifiedhigh · 0.85
vLLM vllm/v1/sample/sampler.py (Sampler.forward / Sampler.sample) source
repovLLM projectsources/sec-vllm-sampler-pipeline-source
verifiedhigh · 0.95
vllm-gaudi gathered-expert MoE kernels (hpu_moe_combine.py and hpu_fused_moe.py, main branch)
repovllm-projectsources/vllm-gaudi-hpu-moe-combine-kernel
verifiedhigh · 0.90
vllm-gaudi PR #1673: routed-expert gather for MiniMax-M3 decode (port of #1656)
repovllm-projectsources/vllm-gaudi-pr-1673-minimax-m3-moe-decode-gather
verifiedhigh · 0.85
vllm-gaudi PR #1731: custom gathered-expert FP8 MoE combine for the Qwen 3.5 family
repovllm-projectsources/vllm-gaudi-pr-1731-fp8-moe-gather-combine
verifiedmedium · 0.80
vllm-gfx906-mobydick: maintained gfx906 fork of vLLM
repoGitHub (ai-infos)sources/comm-vllm-gfx906-mobydick-repo
verifiedmedium · 0.70
vLLM-metal issue #713: benchmarking pitfalls on macOS (in-process decode penalty, GPU co-tenancy, non-diagnostic short probes)
forumvllm-projectsources/pwr2-vllm-metal-issue-713
verifiedhigh · 0.90
vLLM-Metal plugin repository
repovLLMsources/engine-vllm-metal-github
verifiedhigh · 0.95
vLLM-project LLM Compressor (llmcompressor) GitHub README
repovLLM project / Red Hat AIsources/qlab2-llmcompressor-readme
verifiedhigh · 0.90
vllm-project/flash-attention PR #198: Fix SM90 SplitKV work distribution
release-notesvllm-project/flash-attentionsources/gotcha-flash-attention-pr-198-sm90-splitkv
verifiedhigh · 0.90
vllm.cpp (mudler) GitHub repository
repomudlersources/engine-vllm-cpp-github
verifiedhigh · 0.95
vLLM#27579: AITER FP8 GEMM performance on MI355
forumvLLM / AMDsources/src5-gotcha-vllm-27579-aiter-fp8-gemm
verifiedhigh · 0.85
vLLM#40677: FlashInfer head_size not supported on Blackwell SM120
forumvLLMsources/src5-gotcha-vllm-40677-flashinfer-head-size
verifiedhigh · 0.90
vLLM#47159: Triton W4A16 qzeros assertion fails on GPTQ models
forumvLLMsources/src5-gotcha-vllm-47159-triton-w4a16-qzeros
verifiedhigh · 0.90
vLLM#50881: MiniMax-M3 fp8 KV cache garbage under CUDA graphs on SM80
forumvLLMsources/src5-gotcha-vllm-50881-fp8-kv-cache-cudagraph
verifiedhigh · 0.90
vLLM#52617: LMCache P/D receiver reports full hit but decoding diverges
forumvLLMsources/src5-gotcha-vllm-52617-lmcache-pd-divergence
verifiedhigh · 0.90
vLLM#52627: Kimi-K3 silent corruption with Mooncake+NIXL MultiConnector
forumvLLMsources/src5-gotcha-vllm-52627-kimi-k3-mooncake-corruption
verifiedhigh · 0.90
vLLM#52663: FP8 on RDNA3 exceeds 600s engine-ready timeout (no tuned configs)
forumvLLMsources/src5-gotcha-vllm-52663-fp8-rdna3-cold-start
verifiedhigh · 0.90
vLLM#53328: FP4 warning incorrectly blames GPU when checkpoint is weight-only
forumvLLMsources/src5-gotcha-vllm-53328-fp4-warning-weight-only
verifiedhigh · 0.85
vLLM#55131: Batch-invariant matmul not actually batch-invariant, TF32 precision loss
forumvLLMsources/src5-gotcha-vllm-55131-batch-invariant-tf32
verifiedhigh · 0.90
vLLM#56535: FlashInfer b12x MoE runs W4A16 checkpoints as W4A4
forumvLLMsources/src5-gotcha-vllm-56535-flashinfer-b12x-w4a16
verifiedhigh · 0.90
vLLM#56770: MXFP4 W4A16 misclassified as W4A4 on SM100+
forumvLLMsources/src5-gotcha-vllm-56770-mxfp4-w4a16-misclassified
verifiedhigh · 0.90
vLLM#57838: RowWise FP8 kernel regression on RDNA4 (gfx1201)
forumvLLMsources/src5-gotcha-vllm-57838-rdna4-fp8-regression
verifiedhigh · 0.90
vLLM#58263: Batch-invariant mode not in KV-offload namespace
forumvLLMsources/src5-gotcha-vllm-58263-batch-invariant-namespace
verifiedhigh · 0.85
Voxtral-Mini-3B-2507 config.json (HuggingFace)
repoHuggingFace / Mistralsources/hf-mm-voxtral-mini-3b-config
verifiedhigh · 0.95
Watermarking Low-entropy Generation for Large Language Models: An Unbiased and Low-risk Method (STA-1)
paperStates the low-entropy problem directly and proposes Sampling One Then Accepting, an unbiased watermark that preserves the token distribution in expectation with lower risk of unsatisfactory output in low-entropy settings.sources/sec-arxiv-2405-14604
verifiedhigh · 0.90
Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models (ICML 2024)
paperProves strong watermarking impossible under a quality oracle plus a mixing perturbation oracle, and holds in the private-detection-key setting. Demonstrated against Kirchenbauer 2023, Kuditipudi 2023 and Zhao 2023 with minor quality degradation.sources/sec-arxiv-2311-04378
verifiedhigh · 0.90
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations (arXiv:2006.11477)
paperarXivsources/pap-mm-wav2vec2
verifiedhigh · 0.90
wav2vec: Unsupervised Pre-training for Speech Recognition (arXiv:1904.05862)
paperarXivsources/pap-mm-wav2vec
verifiedhigh · 0.90
WebAssembly Specification
spec-sheetW3Csources/local-wasm-spec
verifiedhigh · 0.85
WebGPU Specification
spec-sheetW3Csources/local-webgpu-spec
verifiedhigh · 0.90
WebLLM GitHub repository
repoMLC AIsources/niche-webllm-repo
verifiedhigh · 0.90
WebLLM: A High-Performance In-Browser LLM Inference Engine
paperarXivsources/niche-webllm-paper
verifiedhigh · 0.85
wei390/SpecPrefetch - DeepSeek-VL2 future-expert predictor training and recall eval
repowei390sources/repo-wei390-specprefetch
verifiedmedium · 0.70
Where Does the Energy Go? Profiling LLM Agent Inference on Blackwell GPUs (arXiv:2609.29707)
paperQi Luo, Kunlin Li, Ziwen Wang, Dongsheng Wang, Yun Chensources/pwr2-arxiv-where-does-energy-go
verifiedhigh · 0.85
Which Quantization Should I Use? A Unified Evaluation of llama.cpp Quantization on Llama-3.1-8B-Instruct
paperarXivsources/quant-gguf-kquant-study
verifiedhigh · 0.90
Which Quantization Should I Use? A Unified Evaluation of llama.cpp Quantization on Llama-3.1-8B-Instruct (Kurt, 2026)
paperarXivsources/bench-meth-kquant
verifiedhigh · 0.90
whisper-base config.json (HuggingFace)
repoHuggingFace / OpenAIsources/aud-src-whisper-base-config
verifiedhigh · 0.95
whisper-large-v2 config.json (HuggingFace)
repoHuggingFace / OpenAIsources/aud-src-whisper-large-v2-config
verifiedhigh · 0.95
whisper-large-v3 config.json (HuggingFace)
repoHuggingFace / OpenAIsources/hf-mm-whisper-large-v3-config
verifiedhigh · 0.95
whisper-large-v3-turbo config.json (HuggingFace)
repoHuggingFace / OpenAIsources/hf-mm-whisper-large-v3-turbo-config
verifiedhigh · 0.95
whisper-medium config.json (HuggingFace)
repoHuggingFace / OpenAIsources/aud-src-whisper-medium-config
verifiedhigh · 0.95
whisper-small config.json (HuggingFace)
repoHuggingFace / OpenAIsources/aud-src-whisper-small-config
verifiedhigh · 0.95
whisper-tiny config.json (HuggingFace)
repoHuggingFace / OpenAIsources/aud-src-whisper-tiny-config
verifiedhigh · 0.95
Whisper: Robust Speech Recognition via Large-Scale Weak Supervision (arXiv:2212.04356)
paperarXivsources/pap-mm-whisper
verifiedhigh · 0.90
whisper.cpp README (GitHub)
repoGitHub / ggml-orgsources/aud-src-whisper-cpp-readme
verifiedhigh · 0.95
Why SambaNovas SN40L Chip Is the Best for Inference
blogSambaNova Systemssources/ainv-sambanova-sn40l-blog
verifiedmedium · 0.65
Wikipedia: Biren Technology
reviewWikipediasources/cn-biren-wikipedia
verifiedmedium · 0.70
Wikipedia: Compute Express Link
reviewWikipediasources/link-wikipedia-cxl
verifiedhigh · 0.90
Wikipedia: HiSilicon - section 'AI acceleration' (Ascend 310 / 910 / 910B / 910C / 910D / 920)
reviewWikipediasources/cn-hisilicon-wikipedia
verifiedmedium · 0.70
Wikipedia: Horizon Robotics - Journey 5 / Journey 6 / Journey 7 product sections
reviewWikipediasources/cn-horizon-journey6
verifiedmedium · 0.70
Wikipedia: MetaX
reviewWikipediasources/cn-metax-wikipedia
verifiedmedium · 0.70
Wikipedia: NVLink
reviewWikipediasources/link-wikipedia-nvlink
verifiedhigh · 0.90
Wikipedia: PCI Express - 'Comparison table' (PCI Express link performance) plus the PCIe 1.0a / 2.0 encoding paragraphs
reviewWikipediasources/w7p-wikipedia-pcie-link-performance
verifiedhigh · 0.85
Wormhole PCIe Cards (n150d/n150s/n300d/n300s) product guide
spec-sheetTenstorrentsources/asic-tenstorrent-wormhole-docs
verifiedhigh · 0.90
xAI developer pricing (Text API per 1M tokens, cached input, long-context tiers)
spec-sheetxAIsources/rent-src-xai-pricing
verifiedhigh · 0.90
xai-org/grok-1 model card and run.py
repoxAIsources/model-fr-hf-config-grok-1
verifiedhigh · 0.90
XGrammar GitHub repository (mlc-ai/xgrammar)
repoMLC AIsources/niche-xgrammar-repo
verifiedhigh · 0.90
XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
paperarXivsources/flop2-xgrammar-paper
verifiedhigh · 0.90
XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models
paperarXivsources/niche-xgrammar-paper
verifiedhigh · 0.90
XiaomiMiMo/MiMo-V2.6-Flash-RL config.json
repoXiaomi MiMosources/hf-mimo-v2-6-flash-rl-config
verifiedhigh · 0.90
XiaomiMiMo/MiMo-V2.6-Flash-RL model card
repoXiaomi MiMosources/hf-mimo-v2-6-flash-rl-card
verifiedmedium · 0.82
XiaomiMiMo/MiMo-V2.6-Pro-RL config.json
repoXiaomi MiMosources/hf-mimo-v2-6-pro-rl-config
verifiedhigh · 0.90
XiaomiMiMo/MiMo-V2.6-Pro-RL model card
repoXiaomi MiMosources/hf-mimo-v2-6-pro-rl-card
verifiedmedium · 0.82
Xinference built-in embedding model catalogue
databaseXorbits AIsources/embed-xinference-embedding-catalog
verifiedmedium · 0.80
Xinference built-in rerank model catalogue
databaseXorbits AIsources/embed-xinference-rerank-catalog
verifiedmedium · 0.80
Xinference user guide metrics page
repoxorbitsaisources/w5e-xinference-metrics-docs
verifiedhigh · 0.90
Xinference xinference/core/metrics.py - the aioprometheus metric registry for supervisor and worker
repoxorbitsaisources/w5e-xinference-core-metrics
verifiedhigh · 0.93
XingChen-AGI/Xing4.0-29B-A4B config.json
repoChina Telecom Artificial Intelligence Technology (XingChen-AGI)sources/hf-xing4-0-29b-a4b-config
verifiedhigh · 0.95
XingChen-AGI/Xing4.0-29B-A4B model card
repoChina Telecom Artificial Intelligence Technology (XingChen-AGI)sources/hf-xing4-0-29b-a4b-card
verifiedhigh · 0.85
XingChen-AGI/Xing4.0-29B-A4B-GGUF official quant repo
repoChina Telecom Artificial Intelligence Technology (XingChen-AGI)sources/hf-xing4-0-29b-a4b-gguf
verifiedmedium · 0.80
XiongjieDai GPU-Benchmarks-on-LLM-Inference — llama.cpp cuBLAS on RunPod: LLaMA-3 8B/70B Q4_K_M + F16, generate + prompt-eval tok/s across NVIDIA + Apple parts
repoXiongjie Dai (RunPod rental)sources/xiongjiedai-runpod-llama-cpp-gpu-table
verifiedmedium · 0.65
XiongjieDai/GPU-Benchmarks-on-LLM-Inference — llama.cpp on NVIDIA A100 PCIe 80GB et al. (RunPod, LLaMA-3 8B/70B Q4_K_M + F16, 1024-token generate + prompt-eval)
repoXiongjie Dai (RunPod rental)sources/xiongjiedai-gpu-benchmarks-llm-inference-a100-pcie
verifiedmedium · 0.65
Xorbits Inference (Xinference) README
repoXorbits AIsources/embed-xinference-github
verifiedmedium · 0.80
XWind: A Cross-site Router for Large Language Model Inference Serving at Renewable Energy Farms (arXiv:2605.23348)
paperTella Rajashekhar Reddy, Atharva Deshmukh, Liangcheng Yu, Chaojie Zhang, Mike Shepperd, Rohan Gandhi, Anjaly Parayil, Srinivasan Iyengar, Ajay Manchepalli, Debopam Bhattacherjeesources/pwr2-arxiv-gpu-idling-router
verifiedmedium · 0.75
yandex/AliceAI-Foundation-80B-A3B-Base config.json
repoYandexsources/hf-yandex-aliceai-foundation-80b-a3b-base-config
verifiedhigh · 0.95
yandex/AliceAI-Foundation-80B-A3B-Base model card
repoYandexsources/hf-yandex-aliceai-foundation-80b-a3b-base-card
verifiedhigh · 0.85
YaRN: Efficient Context Window Extension of Large Language Models
paperarXivsources/pap-attn-yarn
verifiedhigh · 0.90
You Only Cache Once: Decoder-Decoder Architectures for Language Models
paperSun et al. / Microsoft (arXiv)sources/arch-yoco
verifiedhigh · 0.92
zai-org/GLM-4.5 · Hugging Face
reposources/hf-glm-4-5
verifiedmedium · 0.80
zai-org/GLM-4.5 config.json
repoHugging Facesources/mbl-cfg-glm-4-5
verifiedhigh · 0.90
zai-org/GLM-4.7-Flash · Hugging Face
reposources/glm-4-7-flash-hf
verifiedmedium · 0.80
zai-org/GLM-5 config.json
repoHugging Facesources/mbl-cfg-glm-5
verifiedhigh · 0.90
zai-org/GLM-5.3 model card
repoZ.AI (Zhipu)sources/hf-glm-5-3-card
verifiedhigh · 0.90
zai-org/GLM-5.3-Flash · Hugging Face
reposources/hf-glm-5-3-flash
verifiedmedium · 0.80
zai-org/GLM-5.3-Flash config.json
repoZ.aisources/hf-zai-glm-5-3-flash-config
verifiedhigh · 0.95
Zamba: A Compact 7B SSM Hybrid Model
paperarXivsources/pap-arch-2405-16712
verifiedhigh · 0.90
ZeroQuant-V2: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation (Yao et al.)
paperarXivsources/qlab-zeroquant-v2-paper
verifiedhigh · 0.88
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers (Yao et al.)
paperarXivsources/qlab-zeroquant-paper
verifiedhigh · 0.88
ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification (Zhang et al., ICT CAS)
paperarXivsources/qlab-zipcache-paper
verifiedhigh · 0.88
Zipformer: A faster and better encoder for automatic speech recognition (arXiv:2310.11230)
paperarXivsources/pap-mm-zipformer
verifiedhigh · 0.90
Zyphra/Zamba-7B-v1 config.json
repoHugging Facesources/mbl-cfg-zamba-7b
verifiedhigh · 0.90
AMD Radeon Pro VII product page (archived AMD page) - FP16/FP32/FP64/INT8 figures, dense, no structured-sparsity label
spec-sheetAdvanced Micro Devices (AMD page, retrieved via the Wayback Machine)sources/w4h-amd-radeon-pro-vii-product-page-dense
deprecatedhigh · 0.85
Most referenced
The records other records point at. Useful as an entry point: a heavily referenced accelerator or engine is one many decisions in this repo assume.