Fireworks AI serverless token pricing + serverless GPU hourly rates (2026-10-04 list price)
Fields
supply/rent-fireworks-serverless-token-pricingNotes
This record deliberately carries both units because Fireworks is the one provider in this set that sells the SAME hardware two ways on one page, and the relationship between the two prices is the most useful thing a reader can learn from it. $8.00 per H100-hour divided by a 1M-token rate of, say, $12.00 for an 80-300B model implies break-even at roughly 666,667 output tokens per GPU-hour - and against the >300B rate of $40.00 it is 5,000,000 tokens per GPU-hour. Compare that with a real decode ceiling of a few thousand tok/s: a single H100 at 2,000 tok/s for a full hour produces about 7.2M output tokens, so the per-token serverless rate is genuinely competitive only for dense high-throughput serving, and the per-GPU rate wins as soon as you can keep the card busy. That crossover is the whole serverless-vs-GPU decision and it moves with your achieved tok/s, not with the list price. Note also Fireworks prices per-PARAMETER-SIZE BAND rather than per named model, so a new release inside a band is priced by the band automatically.
EXPORT CONTROL (2026-10-04): NOT APPLICABLE IN THE HARDWARE-SHIPMENT SENSE - this record prices a token-based API, so no accelerator is transferred across a border and the ECCN 3A090 hardware licence regime does not attach to the transaction. Recorded null rather than false precisely because a token API is where export control instead becomes an END-USER/TERMS question: the provider applies geographic and end-user restrictions to service access (the AI Diffusion Rule briefly put a tiered country structure on exactly this kind of service before being rescinded on 2025-05-13), and a customer can still be refused under sanctions or end-use policy regardless of where the compute sits. Anyone reading this record for a restricted destination should look at the provider's terms, not at the EAR. Sources for the regime: spl-bis-2025-05-ai-diffusion-rescission, spl-bis-2026-05-d5-guidance.
EXPORT CONTROL (2026-10-04): NOT APPLICABLE IN THE HARDWARE-SHIPMENT SENSE - this record prices a token-based API, so no accelerator crosses a border and the ECCN 3A090 hardware licence regime does not attach to the transaction. Recorded NULL rather than false precisely because a token API is where export control instead becomes an END-USER and TERMS question: the provider applies geographic and end-user restrictions to service access (the AI Diffusion Rule briefly put a tiered country structure on exactly this kind of service before being rescinded and unenforced from 2025-05-13), and a customer can still be refused under sanctions or end-use policy regardless of where the compute sits. For a restricted destination, read the provider's terms, not the EAR. Sources: spl-bis-2025-05-ai-diffusion-rescission, spl-bis-2026-05-d5-guidance.
LEAD TIME: null - correct and not a gap. A token-priced serverless API is provisioned on request, so there is no lead time to publish; the binding constraint when a model is at capacity is provider-side queuing and any per-account concurrency limit, which this repo records in notes where a vendor publishes one (see the DeepSeek concurrency figures already here). Deliberately NOT recorded: any 'model capacity lead time' estimate, because vendors publish none and the SEO 'GPU lead time' numbers that circulate do not apply to a rented endpoint. Probe log in source spl-negative-no-oem-publishes-lead-time.
ACCELERATOR LINK ADDED 2026-10-04: Fireworks is the one provider in this slice selling the SAME controlled hardware two ways on one page - serverless per-token and a serverless per-GPU-hour product covering H100 80GB, H200 141GB, B200 180GB, B300 288GB and GB300 - so the ids link the two price records to the same silicon and make the break-even arithmetic in notes checkable.