Cheap exotic silicon with no open LLM stack is a paperweight (Cambricon/Ascend/Iluvatar/Coral/Grayskull/FPGA)
[blocker] framework
Fields
id
gotchas/gotcha-closed-vendor-stack-paperweightClass
framework
Severity
blocker
Concepts
vendor-stackggufpaperweightneuwarecann
Symptom
Cambricon MLU270/370, Huawei Ascend, Iluvatar MR-V100, Google Coral, Tenstorrent Grayskull and FPGA cards appear cheap on eBay but have no llama.cpp/vLLM/GGUF path - they cannot run an open 7B model without writing your own kernels.
Root cause
Neuware (Cambricon), CANN/MindIE (Huawei), CoreX SDK (Iluvatar) are closed vendor stacks; Coral is INT8 vision-only; Grayskull is legacy (no LLM demos in tt-metal); FPGAs have no turnkey LLM flow.
Workaround
Verify an open serving path exists for the exact model size BEFORE buying. For Coral/Grayskull/FPGA/Cambricon the answer today is 'no' - treat as teaching/vision cards only.
Cross-references
Affects (6)
- AcceleratorsCambricon MLU270-S4contested
- AcceleratorsCambricon MLU370 (Siyuan 370) AIDC accelerators
- AcceleratorsHuawei Ascend 310P (Da Vinci edge inference NPU)draft
- AcceleratorsIluvatar CoreX MR-V100 (Zhikai 100) HBM inference carddraft
- AcceleratorsGoogle Coral Edge TPU
- AcceleratorsTenstorrent Grayskull Tensix (e75 / e150)