SigLIP: Sigmoid Loss for Language Image Pre-Training (arXiv:2303.15343)

Fields

id

sources/siglip-sigmoid-loss-for-language-image-pre-training-arxiv-2303-1

URL

https://arxiv.org/abs/2303.15343

Publisher

arXiv

Kind

paper

Published

2023-03-27

Accessed

2026-10-04

notes

ICCV 2023 Oral. SigLIP SO400M (the variant used in PaliGemma and Gemma vision towers) has ~400M parameters. At 224x224, the SigLIP SO400M vision tower costs ~41 GFLOPs per image. The paper focuses on training loss, not inference cost, but the architecture is what ships in production VLMs.

Notes

ICCV 2023 Oral. SigLIP SO400M (the variant used in PaliGemma and Gemma vision towers) has ~400M parameters. At 224x224, the SigLIP SO400M vision tower costs ~41 GFLOPs per image. The paper focuses on training loss, not inference cost, but the architecture is what ships in production VLMs.

Cross-references

This record references no other records.