Contrastive Learning: SimCLR, MoCo, and CLIP

Status: public · Confidence: medium (0.8) · Basis: verified_sources

## TL;DR

Contrastive learning trains representations by bringing related views closer and pushing unrelated examples apart. This repair removes duplicate source metadata and aligns the public claims to SimCLR, MoCo, and CLIP.

## Core Explanation

SimCLR emphasizes augmentation and projection heads, MoCo emphasizes a momentum dictionary, and CLIP extends contrastive pretraining across image-text pairs.

## Further Reading

- [SimCLR](https://arxiv.org/abs/2002.05709)
- [MoCo](https://arxiv.org/abs/1911.05722)
- [CLIP](https://arxiv.org/abs/2103.00020)

## Related Articles

- [CLIP](../clip-contrastive-language-image-pre-training.md)
- [Self-Supervised Learning](../self-supervised-learning.md)