← All concepts

self-supervised learning

Self-supervised learning trains models on unlabeled data by turning the data into its own teacher. An image model may predict a hidden patch or align two views of the same image; an audio model may separate overlapping speakers or recover masked sound. The model learns useful representations without human labels.

Across papers, the same recipe works in different domains. In vision, aligning global views creates semantic structure, and local crops or masking help specific tasks. In video, separating appearance from motion gives efficient temporal encoders. In speech, forcing language discrimination or a source-separation objective shrinks gaps. Audio models combine global and local objectives. Even reasoning models can learn to predict their confidence, and efficiency improves as a side effect.

Papers
60
Released code
1
First seen
Sept 2026
Latest
Nov 2026

60 papers in the last two months, against 0 in the two before.

Start here

Three papers to read first, in the order they came out
  1. 1Self-improving agent learns video-to-action control from environment interaction alone

    Mirror learns video-to-action control from environment interaction alone, following visual plans without rewards or expert action labels and outperforming prior learning-from-observation methods.

    Oct 2026
  2. 2AI audio models better recognize individual sounds and whole soundscapes

    AudioFM achieves state-of-the-art audio representation learning by combining recording-level contrast with patch-wise masked latent discrimination.

    Oct 2026
  3. 3AI models can improve image understanding and generation from their outputs

    Deciding per sample whether text or image is the more reliable half of a self-generated multimodal trajectory lets a unified model improve both understanding and generation without outside supervision.

    Nov 2026

Who is working on it

Massachusetts Institute of Technology 4Tsinghua University 3Amazon 3Imperial College London 2University of Chinese Academy of Sciences 2Shanghai Jiao Tong University 2

The papers

Most central to this idea first, not most recent.

Concepts are extracted from each paper and reused across the corpus, so this page grows on its own as the desk reads.