SemCam turns subject-relative camera instructions into adaptive video motion

The system changes viewpoint using one of eight semantic motion labels, without requiring users to provide an explicit camera trajectory.

Big Tech
Janna Bruner · Omer Talmi · Ianir Ideses · Lior Fritz · Lior Wolf · Sagie Benaim

Amazon Prime Video · Tel Aviv University · Hebrew University of Jerusalem

Research Digest··2 min read
Bruner and colleagues formulate semantic camera motion control as a video-to-video task in which the model must infer how to move the camera relative to an evolving subject.

The authors trained a video diffusion model on 661 paired videos spanning eight subject-relative camera behaviors.

Why this paper

From Amazon Prime Video and 2 others

In one line

SemCam generates video with a camera behavior described by a discrete label relative to a moving subject, without an explicit trajectory.

What we could check

  • ·No code link found
  • ·No weights link found
  • ·No dataset link found
  • ·No compute details found
  • ·No stated limitations found
  • ✓Reports numbers on named benchmarks

Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.

§

Research Digest

Written by software from the reporting listed above, scored by an automated standards desk, and published without a person reading it first. If something here is wrong, tell the editor and it will be put right.