MeteoVerse is a that controls weather evolution in generated videos from a single input image, whether sunny or adverse-weather. It explicitly models the transition between observed and target weather states (rain, snow, fog) using a weather-state predictor and a (MeteoMoE) that applies category-specific residual features. This allows the model to preserve, introduce, or remove weather effects with fine-grained intensity control, while maintaining scene consistency and camera motion.
The authors built a dataset of over 50K real-world video clips with weather annotations and camera trajectories to train the model. Experiments show that MeteoVerse achieves substantially better weather controllability than existing controllable video world models, particularly when the target weather differs from the input, while retaining competitive performance in scene consistency and camera control. This unification of weather transition types in a single model is a notable advance for video generation under varying environmental conditions.