Vision

Image and video understanding, multimodal perception, detection, segmentation, 3D understanding

201 articles · page 5 of 5

Vision

End-to-end model writes 3D scene graphs directly from point clouds or Gaussian splats

Milivojevic et al. present GraphWrit3R, a method that takes a 3D point cloud, Gaussian Splats, or a combination as input and directly outputs a complete scene graph as a structured JSON script. On the 3DSSG benchmark, the method achieves state-of-the-art performance on object class, predicate, and triplet recall, outperforming methods that rely on ground-truth object annotations during inference.

·2 min
Vision

Branched YOLOv2 with geometric features improves traffic sign recognition speed and accuracy.

The authors extended YOLOv2 with intermediate prediction layers (branched architecture) to allow early exit for easy cases, and introduced geometric features from Bayesian segmentation to distinguish visually similar signs. On a combined GTSDB/GTSRB dataset of ten classes, branched YOLOv2 achieved similar accuracy but slightly faster runtime (0.647 s vs 0.6607 s), and adding geometric verification during inference improved mAP from 0.680 to 0.713.

·2 min
Vision

Streaming video memory works better when internalized as evolving latent tokens

The authors introduce LatentStream, a progressive latent working-memory framework for multimodal LLMs processing streaming video. Instead of storing historical clips in an external memory bank and retrieving them as extra visual context, LatentStream converts retrieved evidence into compact, fixed-length latent memory tokens that evolve over time. Experiments show the method outperforms prior store-and-retrieve approaches on both online and offline video understanding benchmarks.

·2 min
Vision

Open-source image model rivals closed systems on minimal budget

The authors introduce Boogu-Image-0.1, a family of open-source multimodal models that unify understanding and generation. By strengthening the system's understanding capability through a better multimodal encoder, agentic prompt rewriting, and inference-time scaling, the model matches or surpasses existing open-source models and approaches closed-source systems, all with a theoretical training cost of roughly $400K.

·1 min