Categories: FAANG

Matrix3D: Large Photogrammetry Model All-in-One

We present Matrix3D, a unified model that performs several photogrammetry subtasks, including pose estimation, depth prediction, and novel view synthesis using just the same model. Matrix3D utilizes a multi-modal diffusion transformer (DiT) to integrate transformations across several modalities, such as images, camera parameters, and depth maps. The key to Matrix3D’s large-scale multi-modal training lies in the incorporation of a mask learning strategy. This enables full-modality model training even with partially complete data, such as bi-modality data of image-pose and image-depth pairs…
AI Generated Robotic Content

Recent Posts

Are there any open source alternatives to this?

I know there are models available that can fill in or edit parts, but I'm…

5 hours ago

The future of engineering belongs to those who build with AI, not without it

As we look ahead, the relationship between engineers and AI systems will likely evolve from…

6 hours ago

The 8 Best Handheld Vacuums, Tested and Reviewed (2025)

Lightweight, powerful, and generally inexpensive, the handheld vacuum is the perfect household helper.

6 hours ago

I really miss the SD 1.5 days

submitted by /u/Dwanvea [link] [comments]

1 day ago

Latent Bridge Matching: Jasper’s Game-Changing Approach to Image Translation

Discover how latent bridge matching, pioneered by the Jasper research team, transforms image-to-image translation with…

1 day ago

A Gentle Introduction to SHAP for Tree-Based Models

Machine learning models have become increasingly sophisticated, but this complexity often comes at the cost…

1 day ago