Title is such clickbait, it does not rewrite the rules of 3d vision, it is a marginal improvement on existing models, and does not work for video, only images. However, Apple open sourced the model weights, which is amazing for research.
For some pictures it outputs something reasonable, for others it's completely broken (black with colored noise in one area).
zimpenfish
Just tried it on a "difficult" image (relatively low contrast photo of a small thin plant in front of a tree trunk with a distant fence in one corner) and it did a pretty good job, I think - https://imgur.com/a/Sqr6hR8 including the depth maps.
LeoPanthera
This presumably is the same model that the Vision Pro Photos app uses to convert 2D photos to 3D.
kylehotchkiss
Was this trained on iPhone photos since there is a decent amount of depth references within iPhone cameras? It’s interesting to see how clearly it understands depth of field. With that, how does it perform on F16 and above?
skykooler
interesting. They claim 0.3 seconds on a consumer GPU; I thought that might scale to 30 seconds or so on CPU but gave up waiting after twelve minutes.
dyauspitr
Can I use this to generate accurate depth maps from 2-D images that I can then CNC or 3-D print?