Nvidia Research is releasing a new AI model called Neuralangelo that can turn 2D iPhone video clips into 3D structures, virtually replicating sculptures, buildings and other real world objects in great detail. Named for Michelangelo’s life-like creations from blocks of marble, Neuralangelo is able to accurately capture repetitive texture patterns, homogenous colors, and strong color variations, tasks that were problematic for earlier AI models. Neuralangelo accomplishes the feat using instant neural graphics primitives, the technology behind Nvidia Instant NeRF. Continue reading Nvidia’s Neuralangelo AI Turns 2D Video Clips into 3D Worlds

Google research scientists report that they have produced realistic frames from open source video data sets at scale. Neural networks are able to generate complete videos from only a start and end frame, but it’s the complexity, information density and randomness of video that have made it too challenging to create such realistic clips at scale. The scientists wrote that, to their knowledge, “this is the first promising application of video-generation models to videos of this complexity.” The systems are based on a neural architecture known as Transformers, as described in a Google Brain paper, and are autoregressive, “meaning they generate videos pixel by pixel.” Continue reading Google Scientists Generate Realistic Videos at Scale with AI