VFusion3D is the latest AI model unveiled by Meta Platforms, which developed it in conjunction with the University of Oxford. The powerful model, which uses single-perspective images or text prompts to generate high-quality 3D objects, is being hailed as a breakthrough in scalable 3D AI that can potentially transform sectors including VR, gaming and digital design. The platform tackles the challenge of scarce 3D training data in a world teeming with 2D images and text descriptions. The VFusion3D approach leverages what the developers call “a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models.” Continue reading Meta, Oxford Advance 3D Object Generation with VFusion3D

Stability AI has added another audio product to its lineup, releasing the open-source text-to-audio generator Stable Audio Open 1.0 for sound design. The new model can generate up to 47 seconds of samples and sound effects, including drum beats, instrument riffs, ambient sounds, foley and production elements. It also allows for adapting variations and changing the style of audio samples. Stability AI — best known for the image generator Stable Diffusion — in September released Stable Audio, a commercial product that can generate sophisticated music tracks of up to three minutes. Continue reading Stability AI Releases Free Sound FX Tool, Stable Audio Open

Meta Platforms has published a new AI technology, the Segment Anything Model (SAM) that the company claims can identify objects it hasn’t seen before. Acting on a text prompt, SAM will highlight items in a photo or video, picking out all the cats, for instance, or flowers. It can also execute other functions, such as generating a 3D construct using a single 2D image or extrapolating from things viewed in a mixed reality headset. Segment Anything can work in concert with other models, potentially minimizing the need for voluminous data sets for training. Continue reading New Meta AI Can Detect Objects It Has Not Been Trained On