Stability AI has introduced a new artificial intelligence model called Stable Virtual Camera, designed to convert 2D images into videos with realistic depth and perspective. According to the company, this tool aims to enhance traditional digital filmmaking and 3D animation by incorporating generative AI, offering users greater control and customization.
Stable Virtual Camera is capable of generating novel views of a scene using one or more images, up to a total of 32, at user-defined camera angles. The model can produce videos that follow dynamic camera paths or presets such as “Spiral,” “Dolly Zoom,” “Move,” and “Pan.”
The current version of Stable Virtual Camera, available as a research preview, can create videos in square (1:1), portrait (9:16), and landscape (16:9) formats, extending up to 1,000 frames in length. However, Stability AI advises that the model may yield lower-quality results in specific situations, particularly with images that include humans, animals, or dynamic textures like water. The company notes that highly ambiguous scenes, complex camera paths that intersect with objects, and irregularly-shaped objects may result in flickering artifacts, especially when target viewpoints significantly differ from the input images.
Stable Virtual Camera is accessible for research purposes under a non-commercial license and can be downloaded from the AI development platform Hugging Face.
Stability AI, the company responsible for the popular image generation model Stable Diffusion, encountered financial difficulties last year despite raising new funds from investors such as Eric Schmidt and Napster founder Sean Parker. Reports indicate that Emad Mostaque, the co-founder and former CEO of Stability AI, mismanaged the company, leading to staff resignations, the collapse of a partnership with Canva, and growing investor concerns about the company’s future.
In recent months, Stability AI has appointed a new CEO, added “Titanic” director James Cameron to its board, and released several new image generation models. Earlier in March, Stability AI collaborated with chipmaker Arm to develop an AI model capable of generating audio and sound effects on mobile devices powered by Arm chips.
