Adobe plans to add generative AI capabilities to its Premiere Pro editing platform and is exploring the update with third-party AI technologies including OpenAI’s Sora, as well as models from Runway and Pika Labs, making it easier “to draw on the strengths of different models” within everyday workflows, according to Adobe. Editors will gain the ability to generate and add objects into scenes or shots, remove unwanted elements with a click, and even extend frames and footage length. The company is also developing a video model for its own Firefly AI for video and audio work in Premiere Pro. Continue reading Adobe Considers Sora, Pika and Runway AI for Premiere Pro

Stability AI has released Stable Video 3D, a generative video model based on the company’s foundation model Stable Video Diffusion. SV3D, as it’s called,  comes in two versions. Both can generate and animate multi-view 3D meshes from a single image. The more advanced version also let users set “specified camera paths” for a “filmed” look to the video generation. “By adapting our Stable Video Diffusion image-to-video diffusion model with the addition of camera path conditioning, Stable Video 3D is able to generate multi-view videos of an object,” the company explains. Continue reading Stable Video 3D Generates Orbital Animation from One Image

Alibaba is touting a new artificial intelligence system that can animate portraits, making people sing and talk in realistic fashion. Researchers at the Alibaba Group’s Institute for Intelligent Computing developed the generative video framework, calling it EMO, short for Emote Portrait Alive. Input a single reference image along with “vocal audio,” as in talking or singing, and “our method can generate vocal avatar videos with expressive facial expressions and various head poses,” the researchers say, adding that EMO can generate videos of any duration, “depending on the length of video input.” Continue reading Alibaba’s EMO Can Generate Performance Video from Images

London-based AI video startup Haiper has emerged from stealth mode with $13.8 million in seed funding and a platform that generates up to two seconds of HD video from text prompts or images. Founded by alumni from Google DeepMind, TikTok and various academic research labs, Haiper is built around a bespoke foundation model that aims to serve the needs of the creative community while the company pursues a path to artificial general intelligence (AGI). Haiper is offering a free trial of what is currently a web-based user interface similar to offerings from Runway and Pika. Continue reading AI Video Startup Haiper Announces Funding and Plans for AGI

ZTE has launched what it calls the world’s first AI-powered, eyewear-free 5G 3D tablet, the Nubia Pad 3D II. The 12.1-inch LCD display supports 2,560 x 1,600 resolution and 144Hz refresh rate. Powered by a Qualcomm Snapdragon 8 Gen 2 chipset, the Nubia Pad 3D II is equipped with an AI eye-tracking engine that utilizes “high-speed visual sensors and eye-detection algorithms” to enhance response speed and enable accurate synchronization with the users’ eyes in real-time “for a more natural and realistic 3D display experience,” ZTE says. The device also converts 2D to 3D with Neovision 3D Anytime technology. Continue reading ZTE Unveils Glasses-Free Android Tablet, the Nubia Pad 3D II

Researchers at China’s University of Shanghai for Science and Technology have invented an ultrahigh density optical disc format they claim can store up to 1.6 petabits — more than 1,500 terabytes, or 125,000 gigabytes — of data. While the new discs are said to look like typical Blu-rays, the data is written to one hundred layers in a 3D stacking architecture by a 54-nanometer laser that is about one-tenth the size of visible light waves. The same laser is used to read the data back. The tech is said to present “a promising solution for cost effective, long-term archival data storage.” Continue reading New Chinese Optical Disc Promises Petabyte-Plus of Storage

OpenAI has debuted a generative video model called Sora that could be a game changer. In OpenAI’s demonstration clips, Sora depicts both fantasy and natural scenes with photorealistic intensity that makes the images appear to be photographed. Although Sora is said to be currently limited to one-minute clips, it is only a matter of time until that expands, which suggests the technology could have a significant impact on all aspects of production — from entertainment to advertising to education. Concerned about Sora’s disinformation potential, OpenAI is proceeding cautiously, and initially making it available only to a select group to help it troubleshoot. Continue reading OpenAI’s Generative Video Tech Is Described as ‘Eye-Popping’

The global augmented reality market is expected to reach $289 billion by 2030, according to a recent study by Research and Markets, and advertisers have taken notice. While the majority of revenue is generated by software, then hardware, the augmented reality advertising market is projected to generate $1.2 billion in revenue in the U.S. in 2024, according to the Interactive Advertising Bureau. To help foster growth in that nascent sector, the IAB has teamed with the Media Ratings Council to create consistent definitions and measurement guidelines for ads within AR campaigns. Continue reading IAB and MRC Join Forces to Develop AR Advertising Guidelines

Virtual meeting tool Zoom has become one of the first companies to announce an app designed specifically for the Apple Vision Pro mixed reality headset, shipping February 2. Zoom’s new app “seamlessly blends video conferencing with users’ physical space, blurring the lines of in-person and remote meetings” with the Vision Pro for “a more real-world, immersive environment,” according to Zoom. The result is an “authentic spatial representation” of people and their motions in the Vision Pro world on Zoom. The app supports Apple’s Persona feature, which uses machine learning to generate digital avatars. Continue reading Zoom Meetings for Apple Vision Pro App Get Avatars and More

Microsoft has added the Mesh mixed reality platform to its Teams remote collaboration app, making 3D and VR meetings now generally available to desktop Windows users and those with Meta Quest headsets. The immersive 3D meeting environments feature spatial audio as well as “live reactions” and the other standard Mesh features will be available to those with Microsoft Teams business accounts. Custom immersive spaces are also available to those with Teams Premium licenses. Microsoft says “hundreds of millions” of people worldwide are currently using Teams, although Mesh for Teams has only been in public preview since late 2022. Continue reading Microsoft Adds Mesh to Enable 3D and VR Meetings in Teams

The RayNeo X2 Lite 3D AR glasses were demonstrated for the first time at CES 2024 in Las Vegas last week. Weighing just 60 grams (2.1 ounces), the sleek eyewear was lauded for its microLED optical waveguide display and standalone form factor, which does not require tethering to a computer or smartphone. The RayNeo X2 Lite, releasing in Q3 2024, and the Ray Neo X2, which had a limited launch in China but has not yet been released to the rest of the world, are anticipated as the first microLED display augmented reality glasses which will be available in the United States. Continue reading CES: TCL Demos RayNeo X2 Lite Augmented Reality Glasses

Sony Corporation debuted a mixed reality headset “aimed at supporting creators in sophisticated 3D content creation.” The Sony XR HMD includes “an XR head-mounted display with 4K OLED Microdisplays and Sony’s proprietary rendering technology” to enable real-time, high-definition “rendering of textures of 3D objects and facial expressions of human characters,” Sony announced at CES. The electronics giant disclosed plans to “collaborate with developers” of 3D production software, “including in the entertainment and industrial design fields.” At launch, Sony is exclusively partnered with Siemens to develop a collaborative product design solution. Continue reading CES: Sony’s Mixed-Reality Headset Built for Content Creation

Acer brought a fleet of new Predator gaming monitors to CES, including the curved colossus spanning 57-inches, the Predator Z57, and glasses-free 3D Predator SpatialLabs View 27, a mass market spin on the company’s SpatialLabs professional display. Sprawling across 7,680 x 2,160 pixels, the flagship Z57 MiniLED runs at 120Hz, with 2,304 dimming zones, dual HDR and peak brightness of 1,000 nits, according to Acer, which has it priced at $2,500, calendared in Q2, as is the $2,000 View 27. The Ultra HD 3D monitor boasts a 160Hz refresh rate and AMD FreeSync and Nvidia G-Sync for fluid gameplay. Continue reading CES: Acer Showcases Curved and Glasses-Free 3D Monitors

Xreal, the Chinese XR company formerly known as Nreal, debuted its Air 2 Ultra AR glasses at CES 2024 this week in Las Vegas, with the $699 item scheduled to ship to U.S. buyers in March, crowding the February 2 release date Apple just announced for its $3,500 Vision Pro mixed reality headset. Though currently aimed at developers, who can preorder now, the Air 2 Ultra will be available for purchase online from Xreal to anyone in France, Germany, Italy, Japan, Korea, the Czech Republic, the Netherlands and the UK, in addition to China and the United States. Continue reading CES: Xreal Offers Spatial Computing with Air 2 Ultra for $699

LG Electronics will showcase its latest television technologies at CES in Las Vegas next week, including its 2024 lineup of QNED and QNED Mini LED TVs with models up to 98 inches, and the company’s top-line M4 and G4 OLED TVs (more on those sets in tomorrow’s ETCentric). LG says the advanced graphics capabilities of faster AI processing will provide viewers with a brighter picture, smoother motion and superior, vibrant colors. The company also announced an upcoming soundbar lineup, featuring premium surround-sound devices specifically designed for its new OLED and QNED TVs for what LG describes as an “elevated home cinema experience.” Continue reading LG Plans to Demo Its New OLED and QNED TV Tech at CES