ETC Releases Final Section of Virtual Production White Paper

The Entertainment Technology Center@USC has released the fourth and final installment of its case study, “Fathead: Virtual Production & Beyond.” Chapter 4 of the four-part white paper is titled “Key Contributors: Process Pipelines,” which summarizes key findings of the production and recommended best practices moving forward. “Fathead” — directed by c. Craig Patterson and produced by Erik Weaver, ETC’s director of adaptive production — was shot at Amazon Stage 15 in Culver City as an experiment in virtual production, in-camera VFX and collaborative, cloud-based workflows. Continue reading ETC Releases Final Section of Virtual Production White Paper

Suno’s AI Music Generator Is Now Available for iOS Devices

Suno, the AI text-to-music startup that along with AI music generator Udio is currently being sued by the Recording Industry Association of America, has launched its long-awaited mobile app. Likened to a pocket-sized virtual music studio, it is available for free (with ads) to iOS users in the U.S. Suno says a global rollout is coming soon, as is a mobile app for Android. “Whether you’re a shower singer or a charting artist, we break barriers between you and the song you dream of making. No instrument needed, just imagination,” touts Suno’s landing page on Apple’s App Store. Continue reading Suno’s AI Music Generator Is Now Available for iOS Devices

Captions: Generative Video Startup Raises $60 Million in NYC

Generative video creation and editing platform Captions has raised $60 million in Series C funding. Founded in 2021 by former Microsoft engineer Gaurav Misra and Goldman Sachs alum Dwight Churchill, the company’s technologies — Lipdub, AI Edit and the 3D avatar app AI Creator — have amassed more than 10 million downloads for mobile, the firm says. The C round brings its total raise to $100 million for a stated market valuation of $500 million. With the new funding, Captions plans to expand its presence in New York City, which is “emerging as the epicenter for AI research,” according to Misra. Continue reading Captions: Generative Video Startup Raises $60 Million in NYC

YouTube AI Song Eraser Easily Removes Copyright Material

YouTube has released an eraser tool update that makes it easy to remove copyrighted music from videos without disturbing the remaining audio, like dialogue and sound effects. The Erase Song update uses an AI algorithm to detect and remove the offending material, making it more accurate than what had previously been available, as well as easier. Creators whose material has Content ID claims can now excise the objectionable material without having to manually edit and upload a new video, thereby avoiding potential restrictions on where the video is viewable or whether it can be monetized. Continue reading YouTube AI Song Eraser Easily Removes Copyright Material

Runway Making Gen-3 Alpha AI Video Model Available to All

New York-based AI startup Runway has made its latest frontier model — which creates realistic AI videos from text, image or video prompts — generally available to users willing to upgrade to a paid plan starting at $12 per month for each editor. Introduced several weeks go, Gen-3 Alpha reportedly offers significant improvements over Gen-1 and Gen-2 in areas such as speed, motion, fidelity and consistency. Runway explains it worked with a “team of research scientists, engineers and artists” to develop the upgrades but did not specify where it collected its training data. As the AI video field ramps up, current rivals include Stability AI, OpenAI, Pika and Luma Labs. Continue reading Runway Making Gen-3 Alpha AI Video Model Available to All

New Prototype Is the World’s First AI-Powered Movie Camera

The world’s first AI-powered movie camera has surfaced. Still in development, it aims to enable filmmakers to turn footage into AI imagery in real time while shooting. Called the CMR-M1, for camera model 1, it is the product of creative tech agency SpecialGuestX and media firm 1stAveMachine, with the goal of providing creatives with a familiar interface for AI imagemaking. It was inspired by the Cine-Kodak device, the first portable 16mm camera. “We designed a camera that serves as a physical interface to AI models,” said Miguel Espada, co-founder and executive creative technologist at SpecialGuestX, a company that does not think directors will use AI sitting at a keyboard. Continue reading New Prototype Is the World’s First AI-Powered Movie Camera

Toys R Us and Native Foreign Create Ad Using OpenAI’s Sora

Toys R Us is the first company to use OpenAI’s generative video platform Sora to produce a commercial, or what is being described as a “brand film.” With a running time of 1:06, the spot depicts company founder Charles Lazurus as a young boy, “envisioning his dreams” for the toy store and mascot Geoffrey the Giraffe. It was co-produced and directed by Los Angeles creative agency Native Foreign co-founder Nik Kleverov, who has alpha access to the pre-release Sora. Toys R Us says that from concept to completed video, the project came together in just a few weeks to premiere at the 2024 Cannes Lions International Festival of Creativity. Continue reading Toys R Us and Native Foreign Create Ad Using OpenAI’s Sora

ByteDance Rival Kuaishou Creates Kling AI Video Generator

China’s Kuaishou Technology has a video generator called Kling AI in public beta that is getting great word-of-mouth, with comments from “incredibly realistic” to “Sora killer,” a reference to OpenAI’s still in closed beta video generator. Kuaishou claims that using only text prompts, Kling can generate “AI videos that closely mimic the real world’s complex motion patterns and physical characteristics,” in sequences as long as two minutes at 30 fps and 1080p, while supporting various aspect ratios. Kuaishou is China’s second most popular short-form video app, after ByteDance’s Douyin, the Chinese version of TikTok. Continue reading ByteDance Rival Kuaishou Creates Kling AI Video Generator

Fable Launches Showrunner Animated Episodic TV Generator

A year after its announcement, Fable is launching Showrunner, a platform that lets anyone make TV-style animated content by writing prompts that are turned into shows by generative AI. The San Francisco company run by CEO Edward Saatchi with recruits from Oculus, Pixar and various AI startups is launching 10 shows that let users make their own episodes “from their couch,” waiting only minutes to see the finished result, according to Saatchi, who says a 15-word prompt is enough to generate 10- to 20-minute episodes. Saatchi is hoping Fable’s shows can garner an audience by self-publishing on Amazon Prime. Continue reading Fable Launches Showrunner Animated Episodic TV Generator

Autodesk Buys Wonder Dynamics, AI VFX App Wonder Studio

Autodesk is going all-in on artificial intelligence with the acquisition of AI startup Wonder Dynamics, maker of the Wonder Studio VFX tool. Autodesk — whose products include Maya, 3ds Max and Flame — worked with Wonder on a Maya plug-in last year and appears to have been impressed. Wonder Studio was purpose-built to be compatible with 3D tools like Maya, largely automating the process of putting 3D characters within live-action scenes. Terms of the deal were not disclosed, and Autodesk did not detail plans for integrating Wonder Dynamics, but it’s likely the company’s AI expertise will make itself felt across the portfolio. Continue reading Autodesk Buys Wonder Dynamics, AI VFX App Wonder Studio

Adobe Considers Sora, Pika and Runway AI for Premiere Pro

Adobe plans to add generative AI capabilities to its Premiere Pro editing platform and is exploring the update with third-party AI technologies including OpenAI’s Sora, as well as models from Runway and Pika Labs, making it easier “to draw on the strengths of different models” within everyday workflows, according to Adobe. Editors will gain the ability to generate and add objects into scenes or shots, remove unwanted elements with a click, and even extend frames and footage length. The company is also developing a video model for its own Firefly AI for video and audio work in Premiere Pro. Continue reading Adobe Considers Sora, Pika and Runway AI for Premiere Pro

NAB: Blackmagic Unveils Two New Full-Frame Cine Cameras

Blackmagic Design has introduced two new attention-getting cameras at NAB 2024 in Las Vegas. The flagship URSA Cine 12K LF (large format) has a new full-frame sensor with 16-stop dynamic range, comes with 8TB of built-in storage, and starts at $14,995. It ships with a Canon EF mount, but also accommodates ARRI PL. Blackmagic will also make the URSA available with a 17K sensor, but has yet to share pricing (though it is expected to cost from $20,000 to $25,000). The $2,995 PYXIS 6K cinema box-style camera offers a choice of three lens attachments: EF, PL or L-mount. Continue reading NAB: Blackmagic Unveils Two New Full-Frame Cine Cameras

Sony 4K 60p PTZ Broadcast Camera Boasts AI Auto Framing

Sony Electronics is previewing a new flagship 4K 60p pan-tilt-zoom (PTZ) camera model, the BRC-AM7, which has an integrated lens that uses artificial intelligence for PTZ Auto Framing technology to control advanced tracking and focus. The camera provides “accurate and natural automatic tracking of moving subjects,” making it ideal for live events and sports productions at broadcast quality. Set for release in 2025, Sony says the BRC-AM7 is the world’s “smallest and lightest” integrated lens PTZ camera, weighing in at just over 8 pounds. The camera is among the numerous Sony products featured at NAB 2024 in Las Vegas. Continue reading Sony 4K 60p PTZ Broadcast Camera Boasts AI Auto Framing

DaVinci Resolve 19 Has AI Motion Tracking and Color Grading

Blackmagic Design has unveiled the new DaVinci Resolve 19, with multi-source editing, neural engine AI tools, Resolve FX and Fairlight AI audio panning among the highlight features. With more than 100 feature upgrades in all, Resolve 19 boasts IntelliTrack AI, Ultra NR noise reduction, ColorSlice six vector grading palettes and Film Look Creator FX. The company also announced the DaVinci Resolve Micro Color Panel, a more affordable color panel for DaVinci Resolve software that Blackmagic says was designed in collaboration with the world’s leading colorists. These tools are featured at the Blackmagic booth at NAB 2024. Continue reading DaVinci Resolve 19 Has AI Motion Tracking and Color Grading

AWS Deadline Cloud Service Scales Up Instant Render Farms

Amazon Web Services has launched a new cloud computing service called AWS Deadline Cloud that allows customers to set up, deploy, and scale rendering projects in what the company says is mere “minutes,” improving efficiency by facilitating parallel rendering pipelines. “With Deadline Cloud, customers creating computer graphics, visual effects, or innovating their pipelines to incorporate artificial intelligence-generated visuals can build a cloud-based render farm — aggregated compute — that scales from zero to thousands of compute instances for peak demand, without needing to manage their own infrastructure,” according to AWS. Continue reading AWS Deadline Cloud Service Scales Up Instant Render Farms