Captions, which leverages AI to help its customers produce “studio quality videos directly from their mobile devices,” has launched a new app called Lipdub that automatically translates and dubs content into 28 languages. The free download lets user dub anyone “and experience familiar voices and faces in a suite of new languages.” Lipdub’s translations not only duplicate what the company says is “the subject’s exact voice,” but also syncs lip movements to match. It also incorporates dialects and idioms, with options like Gen Z and Texas slang. Continue reading Captions Debuts AI Lipdub with Translation and Gen Z Slang

Roku TV and the Roku player are getting new features including better search and discovery to complement its more than 400 free live linear TV channels. The upgrades will begin rolling out with the introduction of Roku OS 12.5 in the coming weeks. Highlights include the ability to follow a favorite sports team, new music channels and the ability to link Roku’s Photo Streams image-based screensaver to a Google Photos account, so personal pictures can be displayed between viewing events. The changes are across a wide range of features targeting sports enthusiasts and others, including technical purists and casual viewers who need help finding entertainment options. Continue reading Roku Adds New Search, Sports, Music Features with OS 12.5

Spotify is using AI to drive podcast language translation in what sounds like the podcaster’s own voice, which has obvious implications for film and television dubbing. Working with podcast notables including Dax Shepard, Monica Padman and Bill Simmons, Spotify used AI to mimic their voices in Spanish, French and German for several episodes. The proprietary Spotify technology uses OpenAI’s new text-to-speech voice-generation technology as well as its open-source Whisper speech recognition system, which transcribes spoken words into text. The result, Spotify says, is “more authentic” and “more personal and natural” than traditional dubbing. Continue reading Spotify Uses AI to Copy Host Voices for Podcast Translations

YouTube announced a new AI-powered creator tool called Dream Screen and hinted at things to come at its annual Made on YouTube event last week. Rolling out on a test basis to select YouTube Shorts creators later this year, Dream Screen will generate “fantastic settings” for video backgrounds. YouTube says it will “eventually” allow creators to “instantly reimagine” their videos by typing an idea prompt that results in new content created with AI tools. The company also announced it will have AI-generated recommendations for video ideas and machine learning assistance with music track search. Continue reading YouTube Debuts AI Creator Tools for Shorts and Mobile Video

As creators embrace artificial intelligence to juice creativity, TikTok is launching a tool that helps them label their AI-generated content while also beginning to test “ways to label AI-generated content automatically.” “AI enables incredible creative opportunities, but can potentially confuse or mislead viewers,” TikTok said in announcing labels that can apply to “any content that has been completely generated or significantly edited by AI,” including video, photographs, music and more. The platform also touted a policy that “requires people to label AI-generated content that contains realistic images, audio or video, in order to help viewers contextualize.” Continue reading TikTok Creates New Tools for Labeling Content Created by AI

Recorded music revenues in the United States reached $8.4 billion for the first half of 2023, an all-time high for the period that translates to a 9.3 percent increase, according to the Recording Industry Association of America (RIAA). Streaming continued to thrive, accounting for a whopping 84 percent of the six-month revenue total, or $7 billion. Total revenue from paid subscription services grew 11 percent to $5.5 billion, nearly double the growth in the number of individual paid accounts, which rose by just over 6 percent year-over-year, to an average of 95.8 million accounts. Continue reading Streaming Drives Music Revenue in the U.S. to a New Record

Spotify is adding a new tool called Showcase that lets artists promote their work in the app’s homepage feed. Showcase “appears as a mobile banner at the top of Spotify’s Home — the most visited place on Spotify, where millions of listeners come to decide what to listen to, resulting in billions of streams each day,” the streamer says, adding that “people who see a Showcase are 6x more likely to stream the promoted release.” The banners will carry labels indicating a recommendation is sponsored. The company is also launching a marketing tool called Songwriter Promo Cards to assist with discovery. Continue reading Spotify Lets Artists Pay to Get Home Feed Recommendations

Stability AI is launching Stable Audio, a music generation AI tool that uses latent diffusion to deliver what the company says is high-quality 44.1 kHz music for commercial use. Stable Audio uses a web-based interface to generate music from text prompts and duration. Because its latent diffusion model architecture has been conditioned on text metadata as well as audio file duration and start time, it defeats a problem common to diffusion for generative audio — producing cohesive musical segments as opposed to arbitrary sections of a song that start or end in the middle of a phrase. Continue reading Stability AI Develops ‘Stable Audio’ Generative Text-to-Music

Universal Music Group and Deezer have set Q4 as the launch date for a new, artist-centric streaming royalty model the companies jointly developed. Indie streaming platform Deezer will launch the concept model in its native France in Q4 2023. The companies conceived the new compensation methodology as part of a previously announced collaboration, using “deep data analysis” for an outcome they say “better reflects the true value of artist-fan relationships.” Calling streaming “the most significant technology advancement in music in many years,” the partners conclude “a flood of uploads with no meaningful engagement” has necessitated reassessment. Continue reading Universal, Deezer to Reinvent Music Streaming Royalty Model

YouTube is developing a plan for responsible AI that includes creating a framework to compensate recording artists and copyright holders for machine-generated music. YouTube’s Music AI Incubator — with support from early partner Universal Music Group — aims to help singers, songwriters, musicians and producers sort out issues like compensation and intellectual property protections, and work with trade groups and government officials on means of enforcement. YouTube CEO Neal Mohan says creators “have embraced AI to streamline and boost their creative processes,” with YouTube logging “more than 1.7 billion views of videos related to AI tools” this year. Continue reading YouTube Launches Music AI Incubator with UMG as Partner

YouTube Music is adding Samples, a discovery feature that lets users scroll by swiping vertically, similar to TikTok’s signature video feed. Described as “the appetizer to a whole meal,” Samples is comprised of 30-second teasers, but quickly lets users add the entire song to a playlist or share it with friends, all “without leaving YouTube Music,” the Google-owned company informs, suggesting fans “kick off a great new radio station, watch the full video, visit the album page, or even use the song to create your own Short.” Rolling out globally in stages, the Samples tab will appear at the bottom of the YouTube Music app next to the Home, Library and Explore sections. Continue reading YouTube Music Adds a Vertical Video Scroll Called ‘Samples’

X is developing a video-calling feature to add as part of its rebranding as an “everything app.” X CEO Linda Yaccarino shared the news in her first television interview since leaving NBCUniversal to become head of Elon Musk’s social media platform in June, when the platform was still known as Twitter. Yaccarino said X users will soon be able to make video calls based on their social ID alone, without sharing phone numbers. Long-form videos, creator subscriptions and the ability to make payments on the platform are additional features that Yaccarino explained will be coming to X. Continue reading Yaccarino: X Getting Video Calls with Its ‘Everything’ Rebrand

Meta Platforms is releasing AudioCraft, a generative AI framework that creates “high-quality,” “realistic” audio and music from text prompts. AudioCraft consists of three models: MusicGen, AudioGen and EnCodec, all of which Meta announced it is open-sourcing. Released in June, MusicGen was trained on Meta-owned and licensed music, and generates music from text prompts, while AudioGen, which was trained on public domain samples, generates sound effects (like honking horns and barking dogs) from text prompts. The EnCodec decoder allows “higher quality music generation with fewer artifacts,” according to Meta. Continue reading Meta’s AudioCraft Turns Words into Music with Generative AI

Spotify is rolling out its new Confidence software development product in private beta. Based on its learnings from more than 10 years of experience experimenting at scale, the company says Confidence aims to make it simple for teams to set up, run and analyze their own user tests so they can quickly perfect and productize ideas. “Whether it’s automatically coordinating simultaneous A/B tests or orchestrating the rollout of an AI recommendation system across mobile, desktop, and web, the platform we built scales experimentation best practices and capabilities,” Spotify explains, adding that it plans to make the technology available soon to all companies. Continue reading Spotify’s Confidence Development Platform Is in Private Beta

Content hubs are gaining traction with streaming platforms as a search and discovery tool, according to a new study by Horowitz Research, which notes eight in 10 consumers indicating they watch content from a collection or hub occasionally. Multicultural audiences are turning to using hub resources in significant numbers, with African American streamers engaging at the 80 percent rate, and Asian viewers at 65 percent. The number trends higher — at 77 percent — among less acculturated Asian streamers. Among Latinx streamers, nearly 59 percent say they’ve turned to Latinx content collections, with less acculturated doing so at higher rates (78 percent). Continue reading Study: Streaming Viewers Are Interested in Hubs for Discovery