Meta AI Seamless Translator Converts Nearly 100 Languages

The research division of Meta AI has developed Seamless Communication, a suite of artificial intelligence models that generate what the company says is natural and authentic communication across languages, facilitating what amounts to real-time universal speech translation. The models were released with accompanying research papers and data. The flagship model, Seamless, merges capabilities from a trio of models — SeamlessExpressive, SeamlessStreaming and SeamlessM4T v2 — into a single system that can translate between almost 100 spoken and written languages, preserving idioms, emotion and the speaker’s vocal style, Meta says. Continue reading Meta AI Seamless Translator Converts Nearly 100 Languages

Stability AI Intros Real-Time Text-to-Image Generation Model

Stability AI, developer of Stable Diffusion (one of the leading visual content generators, alongside Midjourney and DALL-E), has introduced SDXL Turbo — a new AI model that demonstrates more of the latent possibilities of the common diffusion generation approach: images that update in real time as the user’s prompt updates. This feature was always a possibility even with previous diffusion models given text and images are comprehended differently across linear time, but increased efficiency of generation algorithms and the steady accretion of GPUs and TPUs in a developer’s data center makes the experience more magical. Continue reading Stability AI Intros Real-Time Text-to-Image Generation Model

Twitter Users Vote in Favor of Musk Stepping Down as CEO

Facing backlash against his executive leadership, Twitter’s new owner and CEO, billionaire Elon Musk, conducted an informal 12-hour poll over the weekend asking users of the popular social media platform whether he should keep his new position. “Should I step down as head of Twitter?” the controversial executive asked. “I will abide by the results of this poll.” After more than 17.5 million responses, the results indicate that a majority of users believe Musk should step down from his post (57.5 percent voted in the affirmative). As of press time, it remains unclear what action Musk may take in light of the poll results. Continue reading Twitter Users Vote in Favor of Musk Stepping Down as CEO

Facebook Rolls Out New Messenger Feature, Watch Together

Facebook launched Watch Together, a feature for Messenger and videoconferencing platform Messenger Rooms, to allow users to watch videos in real time with family and friends on Apple and Android mobile devices. Users choose videos to view through Facebook’s video hub, Facebook Watch. The push to promote yet more video comes at a time when, due largely to COVID-19, more people than ever are at home watching content. Facebook Messenger allows up to eight people on a video call, and Messenger Rooms tops out at 50 people. Continue reading Facebook Rolls Out New Messenger Feature, Watch Together

Google Bypasses Cloud to Offer AI to Enterprise Customers

AI can enable many important tasks from manufacturing to medicine, but only if the applications are speedy and secure. Communication via the cloud adds latency and risks privacy, which is why Google worked on a solution — dubbed Coral — that avoids centralized data centers. Coral product manager Vikram Tank described Coral as a “platform of [Google] hardware and software components … that help you build devices with local AI — providing hardware acceleration for neural networks … right on the edge device.” Continue reading Google Bypasses Cloud to Offer AI to Enterprise Customers

Android Q Live Caption Feature Enables Real-Time Subtitles

During Google’s I/O 2019 developers conference this week, the company demonstrated an impressive new feature for mobile operating system Android Q. Called Live Caption, the feature enables real-time transcription for any video or audio that users play on their smartphones. No matter if they’re listening or watching via YouTube, Skype, Instagram, Pocket Casts, or other applications, Live Caption overlays the text on top of whatever is being used. Additionally, Live Caption will work on top of original video or audio recordings on users’ phones.

Continue reading Android Q Live Caption Feature Enables Real-Time Subtitles

Real-Time Virtual Production Moves into Television and Film

To be able to bring real-time feedback to every step of the filmmaking workflow has been both the Holy Grail of production and an impossible dream. When Bradley Weiers began to work in film production, he chafed at the delayed feedback and found that the real-time ecosystem of game production was a better fit. Now head of immersive storytelling at Unity Technologies, Weiers said that for the first time, he believes he can connect his first love, film, and the preferable tools of gaming.  “There’s a bridge to cross over,” he suggested during a panel at NAB 2019. Continue reading Real-Time Virtual Production Moves into Television and Film

DeepRay Uses AI to Reconstruct Distorted Video in Real Time

Cambridge Consultants has trained artificial intelligence to reconstruct images from a highly distorted image or video feed in real time that is the AI’s best guess of what the source image originally looked like. The unique approach of their DeepRay product involves recognizing and correcting for a wide universe of distortion patterns. Cambridge Consultants’ first clients are self-driving car companies concerned with accurate object and risk detection, but DeepRay could also have a number of entertainment industry technical and story applications. Continue reading DeepRay Uses AI to Reconstruct Distorted Video in Real Time

Nvidia Reveals Use of Neural Networks to Create Virtual City

Nvidia used processing power and neural networks to create a very convincing virtual city, which will be open for tours by attendees to this year’s NeurIPS AI conference in Montreal. Nvidia’s system, which uses existing videos of scenery and objects to create these interactive environments, also makes it easier for artists to create similar virtual worlds. Nvidia vice president of applied deep learning Bryan Catanzaro said generative models are key to making the process of creating virtual worlds cost effective. Continue reading Nvidia Reveals Use of Neural Networks to Create Virtual City

5G Could Enable Interactive Video But Raise Privacy Issues

People typically associate 5G with ultra-fast high-bandwidth Internet connections, but few realize it will also impact how we watch video and could lead to a range of privacy concerns. With 5G, truly interactive television programming can become a reality, with minimal latency enabling content to respond quickly to the viewer’s emotional and physical responses. According to interactive video company Wirewax co-founder Dan Garraway, the video becomes “a two-way conversation.” In other words, while we watch 5G content, it watches back. Continue reading 5G Could Enable Interactive Video But Raise Privacy Issues

Upgraded Google Lens to Be Featured in Top Android Phones

During this week’s Google I/O conference, the importance of Google Lens to chief executive Sundar Pichai’s AI-first strategy became apparent. Google Lens combines computer vision and natural language processing with Google Search, for a solution aimed at consumers. Lens, described as “Google’s engine for seeing, understanding, and augmenting the real world,” resides in the camera viewfinder of Assistant and, soon, its top-end Android smartphones. Lens recognizes people, animals, objects, environments and text. Continue reading Upgraded Google Lens to Be Featured in Top Android Phones

NAB 2018: Artificial Intelligence Tools for Animation and VFX

Tools powered by artificial intelligence and machine learning can also be used in animation and visual effects. Nvidia senior solutions architect Rick Grandy noted that the benefit of such tools is that artists don’t have to replicate their own work. That includes deep learning used for realistic character motion created in real-time via game engines and AI, as well as a phase-functioned neural network for character control, whereby the network can be trained by motion capture or animation. Continue reading NAB 2018: Artificial Intelligence Tools for Animation and VFX

New Camera-First Twitter Feature Could Threaten Snap’s Ads

After its first profitable quarter on record, Twitter is focusing on new business and advertising opportunities. For example, sources say the social media company is currently working on a camera-first feature that could compete with Snap and potentially threaten its advertising opportunities. The new feature would combine videos and photos with the Twitter Moments feature, creating more real-time content around events and enabling companies to sponsor events or place ads between tweeted content.

Continue reading New Camera-First Twitter Feature Could Threaten Snap’s Ads

Google Maps Helps Develop Real-World Gaming Experiences

Google is enabling game developers to create “Pokémon Go”-like experiences in which game elements are embedded into real-world maps using the new Google Maps API and the Unity game engine. Over 200 games are already in development. Next Games is developing a game based on the popular TV series “The Walking Dead,” and NBCUniversal and Ludia will release a “Jurassic World Alive” location-based game for mobile. Because Google Maps updates in real time, developers can create gaming experiences with a sharp eye on reality.

Continue reading Google Maps Helps Develop Real-World Gaming Experiences

Google Debuts YouTube Shared Viewing App For iOS Users

Google’s Uptime app, that lets users watch YouTube videos in real time with friends, is now freely available to iOS users following its invite-only limited beta test. The beta, which started in March, was updated a few times, adding the ability to play and share music videos, as well as connect to Facebook to find friends to watch videos with. Users can also chat, leave comments and place emoji on top of the video. A replay of a shared video will include the ability to see comments at the time in the video they were made. Continue reading Google Debuts YouTube Shared Viewing App For iOS Users