OpenAI began previewing vision capabilities for GPT-4 in March, and the company is now starting to roll out the image input and output to users of its popular ChatGPT. The multimodal expansion also includes audio functionality, with OpenAI proclaiming late last month that “ChatGPT can now see, hear and speak.” The upgrade vaults GPT-4 into the multimodal category with what OpenAI is apparently calling GPT-4V (for “Vision,” though equally applicable to “Voice”). “We’re rolling out voice and images in ChatGPT to Plus and Enterprise users,” OpenAI announced. Continue reading ChatGPT Goes Multimodal: OpenAI Adds Vision, Voice Ability

OpenAI is experimenting with new voice and image capabilities in ChatGPT. According to the company, users can now “speak with ChatGPT and have it talk back,” thanks to an intuitive new interface that, in addition to facilitating voice conversations, will allow users to show ChatGPT an image to discuss. “Snap a picture of a landmark while traveling and have a live conversation about what’s interesting about it,” OpenAI explains, alternatively suggesting you “snap pictures of your fridge and pantry to figure out what’s for dinner” or have it help with homework based on pictures of a math problem. Continue reading OpenAI’s ChatGPT Upgraded with ‘Talk’ Tech, Image Search

Passkeys — a secure way to login to accounts without passwords — are back in the news as a bevy of companies lend their support to the cryptographic technology. Windows 11, GitHub and Nintendo are among the latest to go passwordless. The standard, which began gaining momentum last year, has also been embraced by companies including Apple, Google, the FIDO Alliance and the World Wide Web Consortium. Each passkey involves two keys — one public and registered with an online service or app, and one private and stored on individual devices, like smartphones or computers. Continue reading Windows 11, GitHub, Nintendo Are Latest to Support Passkeys

YouTube announced a new AI-powered creator tool called Dream Screen and hinted at things to come at its annual Made on YouTube event last week. Rolling out on a test basis to select YouTube Shorts creators later this year, Dream Screen will generate “fantastic settings” for video backgrounds. YouTube says it will “eventually” allow creators to “instantly reimagine” their videos by typing an idea prompt that results in new content created with AI tools. The company also announced it will have AI-generated recommendations for video ideas and machine learning assistance with music track search. Continue reading YouTube Debuts AI Creator Tools for Shorts and Mobile Video

Meta Platforms will offer its “Horizon Worlds” virtual reality experience to the world at large, making it available in 2D via mobile and browsers on the Web, starting with early access. Initially, a “small number of people” will be able to  tap into the FPS game “Super Rumble” via the Meta Quest app on Android, with iOS availability over the next few weeks and “more experiences to come.” Early access can also be requested by those who prefer to use computer browsers at horizon.meta.com. “The metaverse should be available to everyone — no matter what device they’re on,” Meta suggests. Continue reading Meta’s ‘Horizon Worlds’ Offers Metaverse on Mobile, the Web

Roblox is adding an expressive, avatar-based video chat called Roblox Connect to its virtual world in an effort to keep its young user base engaged as it grows up while also potentially expanding its audience. “We’re essentially packaging a Hollywood-style motion capture studio into something that runs on a mobile phone or laptop — without the need for equipment or motion-tracking dots,” Roblox explains, pointing out that the device’s on-board camera is all that’s needed to capture facial motion and convey it in real time. Also, Roblox is is coming to PS4 and PS5 next month, while the company will allow game creators to sell 3D virtual goods. Continue reading Roblox Adds Facial-Tracking Vid Chat, Expands to PlayStation

Epic Online Services, the development hub for Epic Games, has expanded its crossplay overlay initiative to include initial support for games on Microsoft Xbox, Nintendo Switch and Sony PlayStation, optimizing its free SDKs for multiplayer crossplay and making it easier for developers to link their games and communities for those platforms across multiple stores. Last summer, EOS launched a PC crossplay overlay. The current upgrade enhances “capabilities across all supported platforms,” the company says, noting “crossplay enables bigger games, bigger audiences” and global games industry growth by connecting more players with a single overlay. Continue reading Epic Offers Crossplay Support for Xbox, PlayStation, Switch

The StanbyME Go from LG Electronics USA is a 27-inch portable smart touchscreen and LCD TV housed in a suitcase that runs for up to three hours on a full charge. Featuring four built-in speakers, screen mirroring (with Bluetooth, Wi-Fi, iOS and Android) and voice controls, LG is touting its new mobile device as an “all-in-one entertainment option.” The 1080p display swivels, tilts and rotates in landscape or portrait orientation, and even includes a table mode for playing games. Priced at $1,000, it accommodates a full range of streaming apps courtesy of LG webOS. Continue reading StanbyME Go: LG Debuts a Portable, Multi-Purpose LCD TV

Amazon plans to enable palm-scan payments at the company’s 500-plus U.S. Whole Foods stores by year’s end with enrollment in Amazon One. Amazon Fresh grocery stores, select Panera restaurants, some stadiums and concert venues, and even a few Starbucks locations are said to be participating in the rollout. Amazon introduced hand-scanning sensor technology in 2020 in a bid to rival Google and Apple in the digital wallet sector. The e-retail giant now has the scanners installed in about 400 locations, some 150 of which are third-party owned, like the Hudson Group airport stores and Coors Field in Denver. Continue reading Amazon Palm-Scan Payment Plan to Challenge Apple, Google

Verizon has teamed with New York’s Metropolitan Museum of Art on a discovery app called Replica that lets consumers scan artwork to generate digital collectibles. The augmented reality Replica experience lets museum visitors scan items using a mobile app that stores them to Roblox as objects or avatar accessories. Roblox account holders can also virtually explore the Met’s facade and partake in other immersive experiences. The effort follows a previous Verizon collaboration with the museum and indicates the way institutions can leverage AR to engage consumers. Continue reading The Met Teams with Verizon to Create Roblox AR Experience

More than 2 billion logged-in users around the world are watching YouTube Shorts each month. To help creators keep them engaged, YouTube is releasing six new tools to improve creativity. Assists for remixing, adding stickers and effects, going live and more are coming to the platform, which has also begun testing a mobile-first live experience designed to help live creators get noticed in the main Shorts feed. One unusual new feature, Collab, lets creators display a Short in a side-by-side frame with other YouTube or Shorts videos. Collab lets users select from a variety of split-screen layout options. It will debut on iOS with Android to follow.  Continue reading YouTube Shorts Adds Creator Tools Including Collab and Q&A

Google is adding images and video to its Search Generative Experience (SGE), an AI-powered context tool the company began testing in May that some are already calling “the future of Google Search.” Those who have signed up for Search Labs and enabled SGE will begin seeing more multimedia at the top of their search results. The idea is to help searchers “get up to speed on a new topic, uncover quick tips for your specific questions or discover products and things to consider — with article links to dig deeper,” Google explains of its latest AI improvements. Continue reading Google’s AI-Powered Search Delivers Relevant, Visual Results

Netflix is updating its mobile user interface to consolidate watch activity in one place. Rolling out for iOS now and Android in August, My Netflix is the new hub for watchlists, downloads and views in progress. The “one stop shop” also collects My List items, notifications, trailers and other content with which users have interacted, including TV shows or movies that have been validated with a subscriber’s thumbs-up. My Netflix replaces the Downloads section globally, and the streamer says the more users interact with it the more customized it will become. Continue reading UI Update ‘My Netflix’ Aims to Streamline Mobile Experience

Facebook has updated its video features in a bid to be more competitive with popular social video platforms TikTok and YouTube. Improvements from editing to discovery and the ability to upload videos in HDR roll out this week along with some new branding: the “Watch” tab has been renamed “Video,” unifying the streaming experience in one location. Editing tools for Reels are porting over to the main Feed channel, which means users can post and view short- and long-form video content as well as live videos in one place. The company is also making it easier to engage with recommended Instagram Reels directly on Facebook. Continue reading Facebook Updates Video Features and Renames Watch Tab

Google has updated transaction policies to allow for blockchain-based digital content, such as NFTs, to be placed within content distributed through its mobile software marketplace Google Play. Google has been slow to warm to blockchain integration, and the new approach comes with strict transparency requirements. If tokenized digital assets are part of an app or game “developers must declare this clearly,” Google explains, adding that “developers may not promote or glamorize any potential earning from playing or trading activities.” These stipulations intend to prevent the hype that has attached itself to so much blockchain activity from infiltrating Google Play. Continue reading Google Updates Policies Regarding Blockchain in Play Store