Microsoft and Nvidia Debut World’s Largest Language Model

Microsoft and Nvidia have trained what they describe as the most powerful AI-driven language model to date, the Megatron-Turing Natural Language Generation model (MT-NLG), which has “set the new standard for large-scale language models in both model scale and quality,” the firms say. As the successor to the companies’ Turing NLG 17B and Megatron-LM, the new MT-NLG has 530 billion parameters, or “3x the number of parameters compared to the existing largest model of this type” and demonstrates unmatched accuracy in a broad set of natural language tasks. Continue reading Microsoft and Nvidia Debut World’s Largest Language Model

ETC Launches First of Two Metaverse Experience Challenges

University of Southern California students were invited to participate in the first of two scheduled Metaverse Experience Challenges, hosted by ETC@USC. Making use of current and emerging tools, students were tasked with developing original ideas for compelling metaverse experiences. Six teams of randomly-grouped students started work at 1:00 pm on Friday, October 1 and presented their ideas to judges from Epic Games, Universal Pictures and Disney Research at 3:00 pm on Saturday, October 2. Each member of the winning teams — Meetaverse and Virtual Vinyl — received a Nintendo Switch “Fortnite” Edition, courtesy of Epic Games. Continue reading ETC Launches First of Two Metaverse Experience Challenges

Strider Shield Technology Aims to Protect Intellectual Property

Strider Technologies has debuted its Strider Shield platform that helps businesses better understand potential threats to intellectual property — including nation-state directed IP theft and supply chain threats — by combining online tracking tools often used by advertising agencies with data ingestion tools, natural language processing and various algorithms. Strider co-founder and chief strategy officer Eric Levesque said that Strider Shield allows an enterprise to collect thousands of data points such as email addresses, domain names and keywords to correlate against systems where the IP resides, in order to surface potential risks. Continue reading Strider Shield Technology Aims to Protect Intellectual Property

Google AI-Enabled MUM Aims to Reinvent, Empower Search

Google revealed its work on a new AI-enabled Internet search tool dubbed MUM (Multitask Unified Model), which can “read” the nuances globally of human language. The company says that users will be able to find information more readily and be able to ask abstract questions. MUM is not yet publicly available but Google independently used it for a COVID-19 related project. Vice president of search Pandu Nayak and a colleague designed an “experience” that gave in-depth information on vaccines when users searched for them. Continue reading Google AI-Enabled MUM Aims to Reinvent, Empower Search

OpenAI and Microsoft Introduce $100 Million AI Startup Fund

OpenAI unveiled a $100 million OpenAI Startup Fund to fund early-stage companies pursuing ways that AI can have a “transformative” impact on healthcare, education, climate change and other fields. OpenAI chief executive Sam Altman said the Fund will make “big, early bets” on no more than 10 such companies. OpenAI, with funding from Microsoft and others, will manage the Fund. Selected projects will get “early access” to future OpenAI systems, support from OpenAI’s team and credits for Microsoft Azure. Continue reading OpenAI and Microsoft Introduce $100 Million AI Startup Fund

IBM Project CodeNet Employs AI Tools to Program Software

IBM’s AI research unit debuted Project CodeNet, a dataset to develop machine learning models for software programming. The name is a take-off on ImageNet, the influential dataset of photos that pushed the development of computer vision and deep learning. Creating “AI for code” systems has been challenging since software developers are constantly discovering new problems and exploring different solutions. IBM researchers have taken that into consideration in developing a multi-purpose dataset for Project CodeNet. Continue reading IBM Project CodeNet Employs AI Tools to Program Software

Google I/O: Android 12, Remote Working Tools, Wear Update

At this week’s Google I/O developer conference, the company unveiled its Android 12 mobile operating system with numerous visual changes and new privacy features. The company also showcased Project Starline, a prototype virtual meeting booth that could replace Google Meet. In addition, Google is tweaking its smartwatch Wear OS and has improved Photos’ discovery and Chrome’s built-in password manager. More remote working tools and new natural language skills were debuted. Google also tweaked Maps and shopping tools. Continue reading Google I/O: Android 12, Remote Working Tools, Wear Update

Nvidia to Power Giant AI Computing with Its Arm-Based CPU

Nvidia debuted its Arm-based Grace CPU for giant artificial intelligence and high-performance computing applications, the company’s first such data center CPU. At Nvidia’s GTC 2021 conference, chief executive Jensen Huang said Grace, which offers 10 times the performance using energy-efficient Arm cores, will first be used by the Swiss National Supercomputing Centre (CSCS) and the U.S. Department of Energy’s Los Alamos National Laboratory (LANL). The CPU, named for U.S. Navy rear admiral and computer programming pioneer Grace Hopper, is slated for availability in early 2023. Continue reading Nvidia to Power Giant AI Computing with Its Arm-Based CPU

OpenAI and EleutherAI Foster Open-Source Text Generators

OpenAI’s GPT-3, the much-noted AI text generator, is now being used in 300+ apps by “tens of thousands” of developers and generating 4.5 billion words per day. Meanwhile, a collective of researchers, EleutherAI is building transformer-based language models with plans to offer an open source, GPT-3-sized model to the public for free. The non-profit OpenAI has an exclusivity deal with Microsoft that gives the tech giant unique access to GPT-3’s underlying code. But OpenAI has made access to its general API available to all comers, who then build services on top of it. Continue reading OpenAI and EleutherAI Foster Open-Source Text Generators

GPT-3: New Applications Developed for OpenAI’s NLP Model

OpenAI’s natural language processing (NLP) model GPT-3 offers 175 billion parameters, compared with its predecessor, GPT-2’s mere 1.5 billion parameters. The result of GPT-3’s immense size has enabled it to generate human-like text based on only a few examples of a task. Now, many users have gained access to the API, and the result has been some interesting use cases and applications. But the ecosystem is still nascent and how it matures — or whether it’s superseded by another NLP model — remains to be seen. Continue reading GPT-3: New Applications Developed for OpenAI’s NLP Model

CES 2021 Opens with Predictions on Tech Trends for the Year

At the opening of the all-digital CES 2021 this week, Consumer Technology Association vice president of research Steve Koenig and director of research Lesley Rohrbaugh described their predictions for innovation and technology trends to expect in the coming year, noting that the CTA provides 30 studies a year on its website. Koenig put 2021 in context as following a tough 2020 of COVID-19 and related economic downturn. “As a global community we confronted a lot of those challenges together and saw a myriad of solutions from tech innovation,” he said. Continue reading CES 2021 Opens with Predictions on Tech Trends for the Year

OpenAI Unveils AI-Powered DALL-E Text-to-Image Generator

OpenAI unveiled DALL-E, which generates images from text using two multimodel AI systems that leverage computer vision and NLP. The name is a reference to surrealist artist Salvador Dali and Pixar’s animated robot WALL-E. DALL-E relies on a 12-billion parameter version of GPT-3. OpenAI demonstrated that DALL-E can manipulate and rearrange objects in generated imagery and also create images from scratch based on text prompts. It has stated that it plans to “analyze how models like DALL·E relate to societal issues.” Continue reading OpenAI Unveils AI-Powered DALL-E Text-to-Image Generator

Facebook Makes New Natural Language Model Open Source

Facebook and AI startup Hugging Face open-sourced their new natural language processing model, Retrieval Augmented Generation (RAG), which finds and interprets contextual information on the fly. RAG is now available as a component of the Hugging Face transformer library, integrated with the new Datasets library to offer the indexed knowledge source RAG relies on. According to Facebook, RAG can alter or add to its internal knowledge, letting researchers control the model without needing to retrain it. Continue reading Facebook Makes New Natural Language Model Open Source

IBM Provides AI-Based Solutions for U.S. Open Without Fans

In June, the U.S. Tennis Association (USTA) opted to hold the 2020 U.S. Open in New York (August 31-September 13) without fans due to COVID-19. That decision launched many changes, from electronic line calling to food-ordering apps for athletes. USTA has been working with IBM to integrate artificial intelligence for such uses as creating broadcast highlight reels based on crowd reaction. The June decision was “a pivotal moment,” said IBM’s sports and entertainment marketing program director Kristi Kolski. “A lot of the solutions that we had in the pipeline were no longer going to be viable.” Continue reading IBM Provides AI-Based Solutions for U.S. Open Without Fans

The Human Interface: What We Expect From AI at CES 2020

We’re not going to lie: the annual “heads up CES” piece on artificial intelligence is a major exercise in hit or miss. This is because technology rarely evolves on an annual time scale, and certainly not advanced technology like AI. Yet, here we are once again. Sure, 2019 was as fruitful as it gets in the AI research community. The raw debate between Neural Networks Extremists (those pushing for an “all neural nets all the time” approach to intelligence) and the Fanatical Symbolists (those advocating a more hybrid approach between knowledge bases, expert systems and neural nets) took an ugly “Mean Girl” turn, with two of the titans of the field (Gary Marcus and Yann LeCun) trading real insults on Twitter just a few days ago.  Continue reading The Human Interface: What We Expect From AI at CES 2020