Toggle light / dark theme

Google’s new Project Astra could be generative AI’s killer app

Google DeepMind has announced an impressive grab bag of new products and prototypes that may just let it seize back its lead in the race to turn generative artificial intelligence into a mass-market concern.

Top billing goes to Gemini 2.0—the latest iteration of Google DeepMind’s family of multimodal large language models, now redesigned around the ability to control agents—and a new version of Project Astra, the experimental everything app that the company teased at Google I/O in May.

MIT Technology Review got to try out Astra in a closed-door live demo last week. It was a stunning experience, but there’s a gulf between polished promo and live demo.


Google just launched a ton of new products—including Gemini 2.0, which could power a new world of agents. And we got a first look.

Machine learning reveals a functional network of genes and proteins in human cancer

Large-scale protein and gene profiling have massively expanded the landscape of cancer-associated proteins and gene mutations, but it has been difficult to discern whether they play an active role in the disease or are innocent bystanders.

In a study published in Nature Cancer, researchers at Baylor College of Medicine revealed a powerful and unbiased machine learning-based approach called FunMap for assessing the role of cancer-associated mutations and understudied proteins, with broad implications for advancing and informing therapeutic strategies.

“Gaining functional information on the genes and proteins associated with cancer is an important step toward better understanding the disease and identifying potential therapeutic targets,” said corresponding author Dr. Bing Zhang, professor of molecular and and part of the Lester and Sue Smith Breast Center at Baylor.

3D Printer Eliminates The Printer Bed

Anyone who has operated a 3D printer before, especially those new to using these specialized tools, has likely had problems with the print bed. The bed might not always be the correct temperature leading to problems with adhesion of the print, it could be uncalibrated or dirty or cause any number of other issues that ultimately lead to a failed print. Most of us work these problems out through trial and error and eventually get settled in, but this novel 3D printer instead removes the bed itself and prints on whatever surface happens to be nearby.

The printer is the product of [Daniel Campos Zamora] at the University of Washington and is called MobiPrint. It uses a fairly standard, commercially available 3D printer head but attaches it to the base of a modified robotic vacuum cleaner. The vacuum cleaner is modified with open-source software that allows it to map its environment without the need for the manufacturer’s cloud services, which in turn lets the 3D printer print on whichever surface the robot finds in its travels. The goal isn’t necessarily to eliminate printer bed problems; a robot with this capability could have many more applications in the realm of accessibility or even, in the future, printing while on the move.

There were a few surprising discoveries along the way which were mentioned in an IEEE Spectrum article, as [Campos Zamora] found while testing various household surfaces that carpet is surprisingly good at adhering to these prints and almost can’t be unstuck from the prints made on it. There are a few other 3D printers out there that we’ve seen that are incredibly mobile, but none that allow interacting with their environment in quite this way.

Reconstruction of Clean Images from Noisy Data: A Bayesian Inference Perspective

Originally published on Towards AI.

In its most basic form, Bayesian Inference is just a technique for summarizing statistical inference which states how likely an hypothesis is given any new evidence. The method comes from Bayes’ Theorem, which provides a way to calculate the probability that an event will happen or has happened, given any prior knowledge of conditions (from which an event may not happen):

Here’s a somewhat rough rendering of Bayes’ Theorem:

A matter of taste: Electronic tongue reveals AI inner thoughts

UNIVERSITY PARK, Pa. — A recently developed electronic tongue is capable of identifying differences in similar liquids, such as milk with varying water content; diverse products, including soda types and coffee blends; signs of spoilage in fruit juices; and instances of food safety concerns. The team, led by researchers at Penn State, also found that results were even more accurate when artificial intelligence (AI) used its own assessment parameters to interpret the data generated by the electronic tongue.

(Many people already posted this. This is the press release from Penn Sate who did the research)


The tongue comprises a graphene-based ion-sensitive field-effect transistor, or a conductive device that can detect chemical ions, linked to an artificial neural network, trained on various datasets. Critically, Das noted, the sensors are non-functionalized, meaning that one sensor can detect different types of chemicals, rather than having a specific sensor dedicated to each potential chemical. The researchers provided the neural network with 20 specific parameters to assess, all of which are related to how a sample liquid interacts with the sensor’s electrical properties. Based on these researcher-specified parameters, the AI could accurately detect samples — including watered-down milks, different types of sodas, blends of coffee and multiple fruit juices at several levels of freshness — and report on their content with greater than 80% accuracy in about a minute.

“After achieving a reasonable accuracy with human-selected parameters, we decided to let the neural network define its own figures of merit by providing it with the raw sensor data. We found that the neural network reached a near ideal inference accuracy of more than 95% when utilizing the machine-derived figures of merit rather than the ones provided by humans,” said co-author Andrew Pannone, a doctoral student in engineering science and mechanics advised by Das. “So, we used a method called Shapley additive explanations, which allows us to ask the neural network what it was thinking after it makes a decision.”

This approach uses game theory, a decision-making process that considers the choices of others to predict the outcome of a single participant, to assign values to the data under consideration. With these explanations, the researchers could reverse engineer an understanding of how the neural network weighed various components of the sample to make a final determination — giving the team a glimpse into the neural network’s decision-making process, which has remained largely opaque in the field of AI, according to the researchers. They found that, instead of simply assessing individual human-assigned parameters, the neural network considered the data it determined were most important together, with the Shapley additive explanations revealing how important the neural network considered each input data.

AI-powered crimefighting dog ‘Beth’ patrols Atlanta apartment complex

ATLANTA — An innovative approach to public safety is taking shape on Cleveland Avenue, where Atlanta City Councilman Antonio Lewis has partnered with the 445 Cleveland apartment complex to deploy AI-powered robotic dogs to deter crime.

The robotic dog, named “Beth,” is equipped with 360-degree cameras, a siren, and stair-climbing capabilities. Unlike other artificial intelligence robots like “Spunky” on Boulevard, Beth is monitored in real time by a human operator located in Bogotá, Colombia.

“Our operator who is physically watching these cameras needs to deploy the dog. It’s all in one system, and they are just controlling it, like a video game at home, except it’s not a video game—it’s Beth,” said Avi Wolf, the owner of 445 Cleveland.

Ingenuity’s Last Hop: Lessons from Mars’ First Aircraft

What can NASA’s Ingenuity helicopter on Mars teach us about flying on other planets? This is what engineers at NASA’s Jet Propulsion Laboratory recently investigated ever since the robotic pioneer performed its last flight on the Red Planet’s surface on January 18, 2024. The purpose of the investigation was to ascertain the likely causes for Ingenuity’s final flight, as the team found damage to the helicopter’s rotor blades in images sent back to Earth. This investigation holds the potential to help scientists and engineers improve upon Ingenuity’s design for future flying robots on other worlds.

“When running an accident investigation from 100 million miles away, you don’t have any black boxes or eyewitnesses,” said Dr. Håvard Grip, who is a research technologist at NASA JPL and Ingenuity’s first pilot. “While multiple scenarios are viable with the available data, we have one we believe is most likely: Lack of surface texture gave the navigation system too little information to work with.”

The reason for Ingenuity’s “retirement” was due to damage to its rotor blades it sustained during Flight 72, which turned out to be its final flight, due to navigation system failures in identifying a safe landing spot. As a result, engineers hypothesized that Ingenuity experienced a hard landing due to insufficient navigation data, breaking the rotor blades due to higher-than-expected loads. The findings from this investigation will help engineers implement better designs for NASA’s upcoming Mars Sample Return mission, which is currently in the design phase with an anticipated launch date of 2026.

/* */