БЛОГ

Archive for the ‘information science’ category: Page 2

Dec 25, 2023

This Machine Learning Research Opens up a Mathematical Perspective on the Transformers

Posted by in categories: information science, mapping, mathematics, particle physics, robotics/AI

The release of Transformers has marked a significant advancement in the field of Artificial Intelligence (AI) and neural network topologies. Understanding the workings of these complex neural network architectures requires an understanding of transformers. What distinguishes transformers from conventional architectures is the concept of self-attention, which describes a transformer model’s capacity to focus on distinct segments of the input sequence during prediction. Self-attention greatly enhances the performance of transformers in real-world applications, including computer vision and Natural Language Processing (NLP).

In a recent study, researchers have provided a mathematical model that can be used to perceive Transformers as particle systems in interaction. The mathematical framework offers a methodical way to analyze Transformers’ internal operations. In an interacting particle system, the behavior of the individual particles influences that of the other parts, resulting in a complex network of interconnected systems.

The study explores the finding that Transformers can be thought of as flow maps on the space of probability measures. In this sense, transformers generate a mean-field interacting particle system in which every particle, called a token, follows the vector field flow defined by the empirical measure of all particles. The continuity equation governs the evolution of the empirical measure, and the long-term behavior of this system, which is typified by particle clustering, becomes an object of study.

Dec 25, 2023

Guy Brags About “Stealing” Millions of Pageviews by Rewriting Competitors’ Articles Using AI

Posted by in categories: information science, internet, robotics/AI

That’s in large part due to these tools’ ability to churn out content at much faster rates than human writers — and at a fraction of the cost.

Given the biblical flood of bottom-shelf AI-generated content polluting the internet today, it’s clear that everyday internet users are not going to benefit.

However, some entrepreneurs are hellbent on making a buck by repurposing existing content, laundering it through an AI algorithm, and passing it off as their own.

Dec 24, 2023

Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Posted by in categories: computing, encryption, information science, nanotechnology

Computer-generated holography (CGH) represents a cutting-edge technology that employs computer algorithms to dynamically reconstruct virtual objects. This technology has found extensive applications across diverse fields such as three-dimensional display, optical information storage and processing, entertainment, and encryption.

Despite the broad application spectrum of CGH, contemporary techniques predominantly rely on projection devices like spatial light modulators (SLMs) and digital micromirror devices (DMDs). These devices inherently face limitations in display capabilities, often resulting in narrow field-of-view and multilevel diffraction in projected images.

In recent developments, metasurfaces composed of an array of subwavelength nanostructures have demonstrated exceptional capabilities in modulating electromagnetic waves. By introducing abrupt changes to fundamental wave properties like amplitude and phase through nanostructuring at subwavelength scales, metasurfaces enable modulation effects that are challenging to achieve with traditional devices.

Dec 24, 2023

All-optical object identification and three-dimensional reconstruction based on optical computing metasurface

Posted by in categories: biotech/medical, information science, robotics/AI

As object identification and three-dimensional (3D) reconstruction techniques become essential in various reverse engineering, artificial intelligence, medical diagnosis, and industrial production fields, there is an increasing focus on seeking vastly efficient, faster speed, and more integrated methods that can simplify processing.

In the current field of object identification and 3D , extracting sample contour information is primarily accomplished by various computer algorithms. Traditional computer processors suffer from multiple constraints, such as high-power consumption, low-speed operation, and complex algorithms. In this regard, there has recently been growing attention in searching for alternative to perform those techniques.

The development of optical computing theory and has provided a more complete theoretical basis for object identification and 3D reconstruction techniques. Optical methods have received more attention as an alternative paradigm than traditional mechanisms in recent years due to their enormous advantages of ultra-fast operation speed, high integration, and low latency.

Dec 23, 2023

Timelapse of Future Technology Vol. II (Sci-Fi Documentary)

Posted by in categories: biotech/medical, education, information science, internet, nuclear energy, robotics/AI

This timelapse of future technology begins with 2 Starships, launched to resupply the International Space Station. But how far into the future do you want to go?

Tesla Bots will be sent to work on the Moon, and A.I. chat bots will guide people into dreams that they can control (lucid dreams). And what happens when humanity forms a deeper understanding of dark energy, worm holes, and black holes. What type of new technologies could this advanced knowledge develop? Could SpaceX launch 100 Artificial Intelligence Starships, spread across our Solar System and beyond into Interstellar space, working together to form a cosmic internet, creating the Encyclopedia of the Galaxy. Could Einstein’s equations lead to technologies in teleportation, and laboratory grown black holes.

Continue reading “Timelapse of Future Technology Vol. II (Sci-Fi Documentary)” »

Dec 22, 2023

Researchers take a different approach with measurement-based quantum computing

Posted by in categories: computing, information science, quantum physics

The race to develop quantum computers has really heated up over the past few years. State-of-the-art systems can now run simple algorithms using dozens of qubits—or quantum bits—which are the building blocks of quantum computers.

Dec 22, 2023

Model scale versus domain knowledge in statistical forecasting of chaotic systems

Posted by in categories: information science, robotics/AI

Can machine learning predict chaos? This paper performs a large-scale comparison of modern forecasting methods on a giant dataset of 135 chaotic systems.


Chaos and unpredictability are traditionally synonymous, yet large-scale machine-learning methods recently have demonstrated a surprising ability to forecast chaotic systems well beyond typical predictability horizons. However, recent works disagree on whether specialized methods grounded in dynamical systems theory, such as reservoir computers or neural ordinary differential equations, outperform general-purpose large-scale learning methods such as transformers or recurrent neural networks. These prior studies perform comparisons on few individually chosen chaotic systems, thereby precluding robust quantification of how statistical modeling choices and dynamical invariants of different chaotic systems jointly determine empirical predictability.

Dec 22, 2023

Researchers from Indiana University Unveil ‘Brainoware’: A Cutting-Edge Artificial Intelligence Technology Inspired by Brain Organoids and Silicon Chips

Posted by in categories: biotech/medical, information science, mathematics, robotics/AI

The fusion of biological principles with technological innovation has resulted in significant advancements in artificial intelligence (AI) through the development of Brainoware. Developed by researchers at Indiana University, Bloomington, this innovative system leverages clusters of lab-raised brain cells to achieve elementary speech recognition and solve mathematical problems.

The crux of this technological leap lies in the cultivation of specialized stem cells that mature into neurons—the fundamental units of the brain. While a typical human brain comprises a staggering 86 billion neurons interconnected extensively, the team managed to engineer a minute organoid, merely a nanometer wide. This tiny but powerful structure was connected to a circuit board through an array of electrodes, allowing machine-learning algorithms to decode responses from the brain tissue.

Termed Brainoware, this amalgamation of biological neurons and computational circuits exhibited remarkable capabilities after a brief training period. It was discerned between eight subjects based on their diverse pronunciation of vowels with an accuracy rate of 78%. Impressively, Brainoware outperformed artificial networks in predicting the Henon map, a complex mathematical construct within chaotic dynamics.

Dec 21, 2023

Photonic signal processor based on a Kerr microcomb for real-time video image processing

Posted by in categories: biotech/medical, information science, robotics/AI

Signal processing is key to communications and video image processing for astronomy, medical diagnosis, autonomous driving, big data and AI. Menxi Tan and colleagues report a photonic processor operating at 17Tb/s for ultrafast robotic vision and machine learning.

Dec 20, 2023

This AI transformer tech-powered robot taught itself to walk

Posted by in categories: information science, physics, robotics/AI

The robot is blind and cannot see its environment but can continue to balance and walk, even if an object is hurled at it.


UC researchers Ilija Radosavovic and Bike Zhang wondered if “reinforcement learning,” a concept made popular by large language models (LLMs) last year, could also teach the robot how to adapt to changing needs. To test their theory, the duo started with one of the most basic functions humans can perform — walking.

Transformer model for learning

Continue reading “This AI transformer tech-powered robot taught itself to walk” »

Page 2 of 28012345678Last