Lifeboat Foundation

When Open AI’s GPT-3 model made its debut in May of 2020, its performance was widely considered to be the literal state of the art. Capable of generating text indiscernible from human-crafted prose, GPT-3 set a new standard in deep learning. But oh what a difference a year makes. Researchers from the Beijing Academy of Artificial Intelligence announced on Tuesday the release of their own generative deep learning model, Wu Dao, a mammoth AI seemingly capable of doing everything GPT-3 can do, and more.

First off, Wu Dao is flat out enormous. It’s been trained on 1.75 trillion parameters (essentially, the model’s self-selected coefficients) which is a full ten times larger than the 175 billion GPT-3 was trained on and 150 billion parameters larger than Google’s Switch Transformers.

In order to train a model on this many parameters and do so quickly — Wu Dao 2.0 arrived just three months after version 1.0’s release in March — the BAAI researchers first developed an open-source learning system akin to Google’s Mixture of Experts, dubbed FastMoE. This system, which is operable on PyTorch, enabled the model to be trained both on clusters of supercomputers and conventional GPUs. This gave FastMoE more flexibility than Google’s system since FastMoE doesn’t require proprietary hardware like Google’s TPUs and can therefore run on off-the-shelf hardware — supercomputing clusters notwithstanding.

A team at Stony Brook University used ORNL’s Summit supercomputer to model x-ray burst flames spreading across the surface of dense neutron stars.

At the heart of some of the smallest and densest stars in the universe lies nuclear matter that might exist in never-before-observed exotic phases. Neutron stars, which form when the cores of massive stars collapse in a luminous supernova explosion, are thought to contain matter at energies greater than what can be achieved in particle accelerator experiments, such as the ones at the Large Hadron Collider and the Relativistic Heavy Ion Collider.

Although scientists cannot recreate these extreme conditions on Earth, they can use neutron stars as ready-made laboratories to better understand exotic matter. Simulating neutron stars, many of which are only 12.5 miles in diameter but boast around 1.4 to 2 times the mass of our sun, can provide insight into the matter that might exist in their interiors and give clues as to how it behaves at such densities.

The Israeli military is calling Operation Guardian of the Walls the first artificial-intelligence war. the IDF established an advanced AI technological platform that centralized all data on terrorist groups in the Gaza Strip onto one system that enabled the analysis and extraction of the intelligence.

The IDF used artificial intelligence and supercomputing during the last conflict with Hamas in the Gaza Strip.

The US Department of Energy on Thursday is officially dedicating Perlmutter, a next-generation supercomputer that will deliver nearly four exaflops of AI performance. The system, based at the National Energy Research Scientific Computing Center (NERSC) at Lawrence Berkeley National Laboratory, is the world’s fastest on the 16-bit and 32-bit mixed-precision math used for AI.

The HPE Cray system is being installed in two phases. Each of Phase 1’s GPU-accelerated nodes has four Nvidia A100 Tensor Core GPUs, for a total of 6159 Nvidia A100 Tensor Core GPUs. Each Phase 1 node also has a single AMD Milan CPU.

2 sticks of RAM giving you 1TB of memory will be the norm soon.

While consumers today typically use computers with 8GB or 16GB of DDR4 RAM inside, Samsung is pushing ahead with the next generation of memory modules. Its latest stick of RAM is a 512GB DDR5 module running at 7200Mbps.

The new module will be used in servers performing “the most extreme compute-hungry, high-bandwidth workloads.” That means supercomputers, artificial intelligence, and machine learning. It was made possible thanks to advanced HKMG technology, which Samsung adopted back in 2018 for its GDDR6 memory. Basically, HKMG replaces the insulator layer in DRAM structures. The high dielectric material contained in the layer reduces current leakage and therefore allows higher performance. At the same time, Samsung managed to reduce power usage in the new module by 13%.

Continue reading “Samsung Develops a Very Fast 512GB DDR5 Memory Module” »

OLCF’s Frontier is set to use a hybrid multi-tier storage sub-system with 700PB capacity and up to 75TB/s throughput.

STARFORGE, an initiative dedicated to modeling early star formation, has released stunning supercomputer simulations of young protostars.

Keep watching to look at three of the most fantastic quantum breakthroughs that bring liberation and freedom to the world of science today! Subscribe to Futurity for more videos.

#quantum #quantumcomputing #google.

Continue reading “Scientists Just Made A Quantum Computing Breakthrough!!” »

The rise of AI has been accompanied by an explosion of processing horsepower.

News, analysis and comment from the Financial Times, the worldʼs leading global business publication.