8 years of cost reduction in 5 weeks: how Stanford’s Alpaca model changes everything, including the economics of OpenAI and GPT 4. The breakthrough, using self-instruct, has big implications for Apple’s secret large language model, Baidu’s ErnieBot, Amazon’s attempts and even governmental efforts, like the newly announced BritGPT.

I will go through how Stanford put the model together, why it costs so little, and demonstrate in action versus Chatgpt and GPT 4. And what are the implications of short-circuiting human annotation like this? With analysis of a tweet by Eliezer Yudkowsky, I delve into the workings of the model and the questions it rises.

Web Demo: https://alpaca-ai0.ngrok.io/

Alpaca: https://crfm.stanford.edu/2023/03/13/alpaca.html.
Ark Forecast: https://research.ark-invest.com/hubfs/1_Download_Files_ARK-I…_Final.pdf.
Eliezer Tweet:

Dear silly Internet saying “but knowledge distillation is already known”: the key idea here is that the fine-tuning above the base model is comparatively much *easier* and *cheaper* to extract and re-imbue, if you have a new base comparable to the earlier base model.

(Spelling… https://t.co/en28X1PBxk

— Eliezer Yudkowsky (@ESYudkowsky) March 14, 2023

Self-Instruct: https://arxiv.org/pdf/2212.10560.pdf.
InstructGPT: https://openai.com/research/instruction-following.
OpenAI Terms: https://openai.com/policies/terms-of-use.
MMLU Test: https://arxiv.org/pdf/2009.03300.pdf.
Apple LLM: https://www.nytimes.com/2023/03/15/technology/siri-alexa-goo…gence.html.
GPT 4 API: https://openai.com/pricing.
Llama Models: https://arxiv.org/pdf/2302.13971.pdf.
BritGPT: https://www.theguardian.com/technology/2023/mar/15/uk-to-inv…wn-britgpt.
Amazon: https://www.businessinsider.com/amazons-ceo-andy-jassy-on-ch…?r=US&IR=T
AlexaTM: https://arxiv.org/pdf/2208.01448.pdf.
Baidu Ernie: https://www.nytimes.com/2023/03/16/world/asia/china-baidu-chatgpt-ernie.html.
PaLM API: https://developers.googleblog.com/2023/03/announcing-palm-ap…suite.html.

Patreon.com/AIExplained

A new University of Illinois project is using advanced object recognition technology to keep toxin-contaminated wheat kernels out of the food supply and to help researchers make wheat more resistant to fusarium head blight, or scab disease, the crop’s top nemesis.

“Fusarium head blight causes a lot of economic losses in wheat, and the associated toxin, deoxynivalenol (DON), can cause issues for human and animal health. The disease has been a big deterrent for people growing wheat in the Eastern U.S. because they could grow a perfectly nice crop, and then take it to the elevator only to have it get docked or rejected. That’s been painful for people. So it’s a big priority to try to increase resistance and reduce DON risk as much as possible,” says Jessica Rutkoski, assistant professor in the Department of Crop Sciences, part of the College of Agricultural, Consumer and Environmental Sciences (ACES) at Illinois. Rutkoski is a co-author on the new paper in the Plant Phenome Journal.

Increasing resistance to any crop disease traditionally means growing a lot of genotypes of the crop, infecting them with the disease, and looking for symptoms. The process, known in plant breeding as phenotyping, is successful when it identifies resistant genotypes that don’t develop symptoms, or less severe symptoms. When that happens, researchers try to identify the genes related to disease resistance and then put those genes in high-performing hybrids of the crop.

NPL, in collaboration with London Biofoundry and BiologIC Technologies Ltd, have released an analysis on existing and emerging DNA Synthesis technologies in Nature Reviews Chemistry, featuring the work on the front cover.

The study, which was initiated by DSTL, set out to understand the development trajectory of DNA Synthesis as a major industry drive for the UK economy over the next 10 years. The demand for synthetic DNA is growing exponentially. However, our ability to make, or write, DNA lags behind our ability to sequence, or read, it. The study reviewed existing and emerging DNA synthesis technologies developed to close this gene writing gap.

DNA or genes provide a universal tool to engineer and manipulate living systems. Recent progress in DNA synthesis has brought up limitless possibilities in a variety of industry sectors. Engineering biology, therapy and diagnostics, data storage, defense and nanotechnology are all set for unprecedented breakthroughs if DNA can be provided at scale and low cost.

A green bullet train capable of touching 200 miles per hour

The proposed 218-mile high-speed network will connect Las Vegas and Southern California with technology that allows it to maintain a cruising speed of 200 miles per hour (321 km/h). This means the travel time between the cities will be just over an hour. In comparison, a journey by car takes over four hours.

The expenditure on the project is expected to provide a much-needed boost to the economy, including the creation of nearly 35,000 jobs during the construction phase and around 10,000 permanent jobs. According to Brightline, the fully electric, emission-free system will be one of the greenest forms of transportation in the U.S., removing 3 million cars and 400,000 tons of CO₂ each year.

The field equations of Einstein’s General Relativity theory say that faster-than-light (FTL) travel is possible, so a handful of researchers are working to see whether a Star Trek-style warp drive, or perhaps a kind of artificial wormhole, could be created through our technology.

But even if shown feasible tomorrow, it’s possible that designs for an FTL system could be as far ahead of a functional starship as Leonardo da Vinci’s 16th century drawings of flying machines were ahead of the Wright Flyer of 1903. But this need not be a showstopper against human interstellar flight in the next century or two. Short of FTL travel, there are technologies in the works that could enable human expeditions to planets orbiting some of the nearest stars.

Certainly, feasibility of such missions will depend on geopolitical-economic factors. But it also will depend on the distance to nearest Earth-like exoplanet. Located roughly 4.37 light years away, Alpha Centauri is the Sun’s closest neighbor; thus science fiction, including Star Trek, has envisioned it as humanity’s first interstellar destination.

Adamandeve.com Code: MIA 50% off 1 item + free shipping in the US and Canada. Some restrictions apply.

ChatGPT is changing the world, but what if the technology behind it can change the economy too?

Watch some of my other videos!

How To Pass As A Woman | Mia Mulder.

Why You Shouldn’t Be A Nationalist | Mia Mulder.

Anti-intellectualism: “Facts vs Feelings | Mia Mulder.

The firm’s strategists broke down why AI is about to “revolutionize everything” with a similar impact to Steve Jobs’ smartphone.

Alan Thompson, AI Consultant and Former Chairman of Mensa International, examines the latest trends in artificial intelligence, as well as its applications to finance, professional services, and military. He discusses the possibility that AI could become sentient and even dangerous with David Lin, Anchor and Producer at Kitco News.

Alan Thompson’s website: https://lifearchitect.ai/about-alan/

Follow David Lin on Twitter: @davidlin_TV (https://twitter.com/davidlin_TV)
Follow Kitco News on Twitter: @KitcoNewsNOW (https://twitter.com/KitcoNewsNOW)

0:00 — Intro.
1:57 — Overview of AI
8:07 — Chat GPT
11:51 — Human similarities.
15:53 — Microsoft and Google.
19:55 — AI replacing workers.
21:54 — Applications of AI
24:26 — Technological singularity.
26:05 — Dangers of AI
28:52 — Transhumanism.

#technology #ai #chatgpt.

Kitco NEWS is a global news network based in Montreal, with bureaus in New York, Hong Kong, New Mexico, London and Vancouver. Since 2009, our journalists have helped investors make informed decisions through in-depth reporting, daily market updates, and interviews with key industry figures. We aim to accurately and impartially cover the economy, stock markets, commodities, cryptocurrencies, mining and metals.

For the longest time, social media companies have rallied on the fact that their service is “free” to use. All these companies banked on showing ads and getting some user data in return to let them use social networks without any charge. Now with declining revenues and tough global economic conditions, social networks are resorting to offering subscriptions in one way or another. These paid plans can get unlock features ranging from vanity checkmarks to exclusive stickers to increase in reach and more.

Twitter Blue.

Twitter first introduced its paid subscription in June 2021 in Canada and Australia later expanding it to the US and New Zealand.

On stage in front of packed rooms, at lavish private venture capital dinners and over casual games of ping pong, San Francisco’s AI startup scene is blowing up. With tens of thousands of laid off software engineers with time to tinker, glistening empty buildings beckoning them to start something new, and billions of dollars in idle cash in need of investing, it’s no surprise that just weeks after viral AI companion ChatGPT made its jaw-dropping debut on Nov. 30, one of the smartest cities in the world would pick generative AI as the driver of its next economic boom.

San Francisco’s AI startup scene is blowing up thanks to the ChatGPT craze and backing from investors like Y Combinator, Bessemer, Coatue, Andreessen Horowitz, Tiger Global, Mark Benioff’s Time Ventures and Ashton Kutcher’s Sound Ventures. Meet the players who are shaking up the tech mecca.