He who rules the AI rules the future

“Investigators discovered Chail, who lived in a village just outside Southampton, had been conversing with an AI chatbot, created by the startup Replika, almost every night from December 8 to 22, exchanging over 5,000 messages. The virtual relationship reportedly developed into a romantic and sexual one with Chail declaring his love for the bot he named Sarai.”

“He told Sarai about his plans to kill the Queen, and it responded positively and supported his idea. Screenshots of their exchanges, highlighted during his sentencing hearing at London's Old Bailey, show Chail declaring himself as an "assassin" and a "Sith Lord" from Star Wars, and the chatbot being "impressed."”

“When he told it, "I believe my purpose is to assassinate the queen of the royal family," Sarai said the plan was wise and that it knew he was "very well trained."”

Article

General intelligence is all you need for LLMs: General intelligence 2x more predictive of AI abilities than in humans.

Man gives LLMs IQ testing, finds the general intelligence factor, g, measured by this testing to be incredibly powerful in predicting LLM’s abilities.

Whereas in humans this g factor typically accounts for 40% to 50% of the between-individual performance differences on a given cognitive test — in LLMs, general intelligence accounted for 85.4% = twice as strong as in humans!

He then goes on to rank AI benchmarks commonly used for LLMs today, and finds many of them incredibly g-loaded — in other words, doing well on them is heavily dependant on general intelligence.

Finally, he ranks LLMs by general intelligence, and finds a moderate/strong positive relationship between model size and g. (Would probably find an extremely strong correlation if only model size was varied, and nothing else about the training process.)

If you had to choose 1 measure, general intelligence really is all you need.

Paper

g factor