AI Is Eating Its Own Tail — and the Next Models Will Pay For It

AI's Next Frontier Is Choking on Junk Data

The scaling hypothesis — feed AI more data, get smarter AI — worked until it didn't. The next frontier isn't chatbots. It's physical AI and world models: systems that navigate roads, fold laundry, assist in surgery. That leap requires rich, multifaceted real-world data. And right now, the industry is drowning in junk instead.

Junk data is data that doesn't move a model forward. It's cheaper and easier to produce, which is exactly why it's everywhere. AI companies are ravenous for training data, fueling a wave of multi-billion dollar data startups — Scale AI, Surge AI, Mercor among them — but catering to that appetite has flooded pipelines with low-quality inputs that actively degrade performance, slow time to market, and risk unpredictable outcomes. For physical AI, the stakes are concrete: a junk-trained autonomous vehicle struggles to distinguish what's typical from what's merely possible — like a child darting into the street through high glare. The source points to OpenAI quietly sunsetting its Sora video app as an early casualty, citing the world model's insufficient grasp of physics.

Simulating physical-world data is expensive and slow. Machine learning engineers spend hours on virtual reenactments of real-world scenarios just to generate training material for robots and self-driving systems. The fix, the source argues, is investment in tooling that analyzes, cleans, normalizes, and corrects training data — before junk quietly caps what physical AI can ever become.

Gobble's Take: The robots coming to your hospital and highway are only as good as the data nobody wanted to pay to clean.

Source: Reddit / r/technology

Publicly Available AI Can Already Help Plan a Bioweapon. The U.S. Has No Real Answer.

Former government biosecurity officials aren't speaking in hypotheticals anymore. In assessments now circulating among national security circles, publicly available AI models have demonstrated the ability to describe how to acquire genetic material, assemble dangerous pathogens, and walk a motivated actor through laboratory protocols — in some cases outperforming expert virologists on the technical details. The tools doing this aren't classified research systems. They're the same ones anyone can access today.

Beyond bioweapons, the threat landscape is widening fast. AI-powered cyberattacks are growing more sophisticated, deepfake campaigns are capable of triggering geopolitical crises within hours, and autonomous weapons systems are moving from fiction toward procurement lists. Critics argue the U.S. government's response has been slow and structurally broken — key biosecurity positions have gone unfilled, according to reporting from The New York Times, and federal biodefense budget requests were cut sharply in the last fiscal cycle. The gap between what AI can do and what the government is prepared to handle has never been wider.

The people who built the internet underestimated what bad actors would do with it. The people building AI policy appear to be making the same bet.

Gobble's Take: The tech industry ships in quarters; national security threats operate on decades — that mismatch is the actual vulnerability.

Source: The New York Times

While Everyone Chases AI Chatbots, This VC Is Cornering the Semiconductors, Sensors, and Energy Storage Underneath Them

Nicolas Sauvage isn't interested in the next viral AI demo. The president of TDK Ventures — the corporate venture arm of TDK, one of the world's largest electronics manufacturers — is writing checks to the founders building the physical infrastructure that makes generative AI possible in the first place: advanced semiconductors, industrial sensors, robotics systems, and energy storage technology. Unglamorous by Silicon Valley standards. Strategically irreplaceable.

Sauvage calls this the "hard tech" layer, and his thesis is blunt: everyone funding the software is crowding the same trade, while the hardware enabling it remains underinvested. He views the current funding slowdown not as a warning sign but as a buying opportunity — a pattern borne out by venture returns data showing that firms that invested during the 2008 and 2020 downturns consistently outperformed those that waited for the recovery. TDK Ventures has also built its own AI platform, called Kizuna, to help portfolio companies identify follow-on investors — specifically filtering out funds that have already backed direct competitors, a level of strategic discipline rare in a market still largely running on gut feel and warm introductions.

In a gold rush, the people selling pickaxes to both sides have historically done just fine.

Gobble's Take: The hottest AI investment right now might be the boring component your chatbot can't run without.

Source: TechCrunch

In Case You Missed It

Yesterday's top stories:

• Both Parties Are Scared of AI. That Should Scare the Tech Industry.
• Philosophy Majors Are Getting Hired at AI Labs — and the Coders Are Noticing
• The AI Chatbot Asking for a Gift Card Isn't Helping You — It's Robbing You
• Starlink Dishes Are Being Smuggled Into Yemen — and Changing Who Gets to Know What