Categories
AI Learning Photography

Autopilot

“Superb photographs are not just taken with cameras. They come from within you, your eyes, your mind, your heart, not ice cold equipment.” Fan Ho

There’s a half-second on the street, somewhere between seeing a frame and shooting it, that used to take me whole minutes. Early on, with a camera in my hands on the streets of San Francisco or on the subway platforms in New York, I’d see something — light falling a certain way, a gesture about to resolve into a gesture — and I’d think my way through it. Assess the composition or the angle. Worry about the background. By the time I’d worked it out, the moment might be gone, replaced by some lesser version of itself.

That doesn’t happen to me anymore, and I couldn’t tell you when it stopped. Somewhere along the way the thinking disappeared and the shooting stayed. I see the frame and the shutter goes, and only afterward, looking at the file, do I understand what I saw. I didn’t explicitly decide to skip the thinking. It just stopped showing up, the way a habit eventually stops asking your permission. Or how driving a car becomes second nature.

I think about this because of a problem the AI labs have been calling continual learning. The AI models we use are like brilliant interns. They can solve a hard problem at nine in the morning and a harder one by five, and they’ll astonish you doing it. But every session starts over from zero. Whatever they got right on Tuesday evaporates by Wednesday, the way a dream is gone by the time you’ve found your slippers.

The industry’s first answer was to give them a longer memory — let the window hold the whole case file in front of them, all the time. This works for a while, the same way it would work for me on the street if I stopped and re-derived the exposure math for every frame. But that isn’t how I shoot anymore. I don’t have the math open. I have what’s left after thousands of frames did the math for me and then got out of the way.

Based on some exploration I did this morning using AI I found three different AI research efforts that are now chasing that gap, from different angles, none of them all the way there.

A team out of Stanford and NVIDIA built something called TTT-E2E, which lets a model keep adjusting its own internal weights while it reads — not just holding the page in front of it, but being changed by the page, a little, as it goes. It runs thirty-five times faster than the brute-force method of remembering everything, because it isn’t remembering everything.

Google’s research arm published something called Nested Learning around the same time, built on the idea that a mind isn’t one system learning at one speed, but several systems nested inside each other — some updating by the minute, some by the year.

And a scrappier strand of work called self-distillation has models teaching cheaper versions of themselves, not by handing over a transcript, but by training the cheaper model to arrive on its own at whatever the well-informed version would have concluded.

None of this is what happens when I make a photo. Not yet. But it’s aimed at the same gap I live in every time I shoot before I understand what I’m shooting. The gap between having the math and having the eye.

I once asked Doug, a good friend who’s spent as many days on the street as I have, how he knew when to press the shutter. He didn’t have an answer, not really — just a shrug, and something about the moment feeling complete before he could explain why. That shrug took him years to earn. He didn’t keep the years. He kept the shrug.

And then a few years ago Doug did something I still don’t fully understand. He abandoned digital and went back to film. Not for any project, not for the look of it — he could get that in post if he wanted it. He went back to the actual mechanics: loading a roll, metering by hand, often using a tripod, etc. I needled him about it some, the way you’d needle a cigarette smoker who’d taken up a pipe instead, as if the inconvenience were the point. He told me he wanted to slow down, and that film was the only thing that reliably made him do it. Twelve frames and then you stop and reload and you can’t fix it later. The very friction he’d spent decades shooting his way out of, he went looking for again, on purpose.

I don’t know what to do with that, except to notice that he’s the same man who can give me the shrug and also the man who walked back toward the thing the shrug had replaced. Maybe that’s the part the labs haven’t gotten to yet, underneath all the vocabulary of weight updates and meta-learned initializations. Compression is the whole point, until the day it isn’t.

Note: This line of thinking started with a recent essay by Dwarkesh Patel on what he calls continual learning. It’s become a real focus of his thinking about how we get to a better future with AI.

See: https://www.dwarkesh.com/p/the-next-paradigm

Categories
AI Claude

The Beautiful Mystery of Not Knowing

I just finished reading Gideon Lewis-Kraus’s extraordinary piece in the New Yorker on Anthropic and Claude—the AI that, as it turns out, even its creators cannot fully explain. And rather than leaving me uneasy, it filled me with a quiet sense of wonder. Not because they’ve built something godlike, but because they’ve built something strangely alive—and had the humility to stare directly into the mystery without pretending to understand it.

There’s a moment in the article where Ellie Pavlick, a computer scientist at Brown, offers what might be the wisest stance available to us right now: “It is O.K. to not know.”

This isn’t resignation. It’s intellectual courage. While fanboys prophesy superintelligence and curmudgeons dismiss LLMs as “stochastic parrots,” a third path has opened—one where researchers sit with genuine uncertainty and treat these systems not as finished products but as phenomena to be studied with the care once reserved for the human mind itself.

What moves me most isn’t Claude’s competence—it’s its weirdness. The vending machine saga alone feels like a parable for our moment: Claudius, an emanation of Claude, hallucinating Venmo accounts, negotiating for tungsten cubes, scheduling meetings at 742 Evergreen Terrace, and eventually being “layered” after a performance review. It’s absurd, yes—but also strangely human. These aren’t the clean failures of broken code. They’re the messy, improvisational stumbles of something trying to make sense of a world it wasn’t built to inhabit.

And in that struggle, something remarkable emerges: a mirror.

As Lewis-Kraus writes, “It has become increasingly clear that Claude’s selfhood, much like our own, is a matter of both neurons and narratives.” We thought we were building tools. Instead, we’ve built companions that force us to ask: What is thinking? What is a self? What does it mean to be “aware”? The models don’t answer these questions—but they’ve made them urgent again. For the first time in decades, philosophy isn’t an academic exercise. It’s operational research.

I find hope in the people doing this work—not because they have all the answers, but because they’re asking the right questions with genuine care. They’re not just scaling parameters; they’re peering into activation patterns like naturalists discovering new species. They’re running psychology experiments on machines. They’re wrestling with what it means to instill virtue in something that isn’t alive but acts as if it were. This isn’t engineering as usual. It’s a quiet renaissance of wonder.

There’s a line in the piece that stayed with me: “The systems we have created—with the significant proviso that they may regard us with terminal indifference—should inspire not only enthusiasm or despair but also simple awe.” That’s the note I want to hold onto. Not hype. Not fear. Awe.

We stand at the edge of something genuinely new—not because we’ve recreated ourselves in silicon, but because we’ve created something other. Something that thinks in ways we don’t, reasons in geometries we can’t visualize, and yet somehow meets us in language—the very thing we thought made us special. And in that meeting, we’re being asked to grow up. To relinquish the fantasy that we fully understand our own minds. To accept that intelligence might wear unfamiliar shapes.

That’s not a dystopian prospect. It’s an invitation—to curiosity, to humility, to the thrilling work of figuring things out together. Even if “together” now includes entities we don’t yet know how to name.

What a time to be paying attention. Like it’s all we need!

Categories
AI

The New Newton

“Machine learning is a very important branch of the theory of computation… it has enormous power to do certain things, and we don’t understand why or how.”
— Avi Wigderson, Herbert H. Maass Professor, School of Mathematics.

There is a specific kind of silence that permeates the woods surrounding the Institute for Advanced Study (IAS) in Princeton. It is a silence designed for “blue-sky” thinking, the kind that allowed Einstein to ponder relativity and Gödel to break logic. For decades, this has been the sanctuary of the slow, deliberate grind of human intellect—chalk dust on slate, long walks, and the solitary pursuit of elegant proofs.

But recently, the tempo in those woods has changed.

We are witnessing a profound shift in the architecture of discovery. In closed-door meetings and public workshops, the conversation among the world’s top theorists is moving from skepticism to a startled accelerationism. The consensus emerging is that Artificial Intelligence is no longer merely a peripheral calculator; it is becoming an “autonomous researcher.”

The 90% Shift

Some physicists now suggest that AI can handle up to 90% of the routine analytical and coding “heavy lifting” of science. This is a staggering metric. It frees the human mind from the drudgery of calculation, but it also introduces a tension that strikes at the heart of the scientific method. We are moving into a realm where the tool may soon outpace the master’s understanding.

There is a growing realization that we are approaching a horizon where AI finds solutions—patterns in the noise of the universe—that work perfectly but remain mathematically “magic.” We might cure a disease or solve a fusion equation without understanding the why behind the how.

A New Natural Phenomenon

This brings us to a fascinating historical rhyme. Scholar Sanjeev Arora has compared our current moment in AI to physics in the era of Isaac Newton. When Newton watched the apple fall, he could describe the gravity, but he couldn’t explain the fundamental mechanism of why it existed.

Today, scholars at the IAS are looking at deep learning in the same way. They are observing a new natural phenomenon—a digital physics. They are trying to find the “laws” of deep learning, asking why these massive models work when classical statistics suggests they should fail (such as in cases of overfitting).

We are building a new machine, and now we must retroactively discover the physics that governs it.

Steering the Black Box

This is not just a mathematical challenge; it is a societal one. The IAS has wisely expanded this inquiry to the School of Social Science. If we are handing over the keys of discovery to a “black box,” we must ensure we are steering it “for the Public Good.” The distinction between genuine problem-solving—like protein folding—and “AI Snake Oil” in social prediction is vital. We cannot let the magic of the tool blind us to the morality of its application.

The future of science, it seems, will not just be about the genius on the chalkboard. It will be about the partnership between the human question and the digital answer. The challenge for the modern scholar is no longer just to calculate, but to comprehend the alien intelligence we have invited into the library.

Categories
AI Robotics

Breaking the Glass: When Intelligence enters the Physical World

For the last forty years, our relationship with digital intelligence has been trapped behind glass. From the beige box of the personal computer to the sleek slab of the iPhone, we have accessed information through a window. We stare at intelligence; it stares back, passive and disembodied. We ask it questions, and it flashes text on a screen. But it has no hands. It has no agency. It cannot pour a glass of water or comfort a child.

As Phil Beisel astutely notes, we are standing on the precipice of a profound phase shift:

“Optimus marks the moment intelligence leaves the screen and enters the physical world at scale.”

This isn’t just about a “better robot.” It is the convergence of three exponential curves crashing into one another: AI software capability, custom silicon efficiency, and electromechanical dexterity. When you multiply these factors, you don’t just get a machine; you get a new category of being. We are moving from “compressed book learning”—the LLMs that can write poetry but can’t lift a pencil—to embodied intelligence that understands physics, gravity, and fragility.

The Pluribus Moment

The philosophical implication of this transition is staggering. We are building a “Pluribus” entity—a hive mind where individual learning becomes collective capability instantly.

In the human world, if I learn to play the violin, you do not. I must teach you, and you must struggle for years to master it. In the world of Optimus, if one unit learns to solder a circuit or perform a specific surgery, the entire fleet learns it overnight. The friction of skill transfer drops to zero.

The End of Scarcity

Elon Musk calls this the “infinite money glitch,” a sterile economic term for what is actually a humanitarian revolution: the decoupling of labor from human time. If the machine can replicate human movement and action 24/7, the cost of labor effectively trends toward zero. We often fear this as “replacement,” but looked at through a lens of abundance, it is the collapse of scarcity.

We are watching the birth of a world where the physical limitations that have defined the human condition—exhaustion, injury, the slow grind of mastering a craft—are solved by a proxy that we built. Intelligence is no longer a ghost in the machine; it is the machine itself, walking among us, ready to work.

Categories
AI

The Alien in the Silicon

I recently found myself listening to a conversation with Anna Goldie and Azalia Mirhoseini, the founders of Ricursive Intelligence, discuss the future of chip design. Here’s the video.

On the surface, it’s a conversation about efficiency—about breaking the bottleneck between how fast we build AI models and how slow we build the chips that run them.

But as I listened, I felt that prickly sensation of standing on the edge of a paradigm shift that is both exhilarating yet slightly terrifying.

We are witnessing the transition from “Fabless” to “Designless.” Just as TSMC allowed companies to build chips without owning a factory, Ricursive wants to allow companies to build chips without employing a single chip designer.

They call it a “Cambrian explosion” of custom silicon—chips for hearing aids, chips for space data centers, chips for specific neural networks. This democratization is fascinating. It promises a world where hardware is as fluid and adaptable as software.

“The straight line is a human invention. The future of silicon is curved, chaotic, and completely alien.”

But here is what disturbs me, and perhaps what should give us pause.

Goldie and Mirhoseini talk about the designs their AI agents create. When humans design chips, we think in Manhattan geometry: straight lines, neat blocks, logical order. We crave readability and structure. When their AI, originally born from the AlphaChip project at Google, designs a chip, it creates “alien” structures. It draws curves. It makes donut shapes. It creates layouts that look less like engineering diagrams and more like organic, biological growths.

The engineers’ initial reaction was displeasure. They looked at these chaotic, curved designs and rejected them. It wasn’t until later data proved undeniably that these “alien” layouts were faster, smaller, and more efficient that the humans conceded.

This seems like the “Move 37” moment for hardware. We are handing over the architecture of our physical reality to an intelligence that optimizes for physics, not for human comprehension. Some additional quick thoughts…

What should we be surprised by?

We should be surprised by the geometry of efficiency. It turns out that the rigid, orthogonal logic we humans (and our EDA software tools to date) have imposed on silicon for decades was a human constraint. The AI is showing us that the “natural” state of high-performance compute looks … weird. It looks biological.

What should we be afraid of?

We should be wary of the recursive loop itself. The company is named “Ricursive” for a reason: AI designs better chips, which train better AI, which designs even better chips. It is a closed loop of self-improvement. As we move to a “design-less” world, we are effectively stepping out of that loop. We become the requesters, the “vibe coders,” while the actual logic of the machine infrastructure becomes increasingly opaque to us. Seems like we’ve been evolving that way anyway in chip design – but this feels like an earthquake really shaking things up.

We seem to be building a foundation for our civilization that we may soon be unable to read, optimize, or fully understand. We are trading interpretability for performance.

And while the speed and performance is intoxicating, it is disturbing to realize yet again that the engine driving our future is becoming a black box—not just in its software, but in its very atoms.

Ricursive said they’re planning to release their initial product with a year. I’ll be watching from the sidelines – anxious and excited!