Categories
AI: Diffusion Models Art and Artists

An Algorithm by Hand

He didn’t know what he was looking for the first time he walked into the Alhambra. You come in from the heat and the light hits the walls and for a moment you just stand there, your mind doing something it doesn’t have words for yet.

That was 1922. Escher was twenty-four years old, recently graduated. The Moorish artists who made these walls had been dead for six centuries. They had left no notes. No theory. Just the walls.

He came back in 1936. Some things you have to see twice.

What the artists in the Alhambra had discovered — without algebra, without proof, working in a tradition that forbade them from drawing a single living creature — was that there were exactly seventeen ways to tile an infinite plane with a repeating pattern. The Russian mathematician Fedorov would articulate this formally in 1891, centuries after the fact, the way mathematics sometimes chases art home and explains what it already knew.

Escher took the problem and made it harder. He asked: what if the edge between two tiles is also the outline of a fish? What if the sky is made of birds and the birds are made of sky? He would move a single line and the whole system would tremble. He did this for years. Revision after revision, in small notebooks, by hand.

There is a word for what he was doing. We just didn’t have it yet.

The word is algorithm.

An algorithm is a set of rules, followed in sequence, to solve a problem. We think of them as things that live in machines, in data centers drawing enough power to light a city. We think of them as fast. Escher’s algorithm was not fast.

He would begin with a grid. Hexagons, maybe, or the interlocking diamonds of a pattern he had traced from the Alhambra walls. Then he would ask the question that made everything hard: what lives here? Not what shape — what creature? What thing with a spine and a purpose and an outline that a human eye would recognize before the brain caught up?

The constraint was absolute. Every point on every edge had to satisfy two animals simultaneously. Change one line and you changed everything downstream, the way a single altered fact in a long investigation suddenly makes you reread everything you thought you knew.

He failed constantly. The notebooks are full of it. Half a lizard becoming nothing. A bird whose wing destroyed the fish below it. He would back up and try again, the way you back up on a road that has stopped being a road.

He was doing, neuron by neuron, what a diffusion model now does in milliseconds.

But here is the thing about milliseconds. They don’t leave notebooks.

Categories
AI AI: Diffusion Models Bing Image Creator

Neon Cubist

I happened to notice a tweet on Twitter a few days ago along the lines of “Neon cubist Chinatown San Francisco” – so I wanted to try out a few of my own. These are generated by DALL-E 3 but I used the Microsoft Image Generator in Bing instead (it uses DALL-E 3 under the covers).

Categories
AI AI: Diffusion Models AI: Large Language Models AI: Transformers Futures Living

Navigating the Infinite

We will soon, if not already, be drowning in the Sea of Infinite Content!

It’s become clear that we’re heading into a world of infinite content – as if we aren’t already drowning in that sea of meaningless, automatically generated content. What was once a seemingly manageable stream of books, websites, and media is becoming a overwhelming tidal wave, threatening to erode the shores of human creativity. The age of innovation is impacted.

What’s moving us from today’s world of “just a lot” to our future of “way too much”? Why do I say we’re drowning in a sea of infinite content?

In two words: generative AI.

Since the launch last fall of ChatGPT (and many similar tools), it’s become increasing clear that we can now use these tools to churn out endless repetitive, low quality content. Indeed they can create spammy nonsense for themselves, with no regard for truth or diversity. All that matters is predicting the best next word.

The focus is on quantity over quality. So much garbage is being produced that it’s becoming harder to find meaningful information and creative art amidst the noise. Useful voices are being drowned out by the drone of algorithmic imitation of what’s already popular.

There is also the risk of misinformation as fake AI-generated content spreads. Propaganda and radicalization loom as nefarious actors exploit these tools. Jobs in creative fields disappear as AI replaces human creators and artists.

All this tidal wave of endless content needs is electricity. Power. And ever more semiconductors.

Where does this path lead us? What will become of creativity and originality if AI takes over? We must question how to harness infinite content ethically to serve humanity, not overwhelm it. The age of human innovation cannot be allowed to end under a sea of meaningless artificial content. We cannot lose what makes us human.

How can we ensure these technologies are used responsibly? How can we stem the tide before it’s too late? The debates must begin now.

And where will all of that power – and all of those semiconductors – come from?

Categories
AI AI: Diffusion Models ChatGPT

Diffusion Models and Image Creation

I’ve been doing some more exploring with ChatGPT – this time asking it to educate me on how diffusion models work – they’re the underlying technology behind apps like DALL-E, Stable Diffusion, Midjourney, etc. Below is what I learned during my conversation with ChatGPT. The image below was created using DiffusionBee, an app based on Stable Diffusion. I used the input: a colorful illustration of how diffusion models work.