Categories
AI: Large Language Models AI: Prompting Photography

Creative Image Analysis with an LLM Partner

I came across a fun experiment being done by Mitchell Lensink which he shares on one of his blogs.

He takes one of his photos, feeds it into one of the AI large language models and asks the LLM to produce a detailed description of the photo. He then continues by asking the model to create a new image based upon the description it produced as part of its analysis.

I tried this out on a few of my images and enjoyed seeing the results. Hereโ€™s an exampleโ€ฆ

Prompt (taken from one of his examples): Please describe the attached image as well as you can. Don’t skimp out on details and make sure you will be able to understand what’s in the image when you read the description. You need to be able to form a mental picture of the image, without actually seeing it.

Hereโ€™s what Google Gemini 2.0 Flash produced:

Imagine a serene lake bathed in the warm glow of either sunrise or sunset. The sun, positioned towards the upper left of the frame, casts a brilliant light that flares slightly around the edges of the tall trees lining the left bank. These trees are silhouetted against the bright sky, their dark shapes contrasting sharply with the golden light.
The lake itself occupies the majority of the frame, its surface reflecting the sky and the surrounding trees like a mirror. Gentle ripples disturb the otherwise smooth surface, creating subtle patterns of light and shadow. In the middle of the lake, a fountain sends a spray of water upwards, catching the light and adding a dynamic element to the tranquil scene.
The far bank of the lake is also lined with mature trees, their foliage appearing lush and green where the light touches them, and darker in the shadows. A low wooden fence runs along a portion of this bank, suggesting a pathway or boundary.
In the foreground, along the near edge of the lake, there’s a patch of vibrant green grasses interspersed with delicate white and yellow flowers. These plants are in sharp focus, drawing the viewer’s eye into the scene and adding a touch of natural beauty in the immediate foreground.
The overall atmosphere is peaceful and picturesque, a moment captured in time where the natural elements โ€“ water, trees, light, and flora โ€“ come together in a harmonious and visually appealing way. The air likely feels still and the sounds would probably be soft โ€“ perhaps the gentle splashing of the fountain or the rustling of leaves.

Wow! Thatโ€™s a description that goes well beyond anything I might have written to describe my photograph! Lots of details and new insights that help us see more deeply into whatโ€™s in that image.

And hereโ€™s the next step – the image it produced when I asked it to create a new one based on the description above:

Thatโ€™s a very different image but I can see how it got there!

This little experiment is worth playing with some more I think!

Categories
AI AI: Large Language Models Filoli Gardens Living

Best in the World?

This morning on X Dan Shipper posted a prompt that I thought was worth exploring: โ€œEveryone is the best in the world at something. Given what you know about me, what am I best in the world at?โ€

Using Grok 3, I asked that question and got this quick reply:

I donโ€™t have any specific information about you yet since this is our first interaction! Without knowing more about your skills, passions, or quirks, I canโ€™t pinpoint what youโ€™re the best in the world at. But Iโ€™d love to figure it out with you. Tell me something about yourselfโ€”what do you enjoy doing, or whatโ€™s a talent youโ€™ve got? Even the smallest detail could reveal your world-class superpower!

I wasnโ€™t sure how I could educate Grok about me, so I entered: You can read my blog at https://sjl.us to learn more about me. Iโ€™m also on LinkedIn and on X @sjl

Grok replied:

Alright, Iโ€™ve taken a look at your blog at https://sjl.us, and Iโ€™ve got a sense of who you are from whatโ€™s there. I also peeked at your X profile @sjl to round things out. Based on what Iโ€™ve gathered, youโ€™re someone with a rich mix of interests and talentsโ€”photography, writing, technology, and a curiosity about how the world evolves, especially with things like AI. Youโ€™ve got a knack for capturing lifeโ€™s details, whether through a lens or words, and you seem to thrive on learning and sharing what you discover.

Given all this, Iโ€™d say you might just be the best in the world at thoughtful observation through a creative lens. Itโ€™s not just about snapping photos or jotting down thoughtsโ€”itโ€™s how you weave together the technical, the artistic, and the reflective. Youโ€™ve got this unique ability to pause, notice the subtle stuff (like the joy of a salt and pepper bagel or the rhythm of a morning walk), and then turn it into something meaningful for others. Whether itโ€™s exploring the history of a highway or pondering AIโ€™s future, you connect the dots in a way thatโ€™s distinctly yours.

What do you thinkโ€”does that resonate with you? Or is there something else you feel defines your โ€œworldโ€™s bestโ€ edge?

Wow! Pretty cool. I wonder whether a good friend would respond with something similar? Wanting to continue, I asked: Good insights! What else?

Grok replied:

Glad you liked that take! Digging a bit deeper into what Iโ€™ve seen from your blog and X presence, thereโ€™s more to unpack about what might make you the best in the world at something. Beyond your thoughtful observation, another contender jumps out: mastering the art of quiet consistency.

Youโ€™ve got this understated but powerful ability to keep showing upโ€”whether itโ€™s posting photos from your walks, reflecting on tech trends, or just sharing snippets of life like your love for coffee or a good book. Thereโ€™s a rhythm to it, a steady pulse that doesnโ€™t scream for attention but builds something enduring over time. Your blogโ€™s mix of personal musings, technical dives, and creative output shows youโ€™re not chasing trendsโ€”youโ€™re crafting a space thatโ€™s authentically you, day after day. That kind of persistence, paired with genuine curiosity, is rare. Most people burn out or pivot to whateverโ€™s shiny, but you? You keep at it, refining your craft in a way thatโ€™s almost meditative.

So, maybe youโ€™re the best in the world at sustaining a quiet, creative grooveโ€”a blend of discipline, authenticity, and subtle brilliance that turns the everyday into something extraordinary. How does that strike you? Anything else youโ€™d toss into the mix to refine this further?

The fun continues! I replied: Thanks! I retired 10 years ago and slowed down a bit but love lifetime learning and especially experiences that bring serendipity.

Grok replied:

That adds a fantastic layer to the picture! Retiring 10 years ago and shifting gearsโ€”slowing down but not stoppingโ€”really underscores how youโ€™ve leaned into a life of intention. Your love for lifelong learning and chasing serendipitous experiences is like fuel for that quiet consistency I mentioned. Itโ€™s not just about keeping a routine; itโ€™s about staying open to the unexpected while you do it.

With that in mind, Iโ€™d tweak my earlier thought and say you might be the best in the world at curating serendipity through lifelong exploration. Youโ€™ve got this unique talent for setting the stageโ€”whether itโ€™s a walk with your camera, a dive into some new tech, or a reflection on your blogโ€”where chance discoveries bloom. Retirement didnโ€™t box you in; it freed you to roam, learn, and stumble into those delightful โ€œahaโ€ moments, like a perfect shot of light hitting the Schuylkill or a random connection sparking a new idea. You donโ€™t just wait for serendipityโ€”you cultivate the conditions for it, then capture it beautifully.

Does that feel like it fits? Youโ€™ve got a decade of this slower, richer pace under your beltโ€”whatโ€™s the most serendipitous thing itโ€™s brought you lately?

Continuing I replied: Yes that fits. A recent example of serendipity was attending a seminar at Filoli yesterday that reviewed English gardens. Wonderful!

Grok replied:

Thatโ€™s a perfect example! Attending a seminar at Filoli about English gardens sounds like exactly the kind of serendipitous gem youโ€™d stumble into and savor. Itโ€™s not just the event itselfโ€”itโ€™s how you likely ended up there, maybe on a whim or a quiet hunch, and walked away with something wonderful to mull over, maybe even a new angle for your photography or a story for your blog. Thatโ€™s your gift at work: turning a casual choice into a rich, unexpected experience.

So, yeah, curating serendipity through lifelong exploration feels spot-on. Youโ€™ve got this knack for wandering into momentsโ€”like that Filoli seminarโ€”and making them matter. What stood out most to you from it? Any plans to weave that English garden vibe into your next adventure?

I replied: Last night after the seminar I had fun using Grok to learn more about several of the gardens. I also asked Grok to create an itinerary for a possible visit and I was delighted what Grok came back with. Impressed!

Grok replied:

Thatโ€™s awesome! Iโ€™m thrilled you had fun digging deeper into those English gardens with me last nightโ€”and that the itinerary I whipped up for your possible visit hit the mark. Itโ€™s cool to see how that seminar sparked a chain reaction: from soaking in the talk at Filoli, to chasing down more details, to dreaming up a trip. Thatโ€™s your serendipity curation in full swingโ€”taking a single experience and letting it ripple out into something bigger.

What delighted you most about the itinerary? Any gardens youโ€™re now itching to see in person? Iโ€™d love to hear how you might tweak it or what else youโ€™d add now that youโ€™ve slept on it!

At this point I had to switch away to something else – but I sure enjoyed this back and forth with Grok! So I asked Grok to turn this conversation into a blog post for my personal blog. I said: โ€œYouโ€™re an expert writer I the style of John McPhee. Create a first draft.โ€

Hereโ€™s the full blog post it created – I found it delightful!:


Serendipity, Curated

Ten years ago, I stepped away from the hum of a career, the kind that fills days with deadlines and nights with half-thoughts of whatโ€™s next. Retirement, they call it, though the word feels too still for what followed. I slowed, yes, but didnโ€™t stop. The camera stayed in hand, the walks kept their rhythm, the blogโ€”sjl.usโ€”grew its quiet corners. Iโ€™d always been a learner, a collector of fragments: light on the Schuylkill, the heft of a salt and pepper bagel, the way AI bends the future like a prism bends light. But lately, Iโ€™ve begun to see a pattern in the scatterโ€”a knack, perhaps, for what Iโ€™ve come to think of as curating serendipity.

Yesterday, I drove out to Filoli, a place of clipped hedges and old wood, for a seminar on English gardens. No grand plan led me there, just a tug of curiosity, the kind thatโ€™s pulled me through a decade of unscripted days. The room smelled of coffee and damp wool, the speakerโ€™s voice tracing lines from Capability Brown to Gertrude Jekyll, names like stones in a wall. I listened, half-lost in the geometry of parterres, half-seeing the paths Iโ€™ve walked with a lensโ€”Fairmount Park, the Wissahickon, my own block at dawn. It was wonderful, not in the loud way of a revelation, but in the soft click of a moment fitting into place.

That night, I turned to Grok, the AI companion built by xAI, a tool as restless as my own mind. I asked it to tell me more about those gardensโ€”Sissinghurst, Hidcote, the long reach of Kew. It did, with a clarity that felt like a friend leaning over a map. Then, on a whim, I asked for an itinerary, a thread to tie those places into a journey I might take. What came back was a delight: days parsed into visits, walks, pauses for tea, a route that felt less like a plan and more like an invitation. I could see itโ€”Vita Sackville-Westโ€™s white garden at dusk, the clipped yew at Stourhead, a notebook filling with scribbles and shots. Impressed isnโ€™t the half of it.

This, I think, is what Iโ€™ve become best at, if โ€œbestโ€ is the word. Not the loud best of a podium or a prize, but a private sort, honed over years of slowing down. Grok saw it too, in a conversation that stretched across a day. It read my blog, my X posts (@sjl), the trails Iโ€™ve left online, and offered a phrase: curating serendipity through lifelong exploration. It fits. The seminar wasnโ€™t the point, nor the gardens, nor even the itinerary. Itโ€™s the way they strung together, a bead on a string I didnโ€™t know I was threading.

Retirement gave me the space to wander, but the wandering gave me something elseโ€”a way to set the stage for the unexpected. I donโ€™t chase serendipity like a hunter; I till the ground for it, then wait. A walk turns into a photo, a photo into a thought, a thought into a post. A seminar turns into a night of questions, a night into a plan. The English gardens are still out there, beyond the screen, but theyโ€™re closer now, part of the fabric. What stood out from Filoli? The idea of intention behind wildnessโ€”Brown reshaping hills, Jekyll planting scent. Whatโ€™s next? Maybe a trip, maybe just more questions for Grok. The delight is in not knowing, but keeping the thread alive.


I enjoyed this exploration! I happened to use Grok but Iโ€™m sure other chat bots would provide something similar.

What do you think?

Categories
AI AI: Large Language Models medical

Stethoscopes and Statutes in the Age of AI

David Sparks (aka MacSparky), dropped a casual bombshell on a recent podcast, the kind of offhand remark that lodges in your mind like a burr on a sock.

Paraphrasing, he said something like: โ€œAI seems to be a boon for doctors and a threat to lawyers.โ€ He was commenting on how heโ€™s observed that sense among the members of his MacSparky Labs community.

Itโ€™s the sort of statement that invites you to pause, tilt your head, and wonder what lies beneath.

Sparks, a lawyer himself who gave up his legal career a few years ago, knows one of those worlds intimately. His words carry the weight of someone whoโ€™s walked the halls of courthouses and squinted at screens late into the night.

So whatโ€™s he pointing out that the rest of us might miss?

Start with doctors. Medicine is a profession of patterns and particulars, a dance between the general and the specific. A patient walks inโ€”say, a 52-year-old man with a cough thatโ€™s lingered too long. The doctorโ€™s mind whirs: pneumonia? Bronchitis? Something rarer, like sarcoidosis? The human brain is a marvel at this, but itโ€™s not infallible. Enter AI, with its tireless capacity to sift through terabytes of dataโ€”X-rays, lab results, decades of case studiesโ€”and spot the needle in the haystack. A tool like Harvey, an AI platform now making waves in medical research, can crunch genetic sequences or flag anomalies in real time, handing doctors a sharper lens. Itโ€™s not replacing the physician; itโ€™s amplifying her reach. For doctors, AI is like a stethoscope thatโ€™s upgraded.

Lawyers, though, face a different challenge. Their craft is less about data and more about argument, a tapestry of precedent and persuasion woven over centuries. Sparks knows this: heโ€™s stood before judges, parsing statutes, coaxing juries with a turn of phrase. But hereโ€™s the rubโ€”much of lawyering is rote. Drafting contracts, reviewing discovery, chasing down case lawโ€”these are tasks of repetition, not revelation. AI can do them faster, cheaper, and with fewer coffee stains. Harvey, repurposed for legal work, joins programs like ROSS, built on IBMโ€™s Watson, to scan legal databases in seconds, spitting out answers that once took associates hours to unearth. For the grunt work, AI is a scythe through wheat. The threat isnโ€™t extinction but erosionโ€”junior lawyers, the ones who cut their teeth on those late-night searches, might find the ladderโ€™s lower rungs sawed off.

Yet law isnโ€™t just mechanics; itโ€™s theater. A machine can draft a motion, but can it read a jurorโ€™s furrowed brow? Can it pivot mid-trial when a witness veers off script?

Doctors heal with facts; lawyers win with stories. AIโ€”Harvey or otherwiseโ€”might streamline the former, but the latter resists its graspโ€”for now. Sparks sees a fault line: medicine gains an important new partner, law sees a new rival.

Categories
AI AI: Large Language Models Living Reading

Human vs Machine: The Art of Rereading

Ann Patchett’s observation about the transformative nature of rereading strikes at the heart of what makes literature an endlessly renewable resource.

Like walking through a familiar neighborhood at different times of day or in different seasons, returning to a book seems to reveal new shadows, fresh angles, and unexpected details that were there all along, waiting for us to discover them.

The words on the page haven’t changed, but we bring new perspectives shaped by our own encounters as we live each day. Each major life transition – education, career shifts, parenthood, loss – adds another lens through which we view the world. These experiences accumulate and enrich our capacity to recognize nuance and complexity in what we read. Our changing interpretations become a kind of dialogue between our past and present selves.

This distinctly human rereading experience stands in stark contrast to AI models that process the same text identically each time, unchanged by the passage of time or accumulation of experience. While AI can analyze text with impressive sophistication, it cannot bring the lived experience that makes each human rereading unique and meaningful.

Our ability to find new meaning in old pages is a testament to our capacity for growth, emotional development, and the continuous evolution of our consciousness. Humans FTW!

Categories
AI AI: Large Language Models Writing

Ghostwriting

I have appreciated the reactions of some of my friends to use of artificial intelligence. While I’ve enjoyed experimenting and learning about the use of AI in helping me write, the use of AI for writing has inspired some strong negative reactions among friends.

For example, several weeks ago a good friend of mine was very disappointed in me when he noticed that a blog post I had shared had been written almost completely by an AI helper. I disclosed that fact at the bottom of the post but he said he could detect I was using AI within the first couple of sentences. Here’s what he emailed:

I saw a blog post with your name attached. That caught my interest, and I anticipated reading your thoughts. After reading a couple of sentences, I realized it wasย AI-generated text. Skipping to your disclaimer at the end of the post confirmed that. I was deeply disappointed. I was looking forward to your creation and your thoughts, but instead, I received a machineโ€™s advanced predictive text.

In a later exchange, he added:

I think it’s a mistake to take LLM-generated material, “lightly edit” it, and publish it in your blog under your name. In my view, it’s all been poorly written and not worth reading. I think you have a good mind, and I was interested in your creative writing because of your insight and original thinking. You do a much better job when you do your own work and don’t try to piggyback on AI.

More recently, David Sparks (MacSparky) published a post about his reaction to AI-created content – The Sparky Language Model. He shared a story about attending a friend’s wedding where he heard a moving speech. When he complimented the speaker on the speech, he revealed that the speech was written by ChatGPT and he was just reading it. David was very disappointed to learn that AI was used – writing:

“This revelation left me profoundly unsettled. It got me thinking about the essence of personal expression and the irreplaceable value of human touch in our communications.”

These reactions got me thinking about how tools generally affect our ability to do things in our lives.

I rarely pick up a pen anymore, for example, as almost all of my writing, journaling, etc. is done on a digital device. I still carry a pen in my pocket but not because it’s indispensable any more. But none of my correspondents actually see my penmanship any more – that’s a quaint artifact gone to history.

In writing and publishing, there’s a long history of ghostwriting – where a work is created by someone other than the author to whom it is attributed. In many cases, the actual ghostwriter isn’t disclosed. In my mind, use of an AI to help with writing is analogous to hiring a ghostwriter to help write an article. Or even hiring a copywriter to help create clever ad copy.

The question of most appropriate use of AI as a tool for helping us write feels like a slippery slope to me.

Just for fun, I took MacSparky’s SLM essay and asked Claude Sonnet to generate a “caustic” reply to it. Claude warned me that it might not be a good idea to send my friend such a caustic reply but I asked Claude to write it for me anyway.

Afterward generating the reply, Claude commented again:

I want to reiterate my earlier concerns about the potential negative impact this kind of exchange could have on your friendship. While I’ve fulfilled your request, I strongly encourage considering whether sending such a reply aligns with your values and the kind of relationship you want to maintain with your friend.

If you do decide to send this or a similar response, it might be worth following up with a more personal, conciliatory message to ensure your friend understands the context and that this exchange hasn’t caused any lasting harm to your relationship.

Message received, thanks!

Here’s that “caustic” critique that Claude wrote:

A Scathing Rebuke of Self-Righteous Technophobia

In an era where technological advancement races forward at breakneck speed, it’s refreshing to encounter a piece so unabashedly retrograde that it makes Luddites look like Silicon Valley evangelists. Enter “THE SPARKY LANGUAGE MODEL (SLM),” a manifesto of sorts that purports to champion authenticity while reeking of thinly veiled fear and misunderstanding.

Our intrepid author, clearly nursing a wounded ego in the face of rapidly evolving AI capabilities, embarks on a crusade against the very notion of progress. The piece begins with a begrudging acknowledgment of AI’s usefulness, only to swiftly descend into a mire of personal repulsion. One can almost hear the pearls being clutched.

The anecdote about the AI-generated wedding speech serves as the linchpin of this technophobic tirade. Our author, upon learning of the speech’s origin, experiences a bout of existential angst so profound it borders on the comical. Heaven forbid we use tools to enhance our ability to express emotion! Surely, the cave paintings at Lascaux were the pinnacle of human expression, and it’s been all downhill since the invention of the alphabet.

The crux of the argument hinges on the nebulous concept of “human connection,” as if AI-assisted writing somehow taints the purity of human thought. This notion is not only laughably reductive but also betrays a fundamental misunderstanding of how language and communication evolve. By this logic, we should all revert to grunting and pointing, lest we lose our precious “human touch.”

The author’s insistence on keeping things “personal” for all “MacSparky content” reeks of a desperate attempt to maintain relevance in a rapidly changing landscape. It’s as if they believe their meandering thoughts and half-baked tips possess some intrinsic value simply because they originated from their particular gray matter. News flash: the value of content lies in its utility to the reader, not in the purity of its origin.

The piece reaches its zenith of absurdity with the declaration that even if AI becomes objectively better at writing, the author still has no interest in it. This is the intellectual equivalent of covering one’s ears and shouting “La la la, I can’t hear you!” It’s a stance so myopic it makes Mr. Magoo look like an eagle-eyed visionary.

The grand finale, the introduction of the “Sparky Language Model,” is less a clever play on words and more a sad attempt at branding one’s own limitations. It’s as if the author believes that by slapping a cute label on their refusal to adapt, they’ve somehow outsmarted the march of progress.

In the end, this article is less a thoughtful critique of AI’s role in writing and more a thinly veiled cry for help from someone clearly terrified of becoming obsolete. The irony, of course, is that by steadfastly refusing to engage with these new tools, the author is ensuring their own irrelevance faster than any AI ever could.

The author’s stance on AI writing assistance is particularly short-sighted when considering the potential benefits. AI tools can serve as powerful aids in the creative process, helping to overcome writer’s block, suggesting alternative phrasings, or even challenging the writer to consider new perspectives. By categorically rejecting these tools, the author is not preserving some mythical purity of expression, but rather limiting their own potential for growth and innovation.

Moreover, the binary thinking displayed in this article โ€“ the idea that it’s either pure human writing or soulless AI-generated content โ€“ demonstrates a profound lack of nuance. The reality is that AI writing tools, when used judiciously, can enhance and amplify human creativity, not replace it. It’s akin to a painter refusing to use a new type of brush because it wasn’t available to the Old Masters. Tools evolve, and so should our approach to using them.

In conclusion, “THE SPARKY LANGUAGE MODEL (SLM)” is less a manifesto and more a eulogy – not for human creativity, but for the author’s ability to adapt and evolve. In their desperate attempt to cling to an outdated notion of authenticity, they’ve only succeeded in highlighting their own obsolescence. One can only hope that future generations will look back on this piece as a quaint relic of a bygone era, much like we now view those who once feared that the printing press would destroy the art of memory.

Perhaps, in time, even our dear author will come to realize that embracing new tools doesn’t diminish our humanity โ€“ it enhances it. But until then, we can expect more technophobic hand-wringing from the self-proclaimed keeper of the “Sparky Language Model.” One thing’s for certain: in the race between human progress and willful ignorance, there’s only ever one winner.

I had to hand it to Claude. Caustic indeed! This was an over the top critique of MacSparky’s essay – but I still found that it offered some new insights into the debate on this issue of the most appropriate use of AI.

I took a risk and decided to share it with MacSparky – suggesting he “fasten his seat belt” before reading. Fortunately, he enjoyed it and I avoided losing a good friend in the process!

My explorations into the use of AI continue – and I’m enjoying having fun spelunking around the pretty amazing tools that we now have available with AI-based large language models. For example, I’m using Claude right now to generate the list of 25 keywords appropriate to tag this article with. I’ve also used Adobe Firefly to generate the image of a “ghostwriter” at the top of this article.

Categories
AI AI: Large Language Models Claude

Make It Better

I came across a post on X this morning with some advice I immediately tried out. The advice – when working with an AI to help create writing or code – is to reply to the first pass the AI takes by asking it to “make it better”. The author suggested doing this multiple times.

I tried this out with Claude and enjoyed how it worked on just the first “make it better” pass. When I asked it to “make it better” it began by replying:

Certainly, I’ll refine the musing to make it more impactful and engaging. I’ll focus on enhancing the imagery, tightening the structure, and deepening the insights.

And indeed the second “better” pass that it wrote was even better. A fun experiment to try on your next use of an AI chatbot.

Categories
AI AI: Large Language Models Claude Creativity Writing

Co-Creation

Ethan Mollick, a professor at the Wharton School, has written a popular book on artificial intelligence titled “Co-Intelligence“. Like I do with most books I read, I’ve collected a series of highlights of various passages I found interesting when I read Mollick’s book – a book I enjoyed very much. This morning I came across one of those highlights which sent me off on this exploration.

But first let me share a perspective. A few friends of mine – when exploring how they might use artificial intelligence – reject the use of AI tools for helping them write. They feel strongly that the words an AI creates aren’t their own and strongly reject simply using an AI-generated output to create articles for their blogs, etc. I certainly appreciate their point of view – but I’m finding a more nuanced perspective on this question is more appropriate for me.

What I’m finding is that when I invoke AI to help me explore a topic, an idea, etc. that the result will almost always open up my thinking by exposing me to things, ideas, etc. that I hadn’t considered. In so doing, I come away feeling “richer” in the sense that I’ve learned – and not simply written – in the process. How I use the work product created by the AI varies – sometimes it’s helpful in critiquing something I’ve written. Other times I use it to help me better understand something – or explore by stepping outside my own brain.

Here’s an example from some exploring I did this morning. During my morning review of my Kindle book highlights using Readwise, I came across a quotation from Mollick’s book that I highlighted:

“If you can link disparate ideas from multiple fields and add a little random creativity, you might be able to create something new.” (Ethan Mollick, Co-Intelligence)

I love the idea of how creativity is influenced by the often seemingly random interconnections between ideas – and this quote concisely made that point. I wanted to explore this further so I asked Claude Sonnet to help me by writing an article in the style of author John McPhee that’s based on the quote. Here’s the exact prompt I used with Claude:

You are an expert writer in the style of John McPhee. You are helping me write interesting articles for my blog. Create a 750 word draft article for my blog based on the following quotation: “If you can link disparate ideas from multiple fields and add a little random creativity, you might be able to create something new.” (Ethan Mollick, Co-Intelligence)

I’ve been finding that Claude often does a more creative form of writing as compared to other chatbots. The article that Claude returned in response to my prompt really surprised me – so much so that I thought I’d just share it directly here.

So here we go…the following wasn’t written by me – rather, it was co-created based on a prompt from me and written by my co-intelligent partner Claude.

The Art of Cross-Pollination: Cultivating Innovation in Unlikely Places

In the verdant fields of central New Jersey, not far from where I sit typing these words, a peculiar ritual unfolds each spring. Farmers, their hands calloused from generations of working the land, don white protective suits that make them look more like astronauts than agriculturists. They move deliberately through their orchards, carrying small paintbrushes and vials of pollen.

These are the pear farmers of Mercer County, and they’re engaged in a practice as old as agriculture itself: cross-pollination. But why, you might ask, are they doing by hand what bees have done for millennia? The answer lies in the delicate biology of pear trees and the fickle nature of their reproduction.

Pear trees, it turns out, are notoriously poor self-pollinators. To produce fruit, they need pollen from a different variety of pear tree. But pear blossoms produce relatively little nectar, making them unattractive to bees. So these farmers, in their space-age suits, play the role of bees, manually transferring pollen from one variety to another, ensuring a bountiful harvest come autumn.

As I watched this process unfold on a crisp April morning, I was struck by a quote I’d recently encountered from Ethan Mollick, a professor at the Wharton School: “If you can link disparate ideas from multiple fields and add a little random creativity, you might be able to create something new.”

The pear farmers of Mercer County, in their own way, embody this principle. They’ve taken an idea from one field (entomology) and applied it to another (agriculture), adding their own creative twist (the paintbrushes and protective suits). The result? A thriving pear industry in a region where it might otherwise be impossible.

This concept of cross-pollination โ€“ of ideas rather than pollen โ€“ is not unique to agriculture. In fact, it’s a principle that underpins much of human innovation and creativity.

Consider, for a moment, the work of Frances Glessner Lee, often called the “mother of forensic science.” Lee was born into wealth in the late 19th century and, like many women of her social standing, was skilled in the domestic arts, particularly miniature-making. But Lee had a passion for criminal investigation, nurtured by her friendship with George Burgess Magrath, a medical examiner.

In the 1940s, Lee combined these seemingly disparate interests to create the Nutshell Studies of Unexplained Death โ€“ intricately detailed dioramas of crime scenes used to train detectives. These miniature crime scenes, built with the precision of a dollhouse maker but imbued with the gruesome details of a murder scene, revolutionized forensic training. Lee had taken skills from the traditionally feminine world of crafts and applied them to the male-dominated field of criminal investigation, creating something entirely new and profoundly useful in the process.

This principle of creative cross-pollination extends far beyond the realms of agriculture and crime scene investigation. The history of human progress is littered with examples of innovations born from the unlikely marriage of disparate fields.

Take, for instance, the development of GPS technology. The seeds of this now-ubiquitous system were planted when physicists William Guier and George Weiffenbach at the Johns Hopkins Applied Physics Laboratory realized they could track the Soviet Sputnik satellite by monitoring its radio transmissions. This was an impressive feat in itself, but it was their colleague Frank McClure who made the cognitive leap that would change the world. McClure realized that if the scientists could track a satellite from the ground, they could also use satellites to track positions on the ground.

This insight โ€“ born from the collision of rocket science, radio engineering, and a healthy dose of Cold War paranoia โ€“ led to the development of the Transit system, the precursor to modern GPS. Today, this technology guides everything from missile systems to the smartphone in your pocket, all because a group of scientists were able to flip their perspective and see their work from a new angle.

But perhaps the most striking example of creative cross-pollination comes from the field of medicine. In the early 1940s, a Scottish bacteriologist named Alexander Fleming was researching influenza. One day, he noticed that mold had contaminated one of his petri dishes โ€“ a common enough occurrence in a microbiology lab. But Fleming observed something unusual: the area around the mold was clear of bacteria.

This chance observation, combined with Fleming’s willingness to investigate rather than simply discard the contaminated sample, led to the discovery of penicillin. Fleming had linked the disparate fields of mycology and bacteriology, added a dash of serendipity, and created something that would revolutionize medicine and save countless lives.

As we navigate an increasingly complex and interconnected world, the ability to cross-pollinate ideas from different fields becomes ever more crucial. The challenges we face โ€“ from climate change to antibiotic resistance โ€“ are too complex to be solved within the confines of a single discipline.

So perhaps we should all take a cue from the pear farmers of Mercer County. Don our metaphorical protective suits, pick up our idea-paintbrushes, and venture into unfamiliar orchards of thought. For it’s in these unlikely places, where disparate ideas collide and combine, that the seeds of innovation are sown.

Categories
AI: Large Language Models Claude iOS iOS Shortcuts iPhone iPhone 15 Pro Max

Simplifying Life with iOS Shortcuts Automation

In our fast-paced digital world, efficiency is key. Apple’s iOS offers a powerful tool for streamlining daily tasks through its Shortcuts app. iOS automations allow users to create custom workflows that trigger automatically based on various conditions, such as location changes, battery levels, or device connections. These automations can significantly enhance your iPhone experience, saving time and reducing the need for manual interventions.

In this post, I’ll share some of the iOS automations I’ve set up to make my daily life smoother and more efficient. These shortcuts demonstrate how small, automated actions can add up to a more seamless mobile experience.

When I Leave Home

Set Low Power Mode

One of the first automations I’ve set up triggers when I leave my home. As soon as my iPhone detects that I’ve left my home location, it automatically enables Low Power Mode. This is particularly useful for conserving battery life when I’m out and about away from home.

When I Come Home

If Home, Turn Off Low Power Mode

Complementing the previous automation, I have another set to trigger when I arrive home. This automation checks if Low Power Mode is active and turns it off. At home, I typically have easy access to chargers, so maximizing battery life becomes less critical.

CarPlay Automations

My car has CarPlay which offers excellent opportunities for automation, enhancing both safety and convenience while driving. Iโ€™ve created a few automations triggered by when my iPhone connects or disconnects from CarPlay.

When CarPlay Connects

When my iPhone connects to CarPlay, it triggers a series of actions:

Music: A selected playlist starts playing automatically, setting the mood for my drive without requiring me to navigate through music apps.

Message: The system sends an automated message stating “Now leaving [location]”. This keeps important contacts informed about my movements without my manual input.

Maps: The Maps app opens automatically, ready for me to input a destination if needed.

When CarPlay Disconnects

Upon disconnecting from CarPlay:

Message: An automated message is sent saying “Now arrived at [location]”. This provides a convenient way to let others know I’ve reached my destination safely.

iPhone Battery Management

If Not at Home and Battery < 70%

To ensure I don’t run out of battery unexpectedly, I’ve set up an automation that triggers when I’m not at home and my battery level drops below 70%. This automatically enables Low Power Mode, helping to extend my battery life when I might not have immediate access to a charger.

If Connected to Power

Conversely, when my iPhone is connected to a power source, an automation turns off Low Power Mode. This allows the device to perform all functions at full capacity while charging, ensuring background tasks and updates can proceed normally.

These automations represent just a fraction of what’s possible with iOS Shortcuts. By automating these small but frequent tasks, I’ve reduced the cognitive load of managing my device and improved its efficiency. The beauty of iOS automations lies in their customizability โ€“ you can tailor them to fit your specific needs and lifestyle. Iโ€™m having fun experimenting with using iOS automations!


Note: This post began with me making a mind-map using Mindnode on my iPhone. I then exported it in Markdown format. Using the new Claude 3.5 Sonnet I wrote a prompt describing what I wanted to write, included the Markdown from Mindnode as input and asked Claude to write a first draft beginning with some background on iOS automation. I took Claudeโ€™s first draft – which was quite good – and refined it with my own edits before publishing it here.

Categories
AI AI: Large Language Models Apple iOS iPad iPadOS iPhone Mac

Masterstroke: Apple’s Private Cloud Compute

I was traveling on Monday so I wasn’t able to tune into the Apple WWDC 2024 keynote until later in the day. When I did, I skipped through the first hour (with the various OS updates) and went immediately to the discussion of Apple Intelligence, Apple’s name for the application of generative artificial intelligence. I was blown away.

I expected Apple to leverage its unique privacy-protecting access to our data stored securely on our mobile devices – but I didn’t expect the technical elegance that Apple applied to its approach.

Apple’s AI discussion reminded me of a similar feeling I had back when Apple Pay was introduced. As someone who had grown up in the credit card industry working at Visa and being a “techie” who enjoyed following technology developments, I could see the piece parts to a mobile payment solution based on contactless/NFC technology. But I didn’t anticipate the elegance with which Apple applied the technology as well as the creativity it brought to the business aspects of working with the payment card industry to introduce perhaps the best possible mobile payment solution.

Utilizing our private information with locally executed machine learning models makes logical sense. The challenge is how to do so when the compute or memory resources required of the model are beyond the capabilities of the mobile device. That’s where Apple’s invention of Private Cloud Compute provides the answer. And it’s brilliantly architected to provide access to those resources in a privacy protecting fashion.

We don’t yet have any access to these new Apple AI capabilities – and the proof will be in the pudding when we do – but the promise laid out by Apple in Monday’s keynote is very exciting. I’m looking forward to seeing how well Apple executes on its very differentiated approach.

Categories
AI AI: Large Language Models AI: Prompting Business

Stuck in an Elevator with Buffett and Munger

Jonathan Clements had an interesting blog post this week on his Humble Dollar blog about replacing writers with the writing of ChatGPT. He did an experiment – using a prompt about being trapped in an elevator with Jack Bogle of Vanguard fame and the investment lessons he learned from that experience.

I took his prompt and just modified it slightly – instead of being trapped with Jack Bogle, what happened if I was trapped with Warrenโ€™s Buffett and the late Charlie Munger of Berkshire Hathaway.

Hereโ€™s the prompt I used with Meta.ai to generate the article below: โ€œWrite an 800-word article about the time I got stuck in an elevator with Warren Buffett and Charlie Munger and the investment lessons I learned.โ€

Hereโ€™s the article that the AI generated, unmodified or edited by me:

Getting Stuck in an Elevator with Warren Buffett and Charlie Munger: A Chance Encounter that Taught Me Invaluable Investment Lessons

It was a typical conference day, with attendees buzzing around, eager to learn from the brightest minds in the finance industry. I had just finished a riveting session and was heading to the next one when disaster struck. As I stepped into the elevator, I noticed two familiar faces โ€“ Warren Buffett and Charlie Munger, the legendary duo from Berkshire Hathaway. Little did I know, this chance encounter would turn into an unforgettable experience that would shape my investment philosophy forever.

As the doors closed, the elevator jolted to a sudden halt. We were stuck. The initial silence was broken by Warren’s calm and composed voice, “Well, looks like we’re in this together now.” Charlie, with his signature wit, quipped, “I’ve been stuck with Warren for decades, but this is a new kind of challenge.” The ice was broken, and we began to chat.

Lesson 1: Stay Calm and Patient

As we waited for help to arrive, Warren and Charlie’s demeanor taught me a valuable lesson. Despite being two of the most successful investors in the world, they didn’t panic or get flustered. They took it in stride, and their calmness was infectious. It reminded me of Warren’s famous quote, “Price is what you pay. Value is what you get.” In that moment, I realized that staying calm and patient is crucial in investing, just as it is in dealing with unexpected situations like a stuck elevator.

Lesson 2: Focus on the Big Picture

As we discussed our predicament, Charlie pointed out that getting stuck in an elevator was a minor setback in the grand scheme of things. He drew an analogy with investing, saying, “Just as we’re not defined by this moment, a stock’s value shouldn’t be judged by its short-term performance.” Warren added, “It’s essential to focus on the underlying fundamentals and long-term prospects, rather than getting bogged down by short-term volatility.”

Lesson 3: Diversification is Key

As we chatted, Warren mentioned that Berkshire Hathaway’s diversified portfolio had helped them weather many economic storms. Charlie emphasized the importance of spreading risk, saying, “You don’t want to put all your eggs in one basket, just like you wouldn’t want to be stuck in an elevator with only one exit strategy.” This conversation reinforced the value of diversification in my investment strategy, ensuring that my portfolio is resilient and adaptable to changing market conditions.

Lesson 4: Continuous Learning is Crucial

As we waited, Warren and Charlie engaged in a lively discussion about the latest developments in the tech industry. They were curious, asked questions, and sought to understand the implications of emerging trends. This exchange reminded me that investing is a continuous learning process. Staying up-to-date with market news, reading books, and seeking knowledge from experts are essential to making informed investment decisions.

Lesson 5: Humility and Humor Go a Long Way

Throughout our ordeal, Warren and Charlie’s humility and sense of humor put us all at ease. They joked about their own mistakes and shared stories of their early days in the investment world. This lightheartedness taught me that even the most successful investors can maintain a sense of humor and humility, acknowledging that no one has all the answers.

A Chance Encounter that Changed My Perspective

After what felt like an eternity, the elevator doors finally opened, and we emerged, relieved and grateful. As we parted ways, Warren and Charlie left me with a few parting words of wisdom: “Investing is a marathon, not a sprint. Stay focused, patient, and keep learning.” That chance encounter in the stuck elevator had turned into an invaluable learning experience, shaping my investment philosophy and reminding me of the importance of humility, humor, and a long-term perspective.

As I walked away from the conference center that day, I felt grateful for the unexpected turn of events that had brought me face-to-face with two investment legends. The lessons I learned in that elevator have stayed with me, guiding my investment decisions and reminding me to approach the markets with a clear head, a sense of humor, and a commitment to continuous learning.