Web dev at the end of the world, from Hveragerði, Iceland

Studying the pitfalls and potential of generative code (plus links)


Get The Intelligence Illusion in PDF and EPUB

Over the past few months, I’ve been diving deeper and deeper into the topic of language models and, to a lesser extent, diffusion models.

During this time, my newsletter has been dominated by links and research, most of it on AI and AI companies.

​I’d like to thank all of you who have stuck around during this time.

The book I was working on is finally out. The Intelligence Illusion: A practical guide to the business risks of Generative AI.

I wrote a blog post about "why I wrote The Intelligence Illusion" and tweaked the design of the front page of my website while I was at it.

One of my mantras I had while writing it was that it’s a tool. It’s research, made accessible, there to help you decide, for yourself, what the risks of these systems are.

But it’s also a tool for me. I really do think that language models are one of the more promising innovations in software development in later years, but it’s being let down by poor designs, shoddy thinking, superstition, and some of the least trustworthy people and companies that I’ve had the displeasure to read about.

As I wrote in the book itself:

I’ve never before experienced such a disparity between how much potential I see in a technology and how little I trust those who are making it.

The important word there is potential. It’s clear to me that language models fit programming better than they do most other tasks. That deserves exploration. But, exploration only has value if it is structured and researched. Personal exploration just leads to superstition and hearsay.

The research I did for the book was necessary for me to be able to form my thoughts and ideas on generative AI in software development.

Namely, none of the current approaches are likely to unlock that “potential”.

Over the next few weeks, I’ll begin by posting extracts from the book that will serve as the foundation of my argument around the use of language models in programming.

After that, I’ll be publishing a series of essays on some of the pitfalls and potential of generative coding. Most of it will be pitfalls because this is the software industry, and our first instinct as an industry is always to fuck things up.

But, unlike in writing and art, the potential in programming is there. It deserves investigation.

That potential may never be realised. Many prior programming revolutions petered out without revolutionising anything. Some even turned out to be counterproductive. But it needs to be taken seriously.

If you want to support this newsletter and help me publish more essays of substances and less of the automated link posts, the best way is to buy either one of my books:

The income from the ebooks is what pays for the essay writing.

Get The Intelligence Illusion in PDF and EPUB

The Intelligence Illusion by Baldur Bjarnason

What are the major business risks to avoid with generative AI? How do you avoid having it blow up in your face? Is that even possible?

The Intelligence Illusion is an exhaustively researched guide to the business risks of language and diffusion models.

Get the ebook in PDF and EPUB for $35

You can also find me on Mastodon and Twitter