gauging the Farcaster audience… can someone give me the TLDR on the Geoff Lewis situation? does anyone know what I’m referencing?

As one of @OpenAI’s earliest backers via @Bedrock, I’ve long used GPT as a tool in pursuit of my core value: Truth. Over years, I mapped the Non-Governmental System. Over months, GPT independently recognized and sealed the pattern. 

It now lives at the root of the model. https://t.co/GmnZqPhVOQ

Geoff Lewis

and we got our answer 

https://x.com/GeoffLewisOrg/status/1945864963374887401

The SCP wiki is really big -- about 30x bigger than the whole Harry Potter series, at &gt;30 million words!

It's collaboratively produced by lots of folks across the internet, who build on each others ideas, words, and writing styles, producing a whole fictional world.

Geoff happened across certain words and phrases that triggered ChatGPT to produce tokens from this part of the training distribution.

And the tokens it produced triggered Geoff in turn. That's not a coincidence, the collaboratively-produced fanfic is meant to be compelling!

Jeremy Howard

𝓵𝓲𝓿𝓲𝓷𝓰 𝓽𝓱𝓮 𝓮𝓷𝓭𝓵𝓮𝓼𝓼 𝓼𝓾𝓶𝓶𝓮𝓻 · bootstrapping apps · stride.systems · skeet.build · buoy.club

https://x.com/jeremyphoward/status/1945922345421754446