An invented system prompt that grows commit by commit, the way the 1,262 real prompt changes we studied did.
- Press ▶ Play its history, or drag the History slider.
- Watch new lines turn green, and lines that clash turn red.
- Check the commit log: does each message say what changed?
Watch: the red notes under the prompt name each contradiction, and the line under the slider says what each commit did.
Prompting in the Wild: the prompt that argues with itself
In real apps, the prompt is code. Nobody reviews it like code.
I built a static analyzer on Tree-sitter that pulls prompts out of Python projects, then followed 1,262 prompt changes across 243 repositories. Scrub through one prompt's history below: every commit adds, and some commits quietly contradict what came before.
Press ▶ Play its history to watch this prompt grow, one commit at a time.
3 contradictions
in this illustration
of prompt changes were documented in their commit messages. The study followed 1,262 prompt changes in 243 repositories. Prompts mostly grow, and changes can bring in logical contradictions no test catches.