🤖 AI & Machine Learning

AI Text Detectors' Secret Sauce: Perplexity, Burstiness, and Why They Often Fail

What if your most creative prose gets labeled 'AI-generated' by tools like GPTZero? Under the hood, it's all about perplexity and burstiness—stats that expose machine-like predictability.

Graph showing perplexity and burstiness metrics distinguishing AI from human text

⚡ Key Takeaways

  • Perplexity flags low-surprise AI text (5-15), humans run higher (30-80+). 𝕏
  • Burstiness captures human variance; AI stays flat—key for 2D classification. 𝕏
  • Classifiers like RoBERTa boost accuracy but inherit training biases, predicting an arms race loss. 𝕏
Published by

theAIcatchup

Community-driven. Code-first.

Worth sharing?

Get the best Open Source stories of the week in your inbox — no noise, no spam.

Originally reported by Dev.to

Stay in the loop

The week's most important stories from theAIcatchup, delivered once a week.