Eli5: What exactly is text burstiness and text perplexity as it relates to large language models?

126 views

I know that GPT-0 measures these properties somehow when trying to determine if a text was generated by a human or AI, but what is it and how is it measured?

In: 13

2 Answers

Anonymous 0 Comments

Oh boy. This is tricky explaining this like I’m 5. There’s so examples in my own way though! PM me if you need more of an explanation.

Text burstiness is like when you talk a lot all at once, and then don’t talk for a little while. Text perplexity is like trying to figure out what someone is trying to say when they talk like that. A large language model is like a really smart robot that can understand and talk using words, and we use text burstiness and perplexity to measure how well it’s doing its job.

You are viewing 1 out of 2 answers, click here to view all answers.