How large language models produce text, in plain terms

Here is a straightforward look at this topic for Ridents.

A large language model is a program trained on a very large collection of text to predict which word is likely to come next. By repeating that prediction many times it can write paragraphs, answer questions and summarise documents. It does not look facts up the way a search engine does unless it is connected to one, which is why it can sound confident and still be wrong.

A large language model is a program trained on a very large collection of text to predict which word is likely to come next.

Used well, these tools are good at drafting, rephrasing and explaining ideas in simpler words. Treat their output as a first draft from a fast but unreliable assistant. Check names, numbers and quotations against a trusted source, avoid pasting private or confidential information into public services, and say when a text was produced with help from such a tool.