Comment by amrocha

I fed an LLM the record of a chat between me and a friend, and asked it to summarize the times that we met in the past 3 months.

Every time it gave me different results, and not once did it actually get it all right.

LLMs are horrible for summarizing things. Summarizing is the art of turning low information density text into high information density text. LLMs can’t deal in details, so they can never accurately summarize anything.