Comment by nikolayasdf123
Comment by nikolayasdf123 4 days ago
> "Is {sentence_a} similar to {sentence_b}?"
I also find this methods powerful. I see more and more software is getting outsourced into LLM judgements/prompts.
Comment by nikolayasdf123 4 days ago
> "Is {sentence_a} similar to {sentence_b}?"
I also find this methods powerful. I see more and more software is getting outsourced into LLM judgements/prompts.
The problem is to scale that properly. If you have millions of documents, that won't scale that well. You are not going to prompt the LLM millions of times, aren't you?
Embedding models usually have fewer parameters than the LLMs, and once we index the documents, their retrieval is also pretty fast. Using LLM as a judge makes sense, but only on a limited scale.