Comment by anon84873628 3 days ago
This is one of the few places I have gotten value out of the LLM. I tell it about my relationship to the colleague and what we worked on, in a very quick rough way. Then I tell it we are writing peer review and the actual review prompt. It gives quite good results that aren't just BS, but I didn't have to spend the time phrasing it perfectly. Because I do want my peer reviews to reflect well on both me and the colleague.
The interesting thing about the LLM is that it uses its knowledge of our respective roles, overall product (which is public), and peer review process itself to refine and improve the output in ways I wouldn't have considered.
I always put a lot of time into reviews before. Should I not use the tool to make something even better (within realistic time commitment)?
If I use an AI to create some cartoon graphics for a slide, should I have bettered myself by learning graphic design instead?
> that aren't just BS
Having been on the receiving end of many of these, it absolutely is pure BS and I lose all respect for anyone who themselves have so little respect for their colleague's time as to subject them to the AI-written slop instead of actual genuine feedback.
The whole fucking point is to give them actionable feedback, both good and bad, for them to work on themselves, not some generic hallucinated summary of some bullet points you haphazardly threw together. I can copy/paste the review prompt into ChatGPT myself, thank you very much, I don't need you to do it for me and to pass it off as your own genuine thoughts.
I'll take your word on the reviews you actually received.
As for the commenter you are replying to, you dont have any specific information on the review. Yet you declared its hallucinated, generic, haphazardly thrown together, simply copy pasted, etc. Consider that your conclusions are based off an idea in your head and not his actual review.
Counterpoint: I'm not in the job of managing my colleagues, especially in paragraph-length business professional tone.
If a colleague gave me LLM responses instead of genuine feedback I would never ask them for a review again. Which may be what they were going for. But sadly this is not what I wanted.
Be better. Someone respected your opinion enough to go out and ask for it. Take a minute to reflect.
I get where you are coming from with this, but in my opinion being able to give feedback in a clear and concise fashion is a skill that people should have. LLMs will help you elaborate but they will also add their own flair by choosing the actual work. You can think "wow that's actually what a better person of me would have written" but you are biasing yourself based on what the LLM understood of your prompt focusing on form over substance.
But as the other comments mention it might just all be bullshit anyway.