Comment by rjst01
The headline here makes it sound (to me) like Salesforce did the study.
The headline here makes it sound (to me) like Salesforce did the study.
The article also makes it sound like that. Are you saying they didn't? I don't see any reference in the article to any other organization that could have done the research.
Edit: Unless "Salesforce AI Research" is not a part of Salesforce, I think Salesforce did do the research.
judging from the comments most of the people read it like Salesforce did the study
It sure sounds like it in the article:
A team led by Kung-Hsiang Huang, a Salesforce AI researcher, showed that using a new benchmark relying on synthetic data, LLM agents achieve around a 58 percent success rate on tasks that can be completed in a single step without needing follow-up actions or more information.
and
The Salesforce AI Research team argued that existing benchmarks failed to rigorously measure the capabilities or limitations of AI agents, and largely ignored an assessment of their ability to recognize sensitive information and adhere to appropriate data handling protocols.