Zhou Jianxiang

An Evaluation Mechanism of LLM-based Agents on Manipulating APIs

LLM-based agents can greatly extend the abilities of LLMs and thus attract sharply increased studies. An ambitious vision – serving users by manipulating massive API-based tools – has been proposed and explored. However, we find a widely accepted evaluation mechanism for generic agents is still miss…