Did It Happen? Counterfactual Evaluation of LLM Agent Recovery from Ambiguous Tool Outcomes
Published in Research Square (preprint), 2026
A counterfactual evaluation framework studying whether LLM agents can detect, clarify, and recover from ambiguous tool outcomes instead of proceeding on wrong assumptions. Code is available in the ambiguous-tool-outcomes-benchmark repository.
Recommended citation: Sun, S. (2026). "Did It Happen? Counterfactual Evaluation of LLM Agent Recovery from Ambiguous Tool Outcomes." Research Square. doi:10.21203/rs.3.rs-10730245/v1
Download Paper