Cross-Environment Neural Reranking for Sample-Efficient Action Selection

Cross-Environment Neural Reranking for Sample-Efficient Action Selection in Text-Based Agents

Announce Type: new Abstract: Large language model agents achieve strong performance on text-based benchmarks but incur prohibitive inference costs, motivating the use of compact neural rerankers for action selection. We investigate whether a single lightweight model can perform action selection across multiple diverse environments, a capability that would eliminate per-environment model maintenance. Training DeBERTa-v3 (184M-434M parameters) jointly on ALFWorld, WebShop, and ScienceWorld...