Papers
arxiv:2608.01964

LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

Published on Aug 3
ยท Submitted by
Wang Yong
on Aug 4
#2 Paper of the day
Authors:
,
,
,
,
,
,

Abstract

Large language model (LLM) agents increasingly undertake long-horizon tasks that require sustained reasoning, tool use, and revision across many interdependent steps. However, existing agent harnesses maintain task execution, task state, and completion assessment within a growing context, making the state difficult to track and allowing incorrect self-assessments to propagate into later decisions. We reformulate long-horizon execution as a task-state management problem and propose LongHorizon-Harness, which maintains the task state explicitly outside execution and updates it only with facts independently verified from the environment. Its Manage-Execute-Audit(MEA) loop uses a manager to maintain the task state and determine the next subtask, a fresh-context executor to perform it, and a read-only auditor to verify the resulting environment state before the next round. A lightweight AgentAdapter supports interchangeable model and harness backends without modifying their native agent loops. LongHorizon-Harness improves Qwen~3.7-Plus from 51.8% to 80.7% on WeaveBench, from 69.7% to 77.2% on Terminal-Bench~2.1, and from 2.8% to 8.3% on OSWorld~2.0. It also raises Claude Opus~4.7 from 20.0% to 34.3% on an OSWorld2.0 subset, demonstrating consistent gains across models, harnesses, and interaction domains.

Community

Paper submitter

LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks
Github: https://github.com/AMAP-ML/LongHorizon-Harness
Website: https://lh-harness.pages.dev

Interesting approach! Separating task state from execution and verifying it independently seems like a practical way to improve reliability for long-horizon AI agents. The benchmark improvements are impressive.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.01964
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.01964 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.01964 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.01964 in a Space README.md to link it from this page.

Collections including this paper 4