Skip to content

Mind2web-live_Leaderboard.md

Latest commit

 

History

History
31 lines (20 loc) · 1.36 KB

Mind2web-live_Leaderboard.md

File metadata and controls

31 lines (20 loc) · 1.36 KB
Raw

Leaderboard

Agent Model Completion rate Task success rate
★SeeAct-V GPT-4o 50.8% 19.2%
★SeeAct-V GPT-4 50.7% 23.1%
★AGUVIS AGUVIS-72B / 27.1%
★WebDreamer GPT-4o 49.9% 25.0%
★WebCanvas GPT-4 48.8% 23.1%
★WebCanvas Claude-3-Sonnet 47.9% 22.1%
★WebCanvas GPT-4o 47.6% 22.1%
★WebCanvas GPT-4-turbo 44.3% 21.1%

Explanation

  • ★ indicates that the model or code has been open-sourced and verified.
  • Completion rate: Indicates the success rate of the model in completing tasks.
  • Task success rate: Indicates the success rate of the model in performing tasks.

References

[1] SeeAct-V ★

[2] [AGUVIS][https://arxiv.org/pdf/2412.04454] ★

[3] WebDreamer ★

[4] WebCanvas ★