We are happy to release MMBench-GUI, a hierarchical, multi-platform benchmark framework and toolbox, to evaluate GUI agents. MMBench-GUI is comprising four evaluation levels: GUI Content Understanding ...

This repository contains basic desktop GUI applications built with Windows Forms for learning classic .NET desktop development. Projects include both modern and older .NET Framework versions. Visual ...

Abstract: GUI testing automatically using the capture-replay technique is beneficial in shortening testing time. Some of the automated testing tools that implement this technique are Selenium Ide, ...

Abstract: It is not uncommon that real-world data are distributed with a long tail. For such data, the learning of deep neural networks becomes challenging because it is hard to classify tail classes ...

One of the principal challenges in building VLM-powered GUI agents is visual grounding, i.e., localizing the appropriate screen region for action execution based on both the visual content and the ...