Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[computer-use] Double-click fails in Firefox with certain apps, but works when using xdotool for two fast clicks #230

Open
gwpl opened this issue Jan 10, 2025 · 0 comments

Comments

@gwpl
Copy link

gwpl commented Jan 10, 2025

TL;DR-

I came across issue with computer use trying to remove graph nodes in web graph editor ( vis-network based ) in firefox.

I found workaround, and decided to share as maybe helpful to others: :

  • I told model to "double click" with two fast clicks via xdotool .

Title
Double-click fails in Firefox with certain apps, but works when using xdotool for two fast clicks

Description
When using tools that rely on a default “double click” action, Firefox sometimes fails to register the event (e.g., in web-based graph editors). However, simulating two quick single clicks via xdotool works consistently as a workaround.

Steps to Reproduce

  1. Open a web app (like a graph editor) in Firefox.
  2. Attempt a double-click using the default method.
  3. Notice that the double-click may fail to register.

Workaround
Use xdotool to simulate two consecutive single clicks:

xdotool click --repeat 2 --delay 50 1

Suggested Enhancement
Add a fallback action (e.g., “alternative_double_click” or “failover_double_click”) that explicitly triggers two quick single clicks when the normal double-click fails. This could help ensure reliability across different browsers and web apps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant