- Home
- Skills
- Agents & Orchestration
- Windows Click & Write — Desktop Automation & UI Control
Works with the AI Agents you already use
Windows Click & Write — Desktop Automation & UI Control
Full desktop GUI automation for AI agents via MCP: click buttons, type into any app, send keyboard shortcuts, and discover UI elements.
$5
Windows Click & Write — Desktop Automation & UI Control
Example session with this skill installed
Find the Notepad window, type 'Hello World' into the main editor, and save the file.
- Read your context and instructions
- Compiled the windows click
I have identified the Notepad process, entered the text, and triggered the save dialog.
Desktop Automation Log
| Action | Target | Result |
|---|---|---|
list_windows | Desktop | Found "Untitled - Notepad" (process: notepad) |
list_elements | "Untitled - Notepad" | Found Edit control (automationId: "15") |
type_text | Edit (ID: 15) | Entered "Hello World" |
send_keys | System | Sent "Ctrl+S" |
list_elements | "Save As" | Detected save dialog buttons |
Next steps
- Use
type_texton the "File name" element to specify a path. - Call
click_elementon the "Save" button to commit the file to disk. - Use
send_keyswith "Alt+F4" if you want to close the application.
Connects securely to your tools. The creator never sees your data.
About this skill
Developers building desktop-capable AI agents often struggle to bridge the gap between LLM reasoning and local Windows execution. This skill provides a bridge using the Model Context Protocol to control any Windows application, whether it is a native Win32 app, a WPF interface, or a custom-drawn GUI.
What it does
- Window discovery lists all active top-level windows with their process names and titles.
- Element inspection scans target windows for interactive controls like buttons, checkboxes, and tabs.
- Targeted clicking executes mouse actions on specific UI elements using names or automation IDs.
- Coordinate interaction performs raw clicks at absolute pixel positions for custom canvases or games.
- Field input locates specific text fields and enters strings with optional clearing and Enter-key execution.
- System shortcuts triggers complex keyboard combinations like Ctrl+S, Alt+F4, or Win+D.
How it works
- Discovery involves running
list_windowsto identify the target application and its current state. - Inspection uses
list_elementsto map out the UI tree and retrieve unique automation IDs for precision. - Execution calls tools like
click_elementortype_textto drive the application UI through Windows UI Automation.
Frameworks & tools
This skill is built for Windows environments and requires the .NET runtime. It utilizes Windows UI Automation (UIA) patterns and the Model Context Protocol (MCP) for agent communication.
Why this beats prompting it yourself
Writing raw scripts for Windows automation is brittle and fails when windows resize or DPI scales change. This skill handles coordinate fallback and UIA pattern matching internally, allowing agents to navigate complex GUI hierarchies without manual coordinate mapping.
Use cases
- Automate data entry from a web browser into a legacy Win32 accounting application.
- Orchestrate multi-step workflows across professional tools like Photoshop or Blender.
- Build automated QA agents that verify UI state in native desktop software.
- Trigger system-level actions and window management via keyboard shortcuts.
Known limitations
Requires the WindowsClickAndWriteMCP .NET tool installed locally. Interaction is limited to the active desktop session and visible windows.
Requires .NET runtime and local installation of the windows-click-and-write global tool. Only supports Windows desktop environments.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 16 days ago
Requires
Permissions
Requires desktop UI Automation access to interact with Windows applications and send keyboard/mouse input.