agent-browser

Browser Automation with agent-browser

Preferred path in Bao

If agent_browser is present in ## Available Now, use that tool instead of composing shell commands yourself.

Use this skill to understand the workflow and command vocabulary behind the tool, or to debug the underlying CLI behavior when needed.

Runtime

Bao desktop builds should prefer the bundled managed browser runtime.

Source / CLI environments can still use this workflow, but they must provide a browser runtime explicitly for Bao to call. The recommended testing path is to point BAO_BROWSER_RUNTIME_ROOT at a prepared runtime directory instead of assuming a global agent-browser binary on PATH.

Quick start

Preferred Bao tool call shape:

{"action":"open","args":["https://example.com"]}
{"action":"snapshot"}
{"action":"click","args":["@e1"]}
{"action":"fill","args":["@e2","hello"]}
{"action":"close"}

Underlying CLI equivalent:

agent-browser open <url>        # Navigate to page
agent-browser snapshot -i       # Get interactive elements with refs
agent-browser click @e1         # Click element by ref
agent-browser fill @e2 "text"   # Fill input by ref
agent-browser close             # Close browser

Core workflow

1. Navigate to the page.
2. Snapshot the page structure and interactive refs.
3. Interact using refs from the latest snapshot.
4. Re-snapshot after navigation or significant DOM changes.

In Bao, the same loop maps naturally to:

1. agent_browser(action="open", args=[url])
2. agent_browser(action="snapshot")
3. agent_browser(action="click"|"fill"|..., args=[...])
4. agent_browser(action="snapshot") again when the page changed

Commands

Navigation

agent-browser open <url>      # Navigate to URL (aliases: goto, navigate)
                              # Supports: https://, http://, file://, about:, data://
                              # Auto-prepends https:// if no protocol given
agent-browser back            # Go back
agent-browser forward         # Go forward
agent-browser reload          # Reload page
agent-browser close           # Close browser (aliases: quit, exit)
agent-browser connect 9222    # Connect to browser via CDP port