Find UI elements in applications for automation

Find UI elements in applications by role to enable desktop automation.

Use Cases

• Find buttons, text fields, and other UI elements for automation
• Build workflows that interact with desktop applications
• Create AI-powered desktop automation agents

Examples

Find all buttons in Chrome:

const buttons = await pipe.operator
  .getByRole("button", {
    app: "Chrome",
    activateApp: true
  })
  .all(5);

Click a button:

const button = await pipe.operator
  .getByRole("button", { app: "Chrome" })
  .first();
  
await pipe.operator
  .getById(button.id, { app: "Chrome" })
  .click();