Control

Documentation Index

Fetch the complete documentation index at: https://kernel.sh/docs/llms.txt

Use this file to discover all available pages before exploring further.

import Kernel from '@onkernel/sdk';

const kernel = new Kernel();
const kernelBrowser = await kernel.browsers.create();

const screenshot = await kernel.browsers.computer.captureScreenshot(kernelBrowser.session_id);

await kernel.browsers.computer.clickMouse(kernelBrowser.session_id, {
  x: 420,
  y: 280,
});

await kernel.browsers.computer.typeText(kernelBrowser.session_id, {
  text: 'kernel cloud browsers',
});

const response = await kernel.browsers.playwright.execute(
  kernelBrowser.session_id,
  {
    code: `
      await page.goto('https://example.com');
      return await page.title();
    `,
  },
);

console.log(response.result);

import { chromium } from 'playwright';

const browser = await chromium.connectOverCDP(kernelBrowser.cdp_ws_url);
const context = browser.contexts()[0];
const page = context.pages()[0];

await page.goto('https://example.com');
const title = await page.title();
console.log(title);

import { browser } from 'vibium';

const bro = await browser.start(kernelBrowser.webdriver_ws_url);
const page = await bro.page();

await page.goto('https://example.com');
const title = await page.title();
console.log(title);

​

Why computer use for agents

• Native fit. Screenshot, click, type, key, scroll, drag — the primitives the model already speaks.
• Faster screenshots. Captures bypass CDP, which removes the largest source of latency in a vision loop.
• Better against bot detection. No CDP connection means no CDP fingerprint to leak. Pairs naturally with stealth mode and residential proxies.
• Human-like input. OS-level events with Bézier-curve mouse paths, variable typing speed, and configurable mistype rate.
• Not DOM-limited. Screenshots capture the full VM, so the agent can see and interact with native dialogs, canvas elements, iframes, and PDFs — not just things you can address with a selector.

​

Why playwright execution over a direct CDP connection

• Run from anywhere. No playwright package to version-pin, no Chromium download, no CDP connection to manage. Send the code, get the result.
• Co-located with the browser. Code runs in the same VM as the browser — no network hop between your script and the page, fewer flakes.
• Patchright by default. Hardened against bot detection out of the box.
• Full Playwright API. page, context, and browser are all in scope. Anything Playwright can do — DOM queries, file uploads, full-page screenshots — works here.
• Returns values. return from your code and the result comes back in the response. Easy to use as an agent tool.

​

Computer use + playwright execution

const response = await kernel.browsers.playwright.execute(
  kernelBrowser.session_id,
  {
    code: `
      const rows = await page.$$eval('table tr', (trs) =>
        trs.map((tr) => Array.from(tr.querySelectorAll('td')).map((td) => td.textContent))
      );
      return rows;
    `,
  },
);

console.log(response.result);

​

Going deeper

• Computer Controls reference — every mouse, keyboard, and screen primitive.
• Playwright Execution reference — the full execution surface, return values, and timeouts.
• Computer use integrations — drop-in examples for Anthropic, Gemini, OpenAI, and more.