> ## Documentation Index
> Fetch the complete documentation index at: https://learn.workflow.dog/llms.txt
> Use this file to discover all available pages before exploring further.

# Scrape URL

> Extract page content, links, and an optional screenshot with Firecrawl.

**Scrape URL** loads one web page through Firecrawl and returns its content as
HTML, raw HTML, or Markdown. It can also collect page links and capture a
screenshot in the same request.

## Inputs

| Input                    | Type                             | Required | Description                                                                                     |
| ------------------------ | -------------------------------- | -------- | ----------------------------------------------------------------------------------------------- |
| **Third-party account**  | Firecrawl account                | Yes      | The Firecrawl API key used for the request.                                                     |
| **URL**                  | String                           | Yes      | The complete page URL to scrape.                                                                |
| **Format**               | `markdown`, `html`, or `rawHtml` | Yes      | The content representation. Defaults to `html`.                                                 |
| **Include Links**        | Boolean                          | No       | Adds the page's discovered links to the output. Defaults to off.                                |
| **Include Screenshot**   | Boolean                          | No       | Adds a screenshot file to the output. Defaults to off.                                          |
| **Full Page Screenshot** | Boolean                          | No       | When screenshots are enabled, captures the full page instead of the viewport.                   |
| **Only Main Content**    | Boolean                          | No       | Excludes navigation, headers, footers, and similar surrounding content. Defaults to on.         |
| **Mobile**               | Boolean                          | No       | Emulates a mobile device while scraping. Defaults to off.                                       |
| **Headers**              | List of name/value pairs         | No       | Request headers, such as a cookie or user-agent.                                                |
| **Wait For**             | Number                           | No       | Time to wait before scraping, in milliseconds. Defaults to `0`.                                 |
| **Remove Base64 Images** | Boolean                          | No       | Replaces embedded base64 image data with placeholders while retaining alt text. Defaults to on. |

<Warning>
  Headers can contain credentials. Only send them to URLs you trust, and avoid
  exposing private session cookies in workflow outputs or logs.
</Warning>

## Outputs

| Output         | Type            | Available when               | Description                          |
| -------------- | --------------- | ---------------------------- | ------------------------------------ |
| **Content**    | String          | Always                       | Page content in the selected format. |
| **Links**      | List of strings | **Include Links** is on      | Links Firecrawl found on the page.   |
| **Screenshot** | File            | **Include Screenshot** is on | The downloaded page screenshot.      |

Changing either include toggle changes the node's output handles. Check
downstream connections after turning one off.

## Choosing a format

* `markdown` produces compact content suited to summaries, search indexing,
  and language-model prompts.
* `html` returns Firecrawl's cleaned HTML representation.
* `rawHtml` preserves the page's original HTML more closely.

Use **Only Main Content** with Markdown or HTML when page chrome is noise. Turn
it off when headers, navigation, or footer content is part of what you need.

## Troubleshooting

<AccordionGroup>
  <Accordion title="Important text is missing">
    Turn off **Only Main Content** if the text is outside the page's detected
    main region. Increase **Wait For** when the content appears after load.
  </Accordion>

  <Accordion title="The output is unexpectedly large">
    Keep **Remove Base64 Images** on, use `markdown`, and enable **Only Main
    Content**. Embedded images and raw HTML can make results much larger.
  </Accordion>

  <Accordion title="The screenshot output is empty">
    Confirm **Include Screenshot** is enabled. Firecrawl must return a
    screenshot URL for the node to download a file.
  </Accordion>
</AccordionGroup>