> ## Documentation Index
> Fetch the complete documentation index at: https://docs.zappway.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Website Full Crawl

> Crawl and index entire websites for comprehensive AI training

## Overview

Automatically crawl and extract content from your entire website - all pages, subpages, and docs.

***

## Quick Start

<Steps>
  <Step title="Enter Root URL">E.g., [https://example.com](https://example.com)</Step>
  <Step title="Configure Crawler">Set depth, exclude patterns</Step>
  <Step title="Start Crawl">Process can take minutes to hours</Step>
</Steps>

***

## Configuration

### Crawl Depth

* **Level 1**: Homepage only
* **Level 2**: Homepage + direct links
* **Level 3**: Up to 3 clicks deep
* **Unlimited**: Entire site (Pro plans)

### Exclude Patterns