> ## Documentation Index
> Fetch the complete documentation index at: https://prismeai-legacy.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Website to Agent

> Transform website content into conversational AI agents

The Website to Agent template enables you to transform any website's content into a conversational AI agent. This template provides the infrastructure to crawl websites, process their content, and create a knowledge base that powers an intelligent agent capable of answering questions about the site.

## Template Overview

This template includes a complete solution for website-based agents:

* Website crawler configuration
* Content extraction and processing pipelines
* Knowledge base creation and management
* RAG (Retrieval Augmented Generation) configuration
* Conversational agent setup

<CardGroup cols="2">
  <Card title="Automated Crawling" icon="spider">
    Configurable crawler for efficient website content extraction
  </Card>

  <Card title="Intelligent Processing" icon="microchip">
    Content chunking and embedding optimization
  </Card>

  <Card title="Semantic Search" icon="magnifying-glass">
    Advanced retrieval to find the most relevant information
  </Card>

  <Card title="Conversational Interface" icon="message">
    Natural dialogue about website content
  </Card>
</CardGroup>

## Use Cases

<Tabs>
  <Tab title="Documentation Agents">
    Create assistants that help users navigate and understand:

    * Product documentation
    * API references
    * Technical specifications
    * User guides
  </Tab>

  <Tab title="Marketing & Sales">
    Build agents that can discuss:

    * Product features and benefits
    * Pricing information
    * Comparison with competitors
    * Frequently asked questions
  </Tab>

  <Tab title="Knowledge Bases">
    Deploy agents to make corporate websites more accessible:

    * Internal knowledge bases
    * Resource centers
    * Self-service portals
    * Educational content
  </Tab>
</Tabs>

## Key Features

* **Configurable Crawler**: Set crawl depth, URL patterns, and content filters
* **Content Preprocessing**: HTML cleaning, text extraction, and metadata handling
* **Advanced RAG**: Optimized retrieval settings for better answer relevance
* **Citation Support**: Responses reference specific pages and content sources
* **Incremental Updates**: Add new content without rebuilding the entire knowledge base

## Getting Started

For self-hosted Prisme.ai installations, follow these steps:

<Steps>
  <Step title="Download the Template">
    Visit the [Prisme.ai Templates Repository](https://github.com/prismeai/template-website-to-rag-agent) and download the ZIP file
  </Step>

  <Step title="Import the Template">
    In your Prisme.ai instance, go to AI Builder > Import Workspace and upload the ZIP file
  </Step>

  <Step title="Configure the Crawler">
    Enter the website URL and adjust crawling parameters (depth, URL patterns to include/exclude)
  </Step>

  <Step title="Run the Content Pipeline">
    Execute the automation to crawl the website and build the knowledge base
  </Step>

  <Step title="Test and Publish">
    Test the agent's responses and publish it to AI Store when ready
  </Step>
</Steps>

<Note>
  SaaS Prisme.ai users can access this template directly from the Template Gallery.
</Note>

## Performance Considerations

* **Website Size**: Large websites may require adjusting the crawler configuration
* **Content Quality**: The agent's effectiveness depends on the website's content quality
* **Update Frequency**: Consider how often the website content changes and schedule regular updates

## Next Steps

After implementing this template, you can:

* Explore the [SharePoint/Confluence to Agent](/resources/templates/sharepoint-confuence-to-agent) template for internal knowledge bases
* Learn about advanced RAG techniques in [Advanced RAG documentation](/products/ai-knowledge/advanced-rag)
* Add custom tools to extend your agent's capabilities with the [Autonomous Agent with Tools](/resources/templates/autonomous-agent-tools) template