AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimits

Constructors

constructor(maxPages: Int? = null, rateLimit: Int? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val maxPages: Int? = null

Max number of web pages crawled from your source URLs, up to 25,000 pages.

Link copied to clipboard
val rateLimit: Int? = null

Max rate at which pages are crawled, up to 300 per minute per host.