pulumi-aws-kotlin/com.pulumi.aws.bedrock.kotlin.outputs/AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration

AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration

data class AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfiguration(val crawlerLimits: AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimits? = null, val exclusionFilters: List<String>? = null, val inclusionFilters: List<String>? = null, val scope: String? = null, val userAgent: String? = null)

Constructors

constructor(crawlerLimits: AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimits? = null, exclusionFilters: List<String>? = null, inclusionFilters: List<String>? = null, scope: String? = null, userAgent: String? = null)

Types

Link copied to clipboard
object Companion

Properties

Link copied to clipboard
val crawlerLimits: AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimits? = null

Configuration of crawl limits for the web URLs. See crawler_limits block for details.

Link copied to clipboard
val exclusionFilters: List<String>? = null

List of one or more exclusion regular expression patterns to exclude certain object types that adhere to the pattern.

Link copied to clipboard
val inclusionFilters: List<String>? = null

List of one or more inclusion regular expression patterns to include certain object types that adhere to the pattern.

Link copied to clipboard
val scope: String? = null

Scope of what is crawled for your URLs.

Link copied to clipboard
val userAgent: String? = null

String used for identifying the crawler or a bot when it accesses a web server. Default value is bedrockbot_UUID.