pulumi-aws-kotlin/com.pulumi.aws.bedrock.kotlin.inputs/AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationArgs

AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationArgs

data class AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationArgs(val crawlerLimits: Output<AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimitsArgs>? = null, val exclusionFilters: Output<List<String>>? = null, val inclusionFilters: Output<List<String>>? = null, val scope: Output<String>? = null, val userAgent: Output<String>? = null) : ConvertibleToJava<AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationArgs>

Constructors

constructor(crawlerLimits: Output<AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationCrawlerLimitsArgs>? = null, exclusionFilters: Output<List<String>>? = null, inclusionFilters: Output<List<String>>? = null, scope: Output<String>? = null, userAgent: Output<String>? = null)

Configuration of crawl limits for the web URLs. See crawler_limits block for details.

List of one or more exclusion regular expression patterns to exclude certain object types that adhere to the pattern.

List of one or more inclusion regular expression patterns to include certain object types that adhere to the pattern.

val scope: Output<String>? = null

Scope of what is crawled for your URLs.

val userAgent: Output<String>? = null

String used for identifying the crawler or a bot when it accesses a web server. Default value is bedrockbot_UUID.

open override fun toJava(): AgentDataSourceDataSourceConfigurationWebConfigurationCrawlerConfigurationArgs