Data Source Configuration Web Crawler Configuration Urls
data class DataSourceConfigurationWebCrawlerConfigurationUrls(val seedUrlConfiguration: DataSourceConfigurationWebCrawlerConfigurationUrlsSeedUrlConfiguration? = null, val siteMapsConfiguration: DataSourceConfigurationWebCrawlerConfigurationUrlsSiteMapsConfiguration? = null)
Constructors
Link copied to clipboard
fun DataSourceConfigurationWebCrawlerConfigurationUrls(seedUrlConfiguration: DataSourceConfigurationWebCrawlerConfigurationUrlsSeedUrlConfiguration? = null, siteMapsConfiguration: DataSourceConfigurationWebCrawlerConfigurationUrlsSiteMapsConfiguration? = null)
Types
Properties
Link copied to clipboard
val seedUrlConfiguration: DataSourceConfigurationWebCrawlerConfigurationUrlsSeedUrlConfiguration? = null
A block that specifies the configuration of the seed or starting point URLs of the websites you want to crawl. You can choose to crawl only the website host names, or the website host names with subdomains, or the website host names with subdomains and other domains that the webpages link to. You can list up to 100
seed URLs. Detailed below.
Link copied to clipboard