site Maps Configuration
Parameters
value
Configuration of the sitemap URLs of the websites you want to crawl. Only URLs belonging to the same website host names are crawled. You can list up to three sitemap URLs.
suspend fun siteMapsConfiguration(argument: suspend DataSourceWebCrawlerSiteMapsConfigurationArgsBuilder.() -> Unit)
Parameters
argument
Configuration of the sitemap URLs of the websites you want to crawl. Only URLs belonging to the same website host names are crawled. You can list up to three sitemap URLs.