diff --git a/docs/source/documentation/2-docsearch-scraper/2-config-options.html.md.erb b/docs/source/documentation/2-docsearch-scraper/2-config-options.html.md.erb index 584ae71c..44e8537c 100644 --- a/docs/source/documentation/2-docsearch-scraper/2-config-options.html.md.erb +++ b/docs/source/documentation/2-docsearch-scraper/2-config-options.html.md.erb @@ -315,10 +315,6 @@ whitelist, the crawler will not follow it. ### Sitemap crawling _Optional_ -### Sitemap crawling _Optional_ - -### Sitemap crawling _Optional_ - Default is the domain of the first elements in the `start_urls`. ### `min_indexed_level` _Optional_