fixing typo
This commit is contained in:
parent
d11c58371b
commit
5637fae36c
1 changed files with 0 additions and 4 deletions
|
|
@ -315,10 +315,6 @@ whitelist, the crawler will not follow it.
|
|||
|
||||
### Sitemap crawling _Optional_
|
||||
|
||||
### Sitemap crawling _Optional_
|
||||
|
||||
### Sitemap crawling _Optional_
|
||||
|
||||
Default is the domain of the first elements in the `start_urls`.
|
||||
|
||||
### `min_indexed_level` _Optional_
|
||||
|
|
|
|||
Loading…
Reference in a new issue