1
0
Fork 0
This commit is contained in:
Sylvain Pace 2018-08-22 17:23:27 +02:00
parent 129350d6fc
commit df8f4efc8e

View file

@ -399,7 +399,7 @@ If used, `min_indexed_level` is ignored.
### `scrape_start_urls` _Optional_
By default, the crawler will extract content from the pages defined in
`starts_urls`. If you do have valuable content on your `starts_urls` or these pages are duplicates from another one, you should set
`starts_urls`. If you do not have any valuable content on your `starts_urls` or that some pages are duplicates from another one, you should set
this to `false`.
```json