fix
This commit is contained in:
parent
129350d6fc
commit
df8f4efc8e
1 changed files with 1 additions and 1 deletions
|
|
@ -399,7 +399,7 @@ If used, `min_indexed_level` is ignored.
|
|||
### `scrape_start_urls` _Optional_
|
||||
|
||||
By default, the crawler will extract content from the pages defined in
|
||||
`starts_urls`. If you do have valuable content on your `starts_urls` or these pages are duplicates from another one, you should set
|
||||
`starts_urls`. If you do not have any valuable content on your `starts_urls` or that some pages are duplicates from another one, you should set
|
||||
this to `false`.
|
||||
|
||||
```json
|
||||
|
|
|
|||
Loading…
Reference in a new issue