nikon/docsearch
1
0
Fork 0
Code Activity Actions

fix and closes algolia/docsearch-configs-private#82

Browse source
This commit is contained in:
Sylvain Pace 2018-08-21 12:07:10 +02:00
parent 9a15bb2a7e
commit 714abba58d
1 changed files with 4 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
docs/src/config-file.md
View file

@ -398,13 +398,13 @@ If used, `min_indexed_level` is ignored.
### `scrape_start_urls` _Optional_
By default, the crawler will not extract content from the pages defined in
`starts_urls`. If you have valuable content on your homepage, you should set
this to `true`.
By default, the crawler will extract content from the pages defined in
`starts_urls`. If you do have valuable content on your `starts_urls` or these pages are duplicates from another one, you should set
this to `false`.
```json
{
"scrape_start_urls": true
"scrape_start_urls": false
}
```