From df8f4efc8ec087ecf129ddbf9c3485d42bc11187 Mon Sep 17 00:00:00 2001 From: Sylvain Pace Date: Wed, 22 Aug 2018 17:23:27 +0200 Subject: [PATCH] fix --- docs/src/config-file.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/src/config-file.md b/docs/src/config-file.md index 60fe4c13..38c6b43a 100644 --- a/docs/src/config-file.md +++ b/docs/src/config-file.md @@ -399,7 +399,7 @@ If used, `min_indexed_level` is ignored. ### `scrape_start_urls` _Optional_ By default, the crawler will extract content from the pages defined in -`starts_urls`. If you do have valuable content on your `starts_urls` or these pages are duplicates from another one, you should set +`starts_urls`. If you do not have any valuable content on your `starts_urls` or that some pages are duplicates from another one, you should set this to `false`. ```json