From b1d9eade21996e0c07e54224f4e2c4a3c195fbb1 Mon Sep 17 00:00:00 2001 From: Duncan McClean Date: Tue, 20 Aug 2019 21:26:03 +0100 Subject: [PATCH] docs: fix typo (#789) --- docs/src/inside-the-engine.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/src/inside-the-engine.md b/docs/src/inside-the-engine.md index be415c41..c731863e 100644 --- a/docs/src/inside-the-engine.md +++ b/docs/src/inside-the-engine.md @@ -12,7 +12,7 @@ Each crawl will begin its journey by the value of the `start_urls` you have in your config. It will read those pages and recursively extract and follow every link in those pages until it has browsed every compliant page. -If you have explicitly defined a `sitemap.xml`, our crawler will scrap every +If you have explicitly defined a `sitemap.xml`, our crawler will scrape every provided and compliant page. We do recommend using [a sitemap][1] since it clearly exposes URLs to crawl and avoid missing pages that aren't linked from another one.