Doc/update content update content (#354)
* integrate previous work enhance tyle/content reformat part 1 wait for review * adance start_urls * enhance attributes description * fix typo * proofread documentation/docsearch * add apiKey mention intefrate review and small fixes finished proofreading update sclient-rendering use unseen review * update README #269 * fix json * explain new parameter from algolia/docsearch-scraper#368 , solve algolia/docsearch-configs#321 * enhance as algolia/docsearch-configs#387 * updating flavicon * add FAQ section * made some text corrections * Update 1-customize-configuration-file.html.md.erb * fix bad anchor
This commit is contained in:
parent
683090728c
commit
a7307815a7
1 changed files with 1 additions and 1 deletions
|
|
@ -86,7 +86,7 @@ this precise page will be scraped, crawled and so forth.
|
|||
This **de facto discovery** is really practical but not exhaustive enough.
|
||||
If for any reason, a webpage could not be referenced from another covered one,
|
||||
the scope of the search will be imperfect.
|
||||
For those reasons we highly recommend that you use a **Sitemap** (#).
|
||||
For those reasons we highly recommend that you use a [**Sitemap**](#https://www.sitemaps.org/).
|
||||
This lists every page of your web site and will be used as the **main source of truth**
|
||||
and it will define the roadmap of our scraping.
|
||||
Beside this exhaustivity, using a sitemap introduces a significant performance improvement for our scraper.
|
||||
|
|
|
|||
Loading…
Reference in a new issue