SITEMAP: Difference between revisions
Jump to navigation
Jump to search
Nicole Sharp (talk | contribs) (→ROBOTS) |
Nicole Sharp (talk | contribs) (→ROBOTS) |
||
| Line 93: | Line 93: | ||
== ROBOTS == | == ROBOTS == | ||
Once your sitemap is completed, you can add it to the Robots Exclusion Protocol to be indexed by searchbots. <ref><u><code>[[ROBOTS#SITEMAP]]</code></u></ref> <ref><code>https://www.rfc-editor.org/rfc/rfc9309</code></ref> <ref><code>https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt/</code></ref>  An example "<code>/robots.txt</code>" with a sitemap is given below. | Once your sitemap is completed, you can add it to the Robots Exclusion Protocol to be indexed by searchbots. <ref><u><code>[[ROBOTS#SITEMAP]]</code></u></ref> <ref><code>https://www.rfc-editor.org/rfc/rfc9309</code></ref> <ref><code>https://www.robotstxt.org/</code></ref> <ref><code>https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt/</code></ref>  An example "<code>/robots.txt</code>" with a sitemap is given below. | ||
<code><highlight lang="robots"> | <code><highlight lang="robots"> | ||