HUMANS: Difference between revisions
Jump to navigation
Jump to search
Nicole Sharp (talk | contribs) No edit summary |
Nicole Sharp (talk | contribs) (→ROBOTS) |
||
| Line 109: | Line 109: | ||
== ROBOTS == | == ROBOTS == | ||
HUMANS can be added to the Robots Exclusion Protocol ("<code>/robots.txt</code>") as a comment ("<code>#</code>"). <ref><u><code>[[ROBOTS#SECURITY]]</code></u | HUMANS can be added to the Robots Exclusion Protocol ("<code>/robots.txt</code>") as a comment ("<code>#</code>"). <ref><u><code>[[ROBOTS#SECURITY]]</code></u></ref> <ref><code>https://www.robotstxt.org/</code></ref>  An example Robots Exclusion Protocol with HUMANS is given below. | ||
<highlight lang="robots"> | <highlight lang="robots"> | ||