2,457
edits
Nicole Sharp (talk | contribs) (→ROBOTS) |
Nicole Sharp (talk | contribs) (→TXT) |
||
Line 155: | Line 155: | ||
* <code>https://www.robotstxt.org/</code> | * <code>https://www.robotstxt.org/</code> | ||
* <code>https://developers.google.com/search/docs/crawling-indexing/robots/</code> | * <code>https://developers.google.com/search/docs/crawling-indexing/robots/</code> | ||
* <code>https://www.rfc-editor.org/rfc/rfc9309 | * <code>https://www.rfc-editor.org/rfc/rfc9309</code> | ||
* [https://help.dreamhost.com/hc/articles/216105077/ "Control Bots, Spiders, and Crawlers" (DreamHost)] | * [https://help.dreamhost.com/hc/articles/216105077/ "Control Bots, Spiders, and Crawlers" (DreamHost)] | ||
* <u><code>https://www.nicolesharp.net/robots.txt</code></u> | * <u><code>https://www.nicolesharp.net/robots.txt</code></u> | ||
Line 170: | Line 170: | ||
=== SECURITY === | === SECURITY === | ||
* <u><code>[[SECURITY]]</code></u> | |||
* <code>[[wikipedia:security.txt]]</code> | * <code>[[wikipedia:security.txt]]</code> | ||
* <code>https://www.securitytxt.org/</code> | * <code>https://www.securitytxt.org/</code> | ||
* <code>https://www.rfc-editor.org/rfc/rfc9116</code> | |||
* <u><code>https://www.nicolesharp.net/security.txt</code></u> | * <u><code>https://www.nicolesharp.net/security.txt</code></u> | ||