[LEAPSECS] how the internet works

[Jonathan E. Hardis]

On Aug 13, 2013, at 8:49 PM, Steve Allen <sla at ucolick.org> wrote:


> I point out that the URL

> https://www.ussg7.org/robots.txt

> currently returns 404

> I believe that most of this forum understands what that means.


Correct me if I'm wrong, but doesn't it mean that the website owner has no objection to anyone indexing or archiving anything on it?

http://www.robotstxt.org/robotstxt.html

   - Jonathan