We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
bc1be55
Support for reading remote robots.txt files as discussed in #2
