Discussions under General

Can create a fork of this code on github

first post: sjdirect wrote: I've been using your lib for a while and would like to add/extend i...

Added support for "Sitemap:"

first post: sjdirect wrote: Again, please let me know if you would like the changes to incorpor...

Added "crawl-delay" support

first post: sjdirect wrote: I added "crawl-delay" support to your project with unit tests. Plea...

  • 1-3 of 3 discussions
    • Previous
    • 1
    • Next
    • Showing
    • All
    • discussions