X-Robots-Tag HTTP header parser class
Repo VIPnytt/RobotsTagParser, read from GitHub 8 h ago. VIPnytt has not joined Take My Repo.
VIPnytt/RobotsTagParser is a public repo on GitHub by VIPnytt. X-Robots-Tag HTTP header parser class. It declares the MIT license on GitHub. It is written mainly in PHP, has 1 stars and last changed on 2016-07-15. It is archived: its maker no longer maintains it. Nobody has reviewed it on Take My Repo yet, which says nothing about its quality. Read from GitHub on 2026-11-22.
VIPnytt/RobotsTagParser is a public repo on GitHub by VIPnytt. X-Robots-Tag HTTP header parser class.
It declares the MIT license on GitHub.
Its maker has not tagged a system, so it is unknown here. Its README says what it needs.
Open "Take it" on its page: Take My Repo writes an install plan for your machine and hands it to your AI agent (Claude Code, Codex or Cursor), which asks you before each step. Take My Repo has not tested it on any machine.
No. It is archived on GitHub: its maker no longer maintains it.
Nobody has reviewed it on Take My Repo yet, which says nothing about its quality.
XML Sitemap parser class compliant with the Sitemaps.org protocol.
An extensible robots.txt parser and client library, with full support for every directive and specification.
Clean-Param URL filtering class - Find and remove any duplicate URL