Automated Agent Documentation
newspakshbot/1.0
newspakshbot is the automated feed discovery agent operated by NewsPaksh. It fetches publicly available RSS and Atom syndication feeds to organize and index Indian current affairs coverage.
Identification & Headers
Requests initiated by our ingestion pipeline identify themselves with the following HTTP User-Agent string:
Core Operating Principles
1. Zero Article Body Crawling
newspakshbot only requests public RSS and Atom XML feeds explicitly published for syndication. It never crawls, scrapes, renders, or stores full article bodies behind publisher websites.
2. Ultra-Low Request Frequency
Our pipeline runs once every 24 hours (scheduled at 17:00 IST). Each configured publisher feed is requested exactly once per day. We do not poll continuously, and our agent imposes negligible load on publisher infrastructure.
3. Standard HTTP Politeness
Our agent sends compression headers (gzip, deflate), honors If-Modified-Since and ETag cache validators, respects rate-limiting response codes (429), and adheres to Retry-After headers.
Execution & Network Origin
Requests originate from Google Cloud Functions situated in the asia-south1 (Mumbai, India) region.
Robots.txt & Publisher Opt-Out
If your publication wishes to disallow newspakshbotvia your web server's robots.txt, add the following directive:
Disallow: /
Alternatively, you can request immediate, permanent exclusion from our active registry by emailing our publisher desk from your publication's domain:
Opt-out requests are processed unconditionally within 48 hours of verification.