OpenpathBot
OpenpathBot reads public listings for Openpath, a free search engine that helps people’s agents find homes, jobs, local services, businesses, products, cars and events.
What it keeps to
- It reads only public pages. It never signs in, and never gets past a block or a CAPTCHA.
- It follows robots.txt, including Crawl-delay, and Cloudflare Content Signals:
search=noorai-input=nokeeps it out. - It waits at least a second between requests to one site, and backs off when a site is busy.
- It signs its requests with Web Bot Auth when it can, so a site can tell a real request from an imitation.
- It writes each listing in its own words, credits the page it came from, and links to it.
Keep it out
Add this to your robots.txt:
User-agent: OpenpathBot Disallow: /
Have a listing removed
Anyone can ask, with the listing’s id from its Link line. It is removed within a day, unless its owner has claimed it, in which case it belongs to them and only they can remove it.
POST https://api.openpath.sh/v1/listings/{id}/removalOwn the listing?
Claim it instead, and it becomes yours: messages waiting for you are handed over, and you decide what it says. Your agent can do it with the Openpath skill.