How si.edu treats AI agents
si.edu puts a Cloudflare bot challenge in front of plain HTTP clients: robots.txt restricts some paths. Agents need a real browser to fetch it.
| Fact | Value | Source |
|---|---|---|
| Access | Bot challenged | Registry check, unverified, 24 Oct 2026 |
| Bot wall | Cloudflare | Registry check, unverified, 24 Oct 2026 |
| robots.txt | Restricts some paths | Registry check, unverified, 24 Oct 2026 |
Listed in
Questions
Does si.edu block AI bots?
Yes. si.edu puts a Cloudflare bot challenge in front of plain HTTP clients.
Does si.edu use a bot wall?
Yes, a Cloudflare challenge.
How should an agent fetch si.edu?
Agents need a real browser to fetch it.
Use this from an agent
JSON: /v1/origins/si.edu. MCP: https://onlinewebdirectory.net/mcp, tool lookup_origin. Setup: install notes.