Browse sites
4137 sites with enough checked facts to answer how they treat AI agents.
By category
- Sites open to AI agents
- Sites that block AI agents
- Sites behind a Cloudflare bot challenge
- Sites behind an Akamai bot challenge
- Sites behind other bot walls
- Sites that need JavaScript
- Sites that publish llms.txt
- Sites that publish a feed or sitemap
All sites
- 1024tera.com
- 10jqka.com.cn
- 123moviesfree.net
- 123rf.com
- 15min.lt
- 163.com
- 1688.com
- 18comic.vip
- 1984.is
- 1c.ru
- 1capp.com
- 1cfresh.com
- 1digitech.com
- 1mg.com
- 1password.com
- 1tv.ru
- 1und1.de
- 20min.ch
- 20minutes.fr
- 20minutos.es
- 21vek.by
- 22.cn
- 24.hu
- 247sports.com
- 24h.com.vn
- 24sata.hr
- 24ur.com
- 255md.com
- 257.cz
- 2dehands.be
- 2gis.ru
- 2miners.com
- 2osb.com
- 33apk.com
- 360.cn
- 360.com
- 3bmeteo.com
- 3ds.com
- 3hentai.net
- 3lift.com
- 4.cn
- 405kk.com
- 4chan.org
- 4kwallpapers.com
- 4pda.to
- 4shared.com
- 500px.com
- 51.la
- 51cg1.com
- 52shuku.net
- 53.com
- 58.com
- 69shuba.com
- 7-zip.org
- 7hyy.com
- 7mmtv.sx
- 8x8.vc
- 91porn.com
- 91porna.com
- 91porny.com
- 9gag.com
- 9mod.com
- 9to5mac.com
- a-mo.net
- aa.com
- aa.com.tr
- aad.org
- aajtak.in
- aalto.fi
- aap.org
- aarp.org
- abadis.ir
- abc.com
- abc.es
- abc.net.au
- abcnews.com
- abcp.ru
- abebooks.com
- abema.tv
- about.google
- about.me
- aboutamazon.com
- aboutcookies.org
- abovedomains.com
- abplive.com
- abril.com.br
- absher.sa
- abxxx.com
- accompany.com
- aceimg.com
- acesso.gov.br
- acint.net
- aclu.org
- acm.org
- acorns.com
- acs.org
- action.com
- action1.com
- actu.fr
- acuityscheduling.com
- ad-contents.jp
- ad-delivery.net
- ad-stir.com
- adac.de
- adafruit.com
- adam4adam.com
- adblockplus.org
- addtoany.com
- adelaide.edu.au
- adentifi.com
- adevarul.ro
- adguard.com
- adikteev.com
- adkernel.com
- admanmedia.com
- admaster.cc
- admatic.com.tr
- admatic.de
- adme.media
- administracionelectronica.gob.es
- adnkronos.com
- adobe.com
- adp.com
- adplay.ru
- adroll.com
- adsafeprotected.com
- adspower.net
- adsrvr.org
- adsurge.com
- adswizz.com
- adtarget.com.tr
- adtec.ru
- adtelligent.com
- adultwork.com
- advolve.io
- adweek.com
- adx.ws
- adyen.com
- aepd.es
- aetna.com
- affirm.com
- afr.com
- afribaba.com
- afrinic.net
- afrointroductions.com
- afternic.com
- aftonbladet.se
- ageverif.com
- agoda.com
- ahacdn.me
- ahajournals.org
- ahcdn.com
- ahrefs.com
- aif.ru
- aihelp.net
- aip.org
- airbnb.com
- airtable.com
- airtel.in
- ajax.systems
- ajc.com
- akismet.com
- al.com
- alamy.com
- alarabiya.net
- albumaty.com
- albumoftheyear.org
- alchemer.com
- alchemy.com
- alfasense.com
- algolianet.com
- alibaba.com
- alidns.com
- alipay.com
- aljazeera.com
- aljazeera.net
- allaboutcookies.org
- alldatasheet.com
- allegro.cz
- allegro.hu
- allegro.pl
- allmusic.com
- allocine.fr
- allporncomic.com
- allrecipes.com
- alltel24.ru
- allthefallen.moe
- alltrails.com
- ally.com
- almalinux.org
- alodokter.com
- alphapolis.co.jp
- alphonso.tv
- alrosa.ru
- alura.com.br
- alz.org
- amarujala.com
- amazon.ae
- amazon.ca
- amazon.co.jp
- amazon.co.uk
- amazon.co.za
- amazon.com
- amazon.com.au
- amazon.com.br
- amazon.com.mx
- amazon.com.tr
- amazon.de
- amazon.eg
- amazon.es
- amazon.fr
- amazon.ie
- amazon.in
- amazon.it
- amazon.jobs
- amazon.nl
- amazon.pl
- amazon.sa
- amazon.se
- amazonsilk.com
- ameblo.jp
- ameli.fr
- amocrm.ru
- amplify.com
- amplitude.com
- amspbs.com
- amxrtb.com
- an1.com
- anal.media
- android.com
- androidauthority.com
- anikototv.to
- animanch.com
- anime-sama.to
- animepahe.pw
- aniview.com
- aniwaves.ru
- aniworld.to
- anker-in.com
- anker.com
- annas-archive.gl
- annualreviews.org
- annunci69.it
- ansa.it
- answers.com
- antarvasna3.com
- anthropic.com
- anticheatexpert.com
- anu.edu.au
- anybunny.org
- anysex.com
- aol.com
- ap.org
- apa.org
- apache.org
- apachefriends.org
- apachelounge.com
- apachetoday.com
- apkpure.com
- apkpure.net
- apkvision.org
- apnews.com
- apnic.net
- apollo.io
- appcenter.ms
- appdome.com
- appfolio.com
- apple.com
- apple.news
- appleinsider.com
- applovin.com
- appnext.com
- apptracer.ru
- aps.org
- aptoide.com
- aqsi.ru
- arabx.cam
- arabxn.sex
- aramco.com
- arbada.com
- arbeitsagentur.de
- archdaily.com
- architecturaldigest.com
- archive.is
- archive.org
- archive.ph
- archiveofourown.org
- archives.gov
- archlinux.org
- ardmediathek.de
- arduino.cc
- argentina.gob.ar
- arin.net
- arionplay.com
- arizona.edu
- arkoselabs.com
- arm.com
- arstechnica.com
- articulate.com
- artstation.com
- arxiv.org
- aryion.com
- as.com
- asahi.com
- asana.com
- ask.com
- askubuntu.com
- asm.org
- astro-seek.com
- astrumu.io
- asu.edu
- asurascans.com
- asus.com
- atera.com
- aternos.org
- athemes.com
- athome.co.jp
- atlasobscura.com
- atlassian.com
- atol.ru
- atom.com
- atomex.net
- atptour.com
- attheraces.com
- au.com
- aucey.com
- auchan.fr
- auction.co.kr
- auctollo.com
- audio.com
- audiomack.com
- auone.jp
- auth0.com
- author.today
- authorize.net
- auto.ru
- automattic.com
- autoplius.lt
- autoscout24.de
- autoscout24.it
- autotrader.co.uk
- autotrader.co.za
- auvik.com
- av19t.com
- av380.net
- avant.si
- aviasales.com
- aviasales.ru
- avid.com
- avito.ru
- axiom.trade
- axios.com
- axs.com
- ay.delivery
- ay267.com
- aylanetworks.com
- az24.vn
- azbyka.ru
- azet.sk
- aznude.com
- b92.net
- babesource.com
- backblaze.com
- backlinko.com
- backtrace.io
- badoo.com
- badoocdn.com
- bahn.de
- bain.com
- baishan-cloud.net
- bakusai.com
- bale.ai
- balena-cloud.com
- bambulab.com
- bambuser.com
- banahosting.com
- band.us
- bandcamp.com
- bandlab.com
- bandsintown.com
- banki.ru
- bankier.pl
- bankofamerica.com
- bankrate.com
- baomoi.com
- barchart.com
- barnesandnoble.com
- barracuda.com
- bartleby.com
- basalam.com
- basecamp.com
- bash.com
- batch.com
- bayern.de
- bazaarvoice.com
- bazos.cz
- bazos.sk
- bb.com.br
- bbc.co.uk
- bbc.com
- bbcgoodfood.com
- bblaa.com
- bbpos.com
- bbva.mx
- bc.edu
- bcg.com
- beacons.ai
- beatport.com
- beboo.ru
- bedbathandbeyond.com
- beeg.com
- beeg.porn
- beehiiv.com
- beforward.jp
- beget.com
- beget.tech
- behance.net
- belgium.be
- belkin.com
- bell.ca
- bentley.com
- benzinga.com
- berkeley.edu
- besoccer.com
- bestjavporn.com
- betano.com
- betcity.ru
- bethesda.net
- betika.com
- betking.com
- betpawa.cm
- betpawa.co.tz
- betpawa.com
- betpawa.ug
- betterhelp.com
- betway.co.bw
- betway.co.za
- bfmtv.com
- bfv.de
- bfvideo.site
- bhaskar.com
- bhg.com
- bhojpurisex.site
- bhphotovideo.com
- bi.zone
- bible.com
- biblegateway.com
- biblehub.com
- bidease.com
- bidgx.com
- bidmatic.io
- bidster.net
- bidvol.com
- bigbadtoystore.com
- bigbasket.com
- bigcartel.com
- biglobe.ne.jp
- bigo.sg
- bigolive.tv
- bigthink.com
- bikedekho.com
- bikewale.com
- bild.de
- bilibili.tv
- bill.com
- billboard.com
- binance.com
- binance.info
- bing.com
- biobiochile.cl
- biography.com
- biorxiv.org
- bip.com
- bitbucket.org
- bitchute.com
- bitcoin.org
- bitdrift.io
- bitly.com
- bitnami.com
- bitrix24.ru
- bitrix24.tech
- bittorrent.com
- bl.uk
- blackboard.com
- blacknight.com
- blackrussia.online
- blacktoon418.com
- blastapi.io
- ble.ir
- bleacherreport.com
- bleepingcomputer.com
- blender.org
- blesk.cz
- blic.rs
- blick.ch
- blikk.hu
- bling.com.br
- blismedia.com
- blocket.se
- blog.google