Spidering, crawling, or accessing the site through any automated means is not allowed

Classification: neutral

Weight: 20



Service Title Rating Status Author
IBM "You may only use a crawler to crawl this Web site as permitted by this Web site’s robots.txt protocol, and IBM may block any crawlers in its sole discretion. The use authorized under this agreement is non-commercial in nature (e.g., you may not sell the content you access on or through this Web site.) All other use of this site is prohibited.</p>" DECLINED import script Lv. 10 Bot
App.net "" DECLINED import script Lv. 10 Bot
Kink.com "You must not use any automated script or other software to collect information or content from CyberNet's sites in any way." DECLINED alison Lv. 1 Curator
PrivacyTools "You may not automate access to the forum, or monitor the forum, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." APPROVED user 434 Lv. 2
Airbnb "use any robots, spider, crawler, scraper or other automated means or processes to access" DECLINED (deactivated) Lv. 30 Suspended
Medium "Crawling the Services is allowed if done in accordance with the provisions of our robots.txt file, but scraping the Services is prohibited.</p>" DECLINED (deactivated) Lv. 30 Suspended
Wattpad "Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services." APPROVED LuneSirius Lv. 10 Curator
Indiegogo "or use any kind of software to “crawl” or “spider” any part of the Site" APPROVED LuneSirius Lv. 10 Curator
MeWe "Engage in spidering or harvesting, or participate in the use of software, including spyware, designed to collect data from the Site or Services." DECLINED Peepo Lv. 24 Staff
ShapeShift "(iii) other than as specifically approved in writing, any copying, distributing, or disclosing any part of the Service in any medium, including without limitation by any automated or non-automated “scraping”. (iv) other than as specifically approved in writing, using any automated system, including without limitation “robots,” “spiders,” “offline readers,” etc., to access the Service in a manner that sends more request messages to the ShapeShift servers than a human can reasonably produce in the same period of time by using a conventional on-line web browser" DECLINED barelyaware Lv. 5 Curator
LinkedIn "Develop, support or use software, devices, scripts, robots or any other means or processes (including crawlers, browser plugins and add-ons or any other technology) to scrape the Services or otherwise copy profiles and other data from the Services" APPROVED radiorahim Lv. 4 Curator
Turnitin "You agree not to access (or attempt to access) any of the Services or Site through any automated means (including use of scripts or web crawlers) and shall ensure that You comply with the instructions set out in any robots.txt file present on the Services or Site." APPROVED cherryblossom Lv. 7
Bandcamp "(v) use manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Site." APPROVED Peepo Lv. 24 Staff
W3Schools "spider, crawl, or scrape." APPROVED Dr_Jeff Lv. 39 Staff
yelp " You also agree not to, and will not assist, encourage, or enable others to: <ol> <li>Violate the Terms;</li> <li>Modify, adapt, appropriate, reproduce, distribute, translate, create derivative works or adaptations of, publicly display, sell, trade, or in any way exploit the Site or Site Content (other than Your Content), except as expressly authorized by Yelp;</li> <li>Use any robot, spider, site search/retrieval application, or other automated device, process or means to access, retrieve, scrape, or index any portion of the Site or any Site Content;" DECLINED okfifi Lv. 2
Ko-fi "You may not scrape content from this site and repost such content, either manually or automatically, without Ko-fi’s prior written consent. This site must not be framed on any other site without our prior written permission. We reserve the right to withdraw linking, scraping and framing permission without notice. If you wish to make any use of material on this website other than that set out above, please address your request to info@ko-fi.com." DECLINED unshippedozone Lv. 7 Curator
Alignable "(but not through scraping, spidering, crawling or other technology or software used to access data without the express written consent of Alignable or its Users)" APPROVED Esmooth Lv. 7 Curator
Quake Live "You agree that you will not: (a) use any robot, spider, other automatic device or manual process to monitor or copy our web pages or the content contained herein without Id Software’s prior written permission." DECLINED Quited255 Lv. 4
McDonald's "Use or launch any unauthorized technology or automated system to access the online services or extract content from the online services, including but not limited to spiders, robots, screen scrapers, or offline readers;" APPROVED Peepo Lv. 24 Staff
Boingo " Further, the use of manual or automated software, devices, or other processes to “crawl,” “scrape,” or “spider” any portion of the Services is strictly prohibited." APPROVED Peepo Lv. 24 Staff
New York Times "<p>(ii) use robots, spiders, scripts, service, software or any manual or automatic device, tool, or process designed to data mine or scrape the Content, data or information from the Services, or otherwise access or collect the Content, data or information from the Services using automated means." APPROVED Peepo Lv. 24 Staff
Speedtest by Ookla "(ii) use any robot, spider, site search and/or retrieval application, or other device to retrieve or index any portion of the Services." APPROVED Peepo Lv. 24 Staff
Pornhub "p> <p>Additionally, you agree not to:</p> <p>·&nbsp;use the Websites in any manner that could disable, overburden, damage, or impair the site or interfere with any other party’s use of the Websites, including their ability to engage in real time activities through the Websites;</p> <p>·&nbsp;use any robot, spider, or other automatic device, process, or means to access the Websites for any purpose, including monitoring or copying any of the material on the Websites without our prior written consent" APPROVED Peepo Lv. 24 Staff
Social Blade Spidering or crawling is not allowed APPROVED Mixer Lv. 2
Tolino "tolino tab 8″<i> </i> </li> <li> <i> </i>Aggiornamenti<i> </i> </li> </ul>" DECLINED Zemafra95 Lv. 1
Huawei "You shall not use any form of device, program, or algorithm, including spiders, robots, deep-links, and page-scrapes, or any identical or similar manual program, to access, obtain, copy, or monitor any part of this website or its Content." APPROVED mikkkael Lv. 7 Curator
Bitcasa (discontinued?) "using manual or automated software or other means to access, “scrape,” “crawl” or “spider” any pages" DECLINED stefvanschie Lv. 5 Curator
craigslist "You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." APPROVED Peepo Lv. 24 Staff
Netflix " use any robot, spider, scraper or other automated means to access the Netflix service." APPROVED mrseeker Lv. 4
SparkNotes "use any robot, spider, data miner, crawler, scraper or other automated means to access or index the SparkNotes Site or its systems, the Content or any portion or derivative thereof for any purpose." APPROVED cherryblossom Lv. 7
Dribbble "Use, support or develop bots, scrapers, software, scripts, crawlers, browser plugins, robots or other automated methods including human-powered automation through like farming or any other crowd-sourced methods to access, scrape, or copy the Services, or to add or download data, or send or redirect information or messages;</li>" APPROVED donno Lv. 14 Curator
Nextcloud "You may not automate access to the forum or monitor it with tools like browser plug-ins, web crawlers and the like, unless it is for the purposes of a search engine." APPROVED AgnesDeLion Lv. 91 Staff
Kickstarter "Don’t use any kind of software or device (whether it’s manual or automated) to “crawl” or “spider” any part of the Site.</li>" APPROVED Peepo Lv. 24 Staff
Mega " <p> 15.7.5 to run any network scanning software, spiders, spyware, robots, open relay software or similar software." APPROVED AgnesDeLion Lv. 91 Staff
Discord "use data mining, robots, spiders, or similar data gathering and extraction tools on the Service." DECLINED AD59 Lv. 3
4chan "The use of scrapers, bots, or other automated posting or downloading scripts is prohibited" APPROVED jurius Lv. 4
Malwarebytes "● Attempt to access or search the Services or Content or download Content from the Services through the use of any engine, software, tool, agent, device or mechanism (including spiders, robots, crawlers, data mining tools or the like) other than the software and/or search agents provided by Malwarebytes or other generally available third party web browsers." APPROVED AgnesDeLion Lv. 91 Staff
Xfinity "participate in the collection of very large numbers of email addresses, screen names, or other identifiers of others (without their prior consent) from the Comcast Web Services, a practice sometimes known as spidering or harvesting, or participate in the use of software (including "spyware") designed to facilitate this activity;" APPROVED napen123 Lv. 14
Houseparty "access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Life On Air (and only pursuant to those terms and conditions), unless you have been specifically allowed to do so in a separate agreement with Life On Air (NOTE: scraping the Services without the prior consent of Life On Air is expressly prohibited);" APPROVED Sandova Lv. 7
Tripadvisor "using any robot, spider, scraper or other automated means or any manual process for any purpose not in accordance with this Agreement or without our express written permission;</li> " APPROVED AgnesDeLion Lv. 91 Staff
Metacafe " <li>You agree not to use or launch any automated system, including without limitation, "robots," "spiders," and "offline readers,"" APPROVED AgnesDeLion Lv. 91 Staff
WeMod "spider, crawl," APPROVED Dr_Jeff Lv. 39 Staff
WikiTree "You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Website in a manner that sends more request messages to our servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." APPROVED Reblyn Lv. 7
Twitch "xi. access any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services, by means of any robot, spider, scraper, crawler, or other automated means for any purpose, or bypass any measures Twitch may use to prevent or restrict access to any website, server, software application, or other computer resource owned, used, and/or licensed by Twitch, including but not limited to the Twitch Services;</p>" APPROVED Dr_Jeff Lv. 39 Staff
Free Code Camp "You may not automate access to the website, or monitor the website, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." APPROVED earnes2 Lv. 6
Riot Games (League of Legends) "scrape or expropriate any system, data or personal info;" APPROVED Dr_Jeff Lv. 39 Staff
Prezi "Use or launch any automated system (including, without limitation, any robot, spider or offline reader) that accesses the Service." APPROVED Dr_Jeff Lv. 39 Staff
Strava "<li>Using any automated system, including, without limitation, “robots,” “spiders,” “offline readers,” etc.," APPROVED AgnesDeLion Lv. 91 Staff
Grammarly "<strong>k.</strong> automate access to&nbsp;the Site or&nbsp;the Services, including, without limitation, through the use of APIs, bots, scrapers or&nbsp;other similar devices;</p>" APPROVED thatrobotdev Lv. 4
Instructure "<li>access, search, or create accounts for the Service by any means other than our publicly supported interfaces (for example, "scraping" or creating accounts in bulk);" APPROVED Dr_Jeff Lv. 39 Staff
MattressFirm "copy (whether directly or by use of any "scraping" or related technology) any of the contents of the Site.</p> " APPROVED RocketSLC Lv. 4
Attendify "using any robot, spider, other automatic device, or manual process to monitor, copy, or "scrape" web pages or the content contained in the Services or for any other unauthorized purpose without our prior written consent." APPROVED KnossosDomovoi Lv. 10 Curator
craigslist "you agree not to use or provide software (except general purpose web browsers and email clients) or services that interact or interoperate with CL, e.g. for downloading, uploading, creating/accessing/using an account, posting, flagging, emailing, searching, or mobile use. You agree not to copy/collect CL content via robots, spiders, scripts, scrapers, crawlers, or any automated or manual equivalent (e.g., by hand)." DECLINED Vincent (Mr. 404) Lv. 6 Staff
Course Hero "Crawls,” “scrapes,” or “spiders” any page, data or portion of or relating to the Services or Content (through use of manual or automated means" DECLINED (deactivated) Lv. 30 Suspended
Phone2Action "use any means to scrape or crawl any Web pages or content contained in the Websites or Apps" APPROVED dylankuhn Lv. 4
Merriam-Webster "You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." APPROVED AgnesDeLion Lv. 91 Staff
The Walt Disney Company "<p>x. access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney Products using a robot, spider, scraper or other automated means or manual process without our express written permission;</p>" APPROVED AgnesDeLion Lv. 91 Staff
Alan Thomson Simulation "You are not allowed to download or modify it. This may be done only with written consent from us." DECLINED Mezzie Lv. 7 Curator
BOTLABS.GG LLC "“crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)." APPROVED Holonium Lv. 8
V.H. Hess "spider, crawl, or scrape." APPROVED AgnesDeLion Lv. 91 Staff
Guilded "“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means). </li>" APPROVED AgnesDeLion Lv. 91 Staff
NordVPN "<li>use any robot, spider, scraper, or other automated means to access our website or Services for any purpose without our prior written permission;</li> " DECLINED AgnesDeLion Lv. 91 Staff
Burger King "For example, you may not:</p> <p>Impersonate any person or entity, or misrepresent your credentials or any information you provide;</p> <p>Engage in unauthorized spidering, scraping, or harvesting of content, or use any other unauthorized means to compile information;</p>" APPROVED AgnesDeLion Lv. 91 Staff
Disney+ "vii. access, monitor or copy, or permit another person or entity to access, monitor or copy, any element of the Disney+ Service using a robot, spider, scraper or other automated means without our express written permission;<br>" APPROVED AgnesDeLion Lv. 91 Staff
Encyclopedia Britannica " You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on the Services, except with our express written permission." APPROVED AgnesDeLion Lv. 91 Staff
Nslookup "You must not:</p> <ul> <li>Access our Products through scripts or other means of automation.</li> <li>Scrape our Products.</li> " APPROVED AgnesDeLion Lv. 91 Staff
Schoology "<p>You agree, further, not to use or attempt to use any engine, software, tool, agent or other device or other mechanism (including without limitation browsers, spiders, robots, avatars or intelligent agents) to navigate or search the Products or Content." APPROVED HunterTheProto Lv. 4
Web of Trust "You may not attempt to access the WOT Services by any automated means, including scraping, crawling, data-mining, or using any robot, spider, or other automatic device." APPROVED pederdm000 Lv. 27 Staff
Bloomberg L. P. "You shall not use or attempt to use any “scraper,” “robot,” “bot,” “spider,” “data mining,” “computer code,” or any other automate device, program, tool, algorithm, process or methodology to access, acquire, copy, or monitor any portion of the Service, any data or content found on or accessed through the Service, or any other Service information without the prior express written consent of BLP." APPROVED BlueMantis Lv. 9
Podyssey Podcasts "© access or search or attempt to access or search the Services by any means (automated or otherwise) other than through our currently available, published interfaces that are provided by Podyssey (and only pursuant to those terms and conditions) or unless permitted by Podyssey’s robots.txt file or other robot exclusion mechanisms. (d) scrape the Services, and particularly scrape Content (as defined below) from the Services." APPROVED BlueMantis Lv. 9
LightyearVPN "(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." APPROVED BlueMantis Lv. 9
Однокла́ссники (Ok.ru) Spidering, crawling, or accessing the site through any automated means is not allowed APPROVED AgnesDeLion Lv. 91 Staff
SmartThings "<li>"Crawls," "scrapes," or "spiders" any page or portion of the Services (through use of manual or automated means);</li>" APPROVED welda Lv. 34 Curator
webmail "ou agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Website in a manner that sends more request messages to the Webmail.co.za servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." APPROVED AgnesDeLion Lv. 91 Staff
Washington Post "Engage in unauthorized “scraping” or spidering," APPROVED AgnesDeLion Lv. 91 Staff
Gab "Use any robot, spider, or other automatic device, process, or means to access the Website for any purpose, including monitoring or copying any of the material on the Website." APPROVED BlueMantis Lv. 9
Guiding Tech "You are not permitted to use any computer program tools, including, but not limited to, web spiders, bots, indexers, robots, crawlers, harvesters, or any other automatic device, program or algorithm or any similar equivalent process&nbsp. to access, acquire, copy or monitor any portion of the Website or content" APPROVED AgnesDeLion Lv. 91 Staff
Wickr Me "to use any robot, spider, scraper or other automated means to access the Wickr Services without our express written permission;" APPROVED AgnesDeLion Lv. 91 Staff
Remind "<li>"crawls," "scrapes," or "spiders" any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)." APPROVED AgnesDeLion Lv. 91 Staff
Booking.com "Therefore, you are not allowed to resell, deep link, use, copy, monitor (e.g. spider, scrape), display, download, or reproduce any content" APPROVED AgnesDeLion Lv. 91 Staff
Gettr "You also agree that, in using the Service, you will: (i) not monitor, gather, copy, or distribute the Content (except as may be a result of standard search engine activity or use of a standard browser) on the Service by using any robot, rover, “bot”, spider, scraper, crawler, spyware, engine, device, software, extraction tool, or any other automatic device, utility, or manual process of any kind." APPROVED private prawn Lv. 27 Curator
IMDb "</b> You may not use data mining, robots, screen scraping, or similar data gathering and extraction tools on this site, except with our express written consent as noted below." APPROVED AgnesDeLion Lv. 91 Staff
SpaceHey "generate automated searches, requests, or queries to the Site.</li> </ol>" APPROVED H3 Lv. 7
National Geographic "Use no automated means, including spiders, robots, offline readers, crawlers, data mining tools, or the like to download or store data from the Service." APPROVED Peepo Lv. 24 Staff
Amino ""Crawls," "scrapes," or "spiders" any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);</li>" APPROVED welda Lv. 34 Curator
KeyMe "(v) use manual or automated software, devices, or other processes to "crawl" or "spider" any page of the Application, the Kiosk or Site." APPROVED maxicode Lv. 9
Team SDS "(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." APPROVED pederdm000 Lv. 27 Staff
Roadtrip Nation "access the Services through any automated means (including use of scripts or web crawlers)" APPROVED serph Lv. 13 Curator
Facebook "You may not access or collect data from our Products using automated means (without our prior permission)" APPROVED Peepo Lv. 24 Staff
Monkeytype "scrape the Services, scrape Content from the Services, or use automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Services or otherwise access the Services" APPROVED semi Lv. 4
YNAB. (You Need a Budget) "Use any robot, spider or other automatic device, process or means to access the Website for any purpose, including monitoring or copying any of the material on the Website.</li> " APPROVED yoharnu Lv. 9
StreamingSearch "(g)</b> use, access or attempt to access the Service in connection with any automated means, including robot, spider, crawlers, scrapers or other automatic devices or manual processes.</p>" APPROVED Zakronia Lv. 25
National Hockey League (NHL.com) "Engage in unauthorized spidering, scraping, or harvesting of content or information, or use any other unauthorized automated means to compile information;" APPROVED jerbear4328 Lv. 4
Icedrive "<li>Use any robot, spider, offline readers, site search and/or retrieval application, or other device to retrieve or index any portion of the Services, with the exception of public search engines" APPROVED francopan Lv. 6
vericast "Your Use of the Site You may not use any “deep-link”, “page-scrape”, “robot”, “spider” or other automatic device, program, algorithm or methodology, or any similar or equivalent process to access, acquire, copy or monitor any portion of the Site or Content, or in any way reproduce or circumvent the navigational structure or presentation of the Site or any Content." APPROVED pederdm000 Lv. 27 Staff
Wattpad "Don’t scrape Wattpad. " DECLINED ThisIsLiz Lv. 30 Curator
Xandr "uses any robot, spider, or other such programmatic or automatic device, inducing but not limited to automated dial-in or inquiry devices, to obtain information from the Site or otherwise monitor or copy any portion of the Site, products and/or services;" APPROVED pederdm000 Lv. 27 Staff
icepop "You will not perpetrate, try to perpetrate, or assist anyone in perpetrating or trying to perpetrate any attack on our site, be it by means of viruses, by using automated means (such as harvesting bots, robots, spiders, or scrapers)" APPROVED signed Lv. 10
Transit "(v) automate access to the App or the Services, including, without limitation, through the use of bots, scrapers or other similar devices." APPROVED sierra Lv. 5
Canva "including without limitation by any automated or non-automated “scraping”. (ii) using any automated system, including without limitation “robots,” “spiders,” “offline readers,” etc.," APPROVED JoshAtticus Lv. 10
Vercel "You must not access the Vercel's website through automated methods, including any use of robots or other computer code which calls Vercel's website.</small> " APPROVED pederdm000 Lv. 27 Staff
Jsbin "Accounts registered by ‘bots’ or other automated methods are not permitted" APPROVED Rionnane Lv. 5
Bereal "<li>To extract or use in a repeated and systematic way all or part of the visible information of the Application" APPROVED bend1010 Lv. 6
Rockstar Games "(8) you will not cheat or utilize any unauthorized robot, spider, or other program in connection with the Online Services." APPROVED pederdm000 Lv. 27 Staff
#TeamSeas "including, but not limited to, web spiders, web crawlers, web robots, web ants, web indexers, bots," APPROVED pederdm000 Lv. 27 Staff
Undertheboard "(5) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." APPROVED pederdm000 Lv. 27 Staff
Truth Social "<p>(6) you will not access the Site through automated or non-human means, whether through a bot, script, or otherwise." APPROVED pederdm000 Lv. 27 Staff
Privacy Guides "</p> <p>You must not conduct any systematic or automated data collection activities on or in relation to this website without express written consent from Aragon Ventures LLC, including:</p> <ul> <li>Excessive Automated Scans</li> <li>Denial of Service Attacks</li> <li>Scraping</li> <li>Data Mining</li> <li>‘Framing’ (IFrames)" APPROVED AgnesDeLion Lv. 91 Staff
Inrupt Inc " <p>(g) “crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);</p> <p>(h) copies or stores any significant portion of the Content. or</p> <p>(i) decompiles, reverse engineers, or otherwise attempts to obtain the source code or underlying ideas or information of or relating to the Services.</p> " APPROVED AnAlt Lv. 3
Opera "Crawling or scraping the Services without the prior consent of Opera is strictly prohibited.</p>" APPROVED ELP_JAPIS Lv. 8 Curator
OpenAI "(iv) use any method to extract data from the Services, including web scraping, web harvesting, or web data extraction methods, other than as permitted through the API." APPROVED EarldridgeJazzedPineda Lv. 35
Photomath "(f) scrape, build databases or otherwise create permanent copies of any content derived from the Service, or collect any data incorporated in the Service in any automated manner such as through the use of bots, spiders, crawlers or any other automated means;" APPROVED EarldridgeJazzedPineda Lv. 35
Any.Run "automatically collect information from the Website through a crawler bots or similar software (except for using the API);</li>" APPROVED EarldridgeJazzedPineda Lv. 35
Immunet "monitoring or crawling," APPROVED pederdm000 Lv. 27 Staff
VRchat Spidering, crawling, or accessing the site through any automated means is not allowed APPROVED mika Lv. 5
Toddle "You undertake to not use any manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Service Provider.</p>" APPROVED Aperaine Lv. 3
Filen "(5) you will not access the Site through automated or non-human means, whether through a bot, script or otherwise." APPROVED AgnesDeLion Lv. 91 Staff
Airbnb "Do not use bots, crawlers, scrapers, or other automated means to access or collect data or other content from or otherwise interact with the Airbnb Platform" APPROVED AgnesDeLion Lv. 91 Staff
Talking Tom and Friends "<p>In no event may the Website be used in a manner that:</p> <ul> <li>harasses, abuses, threatens, defames or otherwise infringes or violates the rights of any other party;</li> <li>is unlawful, fraudulent or deceptive;</li> <li>uses technology or other means to access our proprietary information that is not authorized by Us;</li> <li>uses or launches any automated system to access the Website or Store;</li>" APPROVED AgnesDeLion Lv. 91 Staff
Wolt Spidering, crawling, or accessing the site through any automated means is not allowed APPROVED lr19_ Lv. 16
Tubi "involves accessing the Tubi Services (including the Content) through any automated means, including “robots,” “spiders,” or “offline readers” (other than by individually performed searches on publicly accessible search engines for the sole purpose of, and solely to the extent necessary for, creating publicly available search indices - but not caches or archives - of the Tubi Services, excluding those search engines or indices that host, promote, or link primarily to infringing or unauthorized content);</p>" APPROVED EarldridgeJazzedPineda Lv. 35
Forbes "Use any data mining, robot, spider, cancelbot, Trojan horse, or any data gathering, scraping, indexing, or extraction method on any part of the Website or Forbes Channels. </li> <li>" APPROVED AgnesDeLion Lv. 91 Staff
Common Sense Media "Use any robot, spider, site search/retrieval application or other manual or automatic device or process to retrieve, index, “scrape,” “data mine” or in any way gather Site content," APPROVED EarldridgeJazzedPineda Lv. 35
DoorDash "You will not deep-link to our websites or access our websites manually or with any robot, spider, web crawler, extraction software, automated process and/or device to scrape, copy, index, frame, or monitor any portion of our websites or any content on our websites.</p> <p>(p) You will not scrape or otherwise conduct any systematic retrieval of data or other content from the Services." APPROVED EarldridgeJazzedPineda Lv. 35
SoloLearn "“crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);" APPROVED EarldridgeJazzedPineda Lv. 35
YTS "You may access our content only directly through this website and not through any third party website, nor may you allow anyone access to the content on this website without visiting this website." DECLINED YTS Lv. 4
Kaggle "<li>“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means);" APPROVED AgnesDeLion Lv. 91 Staff
DealDash "ou may not use any scraper, crawler, spider, robot, or other automated means of any kind to access or copy data on the Site" APPROVED levijneuwirth Lv. 23
VSCO "(c) taking any action that imposes, or may impose, at our sole discretion an unreasonable or disproportionately large load on our infrastructure, including using any automated system, such as “robots,” “spiders,” “offline readers,” etc. to access the Services" APPROVED levijneuwirth Lv. 23
Spankbang "You agree not to use any automated means, including robots, crawlers or data mining tools, to download, monitor or use data or Content from the Website" APPROVED levijneuwirth Lv. 23
Rakuten "(xiv) use the manual or automated software, devices or other processes to "scrape," "crawl," "spider" or index any page of Content from the Company Properties.</p>" APPROVED EarldridgeJazzedPineda Lv. 35
H&R Block "<p>You may not without our prior written permission, use any computer code, data mining software, “robot,” “bot,” “spider,” “scraper” or other automatic device, or program, algorithm or methodology having similar processes or functionality, or any manual process, to monitor or copy any of the web pages, data or content found on this Website or accessed through this Website." APPROVED levijneuwirth Lv. 23
Never Install "V. using any engine, software, tool, agent or other device or mechanism (such as spiders, robots, avatars or intelligent agents) to navigate or search the Platform;</p>" APPROVED EarldridgeJazzedPineda Lv. 35
KiwiCo "Without our written consent, you may not (i) use any high volume, automated, or electronic means to access the Services (including, without limitation, robots, spiders or scripts)." APPROVED EarldridgeJazzedPineda Lv. 35
Waymo "Use any data mining, robots, or similar data gathering or extraction methods designed to scrape or extract data from our Services" APPROVED levijneuwirth Lv. 23
Project Z "<li>use automated scripts to collect information from or otherwise interact with the Services" APPROVED SecretOperations Lv. 5
MIT Technology Review "use any "robot," "spider," "rover," "scraper," or any other data-mining technology or automatic or manual process to monitor, cache, frame, mask, extract data from, copy, or distribute any data from the Services," APPROVED Deveroonie Lv. 15 Curator
Amethyst Craft "<p>You may not automate access to the forum, or monitor the forum, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser" APPROVED Deveroonie Lv. 15 Curator
tldrlegal "You may not access the Sites through any automated mechanism, including but not limited to automated visits to the Sites, automated queries, automated edits or actions, or any other programmatic access." APPROVED EarldridgeJazzedPineda Lv. 35
Tinder "<li>use any robot, bot, spider, crawler, scraper, site search/retrieval application, proxy or other manual or automatic device, method or process to access, retrieve, index, "data mine", or in any way reproduce or circumvent the navigational structure or presentation of the Service or its contents." APPROVED welda Lv. 34 Curator
American Red Cross "You may not: (i) use any “deep link”, “page scrape”, “robot”, “spider”, or other automatic device" APPROVED serph Lv. 13 Curator
MeWe "<li>Engage in spidering or harvesting, or participate in the use of software, including spyware, designed to collect data from the Site or Services.</li> <li>Use automated methods to use the Site or Services." APPROVED AgnesDeLion Lv. 91 Staff
Poki "You agree that you will not (a) use any robot, spider or other automatic device, process or means to access the Site" APPROVED JoshAtticus Lv. 10
Brilliant "User shall not use any "deep-link", "page-scrape", "robot", "spider" or other automatic device, program, algorithm or methodology, or any similar or equivalent manual process, to access, acquire, copy or monitor any portion of the Service or any Content, or in any way reproduce or circumvent the navigational structure or presentation of the Service or any Content, to obtain or attempt to obtain any materials, documents or information through any means not purposely made available through the Service." APPROVED private prawn Lv. 27 Curator
Brax.Me " You will not collect users' content or information, or otherwise access Brax.Me, using automated means (such as harvesting bots, robots, spiders, or scrapers) without our prior permission" APPROVED AgnesDeLion Lv. 91 Staff
Apple Services "You may not use any "deep-link", "page-scrape", "robot", "spider" or other automatic device, program, algorithm or methodology, or any similar or equivalent manual process, to access, acquire, copy or monitor any portion of the Site or any Content," APPROVED JoshAtticus Lv. 10
Privacy.com "access or monitor any material or information on any Privacy system using any manual process or robot, spider, scraper, or other automated means" APPROVED private prawn Lv. 27 Curator
Entrust "You agree that you will not use, directly or indirectly, any robot, spider, other automatic method or means, or manual process to “screen scrape,” monitor, “mine,” or copy the Web pages on the Site or the content contained therein without Datacard’s prior, express, and written permission." APPROVED pederdm000 Lv. 27 Staff
MyAnimeList "You also agree not to use or launch any automated system, including without limitation, "offline readers," "spiders," "robots," etc." APPROVED MoeTsundere Lv. 8 Suspended
Team SDS "Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services. Don’t use any kind of software, device or method (whether it’s manual or automated) to “crawl”, “spider” or otherwise remove any content from any part of the Site or Services." APPROVED pederdm000 Lv. 27 Staff
Bumble "You agree that you will not:</p> <ul> <li>act in an unlawful or unprofessional manner including being dishonest, abusive or discriminatory;</li> <li>misrepresent your identity, your age, your current or previous positions, qualifications or affiliations with a person or entity;</li> <li>disclose information that you do not have the consent to disclose;</li> <li>stalk or harass any other user of the App;</li> <li>create or operate a pyramid scheme, fraud or other similar practice, or;</li> <li>develop, support or use software, devices, scripts, robots, other types of mobile code or any other means or processes (including crawlers, browser plugins and add-on or other technology) to scrape or otherwise exfiltrate from Bumble or its services, or otherwise copy profiles and other data from the services.</li> </ul>" APPROVED maxer137 Lv. 8 Curator
Crunchyroll "Attempt to access, search or meta-search the Site with any engine, software, tool, agent, device or mechanism other than software and/or search agents provided by Ellation or other generally available third party web browsers (such as Microsoft Internet Explorer, Mozilla Firefox, Safari or Opera), including without limitation any software that sends queries to the Site to determine how a website or web page ranks;" APPROVED lr19_ Lv. 16
Tutor.com "You agree to not engage in spidering, "screen scraping," "database scraping," harvesting </p> <p> of e-mail addresses, wireless addresses or other contact or personal information, or any other automatic means of accessing, logging-in or registering on the Site or for the Services, or obtaining lists of users or obtaining or accessing other information or features on, from or through the Site or the Services, including but not limited to any information residing on any server or database connected to the Site or the Services." APPROVED levijneuwirth Lv. 23
Tapas "You agree not to use or launch any automated system, including without limitation, "robots," "spiders," or "offline readers," that accesses the Service in a manner that attempts to forge the presence of a user accessing the site for the purpose of artificially increasing "pageviews," "subscribers," or "likes" or other elements that contribute to a series popularity or advancement within any programs that Tapas Media offers to users.</p>" APPROVED LuneSirius Lv. 10 Curator
Fandango "You agree that you will not use any robot, spider, other automatic device, or manual process to monitor or copy our Web pages or the content contained therein without prior written permission of an authorized officer of Fandango." APPROVED Peepo Lv. 24 Staff
Meredith "(e) you shall not use any manual or automated software, devices or other processes (including but not limited to spiders, robots, scrapers, crawlers, avatars, data mining tools or the like) to "scrape" or download data from the Services (except that we grant the operators of public search engines revocable permission to use spiders to copy materials from the Website for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials, but not caches or archives of such materials)." APPROVED Peepo Lv. 24 Staff
pCloud " <li>use any means to "scrape," "crawl," or "spider" any web pages contained in the Site " APPROVED AgnesDeLion Lv. 91 Staff
Hulu "uses technology or other means to access, index, frame or link to the Services (including the Content) that is not authorized by Hulu (including by removing, disabling, bypassing, or circumventing any content protection or access control mechanisms intended to prevent the unauthorized download, stream capture, linking, framing, reproduction, access to, or distribution of the Services);</li> <li> involves accessing the Services (including the Content) through any automated means, including "robots," "spiders," or "offline readers" (other than by individually performed searches on publicly accessible search engines for the sole purpose of, and solely to the extent necessary for, creating publicly available search indices - but not caches or archives - of the Services and excluding those search engines or indices that host, promote, or link primarily to infringing or unauthorized content);</li" APPROVED parent5446 Lv. 3
CNN "<li>You agree not to use any service, technology or automated system to artificially inflate the page views that your User Content receives. This includes pay-per-click services, web "robots" and any other current or future technologies. You also agree not to direct any third party to use these services, technologies or automated systems on your behalf." APPROVED Peepo Lv. 24 Staff
Google "misleading others, or scraping content that doesn’t belong to you" APPROVED Dr_Jeff Lv. 39 Staff
PortableApps " You may not use manual or automated software, devices, scripts robots, other means or processes to access, "scrape", "crawl", "spider", or "cache" any of our content, services, updater database, or related data." APPROVED signed Lv. 10
Brainly "You agree not to use any automated tool, such as a web scraping tool, a bot or web robot, or web automation, to mine the Brainly Services or any products, services, information, or other materials available on, through or in connection with the Brainly Services or your Brainly Subscription, including, but not limited to, the Mobile Software, for information or to fill out forms on the Brainly Services, that you will not circumvent any technical measures implemented to prevent or limit such access, and that you will comply with the restrictions in any robot exclusion header" APPROVED (deactivated) Lv. 30 Suspended
BlueStacks "<li>“Crawls,” “scrapes,” or “spiders” any page, data, or portion of or relating to the Services or Content (through use of manual or automated means)" APPROVED (deactivated) Lv. 30 Suspended
Cisco "Disable, disrupt, circumvent, interfere with, or otherwise violate the security of the Site.</li> <li>Attack, abuse, interfere with, intercept, disrupt, or exploit any users, systems, or services, regardless of how accomplished and notwithstanding anything to the contrary in these Terms, including but not limited to Denial of Service (DoS), monitoring, crawling, spamming, using bots or scripts, or distributing malware (such as viruses, Trojan horses, worms, spyware, or adware)." APPROVED Dr_Jeff Lv. 39 Staff
iFunny "iFunny prohibits crawling, scraping, caching or otherwise accessing any Content or User Engagement on the iFunny Service via automated means, except as may be the result of standard search engine protocols or technologies used by a search engine with iFunny's express consent.</p> " APPROVED AgnesDeLion Lv. 91 Staff
Bilibili "未经哔哩哔哩事先明确书面许可,以任何方式(包括但不限于机器人软件、蜘蛛软件、爬虫软件等任何自动程序、脚本、软件)和任何理由自行或委托他人、协助他人获取平台的服务、内容、数据" APPROVED reikousami Lv. 17 Curator
eBay "use any robot, spider, scraper, data mining tools, data gathering and extraction tools, or other automated means to access our Services for any purpose, except with the prior express permission of eBay" APPROVED private prawn Lv. 27 Curator
XE.com "<b>use any automatic or manual process to collect, harvest, gather, or extract information about other visitors to or users of the Services, or otherwise systematically extract data or data fields, including without limitation any financial and/or currency data or e-mail addresses;" APPROVED 281587887a Lv. 12 Curator
Kick Crawling the site through any automated or non-automated means is not allowed APPROVED lr19_ Lv. 16
Omnivore "You may not automate access to the website, or monitor the website, such as with a web crawler, browser plug-in or add-on, or other computer program that is not a web browser." APPROVED UsefulRabbit Lv. 2
Safebooru "You will not use any automated process to retrieve or index any portion of the site or site contents, with the exception of public search engines." APPROVED Deveroonie Lv. 15 Curator
Thumbtack "Use any automated system including but not limited to robots, spiders, offline readers, or scrapers to access the Platform for any purpose without Thumbtack's prior written approval." APPROVED maxicode Lv. 9
Redfin "Accessing the redfin.com in an automated fashion is a violation of the Redfin's terms of use." APPROVED Deveroonie Lv. 15 Curator
Airtable "Except as we otherwise agree in writing or to the extent a restriction is prohibited by law, you agree not to do, and not to assist, permit, or enable any third party or Application (defined below) to do, any of the following:</p> <ol> <li>disassemble, reverse engineer, decode, or decompile any part of Airtable;</li> <li>use any robot, spider, scraper, data mining tool, data gathering or extraction tool, or any other automated means, to access, collect, copy or record Airtable;" APPROVED AgnesDeLion Lv. 91 Staff
Beeper "Use any robot, spider, or other automatic device, process, or means to access Service for any purpose" APPROVED SolarSciencePup Lv. 4
Unity "<p>(l) Use automated means (including “web crawlers,” bots, robots, spiders, scrapers or other types of software or hardware technology) to collect content or information, download materials automatically or otherwise access any Offering;" APPROVED AgnesDeLion Lv. 91 Staff
Project Gutenberg "This website is intended for human users only.</b> Any perceived use of automated tools to access this website will result in a temporary or permanent block of your IP address. " DECLINED (deactivated) Lv. 30 Suspended
Ashley Home And Furniture "<li>use or attempt to use any engine, software, tool, agent, or other device or mechanism (including browsers, spiders, robots, or intelligent agents) to navigate or search the Site other than the search engine and search agents made available on the Site or generally publicly available browsers;" APPROVED ThisIsLiz Lv. 30 Curator
Userstyles.world "<li>You will not access the Site through automated or non-human means, whether through a bot, script, or otherwise with an exception trough our provided API on intended usage" APPROVED shadowwwind Lv. 15 Staff
Embedly "<p>use any robot, spider, other automatic device, or manual process to crawl, index, or copy the Site or the content contained herein;</p>" APPROVED ThisIsLiz Lv. 30 Curator
Pocket "7) use any robot, spider, scraper, or other automated means to access our website or proprietary work for any purpose without our prior written permission." APPROVED Sandova Lv. 7
JojoYou (PriEco) "his includes, but is not limited to, scraping PriEco results" APPROVED shadowwwind Lv. 15 Staff
Pico "<li>use automated scripts to collect information from or otherwise interact with our Services;</li>" APPROVED (deactivated) Lv. 30 Suspended
Whosampled Spidering, crawling, or accessing the site through any automated means is not allowed APPROVED Dimalsing Lv. 8
Socratic "use manual or automated software, devices, or other processes to “crawl” or “spider” any page of the Sit" APPROVED levijneuwirth Lv. 23
Restaurant.com "use any “deep-link”, “page-scrape”, “robot”, “spider”, or other automatic device, program, algorithm, or methodology, or any manual process to access, acquire, copy, or monitor any portion of the Site or any Restaurant.com Content" APPROVED levijneuwirth Lv. 23
OpenVPN "facilitate the attack or disruption of the Cloud Service or use the Cloud Service ,to perform a denial-of-service attack, syn flood, unauthorized access, crawling or" APPROVED DJJ05 Lv. 19
Nike "Do not use any data mining, robots, scraping or similar data gathering methods.</li>" APPROVED levijneuwirth Lv. 23
Pandora "use any systems or means, automated or otherwise, to access, acquire, copy, scrape, harvest, or monitor any part of the Services" APPROVED levijneuwirth Lv. 23
Red Shield VPN "Use our Services for web crawling, scraping, harvesting or other similar activities which might negatively affect rendering of our Services to other users" APPROVED DJJ05 Lv. 19
Thingiverse "introduce software or automated agents or scripts to the Sites or Services so as to produce multiple accounts, generate automated searches, requests and queries, or to strip, scrape, or mine data from the Sites or Services (except that we grant the operators of public search engines revocable permission to use spiders to copy materials from the Sites or Services for the sole purpose of and solely to the extent necessary for creating publicly available searchable indices of the materials, but not caches or archives of such materials)." PENDING plentify Lv. 6
KAYAK "Use of any automated system or software to extract data from Our Website (“screen scraping”), for commercial or non-commercial purposes, is prohibited." APPROVED plentify Lv. 6
Weird Gloop Limited Spidering, crawling, or accessing the site through any automated means is not allowed without prior consent PENDING EarldridgeJazzedPineda Lv. 35
Ouest-France Spidering, crawling, or accessing the site through any automated means is not allowed PENDING AgnesDeLion Lv. 91 Staff
RateYourMusic ">Note: you may not use any automated means to access rateyourmusic.com without our express permission." PENDING 20210 Lv. 1
WatZatSong "You agree not to use or launch any automated system, including without limitation, "robots" "spiders" "offline readers" etc., that accesses the Website in a manner that sends more request messages to the WatZatSong servers in a given period of time than a human can reasonably produce in the same period by using a conventional on-line web browser." PENDING 20210 Lv. 1
Spotify " <li>“crawling” the Spotify Service or otherwise using any automated means (including bots, scrapers, and spiders) to view, access or collect information from Spotify or the Spotify Service;" QUOTE NOT FOUND Dr_Jeff Lv. 39 Staff
Discord "or (iii) use data mining, robots, spiders, or similar data gathering and extraction tools on the Service. " QUOTE NOT FOUND Dr_Jeff Lv. 39 Staff
SpigotMC "Do not access the forums via automated mechanisms.</li>" APPROVED (deactivated) Lv. 30 Suspended
Grammarly "a.</strong> copy, modify or create derivative works based on the Site, Services, Software or Documentation, or any portion(s) of any of the foregoing (individually and collectively, “Grammarly IP”);" DECLINED (deactivated) Lv. 30 Suspended


Comments:
No comments found