Robots
| Box | |||
|---|---|---|---|
| HJ Travel | hjtravel.org | EntegraProductionSharedReplacement | Useragent Disallow wpadminAllow wpadminadminajaxphpSitemap httpshjtravelorgsitemapindexxml |
| Locations dovegroup | locations.dovegroup.co.uk | DoveLocationsServerFT | Useragent Disallow |
| funeral | thefuneralcaterer.co.uk | VA1-Replacement | UseragentDisallowcssDisallowincludesDisallowjsDisallowwpadminDisallowwpincludesDisallowwpcontentpluginsDisallowwpcontentcacheDisallowwpcontentthemesDisallowtrackbackDisallowcgibinDisallowsearchDisallowfeedDisallowrssDisallowcommentsfeedDisallowfeedDisallowfeedDisallowfeedrssDisallowtrackbackUseragentTeomaDisallowUseragentGooglebotDisallowswfUseragentDisallowgifDisallowjpgDisallowzipDisallowdocDisallowexeDisallowpdfUseragentiaarchiverDisallowUseragentatSpiderDisallowUseragentb2w01DisallowUseragentBecomeBotDisallowUseragentCheeseBotDisallowUseragentCherryPickerDisallowUseragentCopyRightCheckDisallowUseragentCopernicDisallowUseragentCrescentDisallowUseragentDSurfDisallowUseragentdumbotDisallowUseragentEliteSys EntryDisallowUseragentEmailCollectorDisallowUseragentEmailSiphonDisallowUseragentEmailWolfDisallowUseragentEnterpriseSearch10DisallowUseragentEnterpriseSearchDisallowUseragentesDisallowUseragentExtractorProDisallowUseragentFlaming AttackBotDisallowUseragentFreeFindDisallowUseragentgrubDisallowUseragentgrubclientDisallowUseragentHatena AntennaDisallowUseragentJetbotDisallowUseragentJetbot10DisallowUseragentlarbinDisallowUseragentMail SweeperDisallowUseragentmunkyDisallowUseragentnaverDisallowUseragentNetMechanicDisallowUseragentNutchDisallowUseragentOmniExplorerBotDisallowUseragentOracle Ultra SearchDisallowUseragentPerManDisallowUseragentProWebWalkerDisallowUseragentpsbotDisallowUseragentPythonurllibDisallowUseragentRadiation Retriever 11DisallowUseragentRoverbotDisallowUseragentsearchpreviewDisallowUseragentSiteSnaggerDisallowUseragentsootleDisallowUseragentStanfordDisallowUseragentURLSpiderProDisallowUseragentWebBanditDisallowUseragentWebEmailExtracDisallowUseragentWebVacDisallowUseragentWebZipDisallowUseragentxGetDisallowUseragentwGetDisallowUseragentWebWalkDisallowUseragentwebvacDisallowUseragentWebReaperDisallowUseragentWebMirrorDisallowUseragentWebFetcherDisallowUseragentWebCopyDisallowUseragentwebcopierDisallowUseragentWebCatcherDisallowUseragentw3mirDisallowUseragentvobsubDisallowUseragentTempletonDisallowUseragentssearcher100DisallowUseragentSpiderBotDisallowUseragentShaiHuludDisallowUseragentPBWFDisallowUseragentLightningDownloadDisallowUseragentKDD ExplororDisallowUseragentJeevesDisallowUseragentInternet ExploreDisallowUseragentInfoSpidersDisallowUseragenthttrackDisallowUseragentHavIndexDisallowUseragentGetUrlDisallowUseragentGetBotDisallowUseragentESIRoverDisallowUseragentDownload WonderDisallowUseragentCollageDisallowUseragentLNSpiderguyDisallowUseragentAlexibotDisallowUseragentTeleportDisallowUseragentTeleportProDisallowUseragentStanford Comp SciDisallowUseragentMIIxpcDisallowUseragentTelesoftDisallowUseragentWebsite QuesterDisallowUseragentmoget21DisallowUseragentWebZip40DisallowUseragentWebStripperDisallowUseragentWebSaugerDisallowUseragentWebCopierDisallowUseragentNetAntsDisallowUseragentMister PiXDisallowUseragentWebAutoDisallowUseragentTheNomadDisallowUseragentWWWCollectorEDisallowUseragentRMADisallowUseragentlibWebclsHTTPDisallowUseragentasteriasDisallowUseragenthttplibDisallowUseragentturingosDisallowUseragentspannerDisallowUseragentInfoNaviRobotDisallowUseragentHarvest15DisallowUseragentBullseye10DisallowUseragentCrescent Internet ToolPak HTTP OLE Control v10DisallowUseragentCherryPickerSE10DisallowUseragentCherryPickerElite10DisallowUseragentWebBandit350DisallowUseragentNICErsPRODisallowUseragentMicrosoft URL Control 5014511DisallowUseragentDittoSpyderDisallowUseragentFoobotDisallowUseragentSpankBotDisallowUseragentBotALotDisallowUseragentlwptrivial134DisallowUseragentlwptrivialDisallowUseragentBunnySlippersDisallowUseragentMicrosoft URL Control 6008169DisallowUseragentURLy WarningDisallowUseragentWget16DisallowUseragentWget153DisallowUseragentWgetDisallowUseragentLinkWalkerDisallowUseragentcosmosDisallowUseragentmogetDisallowUseragenthloaderDisallowUseragentURL ControlDisallowUseragentZeus Link ScoutDisallowUseragentZeus 32297 Webster Pro V29 Win32DisallowUseragentWebster ProDisallowUseragentEroCrawlerDisallowUseragentLinkScan81a UnixDisallowUseragentKeyword Density09DisallowUseragentKenjin SpiderDisallowUseragentIron33102DisallowUseragentBookmark search toolDisallowUseragentGetRight42DisallowUseragentFairAd ClientDisallowUseragentGaisbotDisallowUseragenthumanlinksDisallowUseragentLinkextractorProDisallowUseragentOffline ExplorerDisallowUseragentMata HariDisallowUseragentLexiBotDisallowUseragentWeb Image CollectorDisallowUseragentThe IntraformantDisallowUseragentTrueRobot10DisallowUseragentTrueRobotDisallowUseragentBlowFish10DisallowUseragentJennyBotDisallowUseragentMIIxpc42DisallowUseragentBuiltBotToughDisallowUseragentProPowerBot214DisallowUseragentBackDoorBot10DisallowUseragenttoCrawlUrlDispatcherDisallowUseragentWebEnhancerDisallowUseragentsuzuranDisallowUseragentVCI WebViewer VCI WebViewer Win32DisallowUseragentVCIDisallowUseragentSzukacz14DisallowUseragentQueryN MetasearchDisallowUseragentOpenfindDisallowUseragentZeusDisallowUseragentRepoMonkey Bait Tacklev101DisallowUseragentRepoMonkeyDisallowUseragentMicrosoft URL ControlDisallowUseragentOpenbotDisallow |
| samsonawnings2024 | samsonawnings.co.uk | WP08 | START YOAST BLOCK Useragent DisallowSitemap httpswwwsamsonawningscouksitemapindexxml END YOAST BLOCK |
| Delkim2 | archive.delkim.co.uk | Delkim2 | Useragent Disallow healthphp |
| smartconservatorysolutions.com | smartconservatorysolutions.co.uk | SMARTCON-2025REPLACEMENT | UseragentDisallowcssDisallowincludesDisallowjsDisallowwpadminDisallowwpincludesDisallowwpcontentpluginsDisallowwpcontentcacheDisallowwpcontentthemesDisallowtrackbackDisallowcgibinDisallowsearchDisallowfeedDisallowrssDisallowcommentsfeedDisallowfeedDisallowfeedDisallowfeedrssDisallowtrackbackUseragentTeomaDisallowUseragentGooglebotDisallowswfUseragentDisallowgifDisallowjpgDisallowzipDisallowdocDisallowexeDisallowpdfUseragentiaarchiverDisallowUseragentatSpiderDisallowUseragentb2w01DisallowUseragentBecomeBotDisallowUseragentCheeseBotDisallowUseragentCherryPickerDisallowUseragentCopyRightCheckDisallowUseragentCopernicDisallowUseragentCrescentDisallowUseragentDSurfDisallowUseragentdumbotDisallowUseragentEliteSys EntryDisallowUseragentEmailCollectorDisallowUseragentEmailSiphonDisallowUseragentEmailWolfDisallowUseragentEnterpriseSearch10DisallowUseragentEnterpriseSearchDisallowUseragentesDisallowUseragentExtractorProDisallowUseragentFlaming AttackBotDisallowUseragentFreeFindDisallowUseragentgrubDisallowUseragentgrubclientDisallowUseragentHatena AntennaDisallowUseragentJetbotDisallowUseragentJetbot10DisallowUseragentlarbinDisallowUseragentMail SweeperDisallowUseragentmunkyDisallowUseragentnaverDisallowUseragentNetMechanicDisallowUseragentNutchDisallowUseragentOmniExplorerBotDisallowUseragentOracle Ultra SearchDisallowUseragentPerManDisallowUseragentProWebWalkerDisallowUseragentpsbotDisallowUseragentPythonurllibDisallowUseragentRadiation Retriever 11DisallowUseragentRoverbotDisallowUseragentsearchpreviewDisallowUseragentSiteSnaggerDisallowUseragentsootleDisallowUseragentStanfordDisallowUseragentURLSpiderProDisallowUseragentWebBanditDisallowUseragentWebEmailExtracDisallowUseragentWebVacDisallowUseragentWebZipDisallowUseragentxGetDisallowUseragentwGetDisallowUseragentWebWalkDisallowUseragentwebvacDisallowUseragentWebReaperDisallowUseragentWebMirrorDisallowUseragentWebFetcherDisallowUseragentWebCopyDisallowUseragentwebcopierDisallowUseragentWebCatcherDisallowUseragentw3mirDisallowUseragentvobsubDisallowUseragentTempletonDisallowUseragentssearcher100DisallowUseragentSpiderBotDisallowUseragentShaiHuludDisallowUseragentPBWFDisallowUseragentLightningDownloadDisallowUseragentKDD ExplororDisallowUseragentJeevesDisallowUseragentInternet ExploreDisallowUseragentInfoSpidersDisallowUseragenthttrackDisallowUseragentHavIndexDisallowUseragentGetUrlDisallowUseragentGetBotDisallowUseragentESIRoverDisallowUseragentDownload WonderDisallowUseragentCollageDisallowUseragentLNSpiderguyDisallowUseragentAlexibotDisallowUseragentTeleportDisallowUseragentTeleportProDisallowUseragentStanford Comp SciDisallowUseragentMIIxpcDisallowUseragentTelesoftDisallowUseragentWebsite QuesterDisallowUseragentmoget21DisallowUseragentWebZip40DisallowUseragentWebStripperDisallowUseragentWebSaugerDisallowUseragentWebCopierDisallowUseragentNetAntsDisallowUseragentMister PiXDisallowUseragentWebAutoDisallowUseragentTheNomadDisallowUseragentWWWCollectorEDisallowUseragentRMADisallowUseragentlibWebclsHTTPDisallowUseragentasteriasDisallowUseragenthttplibDisallowUseragentturingosDisallowUseragentspannerDisallowUseragentInfoNaviRobotDisallowUseragentHarvest15DisallowUseragentBullseye10DisallowUseragentCrescent Internet ToolPak HTTP OLE Control v10DisallowUseragentCherryPickerSE10DisallowUseragentCherryPickerElite10DisallowUseragentWebBandit350DisallowUseragentNICErsPRODisallowUseragentMicrosoft URL Control 5014511DisallowUseragentDittoSpyderDisallowUseragentFoobotDisallowUseragentSpankBotDisallowUseragentBotALotDisallowUseragentlwptrivial134DisallowUseragentlwptrivialDisallowUseragentBunnySlippersDisallowUseragentMicrosoft URL Control 6008169DisallowUseragentURLy WarningDisallowUseragentWget16DisallowUseragentWget153DisallowUseragentWgetDisallowUseragentLinkWalkerDisallowUseragentcosmosDisallowUseragentmogetDisallowUseragenthloaderDisallowUseragentURL ControlDisallowUseragentZeus Link ScoutDisallowUseragentZeus 32297 Webster Pro V29 Win32DisallowUseragentWebster ProDisallowUseragentEroCrawlerDisallowUseragentLinkScan81a UnixDisallowUseragentKeyword Density09DisallowUseragentKenjin SpiderDisallowUseragentIron33102DisallowUseragentBookmark search toolDisallowUseragentGetRight42DisallowUseragentFairAd ClientDisallowUseragentGaisbotDisallowUseragenthumanlinksDisallowUseragentLinkextractorProDisallowUseragentOffline ExplorerDisallowUseragentMata HariDisallowUseragentLexiBotDisallowUseragentWeb Image CollectorDisallowUseragentThe IntraformantDisallowUseragentTrueRobot10DisallowUseragentTrueRobotDisallowUseragentBlowFish10DisallowUseragentJennyBotDisallowUseragentMIIxpc42DisallowUseragentBuiltBotToughDisallowUseragentProPowerBot214DisallowUseragentBackDoorBot10DisallowUseragenttoCrawlUrlDispatcherDisallowUseragentWebEnhancerDisallowUseragentsuzuranDisallowUseragentVCI WebViewer VCI WebViewer Win32DisallowUseragentVCIDisallowUseragentSzukacz14DisallowUseragentQueryN MetasearchDisallowUseragentOpenfindDisallowUseragentZeusDisallowUseragentRepoMonkey Bait Tacklev101DisallowUseragentRepoMonkeyDisallowUseragentMicrosoft URL ControlDisallowUseragentOpenbotDisallow |
| BCIE | bcie.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| UK Sleepers 2024 | uksleepers.co.uk | EntegraProductionSharedReplacement | Useragent Allow Sitemap httpswwwfreetimerscomsitemap |
| Walterblom | walterblom.com | New-Walterblom |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Uktimberfuels | uktimberfuels.co.uk | UKT2r |
# robots.txt automatically generated by PrestaShop e-commerce open-source solution # https://www.prestashop.com - https://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # https://www.robotstxt.org/robotstxt.html User-agent: * # Allow Directives Allow: */modules/*.css Allow: */modules/*.js Allow: */modules/*.png Allow: */modules/*.jpg Allow: /js/jquery/* # Private pages Disallow: /*?order= Disallow: /*?tag= Disallow: /*?id_currency= Disallow: /*?search_query= Disallow: /*?back= Disallow: /*?n= Disallow: /*&order= Disallow: /*&tag= Disallow: /*&id_currency= Disallow: /*&search_query= Disallow: /*&back= Disallow: /*&n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories for fuels.mconie.uk Disallow: /app/ Disallow: /cache/ Disallow: /classes/ Disallow: /config/ Disallow: /controllers/ Disallow: /download/ Disallow: /js/ Disallow: /localization/ Disallow: /log/ Disallow: /mails/ Disallow: /modules/ Disallow: /override/ Disallow: /pdf/ Disallow: /src/ Disallow: /tools/ Disallow: /translations/ Disallow: /upload/ Disallow: /var/ Disallow: /vendor/ Disallow: /webservice/ Disallow: /en/app/ Disallow: /en/cache/ Disallow: /en/classes/ Disallow: /en/config/ Disallow: /en/controllers/ Disallow: /en/download/ Disallow: /en/js/ Disallow: /en/localization/ Disallow: /en/log/ Disallow: /en/mails/ Disallow: /en/modules/ Disallow: /en/override/ Disallow: /en/pdf/ Disallow: /en/src/ Disallow: /en/tools/ Disallow: /en/translations/ Disallow: /en/upload/ Disallow: /en/var/ Disallow: /en/vendor/ Disallow: /en/webservice/ Disallow: /gb/app/ Disallow: /gb/cache/ Disallow: /gb/classes/ Disallow: /gb/config/ Disallow: /gb/controllers/ Disallow: /gb/download/ Disallow: /gb/js/ Disallow: /gb/localization/ Disallow: /gb/log/ Disallow: /gb/mails/ Disallow: /gb/modules/ Disallow: /gb/override/ Disallow: /gb/pdf/ Disallow: /gb/src/ Disallow: /gb/tools/ Disallow: /gb/translations/ Disallow: /gb/upload/ Disallow: /gb/var/ Disallow: /gb/vendor/ Disallow: /gb/webservice/ # Files Disallow: /*en/password-recovery Disallow: /*en/address Disallow: /*en/addresses Disallow: /*en/login Disallow: /*en/cart Disallow: /*en/discount Disallow: /*en/order-history Disallow: /*en/identity Disallow: /*en/my-account Disallow: /*en/order-follow Disallow: /*en/credit-slip Disallow: /*en/order Disallow: /*en/search Disallow: /*en/guest-tracking Disallow: /*en/order-confirmation Disallow: /*gb/password-recovery Disallow: /*gb/address Disallow: /*gb/addresses Disallow: /*gb/login Disallow: /*gb/cart Disallow: /*gb/discount Disallow: /*gb/order-history Disallow: /*gb/identity Disallow: /*gb/my-account Disallow: /*gb/order-follow Disallow: /*gb/credit-slip Disallow: /*gb/order Disallow: /*gb/search Disallow: /*gb/guest-tracking Disallow: /*gb/order-confirmation |
| Hillcrest | hillcrestestates.co.uk | WP03 |
# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://hillcrestestates.co.uk/sitemap_index.xml # --------------------------- # END YOAST BLOCK |
| Flatmanagers | flatmanagers.co.uk | WP03 |
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.flatmanagers.co.uk/sitemap_index.xml |
| vasectomy-reversals.co.uk | vasectomy-reversals.co.uk | WP01-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /health.php User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| uk-oakbeams.co.uk | uk-oakbeams.co.uk | WP01-Replacement |
User-agent: * Allow: / Sitemap: https://www.uk-oak.co.uk/sitemap |
| thefuneralcaterer.com | thefuneralcaterer.com | WP01-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| baptismalgiftsandclothing.com | baptismalgiftsandclothing.com | WP01-Replacement | UseragentDisallowcssDisallowincludesDisallowjsDisallowwpadminDisallowwpincludesDisallowwpcontentpluginsDisallowwpcontentcacheDisallowwpcontentthemesDisallowtrackbackDisallowcgibinDisallowsearchDisallowfeedDisallowrssDisallowcommentsfeedDisallowfeedDisallowfeedDisallowfeedrssDisallowtrackbackUseragentTeomaDisallowUseragentGooglebotDisallowswfUseragentDisallowgifDisallowjpgDisallowzipDisallowdocDisallowexeDisallowpdfUseragentiaarchiverDisallowUseragentatSpiderDisallowUseragentb2w01DisallowUseragentBecomeBotDisallowUseragentCheeseBotDisallowUseragentCherryPickerDisallowUseragentCopyRightCheckDisallowUseragentCopernicDisallowUseragentCrescentDisallowUseragentDSurfDisallowUseragentdumbotDisallowUseragentEliteSys EntryDisallowUseragentEmailCollectorDisallowUseragentEmailSiphonDisallowUseragentEmailWolfDisallowUseragentEnterpriseSearch10DisallowUseragentEnterpriseSearchDisallowUseragentesDisallowUseragentExtractorProDisallowUseragentFlaming AttackBotDisallowUseragentFreeFindDisallowUseragentgrubDisallowUseragentgrubclientDisallowUseragentHatena AntennaDisallowUseragentJetbotDisallowUseragentJetbot10DisallowUseragentlarbinDisallowUseragentMail SweeperDisallowUseragentmunkyDisallowUseragentnaverDisallowUseragentNetMechanicDisallowUseragentNutchDisallowUseragentOmniExplorerBotDisallowUseragentOracle Ultra SearchDisallowUseragentPerManDisallowUseragentProWebWalkerDisallowUseragentpsbotDisallowUseragentPythonurllibDisallowUseragentRadiation Retriever 11DisallowUseragentRoverbotDisallowUseragentsearchpreviewDisallowUseragentSiteSnaggerDisallowUseragentsootleDisallowUseragentStanfordDisallowUseragentURLSpiderProDisallowUseragentWebBanditDisallowUseragentWebEmailExtracDisallowUseragentWebVacDisallowUseragentWebZipDisallowUseragentxGetDisallowUseragentwGetDisallowUseragentWebWalkDisallowUseragentwebvacDisallowUseragentWebReaperDisallowUseragentWebMirrorDisallowUseragentWebFetcherDisallowUseragentWebCopyDisallowUseragentwebcopierDisallowUseragentWebCatcherDisallowUseragentw3mirDisallowUseragentvobsubDisallowUseragentTempletonDisallowUseragentssearcher100DisallowUseragentSpiderBotDisallowUseragentShaiHuludDisallowUseragentPBWFDisallowUseragentLightningDownloadDisallowUseragentKDD ExplororDisallowUseragentJeevesDisallowUseragentInternet ExploreDisallowUseragentInfoSpidersDisallowUseragenthttrackDisallowUseragentHavIndexDisallowUseragentGetUrlDisallowUseragentGetBotDisallowUseragentESIRoverDisallowUseragentDownload WonderDisallowUseragentCollageDisallowUseragentLNSpiderguyDisallowUseragentAlexibotDisallowUseragentTeleportDisallowUseragentTeleportProDisallowUseragentStanford Comp SciDisallowUseragentMIIxpcDisallowUseragentTelesoftDisallowUseragentWebsite QuesterDisallowUseragentmoget21DisallowUseragentWebZip40DisallowUseragentWebStripperDisallowUseragentWebSaugerDisallowUseragentWebCopierDisallowUseragentNetAntsDisallowUseragentMister PiXDisallowUseragentWebAutoDisallowUseragentTheNomadDisallowUseragentWWWCollectorEDisallowUseragentRMADisallowUseragentlibWebclsHTTPDisallowUseragentasteriasDisallowUseragenthttplibDisallowUseragentturingosDisallowUseragentspannerDisallowUseragentInfoNaviRobotDisallowUseragentHarvest15DisallowUseragentBullseye10DisallowUseragentCrescent Internet ToolPak HTTP OLE Control v10DisallowUseragentCherryPickerSE10DisallowUseragentCherryPickerElite10DisallowUseragentWebBandit350DisallowUseragentNICErsPRODisallowUseragentMicrosoft URL Control 5014511DisallowUseragentDittoSpyderDisallowUseragentFoobotDisallowUseragentSpankBotDisallowUseragentBotALotDisallowUseragentlwptrivial134DisallowUseragentlwptrivialDisallowUseragentBunnySlippersDisallowUseragentMicrosoft URL Control 6008169DisallowUseragentURLy WarningDisallowUseragentWget16DisallowUseragentWget153DisallowUseragentWgetDisallowUseragentLinkWalkerDisallowUseragentcosmosDisallowUseragentmogetDisallowUseragenthloaderDisallowUseragentURL ControlDisallowUseragentZeus Link ScoutDisallowUseragentZeus 32297 Webster Pro V29 Win32DisallowUseragentWebster ProDisallowUseragentEroCrawlerDisallowUseragentLinkScan81a UnixDisallowUseragentKeyword Density09DisallowUseragentKenjin SpiderDisallowUseragentIron33102DisallowUseragentBookmark search toolDisallowUseragentGetRight42DisallowUseragentFairAd ClientDisallowUseragentGaisbotDisallowUseragenthumanlinksDisallowUseragentLinkextractorProDisallowUseragentOffline ExplorerDisallowUseragentMata HariDisallowUseragentLexiBotDisallowUseragentWeb Image CollectorDisallowUseragentThe IntraformantDisallowUseragentTrueRobot10DisallowUseragentTrueRobotDisallowUseragentBlowFish10DisallowUseragentJennyBotDisallowUseragentMIIxpc42DisallowUseragentBuiltBotToughDisallowUseragentProPowerBot214DisallowUseragentBackDoorBot10DisallowUseragenttoCrawlUrlDispatcherDisallowUseragentWebEnhancerDisallowUseragentsuzuranDisallowUseragentVCI WebViewer VCI WebViewer Win32DisallowUseragentVCIDisallowUseragentSzukacz14DisallowUseragentQueryN MetasearchDisallowUseragentOpenfindDisallowUseragentZeusDisallowUseragentRepoMonkey Bait Tacklev101DisallowUseragentRepoMonkeyDisallowUseragentMicrosoft URL ControlDisallowUseragentOpenbotDisallow |
| Vasecrev | vasectomyreversals.co.uk | VA1-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /health.php User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Timbergd | timbergaragedoors.co.uk | VA1-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Tarle2 | tarletontravel.com | WP01-Replacement | START YOAST BLOCK Useragent DisallowSitemap httpswwwtarletongolfcomsitemapindexxml END YOAST BLOCK |
| Doordraw | doorsanddrawers.co.uk | VA1-Replacement |
User-agent: * Allow: / Disallow: *?lightbox= # Optimization for Google Ads Bot User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google Disallow: /_partials* Disallow: /pro-gallery-webapp/v1/galleries/* # Block PetalBot User-agent: PetalBot Disallow: / # Crawl delay for overly enthusiastic bots User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10 Sitemap: https://doorsanddrawers.co.uk/sitemap.xml # Auto generated, go to SEO Tools > Robots.txt Editor to change this |
| Wroughtiron | wroughtirongatesdirect.co.uk | VA1-Replacement |
User-agent: * Allow: / Disallow: /wp-admin Disallow: /health.php Sitemap: https://www.wroughtirongatesdirect.co.uk/sitemap-index.xml |
| EntegraHub | entegrahub.uk-timber.co.uk | UKTHub |
User-agent: * Disallow: |
| Sandwich | blahblahcatering.co.uk | UKF4-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /health.php User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Outside | ukglassrooms.co.uk | UKF4-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Jdaniels | jdelectrical.co.uk | UKF4-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Breakfast | namedroppers.org.uk | UKF4-Replacement | DOCTYPE html PUBLIC W3CDTD XHTML 10 TransitionalEN httpwwww3orgTRxhtml1DTDxhtml1transitionaldtdhtml xmlnshttpwwww3org1999xhtml headtitletitlemeta namekeywords contentBusiness Networking Northampton Networking Events Northampton Businesses Northants Northamptonshire Networking Networking meetings Networking members business networking networking membership networking groups business referrals sales leadsmeta namedescription contentName Droppers is a Northampton Business Networking organisation run and owned by the members Generate new sales and business with quality referralsmeta httpequivContentType contenttexthtml charsetutf8 link relicon hreftemplatesdefaultimagesfaviconico typeimagexicon link relshortcut icon hreftemplatesdefaultimagesfaviconico typeimagexicon link relstylesheet typetextcss hreftemplatesdefaultcssresetcss link relstylesheet typetextcss hreftemplatesdefaultcsslayoutcss link relstylesheet typetextcss hreftemplatesdefaultcssmenucss link relstylesheet typetextcss hreftemplatesdefaultcssmaincss link relstylesheet typetextcss hreftemplatesdefaultcssthickboxcss script typetextjavascript srctemplatesdefaultjsjquery132minjsscriptscript typetextjavascript srctemplatesdefaultjsjquerynospamjsscriptscript typetextjavascript srctemplatesdefaultjsdefaultjsscriptscript typetextjavascript srctemplatesdefaultjsthickboxjsscriptscript typetextjavascript srctemplatesdefaultjsACRunActiveContentjsscript head body h1 idfttitleh1 div idwrapperdiv idcontainer div idheader div idmenumainh ul classdropdown li classhomea hrefhttpwwwnamedroppersorguk titleHomeaul classsubmenulia hrefaboutnamedroppersspanAbout Name Droppersspanaliulli li classmembersa hrefhttpwwwnamedroppersorgukmembers titleMembersaul classdropdown submenulia hrefhowtojoinnamedroppersspanHow to Join Name Droppersspanaliulli li classbenefitsa hrefhttpwwwnamedroppersorgukbenefits titleBenefitsali li classguaranteea hrefhttpwwwnamedroppersorgukguarantee titleGuaranteeali li classtestimonialsa hrefhttpwwwnamedroppersorguktestimonials titleTestimonialsali li classfaqa hrefhttpwwwnamedroppersorgukfaqs titleFAQsali li classmeetingplacea hrefhttpwwwnamedroppersorgukmeetingplace titleMeeting Placeali li classcontactusa hrefhttpwwwnamedroppersorgukcontactus titleContact Usali ul div classcleardiv div div classbanner img srctemplatesdefaultimagesheadermembersjpg width970 height240 altbanner div div classlogin form idfrmsearch namefrmsearch classfrmsearch actionhttpwwwnamedroppersorguknewssearch methodget input namesearch typetext idsearch valuesearch onfocusclearSearchthissearch onbluraddSearchthissearch onkeypressreturn submitenterthiseventa hrefjavascriptdocumentfrmsearchsubmit classcmd cmdsearchaa hrefhttpwwwnamedroppersorguknewssearchadvanced searcha input typehidden nametask valuesearch form form idfrmlogin namefrmlogin classfrmlogin action methodpost input typehidden nameregistrantLogin value1 a hrefhttpwwwnamedroppersorgukforgotpasswordforgot passworda input idusername nameusername valueemail address typetext onfocusclearSearchthisemail address onbluraddSearchthisemail address input typepassword valuepass word idpassword namepassword onfocusclearSearchthispass word onbluraddSearchthispass word onkeypressreturn submitenterthisevent a hrefjavascriptdocumentfrmloginsubmit classcmd cmdlogina form div div classcleardiv div div idcolWrapper div idcolcentre pThe page you are looking for doesnt seem to be available or doesnt exist please make sure you have typed the URL in the address bar correctly if you have then please contact our administratorspdiv classcleardiv div div idcolright Begin News Module div classmodnewsh2a hrefhttpwwwnamedroppersorguknewsNewsah2ullispan classtitleemema hrefhttpwwwnamedroppersorguknews125 titleMartin Bell OBEMartin Bell OBEaspanspanWell give you a Bell in the morningHeard it spanliul p classshowalla hrefhttpwwwnamedroppersorguknews titleShow All NewsShow All Newsap div classcleardivdivdiv classcleardivEnd News Module Begin Next Meeting Module div classmodnewsh2a hrefhttpwwwnamedroppersorguknextmeetingNext Meetingah2ullipbThursday 23rd August 700pm ndash Late ndash Brampton Heath Golf ClubbppYou are invited to laze away this summer evening on a private terrace overlooking the golf course and idyllic open countryside beyond as you tuck in to a sizzling hot hog roast and savour a glass of something chilled This informal treat is supported by Brampton Heath Golf Club and vegetarians will be catered forLive music from local band Moulton Lava amp Inspiration FMrsquos Jon Liburd Friends partners amp business associates are most welcome too Cost just pound10 each Call Sheila Smith on 07809 635181 or clicknbspa hrefhttpswwwfacebookcomevents365082966890268 targetblankhereanbspfor more detailsplidiv classcleardivuldiv classcleardivdivdiv classcleardivEnd Next Meeting Module Begin Members Module div classmodmemberh2a hrefhttpwwwnamedroppersorgukmembersFeatured Memberah2h2a classprofile hrefhttpwwwnamedroppersorgukmembers119 titleChris DyerChris DyeremChris Dyer Associatesemah2div classcleardiva classprofile hrefhttpwwwnamedroppersorgukmembers119 titleChris Dyer spanspan img srchttpwwwnamedroppersorgukUserFilesuserprofile119chrisdyerjpg width210 height260 altChris Dyer adiv classcleardivdivdiv classcleardivEnd Members Module div classcleardiv div div classcleardiv divdiv stylewidth500pxul li h3Website Developmenth3 p a hrefhttpwwwfreetimerscom stylecolorgreyaltwebsite development classdisplayunderlineWebsitenbspdevelopmentais a specialist art Behind everysuccessful website is a great development team A great developer canbring additional features to a website that enhances the userexperience p li li h3Website Marketingh3 pIf you are looking for a a stylecolorgrey hrefhttpwwwftwebmarketingcoukmarketingnorthamptonaltmarketing northampton agency classdisplayunderlinemarketingnbspnorthampton agencya finding a great agencyto handle all of your internet marketing needs is the best way for youto benefit your business p li li h3Hall Hire Northamptonh3 pThe a stylecolorgrey hrefhttpswwwvenuesunlimitedcouktown59northampton classdisplayunderline altHall Hire Northamptonhall hire Northamptona has available differs between properties Spaces are available that can accommodate conferences business events and team building sessions in a wide variety of buildings from modern hotels to older character properties If businesses need additional services such as audio visual equipment hire or the provision of speakers this can also be arranged p liul div div idfooter pcopynbspnbspnbsp2010 name droppersnbspnbspnbsp8226nbspnbspnbspcopy 2010 Freetimers for Web Programming amp CMSnbspnbspnbsp8226nbspnbspnbspa hrefhttpwwwfreetimerscom targetblank Website Design and Programming by Freetimersap ul classseoextraLinkslia title hrefnorthamptonbusinessnetworkingNorthampton Business Networkingalilia title hrefnorthamptonshirebusinessnetworkingNorthamptonshire Business Networkingalilia title hrefbusinessnetworkingnorthamptonBusiness Networking Northamptonalilia title hrefreferralmarketingnorthamptonReferral Marketing Northamptonaliul ul lia hrefhttpwwwnamedroppersorguk titleHomeHomeaul classsubmenulia hrefaboutnamedroppersspanAbout Name Droppersspanaliulli lia hrefhttpwwwnamedroppersorgukmembers titleMembersMembersaul classdropdown submenulia hrefhowtojoinnamedroppersspanHow to Join Name Droppersspanaliulli lia hrefhttpwwwnamedroppersorgukbenefits titleBenefitsBenefitsali lia hrefhttpwwwnamedroppersorgukguarantee titleGuaranteeGuaranteeali lia hrefhttpwwwnamedroppersorguktestimonials titleTestimonialsTestimonialsali lia hrefhttpwwwnamedroppersorgukfaqs titleFAQsFAQsali lia hrefhttpwwwnamedroppersorgukmeetingplace titleMeeting PlaceMeeting Placeali lia hrefhttpwwwnamedroppersorgukcontactus titleContact UsContact Usali ul div div classcleardiv div div classcleardivdivscript typetextjavascript function clearSearchobjtxt if objvalue txt objvalue function addSearchobjtxt if objvalue objvalue txt function submitentermyfielde var keycode if windowevent keycode windoweventkeyCode else if e keycode ewhich else return true if keycode 13 myfieldformsubmit return false else return true scriptscript typetextjavascript var gaq gaq gaqpushsetAccount UA206823631 gaqpushtrackPageview function var ga documentcreateElementscript gatype textjavascript gaasync true gasrc https documentlocationprotocol httpsssl httpwww googleanalyticscomgajs var s documentgetElementsByTagNamescript0 sparentNodeinsertBeforega s script bodyhtml |
| Avgpoint | avantgarderoofing.co.uk | UKF4-Replacement | UseragentDisallowcssDisallowjsDisallowwebadminDisallowincludesDisallowincludeDisallowawstatsDisallowclientsDisallowfeedDisallowmpDisallowoldDisallowpicturelibraryDisallowpleskstatDisallowpaypalDisallowproxyDisallowpreviewDisallowqpDisallowscriptsDisallowsiteimagesDisallowstylesDisallowtopseocompaniesDisallowadsDisallowclients 9sep11DisallowflashDisallowflash 9sep11DisallowsupportDisallowtestDisallow healthphp |
| Railwayfs | railwayfs.co.uk | UKF4-Replacement | robotstxt file for domain httpwwwrailwayFScoukUseragentDisallow cgibinDisallow logstatsDisallow mailphpDisallow imagesDisallow scriptsDisallow stylesDisallow javajsDisallow cartjsDisallow validatejsDisallow emailCheckjsDisallow ccheckjsDisallow mapjsDisallow setupjsDisallow navbarsjsDisallow layerjsDisallow mailphpDisallow orderphpDisallow searchincDisallow layersincDisallow linksinc Following text taken from wwwrobotstxtorg Modified by howardfreetimerscomNote that you need a separate Disallow line for every URL prefix you want to exclude you cannot say Disallow cgibin tmpNote also that only 1 robotstxt may exist on a server and it must be in the root directory eg httpwwwthisdomaincomrobotstxt not httpwwwthisdomaincomsomedirrobotstxtAlso you may not have blank lines in a record as they are used to delimit multiple records Note also that regular expression are not supported in either the Useragent or Disallow linesThe in the Useragent field is a special value meaning any robotEG You cannot have lines like Disallow tmp or Disallow gif IMPORTANTDo not put sensitive docs in robotstxtAnyone can request robotstxt and find out which files we dont want people seeingKind of defeats the object slightly but lets face it search engines only follow linksIf its that sensitive whats it doing onlineAlso do not disallow robotstxt in either robotstxt or htaccessRemember as well that robots do not have to obey robotstxt most eg google altavista etc do butif youre being spidered by an email bot its gonna rip through everything it canEverything not explicitly disallowed is considered fair game to retrieve Here follow some examples To exclude all robots from the entire serverUseragent Disallow To allow all robots complete accessOr just dont have a robotstxt file will generate 404s thoughUseragent DisallowTo exclude all robots from part of the serverUseragent Disallow cgibinDisallow tmpDisallow privateTo exclude a single robotUseragent BadBotDisallow To allow only a single robotUseragent WebCrawlerDisallowUseragent Disallow To exclude all files except oneThis is currently a bit awkward as there is no Allow fieldThe easy way is to put all files to be disallowed into a separate directory say joedocsand leave the one file in the level above this directory Useragent Disallow joedocsAlternatively you can explicitly disallow all disallowed pages Useragent Disallow joeprivatehtmlDisallow joefoohtmlDisallow joebarhtml |
| Oxygencreative | oxygen-creative.com | UKF4-Replacement | robotstxt file for domain httpwwwTHIS DOMAINcomUseragentDisallow cgibinDisallow logstatsDisallow mailphpDisallow imagesDisallow scriptsDisallow stylesDisallow javajsDisallow cartjsDisallow validatejsDisallow emailCheckjsDisallow ccheckjsDisallow mapjsDisallow setupjsDisallow navbarsjsDisallow layerjsDisallow mailphpDisallow orderphpDisallow searchincDisallow layersincDisallow linksinc Following text taken from wwwrobotstxtorg Modified by howardfreetimerscomNote that you need a separate Disallow line for every URL prefix you want to exclude you cannot say Disallow cgibin tmpNote also that only 1 robotstxt may exist on a server and it must be in the root directory eg httpwwwthisdomaincomrobotstxt not httpwwwthisdomaincomsomedirrobotstxtAlso you may not have blank lines in a record as they are used to delimit multiple records Note also that regular expression are not supported in either the Useragent or Disallow linesThe in the Useragent field is a special value meaning any robotEG You cannot have lines like Disallow tmp or Disallow gif IMPORTANTDo not put sensitive docs in robotstxtAnyone can request robotstxt and find out which files we dont want people seeingKind of defeats the object slightly but lets face it search engines only follow linksIf its that sensitive whats it doing onlineAlso do not disallow robotstxt in either robotstxt or htaccessRemember as well that robots do not have to obey robotstxt most eg google altavista etc do butif youre being spidered by an email bot its gonna rip through everything it canEverything not explicitly disallowed is considered fair game to retrieve Here follow some examples To exclude all robots from the entire serverUseragent Disallow To allow all robots complete accessOr just dont have a robotstxt file will generate 404s thoughUseragent DisallowTo exclude all robots from part of the serverUseragent Disallow cgibinDisallow tmpDisallow privateTo exclude a single robotUseragent BadBotDisallow To allow only a single robotUseragent WebCrawlerDisallowUseragent Disallow To exclude all files except oneThis is currently a bit awkward as there is no Allow fieldThe easy way is to put all files to be disallowed into a separate directory say joedocsand leave the one file in the level above this directory Useragent Disallow joedocsAlternatively you can explicitly disallow all disallowed pages Useragent Disallow joeprivatehtmlDisallow joefoohtmlDisallow joebarhtml |
| Metalgates | metalgatesdirect.co.uk | UKF4-Replacement |
User-agent: * Allow: / Disallow: /wp-admin Sitemap: https://www.metalgatesdirect.co.uk/sitemap-index.xml |
| Gardengatesdirect | gardengatesdirect.co.uk | UKF4-Replacement |
User-agent: * Allow: / Disallow: /health.php Disallow: /wp-admin Sitemap: https://www.gardengatesdirect.co.uk/sitemap-index.xml |
| Freetimers | freetimers.co.uk | UKF4-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /mail.freetimers.co.uk Disallow: /smtp.freetimers.co.uk Disallow: /pop.freetimers.co.uk Disallow: /pop3.freetimers.co.uk Disallow: /ns.freetimers.co.uk User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |
| Uktimber-2023 | uk-timber.co.uk | UKTimberServer1Replacement | robotstxt automatically generated by PrestaShop ecommerce opensource solution httpswwwprestashopcom httpswwwprestashopcomforums This file is to prevent the crawling and indexing of certain parts of your site by web crawlers and spiders run by sites like Yahoo and Google By telling these robots where not to go on your site you save bandwidth and server resources For more information about the robotstxt standard see httpswwwrobotstxtorgrobotstxthtmlUseragent Allow DirectivesAllow modulescssAllow modulesjsAllow modulespngAllow modulesjpgAllow modulesgifAllow modulessvgAllow moduleswebpAllow jsjquery Private pagesDisallow orderDisallow tagDisallow idcurrencyDisallow searchqueryDisallow backDisallow nDisallow orderDisallow tagDisallow idcurrencyDisallow searchqueryDisallow backDisallow nDisallow controlleraddressesDisallow controlleraddressDisallow controllerauthenticationDisallow controllercartDisallow controllerdiscountDisallow controllerfooterDisallow controllergetfileDisallow controllerheaderDisallow controllerhistoryDisallow controlleridentityDisallow controllerimagesincDisallow controllerinitDisallow controllermyaccountDisallow controllerorderDisallow controllerorderslipDisallow controllerorderdetailDisallow controllerorderfollowDisallow controllerorderreturnDisallow controllerorderconfirmationDisallow controllerpaginationDisallow controllerpasswordDisallow controllerpdfinvoiceDisallow controllerpdforderreturnDisallow controllerpdforderslipDisallow controllerproductsortDisallow controllerregistrationDisallow controllersearchDisallow controllerstatisticsDisallow controllerattachmentDisallow controllerguesttracking Directories for uktimbercoukv8staging2freetimersnetDisallow appDisallow cacheDisallow classesDisallow configDisallow controllersDisallow downloadDisallow jsDisallow localizationDisallow logDisallow mailsDisallow modulesDisallow overrideDisallow pdfDisallow srcDisallow toolsDisallow translationsDisallow uploadDisallow varDisallow vendorDisallow webserviceDisallow enappDisallow encacheDisallow enclassesDisallow enconfigDisallow encontrollersDisallow endownloadDisallow enjsDisallow enlocalizationDisallow enlogDisallow enmailsDisallow enmodulesDisallow enoverrideDisallow enpdfDisallow ensrcDisallow entoolsDisallow entranslationsDisallow enuploadDisallow envarDisallow envendorDisallow enwebserviceDisallow gbappDisallow gbcacheDisallow gbclassesDisallow gbconfigDisallow gbcontrollersDisallow gbdownloadDisallow gbjsDisallow gblocalizationDisallow gblogDisallow gbmailsDisallow gbmodulesDisallow gboverrideDisallow gbpdfDisallow gbsrcDisallow gbtoolsDisallow gbtranslationsDisallow gbuploadDisallow gbvarDisallow gbvendorDisallow gbwebservice FilesDisallow enpasswordrecoveryDisallow enaddressDisallow enaddressesDisallow enloginDisallow enregistrationDisallow encartDisallow endiscountDisallow enorderhistoryDisallow enidentityDisallow enmyaccountDisallow enorderfollowDisallow encreditslipDisallow enorderDisallow ensearchDisallow enguesttrackingDisallow enorderconfirmationDisallow gbpasswordrecoveryDisallow gbaddressDisallow gbaddressesDisallow gbloginDisallow gbregistrationDisallow gbcartDisallow gbdiscountDisallow gborderhistoryDisallow gbidentityDisallow gbmyaccountDisallow gborderfollowDisallow gbcreditslipDisallow gborderDisallow gbsearchDisallow gbguesttrackingDisallow gborderconfirmation |
| Firewood | firewoodandlogs.co.uk | UKT2r |
# robots.txt automatically generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: * # Allow Directives Allow: */modules/*.css Allow: */modules/*.js Allow: */modules/*.png Allow: */modules/*.jpg Allow: /js/jquery/* # Private pages Disallow: /*?order= Disallow: /*?tag= Disallow: /*?id_currency= Disallow: /*?search_query= Disallow: /*?back= Disallow: /*?n= Disallow: /*&order= Disallow: /*&tag= Disallow: /*&id_currency= Disallow: /*&search_query= Disallow: /*&back= Disallow: /*&n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories for www.decking-direct.co.uk Disallow: /app/ Disallow: /cache/ Disallow: /classes/ Disallow: /config/ Disallow: /controllers/ Disallow: /download/ Disallow: /js/ Disallow: /localization/ Disallow: /log/ Disallow: /mails/ Disallow: /modules/ Disallow: /override/ Disallow: /pdf/ Disallow: /src/ Disallow: /tools/ Disallow: /translations/ Disallow: /upload/ Disallow: /var/ Disallow: /vendor/ Disallow: /webservice/ Disallow: /en/app/ Disallow: /en/cache/ Disallow: /en/classes/ Disallow: /en/config/ Disallow: /en/controllers/ Disallow: /en/download/ Disallow: /en/js/ Disallow: /en/localization/ Disallow: /en/log/ Disallow: /en/mails/ Disallow: /en/modules/ Disallow: /en/override/ Disallow: /en/pdf/ Disallow: /en/src/ Disallow: /en/tools/ Disallow: /en/translations/ Disallow: /en/upload/ Disallow: /en/var/ Disallow: /en/vendor/ Disallow: /en/webservice/ Disallow: /gb/app/ Disallow: /gb/cache/ Disallow: /gb/classes/ Disallow: /gb/config/ Disallow: /gb/controllers/ Disallow: /gb/download/ Disallow: /gb/js/ Disallow: /gb/localization/ Disallow: /gb/log/ Disallow: /gb/mails/ Disallow: /gb/modules/ Disallow: /gb/override/ Disallow: /gb/pdf/ Disallow: /gb/src/ Disallow: /gb/tools/ Disallow: /gb/translations/ Disallow: /gb/upload/ Disallow: /gb/var/ Disallow: /gb/vendor/ Disallow: /gb/webservice/ # Files Disallow: /*en/password-recovery Disallow: /*en/address Disallow: /*en/addresses Disallow: /*en/login Disallow: /*en/cart Disallow: /*en/discount Disallow: /*en/order-history Disallow: /*en/identity Disallow: /*en/my-account Disallow: /*en/order-follow Disallow: /*en/credit-slip Disallow: /*en/order Disallow: /*en/search Disallow: /*en/guest-tracking Disallow: /*en/order-confirmation Disallow: /*gb/password-recovery Disallow: /*gb/address Disallow: /*gb/addresses Disallow: /*gb/login Disallow: /*gb/cart Disallow: /*gb/discount Disallow: /*gb/order-history Disallow: /*gb/identity Disallow: /*gb/my-account Disallow: /*gb/order-follow Disallow: /*gb/credit-slip Disallow: /*gb/order Disallow: /*gb/search Disallow: /*gb/guest-tracking Disallow: /*gb/order-confirmation |
| Brigstock | brigstocksawmill.co.uk | UKT2r |
# robots.txt automatically generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: * # Allow Directives Allow: */modules/*.css Allow: */modules/*.js Allow: */modules/*.png Allow: */modules/*.jpg Allow: /js/jquery/* # Private pages Disallow: /*?order= Disallow: /health.php Disallow: /*?tag= Disallow: /*?id_currency= Disallow: /*?search_query= Disallow: /*?back= Disallow: /*?n= Disallow: /*&order= Disallow: /*&tag= Disallow: /*&id_currency= Disallow: /*&search_query= Disallow: /*&back= Disallow: /*&n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories for www.brigstocksawmill.co.uk Disallow: /app/ Disallow: /cache/ Disallow: /classes/ Disallow: /config/ Disallow: /controllers/ Disallow: /download/ Disallow: /js/ Disallow: /localization/ Disallow: /log/ Disallow: /mails/ Disallow: /modules/ Disallow: /override/ Disallow: /pdf/ Disallow: /src/ Disallow: /tools/ Disallow: /translations/ Disallow: /upload/ Disallow: /var/ Disallow: /vendor/ Disallow: /webservice/ Disallow: /gb/app/ Disallow: /gb/cache/ Disallow: /gb/classes/ Disallow: /gb/config/ Disallow: /gb/controllers/ Disallow: /gb/download/ Disallow: /gb/js/ Disallow: /gb/localization/ Disallow: /gb/log/ Disallow: /gb/mails/ Disallow: /gb/modules/ Disallow: /gb/override/ Disallow: /gb/pdf/ Disallow: /gb/src/ Disallow: /gb/tools/ Disallow: /gb/translations/ Disallow: /gb/upload/ Disallow: /gb/var/ Disallow: /gb/vendor/ Disallow: /gb/webservice/ # Files Disallow: /*gb/address Disallow: /*gb/addresses Disallow: /*gb/login Disallow: /*gb/cart Disallow: /*gb/discount Disallow: /*gb/guest-tracking Disallow: /*gb/order-history Disallow: /*gb/identity Disallow: /*gb/my-account Disallow: /*gb/order Disallow: /*gb/order-confirmation Disallow: /*gb/order-follow Disallow: /*gb/credit-slip Disallow: /*gb/password-recovery Disallow: /*gb/search |
| Trinity | trinitypropertygroup.com | EntegraProductionSharedReplacement |
User-agent: * Allow: / |
| Objectivetravelsafety | objectivetravelsafety.com | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| Mcgeesuk | mcgeesuk.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| Heritage | heritage-management.co.uk | EntegraProductionSharedReplacement |
User-agent: * Disallow: /health.php Allow: / |
| Gdcblog | garagedoorsblog.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.garagedoorsblog.co.uk/sitemap-index |
| Freetimers | freetimers.com | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| Ews | ews.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / |
| Durast33l | durasteelroofingservices.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| Awningsonline | awningsonline.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.freetimers.com/sitemap |
| BOOMERANGRENTALS | boomerangrentals.co.uk | BOOMERANGRENTALS |
User-agent: * Disallow: _sales_transit.php* Disallow: /webuser/* Disallow: nj/games_rent.php* Disallow: /book.php* User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Googlebot Crawl-delay: 100 User-agent: Slurp Crawl-delay: 100 User-Agent: msnbot Crawl-Delay: 100 User-Agent: bingbot Crawl-Delay: 100 User-Agent: rogerbot Crawl-Delay: 100 |
| UK Oak | uk-oak.co.uk | VA1-Replacement |
User-agent: * Allow: / Sitemap: https://www.uk-oak.co.uk/sitemap |
| Dove Group | dovegroup.co.uk | EntegraProductionSharedReplacement |
User-agent: * Allow: / Sitemap: https://www.dovegroup.co.uk/sitemap-index |
| Teesurology | teesurology.org | WP08 | Useragent Disallow wpcontentuploadswclogsDisallow wpcontentuploadswoocommercetransientfilesDisallow wpcontentuploadswoocommerceuploadsDisallow addtocartDisallow addtocartDisallow wpadminAllow wpadminadminajaxphp START YOAST BLOCK Useragent DisallowSitemap httpsteesurologyorgsitemapindexxml END YOAST BLOCK |
| Trinity estates | trinityestates.com | WP02 |
# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://www.trinityestates.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK |
| Hobdens manage | hobdensmanage.co.uk | WP08 |
# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://www.hobdensmanage.co.uk/sitemap_index.xml # --------------------------- # END YOAST BLOCK |
| Elim properties | elimproperties.net | WP02 |
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://elimproperties.net/wp-sitemap.xml |
| Chaneys | chaneys-cs.com | WP08 |
# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://chaneys-cs.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK |
| Best life clinic | bestlifeclinic.org | WP02 |
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://bestlifeclinic.org/wp-sitemap.xml |
| Garage Doors Centre | thegaragedoorcentre.co.uk | GDC-2025-Replacement |
User-agent: * Crawl-delay: 10 Disallow: /Crm_WebSer/ User-agent: Googlebot Crawl-delay: 15 User-agent: Slurp Crawl-delay: 15 User-Agent: msnbot Crawl-Delay: 15 User-agent: * Disallow: /dev/* |
| Commercial awnings uk | commercialawningsuk.co.uk | UKF4-Replacement |
User-agent: * Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /cgi-bin Disallow: /search Disallow: /feed Disallow: /rss Disallow: /comments/feed Disallow: /feed/$ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /health.php User-agent: Teoma Disallow: / User-agent: Googlebot Disallow: /*swf* User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.pdf$ User-agent: ia_archiver Disallow: / User-agent: atSpider Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: BecomeBot Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copernic Disallow: / User-agent: Crescent Disallow: / User-agent: DSurf Disallow: / User-agent: dumbot Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Enterprise_Search/1.0 Disallow: / User-agent: Enterprise_Search Disallow: / User-agent: es Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FreeFind Disallow: / User-agent: grub Disallow: / User-agent: grub-client Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Jetbot Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: larbin Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: naver Disallow: / User-agent: NetMechanic Disallow: / User-agent: Nutch Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Oracle Ultra Search Disallow: / User-agent: PerMan Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: Radiation Retriever 1.1 Disallow: / User-agent: Roverbot Disallow: / User-agent: searchpreview Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sootle Disallow: / User-agent: Stanford Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: WebBandit Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: WebVac Disallow: / User-agent: WebZip Disallow: / User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Stanford Comp Sci Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: NetAnts Disallow: / User-agent: Mister PiX Disallow: / User-agent: WebAuto Disallow: / User-agent: TheNomad Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: RMA Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: asterias Disallow: / User-agent: httplib Disallow: / User-agent: turingos Disallow: / User-agent: spanner Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Foobot Disallow: / User-agent: SpankBot Disallow: / User-agent: BotALot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: BunnySlippers Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: URLy Warning Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget Disallow: / User-agent: LinkWalker Disallow: / User-agent: cosmos Disallow: / User-agent: moget Disallow: / User-agent: hloader Disallow: / User-agent: URL Control Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Webster Pro Disallow: / User-agent: EroCrawler Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Iron33/1.0.2 Disallow: / User-agent: Bookmark search tool Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: FairAd Client Disallow: / User-agent: Gaisbot Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Mata Hari Disallow: / User-agent: LexiBot Disallow: / User-agent: Web Image Collector Disallow: / User-agent: The Intraformant Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: JennyBot Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: WebEnhancer Disallow: / User-agent: suzuran Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: VCI Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Openfind Disallow: / User-agent: Zeus Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: Openbot Disallow: / |