# Search engines and link previews are welcome everywhere public. User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /api/ Disallow: /api Disallow: /auth/ Disallow: /account/ Disallow: /savedplaces # Commercial SEO and dataset crawlers. They index this site for someone # else's product and send no visitors, while consuming the bandwidth # allowance a small site is billed on. The polite ones stop here; the rest # are refused by the shield in server/lib/bot-shield.ts. User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SerpstatBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: SeekportBot Disallow: / User-agent: MegaIndex Disallow: / Sitemap: https://www.wandercyprus.com/sitemap.xml