# DownToMeet.com -- Down To Meet -- Find Your Community. Create groups. Make friends. Meet. robots.txt. User-agent: * Allow: / Disallow: /terms Disallow: /privacy-policy # Crawl delay in seconds on whole site User-agent: baiduspider Crawl-delay: 10 User-agent: ccbot Crawl-delay: 10 User-agent: CloudflarePrefetch Crawl-delay: 10 User-agent: coccoc Crawl-delay: 10 User-agent: Yandex Crawl-delay: 10 User-agent: YandexImages Crawl-delay: 10 # # __ \ __ __| \ | | # | | _ \ \ \ \ / __ \ | _ \ |\/ | _ \ _ \ __| # | | ( | \ \ \ / | | | ( | | | __/ __/ | # ____/ \___/ \_/\_/ _| _| _| \___/ _| _| \___| \___| \__| # #