robots-txt.net valuation and analysis
Robots.txt Information
| Robot | Path | Permission |
| GoogleBot | / | ✔ |
| BingBot | / | ✔ |
| BaiduSpider | / | ✔ |
| YandexBot | / | ✔ |
User-agent: * Disallow: | ||
Meta Tags
| Title | robots.txt |
| Description | The robots.txt checker tool shows you whether your robots.txt file blocks web crawlers from specific URLs on your |
| Keywords | N/A |
Server Information
| WebSite | |
| Host IP | 5.9.6.163 |
| Location | Germany |
Related Websites
| Site | Rank |
More to Explore
robots-txt.net Valuation
|
US$1,098,019
Last updated: 2023-05-11 13:09:01
robots-txt.net has Semrush global rank of 9,639,456. robots-txt.net has an estimated worth of US$ 1,098,019, based on its estimated Ads revenue. robots-txt.net receives approximately 126,695 unique visitors each day. Its web server is located in Germany, with IP address 5.9.6.163. According to SiteAdvisor, robots-txt.net is safe to visit. |
Traffic & Worth Estimates
| Purchase/Sale Value | US$1,098,019 |
| Daily Ads Revenue | US$1,014 |
| Monthly Ads Revenue | US$30,407 |
| Yearly Ads Revenue | US$364,881 |
| Daily Unique Visitors | 8,447 |
| Note: All traffic and earnings values are estimates. | |
DNS Records
| Host | Type | TTL | Data |
| robots-txt.net. | A | 1798 | IP: 5.9.6.163 |
| robots-txt.net. | NS | 1800 | NS Record: dns2.registrar-servers.com. |
| robots-txt.net. | NS | 1800 | NS Record: dns1.registrar-servers.com. |
| robots-txt.net. | MX | 1800 | MX Record: 10 eforward3.registrar-servers.com. |
| robots-txt.net. | MX | 1800 | MX Record: 20 eforward5.registrar-servers.com. |
| robots-txt.net. | MX | 1800 | MX Record: 15 eforward4.registrar-servers.com. |
| robots-txt.net. | MX | 1800 | MX Record: 10 eforward1.registrar-servers.com. |
| robots-txt.net. | MX | 1800 | MX Record: 10 eforward2.registrar-servers.com. |
| robots-txt.net. | TXT | 1800 | TXT Record: v=spf1 include:spf.efwd.registrar-servers.com ~all |
HtmlToTextCheckTime:2023-05-11 13:09:01
| robots.txt checker Bots robots.txt domain Bot Google Mediapartners-Google Bing Yahoo Yandex robots.txt content Pathes(ex. /path1/page1) © robots-txt.net |
HTTP Headers
HTTP/1.1 200 OK Server: nginx/1.4.6 (Ubuntu) Date: Thu, 04 Nov 2021 19:55:19 GMT Content-Type: text/html; charset=UTF-8 Connection: keep-alive Set-Cookie: PHPSESSID=bqqnus1q3sr80fhi5hj3dglhe4; path=/; HttpOnly Expires: Thu, 19 Nov 1981 08:52:00 GMT Cache-Control: no-store, no-cache, must-revalidate Pragma: no-cache Set-Cookie: _csrf=66c1cb4e5dd82b0996887fe1e3863f9d2ad42388b20bc4b9ee44cd45d60bb851a%3A2%3A%7Bi%3A0%3Bs%3A5%3A%22_csrf%22%3Bi%3A1%3Bs%3A32%3A%22iP0yH9MW5TkkKnDQwfvpVeTBL_kXW8zf%22%3B%7D; path=/; HttpOnly |
robots-txt.net Whois Information
Domain Name: ROBOTS-TXT.NET Registry Domain ID: 2093456031_DOMAIN_NET-VRSN Registrar WHOIS Server: whois.namecheap.com Registrar URL: http://www.namecheap.com Updated Date: 2020-12-28T07:07:30Z Creation Date: 2017-01-27T07:22:29Z Registry Expiry Date: 2022-01-27T07:22:29Z Registrar: NameCheap, Inc. Registrar IANA ID: 1068 Registrar Abuse Contact Email: abuse@namecheap.com Registrar Abuse Contact Phone: +1.6613102107 Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Name Server: DNS1.REGISTRAR-SERVERS.COM Name Server: DNS2.REGISTRAR-SERVERS.COM DNSSEC: unsigned >>> Last update of whois database: 2021-10-30T06:56:02Z <<< |