The Web Robots Pages
Added: 2015-04-01 00:00:00 (10 years, 3 months, 10 days ago)
Robotstxt.org is ranked #9,467 among the most popular web sites, the lower the rank indicator the more popular is the web site and the more visitors it has. Robotstxt.org is registered in 2000-09-04 owned by RobotsTXT Hostmaster, website’s age 24 years, 10 months, 7 days years. The number of unique users visiting this website every day is 38,542. Each individual visits 2.2 unique pages per day. Approximate time spent on a web site 2:27. There are an average of 4,768 links pointing back to robotstxt.org from other websites. Robotstxt.org daily advertisement revenue is $771 USD. According to our analysis the approximate value of the website is $277,502 US Dollars. Most popular search engine request "robots.txt". Google PageRank™ of the website is 7 of 10. Robotstxt.org reputation rank is 92 of 100. Average time of a website’s page load is 0.76381 seconds. The web site is listed in DMOZ open directory project.
Overview Information about Robotstxt.org | |
---|---|
Title |
|
Alexa Rank | #9,467 |
Alexa Backlinks | 4,768 |
Estimated Daily Traffic | 38,542 visitors |
Estimated Daily Revenue | $770.84 USD |
Website Worth | $277,502.41 USD |
Domain Name | Robotstxt.org |
Domain Created | 2000-09-04 (24 years, 10 months, 7 days ago) |
Domain Expires | 2013-09-04 (in 11 years, 10 months, 7 days) |
Domain Registrar | Public Interest Registry |
Domain Owner | RobotsTXT Hostmaster |
Domain Nameservers |
ns1.mythic-beasts.com (69.56.173.190) ns2.mythic-beasts.com (93.93.128.67) |
Google Adsense ID | pub-9311532361854131 |
Google PageRank™ |
![]() |
Yahoo Indexed | 7 pages |
Bing Indexed | 7 pages |
Dmoz Listing | Yes |
Average Load Time | 0.76 second(s) |
Server IPs | 78.129.143.219 |
Server Provider | RapidSwitch Ltd |
Server Location | ![]() |
Robotstxt.org is visited by around 38,542 unique visitors per day. Every visitor of this website viewing approximately 2.2 pages per day.
We found 4,768 backlinks to Robotstxt.org from other web sites. The largest number of backward links are 0, the smallest number of links are 0, the average number of links are 0 refer to this web site.
Using information from users, and other reliable sources, Robotstxt.org has the reputation 92 out of 100.
Main HTML elements that might affect on search engines ranking.
<H1> Tags: | 0 | <H2> Tags: | 1 |
---|---|---|---|
<H3> Tags: | 0 | <H4> Tags: | 0 |
<H5> Tags: | 0 | <H6> Tags: | 0 |
IFrames: | 0 | Flash: | No |
Total Links: | 25 | Total Images: | 1 |
Language: | English | Text/Html Ratio: | 31.66% |
Doctype: | Yes | Microformats: | Not found |
The top queries driving traffic to Robotstxt.org from search engines.
Query | Search Traffic |
---|---|
robots.txt | 26.70% |
robot.txt | 8.70% |
robots txt | 3.86% |
robot.txt file | 1.67% |
robots.txt disallow | 1.33% |
noindex nofollow | 1.32% |
no index no follow | 1.26% |
meta robots | 0.98% |
robots meta tag | 0.89% |
robots.txt disallow all | 0.86% |
High impact keywords that attract search engine traffic.
Visitor's map indicates that Robotstxt.org has 38,542 daily visitors from 32 countries, 29.60% of visitors come from India .
Detailed information about the server that hosts Robotstxt.org
Server IPs: | 78.129.143.219 |
---|---|
Server Name: | PasteWSGIServer/0.5 Python/2.7.3 |
Server Provider: | RapidSwitch Ltd |
Server Location: |
in United Kingdom ![]() |
Charset: | UTF-8 |
Average Load Time: | 0.76 second(s) |
Server located:
in United Kingdom
The IP address of Robotstxt.org is 78.129.143.219.
From the HTTP headers of Robotstxt.org, you will know that HTTP status code is HTTP/1.1 200 OK, server name is PasteWSGIServer/0.5 Python/2.7.3.
HTTP/1.1 200 OK |
Server : PasteWSGIServer/0.5 Python/2.7.3 |
Date : Fri, 01 Mar 2013 12:37:54 GMT |
Pragma : no-cache |
Cache-Control : no-cache |
Content-Type : text/html; charset=utf-8 |
Content-Length : 4732 |
The ratio of outbound links to inbound links influences the distribution of the weight of a website as a whole.
The chart shows how Robotstxt.org indexed in major search engines.
PageRank™ is a link analysis algorithm used by Google™.
Google™ assigned this website a Pagerank of 7. The maximum value is 0, the minimum value is 0, while the average value is 0.
The W3C Markup Validation Service is a validator by the World Wide Web Consortium (W3C), which allows Internet users to check HTML and XHTML documents for well-formed markup.
Links (even if they have nofollow attributes) from major social networks is a "human" signal for search engines, which has some influence (non-determining influence) on the position of your website in search results.