Referral Log Analysis

Who is hitting your site? How are they finding you? What keywords or phrases are they using to find your site? All these questions are answered by the referral log. To make it easier to read, we have a program that analyzes the log and gives you a summary of this information.

Sample report:

Explanation of sections

Header
Mainly a pointer to this page.
Keywords and Phrases
The keywords from the recognized search engines that have referred someone to your pages. This only includes actual searches. Referrals from a page on those sites are not included.
Search Engines
A list of recognized search engines that have referred someone to your pages. This only includes actual searches. Referrals from a page on those sites are not included.
Referring Domains
The domain/machine that the referral came from. This can be a search or a page on someone's site. The domain [NONE] signifies that no referral information was given to the web server. These can be from a search engine or some program that does not provide this information.
Referring URLs
The page or search that the referral came from. This is what we look at to determine which search engines were used and what keywords were used from that search engine. We are constantly adding new ones as they show up in the referral logs. URLs that start with [NONE] are not actually a referral. This is the name of the machine that accessed a page and did not give the web server referral information.
Referred pages
This is a list of pages that were referred to from another site or retrieved without referral information. This shows you where people are entering your site. Some unexpected pages will show up here. Images(.gif or .jpg) may show up here if a lot of programs that don't provide referral information have visited them. Especially if they are used a lot on your site.

The page robots.txt is a file that is used by robots(search engines, etc.) to determine what pages they are allowed to index on your site. See A Standard for Robot Exclusion for more details. There are methods to exclude archiving or indexing on a page basis. This page can show up high on the referred pages list because some search engines (e.g. atext.com[Excite!] and wisewire.com) check this page frequently.

The report

============================================================
Referral Log report for clarkecomputer.com
============================================================

For an explanation about this report, see:
http://www.clarkecomputer.com/services/referrals.html

If you have comments or questions on the output, send them to
me and I will work on improving the script
 
Thank you

------------------------------------------------------------
Top (25 max.) Keywords/Phrases : 27 searches total
------------------------------------------------------------
       2 : computer company
       2 : +"airs taxonomy"
       1 : search engine submittal
       1 : link checking program
       1 : create web pages
       1 : create a web pages
       1 : "search engine submittal"
       1 : +getstat
       1 : Error logging in COM
       1 : link checking
       1 : getting a domain name
       1 : getting your own domain name
       1 : IBM, products, link checking
       1 : request a free sample
       1 : "domain hoster"
       1 : link checking verification robot
       1 : "error log" analysis
       1 : search engine submittals
       1 : "bad header"
       1 : search engine submittal form
       1 : pc display rotate
       1 : PROftp
       1 : ProFTP
       1 : getstat
 
26 searches out of 27 (96%)
 
------------------------------------------------------------
Top (25 max.) Search Engines : 27 searches total
------------------------------------------------------------
      15 : AltaVista
       4 : InfoSeek
       3 : Yahoo
       2 : LookSmart
       1 : Search.com (Infoseek)
       1 : Excite!
       1 : MetaCrawler
 
27 searches out of 27 (100%)
 
------------------------------------------------------------
Top (25 max.) referrer domains : 201 referrals total
------------------------------------------------------------
     162 : [NONE]
       9 : http://altavista.digital.com
       5 : http://www.altavista.digital.com
       4 : http://www.infoseek.com
       3 : http://ink.yahoo.com
       3 : http://www.fortnet.org
       2 : http://www.looksmart.com
       2 : http://www.access-by-design.com
       1 : http://www.altavista.com
       1 : http://search.excite.com
       1 : http://209.38.108.38
       1 : http://www.search.com
       1 : http://www.netcraft.com
       1 : http://www.metacrawler.com
       1 : http://www.verinet.com
       1 : file://
       1 : http://nu2.com
       1 : http://www.fortnet.com
       1 : http://www.zensearch.com
 
201 referrals out of 201 (100%)
 
------------------------------------------------------------
Top 25 referrer URLs : 201 referrals total
------------------------------------------------------------
      28 : [NONE] - taz.northernlight.com
      22 : [NONE] - brillo.av.pa-x.dec.com
      14 : [NONE] - batch.atweb.com
      14 : [NONE] - phobos.frii.com
      11 : [NONE] - spider2-uu.wisewire.com
       6 : [NONE] - mail.seventwentyfour.com
       4 : [NONE] - 205.218.219.40
       4 : [NONE] - soap.av.pa-x.dec.com
       3 : [NONE] - spider4-uu.wisewire.com
       3 : [NONE] - scrubtheweb.com
       3 : [NONE] - linden.fortnet.org
       3 : [NONE] - fc229.webaccess.net
       2 : [NONE] - dialup-b109.europa.com
       2 : [NONE] - ocn.smart-d.com
       2 : [NONE] - blue-bbn.infoseek.com
       2 : [NONE] - gatekeeper.cognos.com
       2 : [NONE] - 130.181.134.242
       2 : [NONE] - fido.planetsearch.com
       2 : [NONE] - cca2625a.infoseek.com
       2 : [NONE] - j2006.inktomi.com
       2 : http://www.altavista.digital.com/cgi-bin/query?pg=q&kl=XX&q=%2B%22airs+taxonomy%22&search=Search
       2 : [NONE] - sjc-fe2-1.sjc.lycos.com
       2 : http://www.fortnet.org/FortNet/business/compinternet.html
       2 : [NONE] - dol-proxy1.disney.com
 
139 referrals out of 201 (69%)

------------------------------------------------------------
Top 25 referred pages : 201 referrals total
------------------------------------------------------------
      64 : /index.html
      14 : /robots.txt
      10 : /domain_hosting.html
       7 : /services/error_log.html
       7 : /services/momspider.html
       7 : /submit/submit.html
       7 : /get_domain.html
       6 : /sample.html
       5 : /cgi-bin/domains/secondaries.cgi
       5 : /momspider.html
       5 : /clarke/resume.html
       5 : /client_checklist.html
       5 : /advertising.html
       5 : /submit/submit_pages.html
       5 : /smart_errors.html
       4 : /clients.html
       4 : /site_services/getstats_format.html
       4 : /web_pub_steps.html
       3 : /register_domain.html
       3 : /site_services/index.html
       3 : /services/domain_hosting.html
       3 : /error_log.html
       2 : /submit_tips.html
       2 : /submit_pages.html
 
185 referrals out of 201 (92%)
To visit any of the sites below without leaving this site hold down the shift key when you click on the link.


Google
 
Web http://www.clarkecomputer.com

Domain Hosting Error Log Analysis Submittal Engines Free Web Hosting
What's New Domain Resources B&N BookStore Privacy Policy

Please send any questions or comments to: clarke@clarkecomputer.com
Phone: (970) 482-6785.
© 1995-2015 Clarke Computer Company