LogZ Free Log Analyzer for User-Agent and IP Detection

LogZ is a Free Log Analyzer developed in php that retrieves data from raw log files and organizes it in an easy yet relevant way for further analysis. LogZ works with any Apache combined log file format. Now you can know exactly which bots and crawlers visit your website. Our Free Log Analyzer tabulates data on User-Agents (UA), the number of visits they made, and shows their IP Addresses or Hostnames. LogZ also provides additional tools to perform Reverse and Forward DNS Lookups, get the Whois information of a Domain... 

How to Identify User-Agents and IP Addresses for Blocking Bots and Crawlers

In a prior post I explained the main reasons why to block undesirable bots, scrapers and crawlers in order to prevent content stealing, malware injection, and vulnerability scanning in a website. If you haven’t read that post I encourage you to do so. One of the solutions provided was a change to the .htaccess file to block crawlers based on User-Agent or IP Address. As a result, folks were asking me how to identify which User-Agent (UA) or IP Address to block? I am going to walk you through the log analysis process, show... 

Practical Solutions for Blocking Spam, Bots and Scrapers

Spam has become a major problem for many of us that deal with content development on a regular basis. It takes different forms, affects performance and compromises the security of a site. There are bots that specialize in spamming by inserting links and unsolicited information in input fields and forms of websites. The comment section of a blog, subscription or price match forms in eCommerce sites are very susceptible to these types of attacks. Likewise, unauthorized scrapers represent a thread to intellectual property by...