PHP Classes

PHP Detect Google Crawler: Check if an access is from Google checking its IP

Recommend this page to a friend!
     
  Info   Documentation   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStarStar 70%Total: 357 All time: 6,941 This week: 59Up
Version License PHP version Categories
kalmargabor 1.0.0MIT/X Consortium ...5Networking, PHP 5, Searching
Description 

Author

Gábor Kalmár

This class can check if an access is from Google checking its IP.

It takes a given IP address and verifies if it is from Google Bot.

The class determines the IP address host name and compares with google.com or googlebot.com.

Innovation Award
PHP Programming Innovation award nominee
August 2016
Number 11		 Google is the most popular search engine. Being well ranked on Google is important for many sites to get nice organic traffic.

Many sites try to serve content for Google crawler bots as fast as possible, so that increases the chances of the sites pages to rank well.

In theory it is easy to detect when the Google bot is accessing a Web page. It is usually a matter of detecting the user agent string sent with requests from the Google bot crawler.

However, there are crawlers and malicious bots that pretend to be the real Google bot faking its user agent string.

This class provides a more robust way to detect whether a request is coming from Google bot or not.

It just gets the HTTP client IP address and resolves its host name to verify if it really has one of the known Google bot domains.

Manuel Lemos
Picture of Gábor Kalmár
Name: Gábor Kalmár <contact>
Classes: 1 package by
Country: Hungary Hungary
Innovation award
Innovation award
Nominee: 1x

Documentation

Install

Composer

composer require kalmargabor/crawler-check

Examples

$crawlerCheck = new \Kalmargabor\CrawlerCheck\CrawlerCheck();

$ipToCheck = 'ip.address.ip.address';

var_dump($crawlerCheck->isValid($ipToCheck));


  Files folder image Files (4)  
File Role Description
Files folder imagesrc (1 directory)
Accessible without login Plain text file composer.json Data Auxiliary data
Accessible without login Plain text file LICENSE Lic. License text
Accessible without login Plain text file README.md Doc. Documentation

  Files folder image Files (4)  /  src  
File Role Description
Files folder imageCrawlerCheck (1 file)

  Files folder image Files (4)  /  src  /  CrawlerCheck  
File Role Description
  Plain text file CrawlerCheck.php Class Class source

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
Downloadkalmargabor-2016-08-03.zip 2KB
Downloadkalmargabor-2016-08-03.tar.gz 1KB
Install with ComposerInstall with Composer
 Version Control Unique User Downloads Download Rankings  
 100%
Total:357
This week:0
All time:6,941
This week:59Up
 User Ratings  
 
 All time
Utility:100%StarStarStarStarStarStar
Consistency:100%StarStarStarStarStarStar
Documentation:100%StarStarStarStarStarStar
Examples:-
Tests:-
Videos:-
Overall:70%StarStarStarStar
Rank:306
  

  Applications that use this package  
No pages of applications that use this class were specified.

Add link image If you know an application of this package, send a message to the author to add a link here.