High Bandwidth usage alert on my cPanel hosting server

Discussions related with hosting control panels used, which include cPanel, Plesk, Directadmin etc..

Moderator: Staff

Post Reply
John Stanley
Posts: 0
Joined: Wed Sep 28, 2016 10:50 am

High Bandwidth usage alert on my cPanel hosting server

Post by John Stanley »

Hello,

One of my client reported that his website appears to be consuming more bandwidth than is expected. We have narrowed it down to most probably being related to bots/search engines causing the traffic. Can you help us to identify which bots/search engines are causing it and whether we can use a .htaccess file to block these traffic?


Aaron
Posts: 17
Joined: Mon Apr 11, 2016 8:59 am

Re: High Bandwidth usage alert on my cPanel hosting server

Post by Aaron »

cPanel has several built in statistic reports, one of the favored interface is Awstat on cPanel. The Awstats interface displays traffic statistics and details about the amount of people coming to your website.

To view AWStats traffic statistics for your website. Logon to cPanel account

Goto Cpanel Home> Metrics> Awstats

Click 'View' for the domain that you wish to view. A new interface will appear that displays the AWStats traffic statistics for that domain. There you can view the details about your website's visitors and also under 'Robots/Spiders visitors' section you can identify which bots/search engines are consuming more bandwidth usage.

You can block the bots/search engines which are causing high bandwidth usage with .htaccess rules.

Open the .htaccess page on you website's document root and add the below rules into it.

<IfModule mod_rewrite.c>
RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} ^YandexBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SeznamBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^houzzbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^MJ12bot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Twitterbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Exabot [OR]
RewriteCond %{HTTP_USER_AGENT} ^AhrefsBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^XoviBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^FakeUser
RewriteRule .* - [F,L]
</IfModule>

You can specify the bots/search engines that you have identified on your Awstats interface like this.

Aaron N
Linux Support Engineer.
Nixtree Solutions
Managed Full Server Backups
https://www.nixtree.com/managed-backups.php
Follow us on : https://twitter.com/nixtree


Martin
Posts: 36
Joined: Fri Sep 16, 2016 10:34 am

Re: High Bandwidth usage alert on my cPanel hosting server

Post by Martin »

Enable hotlink protection in cpanel - Some people might steal bandwidth by linking your images in their site so it is better to enable hotlink protection.

-----------------------
Martin N
Linux Support Engineer.
Nixtree Solutions

Follow us on : https://twitter.com/nixtree-


If you are looking for assistance in server management, please get in touch with our support.
Post Reply