Version: 11.2
Revision: 33 Build 21

Vol 3 – .htaccess rewrites & mod – madness!

For those who have their own domain and server, have you ever wonder about maintaining your own .htaccess file? It’s very important to keep this file at good health. If you don’t, then you will have a door slammed at your face with many errors. Even worse, you will get a bunch of spam – hooligans bombarding your pages and scoff all of your resources! In other terms, they will do anything to put your server down and get your domain penalized by famous search engine.

For now, you will be using simple HTA resources. They are also free for distribution.
Therefore, if I were you, I would copy these codes and put a smile on SEO search engine.

1.] Running your very own domain is the biggest gift you can afford. But, wait a second. How do I kick out this *www tags from appearing on the address bar? Well, there is one solution to this dilemma: we use the basic “Host” request and staple “RewriteCond” with your own domain under “RewriteRule” tags. However, this source must be placed above your .htaccess file for it to work.

Method 01 – kick out *www with style!

Options +FollowSymLinks
RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_HOST} !^mydomain\.co.uk$ [NC]
RewriteRule ^(.*)$ http://askapache.com/$1 [R=301,L]

Method 02 – take a shortcut and don’t bother…

Options +FollowSymlinks
RewriteEngine On
RewriteCond %{HTTP_HOST} ^www\.(.+)$ [NC]
RewriteRule ^(.*)$ http://%1/$1 [R=301,L]

Method 3 – I want it in a tuxedo!

# Enable Rewrite Engine
RewriteEngine On
RewriteBase /

# Strip the www from your domain
RewriteCond %{HTTP_HOST} ^www\.(.+)$ [NC]
RewriteRule ^(.*)$ http://%1/$1 [R=301,L]

Method 04 – I want it in a simpler form!

RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_HOST} ^www\.(.+)$ [NC]
RewriteRule ^ http://%{HTTP_HOST}%{REQUEST_URI} [L,R=301]

2.] For those who love SSL encryption, you can use these sources for your server. However, you got to be careful! These methods will only work, if you have a dedicated IP address. If you don’t have one by default, then get your skull on the chat-line and make a request with your hosting provider!

If you want to redirect “non-https” to a real “https” directory, then why not use these samples? They are short, simple and it doesn’t eat a lot of space on your .htaccess file.

Method 01 – Use “https” without “mod_ssl”.

RewriteCond %{HTTPS} !=on
RewriteRule .* https://%{SERVER_NAME}%{REQUEST_URI} [R,L]

Notes: if you want to direct your domain from a specific PORT, then, get this version.
Now, here is a lolly for you to chew. Its htaccess candies after all…

RewriteCond %{SERVER_PORT} !^443$
RewriteRule .* https://%{SERVER_NAME}%{REQUEST_URI} [R,L]

Method 02 – I want precision!

RewriteEngine On
RewriteCond %{HTTPS} !=on [OR]
RewriteCond %{HTTP_HOST} != example.com
RewriteRule ^ https://example.com%{REQUEST_URI} [L,R=301]

Method 03 – Search Engine Friendly.

Options Options +FollowSymlinks
RewriteEngine On
RewriteCond %{SERVER_PORT} !=443
RewriteRule ^ https://%{SERVER_NAME}%{REQUEST_URI} [R,L]

3.] In this section, you should add these sources into your .htaccess file. It will cloak all of your directories on your server that doesn’t have an index page. You will also be surprise that it hold tiny amounts of coding and resources. So, if I were you, I would slap this pretty script into your .htaccess file for better security and protection against directory spies and evil bots.

Method 01 – Disable Indexies Only!

Options –Indexes

Notes: if you want to hide everything and prevent directory listing, then, you better staple this after “Options –Indexes”. However, got to be careful and lists the files that you want to hide / cloak from prying eyes.

Options –Indexes
IndexIgnore *

Notes: the above will hide everything – including your images! Therefore, I’ve made another sample for you to use. You may use this source instead of the above. But, you must type / input your own extension.

Options –Indexes
IndexIgnore *.gif *.jpg *.png

IndexIgnore readme.txt .htaccess

See the above rules? You can also give out file names! Pretty simple and stylish!!

4.] If you are bored to death with the old name, then, change it for your own good! We don’t want you to fall asleep, normally looking at your .htaccess file!

# Rename your htaccess files
AccessFileName file.hta

5.] Have you wonder where do these spammer came from? Well, the truth behind this is internet –bots gathering email addresses, server addresses and many other thing, such as hacking. But, don’t just hold your breath! There is more! So, be careful and keep a lookout for these hooligans. We don’t want them and so do you!

Order allow,deny
deny from .domain1.org
deny from domain2.org
allow from all

You can use this as well for domain blocking. But, don’t be stupid and block your own domain. If you do this by mistake or just for stupid fun. Well, all I can say is be prepare for some nasty surprise! Good luck with that!!

RewriteCond %{HTTP_REFERER} ^https?://([^.]+\.)*example\.com [NC,OR]
RewriteCond %{HTTP_REFERER} ^https?://([^.]+\.)*example\.com [NC]
RewriteRule ^ - [F]

If you want to be smart and shorten your time with image linkers, then slap this into your .htaccess file. This script will boot any person / user from eating MOST of your bandwidth. Just save the rest for the angel will ya?

Warning: image thief shall be booted! Beware of dogs!!

RewriteEngine on
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://(www\.)?domain.com/.*$ [NC]
RewriteRule \.(gif|jpg)$ - [F]

6.] Email bots will… let just say: most of them will harvest your email addresses or eat your bandwidth until you are dry. They also act like idiots and they will love your medicine, if you add these sources for protection.

- I love you .htaccess! You are my hero!!

Ohhh… just forget the romance and stick this in your .htaccess file!

RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPickerSE [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPickerElite [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailCollector [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^FrontPage [OR]
RewriteCond %{HTTP_USER_AGENT} ^vayala [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro
RewriteRule ^.* - [F,L]

Alright everyone! This is the end Lair360’s Volume 3. But, don’t forget to support this domain and do some donation. If you don’t, then I will have to stop everything and pull the plug. Simple as it can be. No more FREE articles and resources to share or learn…

Copyrighted By Lair360

Version: 11.1
Revision: 33 Build 12

Give the thieves a good kick in the butt!

For the passed months, I was reading a book about “Linux coding”. It really made me wanting to simplify the ‘htaccess’ by modifying parts of my blocking sequences. So that the server doesn’t get angry and overkill the resources. However, this source will only support ‘Linux’ servers with HTA backbone support.

1.] Create a new ‘HTA script file’ and copy these codes…

RewriteCond %(HTTP_REFERER) !^http(s)?://(www\.)?your-domain\.com [NC]
RewriteCond %(HTTP_REFERER) !^$
RewriteCond %(HTTP_REFERER) ^http(s)?://.*$
RewriteRule \.(jpe?g|gif|png|bmp)$ - [F]

2.] Save your new ‘HTA file’ and delete your old revision. Nevertheless, if you want to keep your old file, you will need to rename it as ‘old.htaccess’ or something like that.

3.] Upload your new ‘htaccess’ file and delete your internet temporary files.

4.] You are done!

Tips for confused users

‘nocase | NC’ [no case] – this source makes the test case-insensitive. In other terms, there is no similarity or difference between ‘upper-cases and lower-cases’. This flag is effective only for comparison, and it has no direct – effect on file systems and sub-request checks.

‘ornext | OR’ [or next condition] – this source is useful if you want to link or combine individual rules with a local OR instead of the using AND.

‘forbidden | F’ (force URL to be forbidden) – this source forces the Url to be forbidden for all users. So, if you ever add one of these commands, there is going to be a 403 (FORBIDDEN) message right at your door.

‘^’ – this is the start of line anchoring.
‘$’ – this is the end of line anchoring

Copyrighted By Lair360

Version: 13.1
Revision: 23 Build 13

Parse HTML files as PHP

Introduction: On the 29th of October, I was trying to get my server to parse php codes from a html / htm file. However, when I tried to define the extension, my server just prompt the user to download a file. But, that is not what I wanted! So, I asked Pickaweb for assistance. Soon enough, my problem was fixed!

Here is my tutorial for Pickaweb users. But, please be aware that this article is only for user who is registered with Pickaweb, as their hosting provider.

Notes: by parsing php codes inside your html file, you can implement image – ads and other sources without touching your main file. This is also useful if you’re adding a big chunk of codes without messing your original html / htm files.

1.] Login to your FTP server and look for your “.htaccess” file.

2.] Rename the file and download it to your hard drive.

3.] Copy one of these codes and paste it to the bottom of your “.htaccess” file.

// For PHP5 Server.
// -----------------------
AddHandler application/x-httpd-php5 .html .htm
AddType x-mapp-php5 .html .htm

// For PHP4 Server.
// ----------------------
AddHandler application/x-httpd-php4 .html .htm
AddType x-mapp-php4 .html .htm

4.] Save your changes and delete your old “.htaccess” file (online server).

5.] Upload your modified file and rename it. After that, you will need to clear your Internet caches and temporary files.

6.] Check your website and have fun!

7.] You are done!

Copyrighted By Lair360

Version: 13.2
Revision: 34 Build 13

HTA – Redirect everyone for site maintenance.

Introduction: When I checked my email, I had a request from a uni-student.
He’s asked me for help. It’s about blocking users from his old domain and redirecting them to his new domain.

Notes: this is also useful if you want to tell “Google Engine” that you are changing domain name.

Anyway, if anybody wants to use this script, then you must have “Static IP Address + HTA Engine.” However, if you haven’t got HTA engine, then you’ll need to consult this problem with your provider.

Warning: if you want to check your old domain, you must input the correct IP address (your IP Address), or else, you be redirected to your new domain. Also, if you want to keep this script, then you’ll need to comment out “Remote Address”. Just add ‘#’ before each command. But, there is another thing: this will only work if you still have your previous domain name.

Finally, if you have SSL encryption, please use this command: “https” – encrypted connection.

Caution *1: if there is a problem with the script, just keep it simple and remove “R=301″ and replace it with “R”.
Caution *2: if your website has SSL, then please comment “HTTP_HOST” and remove comments for this command: “SERVER_PORT”.

HTA – Redirect everyone to a new domain (accept you).
———— Copy Text —————

RewriteEngine On
Options +FollowSymLinks
# This is where you add your IP address.
RewriteCond %{REMOTE_ADDR} !^1\.2\.3\.4$
#---------------------
# This is use if your hosting provider requires ports.
# RewriteCond %{SERVER_PORT} 80 [NC,OR]
# RewriteCond %{SERVER_PORT} 443 [NC]
# RewriteCond %{REQUEST_URI} example
#---------------------
# Match a specific domain OR sub domain (if it exist).
RewriteCond %{HTTP_HOST} ^(.+\.)?example\.co\.uk$ [NC,OR]
RewriteCond %{HTTP_HOST} ^(.+\.)?example\.co\.cc$ [NC]
# %1 is the sub domain (or empty).
RewriteRule ^(.*)$ http://%1example.net/$1 [R=301,L]
# RewriteRule ^(.*)$ https://%1example.net/$1 [R=301,L]

———— End —————

Notes: if you don’t have SSL and the above looks complicated, please use this instead.
———— Copy Text —————

RewriteEngine On
Options +FollowSymLinks
# This is where you add your IP address.
RewriteCond %{REMOTE_ADDR} !^1\.2\.3\.4$
# Match a specific domain OR sub domain (if it exist).
RewriteCond %{HTTP_HOST} ^(.+\.)?example\.co\.uk$ [NC,OR]
RewriteCond %{HTTP_HOST} ^(.+\.)?example\.co\.cc$ [NC]
# %1 is the sub domain (or empty).
# %2 is SSL encryption (or disabled)
RewriteRule ^(.*)$ http://%1example.net/$1 [R=301,L]

———— End —————

Copyrighted By Lair360

Version: 11.1
Revision: 23 Build 13

HTA – CEO friendly redirects.

Introduction: when I was eating at the Fish ‘n Chips shop, my head was thinking about links redirect (www and non – www). But, its not just about this redirect! It’s about your site’s CEO. In other terms, I have to create a smaller HTA file which consists these redirect without hurting other search engines. But, don’t panic, these codes were written from scratch and tested for a month!
———————

1.] Download Notepad++ (http://notepad-plus.sourceforge.net/) from the author’s website and install the application.

2.] Paste these codes and save it as: “codes.htaccess” file. After that, just delete your old HTA file (which is located in your server) and upload your new version. Then, you’ll need to rename it as: “.htaccess” (without the ‘codes’).

3.] Refresh your browser and let the changes take effect.

- Codes without WWW.
—————————-

<IfModule mod_rewrite.c>
RewriteEngine On
#Options +FollowSymLinks
RewriteBase /
RewriteCond %{HTTP_HOST} ^www\.(.*)$ [NC]
RewriteRule ^(.*)$ http://%1/$1 [R=301,L]
</IfModule>

—————————-

- Codes with WWW.
—————————-

<IfModule mod_rewrite.c>
RewriteEngine On
#Options +FollowSymLinks
RewriteBase /
RewriteCond %{HTTP_HOST} !^www\.
RewriteRule (.*) http://www.%{HTTP_HOST}/$1 [R=301,L]
</IfModule>

—————————-

Copyrighted by Lair360

Version: 13.1b
Revision: 43 Build 12

How to redirect non – encrypted webpage to ssl encrypted webpage

Introduction: when I was repairing my website and directories, I’ve managed to re-direct all of my webpages to SSL encrypted pages. However, this techniques requires “htaccess” script for redirecting webpage. This will only work with a private IP address + SSL supported server.

Notes: for this to work, you must have a private IP address and a working SSL certificate. These can be obtained by the hosting provider.
Just talk to them and they will sort these out for you. When you’re done, you can read this tutorial…

1.] Execute your FTP application and log-in. Wait for the server to connect and navigate yourself to your WordPress directory. After that, you must look for your htaccess files and transfer them to your hard drive. When you’re done with this procedure, please execute your htaccess file (from your hard drive) and make sure that you have this or something that is / are similar.

<IfModule mod_rewrite.c>
RewriteEngine On
#Options +FollowSymlinks
RewriteBase /blog/
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /blog/index.php [L]
</IfModule>
# END WordPress

2.] If you have the source, which is shown above, please add this below “# END WordPress” and save your work.

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{SERVER_PORT} 80
RewriteCond %{REQUEST_URI} wp-login.php
RewriteRule ^(.*)$ https://webpages.co.uk/blog/$1 [R,L]
</IfModule>
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{SERVER_PORT} 80
RewriteCond %{REQUEST_URI} wp-admin
RewriteRule ^(.*)$ https://webpages.co.uk/blog/$1 [R,L]
</IfModule>

Notes: if you want your entire blog to be encrypted, please use this source provided. But, you must alter “webpages.co.uk” with your own website / domain. Also, the default port is 80. But, if there is a problem with your ports, please consult your problems with your hosting provider.

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{SERVER_PORT} 80
RewriteCond %{REQUEST_URI} blog
RewriteRule ^(.*)$ https://webpages.co.uk/$1 [R,L]
</IfModule>

3.] Save your progress and delete your old htaccess file (which is from your server). When you’re done, please double check your server and upload your modified htaccess file. After that, you must clear your internet temporary files and check your website.

4.] Done!

Copyrighted by Lair360

Version: 13.1
Revision: 22 Build 12c

How to remove world wide web – WWW

Introduction: everyday in my life, there are hundreds of users, who would like to get rid of this annoying “world wide web”, which is located on their hosting services and the address bar. These strings can be remove by using “htaccess” commands, to redirect a web-link into an url without “www”.

Example: all urls will be redirect by the ‘htaccess’ files, from “www.example.com” to “example.com”, even if the “www” is typed into the address box.

1.] Create a single “.htaccess” file or add this code into the top of your “.htaccess” file.
But, you must delete your old “htaccess” files (server files) before you transfer it into your hosting server. If you overwrite it, the codes will not work…

—Copy Source Code—

<IfModule mod_rewrite.c>
RewriteEngine On
Options +FollowSymLinks
RewriteCond %{HTTP_HOST} ^www\.example\.come$ [NC]
RewriteRule ^(.*)$ http://example.com/$1 [R=301,L]
</IfModule>

—End Source Code—

Notes: replace “example” with your own domain names (before you import). After that, just clear your internet browsers’ temporary files and caches.

2.] Check your website by typing the urls with “www” and see it for yourself.

3.] Finish!

Tips: if you want to be smart and keep your page rank from being slaughter, you can use this htaccess methods to hide this problem.

—Copy Source Code—

<IfModule mod_rewrite.c>
RewriteEngine On
#Options +FollowSymLinks
RewriteBase /
RewriteCond %{HTTP_HOST} ^www\.(.*)$ [NC]
RewriteRule ^(.*)$ http://%1/$1 [R=301,L]
</IfModule>

—End Source Code—

Notes: just remove the “#” symbol, if you want to activate “FollowSymLinks”.

Version: 41.1s
Revision: 141 Build 46

RewriteEngine – Blocking Robots v3

Introduction: this powerful ‘htaccess’ script was designed and tested for 2 months.
It was a successful project and it’s free for use! However, you must have “RewriteEngine” enabled for the process to work!

1.] Download notepad++ from the original author or from a mirror and install the software.
——————————-

http://sourceforge.net/projects/notepad-plus/

http://filehippo.com/download_notepad/

——————————-

2.] Copy this “ANSI – script” and save it as a “.htaccess” extension.

Notes: if you want to cancel any robots or harvester from being block, you’ll need to add the comment symbol “#” (without the quotes).

Advice: To activate the script, please unmark the comment symbol (#) from line two and three. That is all…

—Copy Source Code—

# -blockBots-
Options +FollowSymlinks
RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} ^web.?(auto|bandit|collector|copier|devil|hook|mole|miner|mirror|reaper|sauger|sucker|site|snake|stripper|weasel) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Alphared [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SapphireWebCrawler\ Nuch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^AsiaNetBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^DIIbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailCollector [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^PERL/? [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Indy.Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InternetSeer.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^RADIAN6.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^R6_ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WIKIOFEED\ wikio.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JAVA [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Java/1.4.1_ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JAVA/1.6.0_ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^JAVA/1\.* [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WhosTalking [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WebEnhancer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^vayala [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^EATRSSFEEDHUNGRYSPIDER\* [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^TurnitinBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^psbot [NC]
RewriteRule ^.* - [F,L]

—End Source Code—

3.] Remove the old file from your server and upload your new version!

4.] Done!

Notes: if you want to download the files, you can use this link instead: http://www.2shared.com/file/5082668/bfa5c0cc/Blocking_Robots.html

Copyrighted by Lair360

Version: 43.1
Revision: 13 Build 11

Mod_deflate.c – compress webpages and files

Introduction: from my previous article, I was writing my favourite tutorial about “Gzip” compression for Apache v1.3xx or above. But, this time I would be writing: “mod_deflate.c” which is designed for Apache v2.0xx or above.

Notes: older browser may cause problems with “mod_deflate” compression.
Nevertheless, if you are using these browsers: “IE5, IE6, IE7, Opera 8 & 9, Safari, Camino & FF1 & FF2”, then you are not effected!

1.] Download notepad++ from the original author or from a mirror and install the software.
——————————-

http://sourceforge.net/projects/notepad-plus/

http://filehippo.com/download_notepad/

——————————-

2.] Copy one of these codes and insert at the very top of the “.htaccess” file.
However, please delete your old “.htaccess” files before uploading…

a.] match a certain type of files or extension and compress (v1).
—Copy Source Code—

<IfModule mod_deflate.c>
<FilesMatch "\\.(js|css|html|htm|php|xml)$">
SetOutputFilter DEFLATE
</FilesMatch>
</IfModule>

—End Source Code—

b.] deflate individual files (manually) and exclude the rest…
—Copy Source Code—

<IfModule mod_deflate.c>
<Location />
# Files and Text to compress
#***************************
AddOutputFilterByType DEFLATE text/plain
AddOutputFilterByType DEFLATE text/html
AddOutputFilterByType DEFLATE text/xml
AddOutputFilterByType DEFLATE text/css
AddOutputFilterByType DEFLATE application/xml
AddOutputFilterByType DEFLATE application/xhtml+xml
AddOutputFilterByType DEFLATE application/rss+xml
AddOutputFilterByType DEFLATE application/javascript
AddOutputFilterByType DEFLATE application/x-javascript
AddOutputFilterByType DEFLATE application/x-httpd-php
AddOutputFilterByType DEFLATE application/x-httpd-fastphp
AddOutputFilterByType DEFLATE application/x-httpd-eruby
# Files and Text to exclude from compression
#***************************
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.avi$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mov$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mp3$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mp4$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.rm$ no-gzip dont-vary
</Location>
</IfModule>

—End Source Code—

Notes: please remove the ones which you don’t need or require.

c.] compress a specific directory…
—Copy Source Code—

<IfModule mod_deflate.c>
<Directory "/static/help">
AddOutputFilterByType DEFLATE text/plain
AddOutputFilterByType DEFLATE text/html
AddOutputFilterByType DEFLATE text/xml
AddOutputFilterByType DEFLATE text/css
</Directory>
</IfModule>

—End Source Code—

e.] using “mod_deflate.c” and disable buggy browser from compressing data.
—Copy Source Code—

<IfModule mod_deflate.c>
  # Compress contents that of a certain type
  AddOutputFilterByType DEFLATE text/plain
  AddOutputFilterByType DEFLATE text/xml
  AddOutputFilterByType DEFLATE application/xhtml+xml
  AddOutputFilterByType DEFLATE text/css
  AddOutputFilterByType DEFLATE application/xml
  AddOutputFilterByType DEFLATE image/svg+xml
  AddOutputFilterByType DEFLATE application/rss+xml
  AddOutputFilterByType DEFLATE application/atom_xml
  AddOutputFilterByType DEFLATE application/x-javascript
  AddOutputFilterByType DEFLATE application/x-httpd-php
  AddOutputFilterByType DEFLATE application/x-httpd-fastphp
  AddOutputFilterByType DEFLATE application/x-httpd-eruby
  AddOutputFilterByType DEFLATE text/html

# Files and Text to exclude from compression
#***************************
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.avi$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mov$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mp3$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.mp4$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.rm$ no-gzip dont-vary

# Properly handle old browsers that doesn't support compression
  BrowserMatch ^Mozilla/4 gzip-only-text/html
  BrowserMatch ^Mozilla/4\.0[678] no-gzip
  BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</IfModule>

—End Source Code—

f.] compress all types of extension and exclude the rest (v2).
—Copy Source Code—

<IfModule mod_deflate.c>
<Location />
    SetOutputFilter DEFLATE
      SetEnvIfNoCase Request_URI  \\.(?:gif|jpe?g|png)$ no-gzip dont-vary
      	SetEnvIfNoCase Request_URI  \\.(?:exe|t?gz|zip|gz2|sit|rar)$ no-gzip dont-vary
	</Location>
</IfModule>

—End Source Code—

e.] Compress everything with “DeflateFilterNote”. However, this is optional…
—Copy Source Code—

<IfModule mod_deflate.c>
SetOutputFilter DEFLATE
DeflateFilterNote ratio
	SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
	SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
	SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
</IfModule>

—End Source Code—

f.] Deflate everything with browser support (mostly for older browser).
—Copy Source Code—

<IfModule mod_deflate.c>
SetOutputFilter DEFLATE
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</IfModule>

—End Source Code—

g.] This is one of my version, which I was using from my previous server, in-fact, it was a very well built version. However, there two big setback…
————————————————–
1.] To allow compression from a proxy client, you’ll need to install “mod_headers.so”.
Without this “mod_engine.so”, there might be some errors and conflicts if you’re behind a ‘proxy’ server!

2.] You’ll need to remove some parts and stitch them up by pieces.
Nevertheless, if you don’t know, please use the above codes…
—Copy Source Code—

# Version: 31
# Apache Version: 2.1xxx
#*******************************

# Method 1 - Only compress specified content type
<Location />
  <IfModule mod_deflate.c>
    # compress content with type html, text, and css
    AddOutputFilterByType DEFLATE text/html text/plain text/css
    <IfModule mod_headers.c>
      # properly handle requests coming from behind proxies
      Header append Vary User-Agent
    </IfModule>
  </IfModule>
</Location>

# Method 2 - Compress all content, manually excluding specified file types
<IfModule mod_deflate.c>
  # place filter 'DEFLATE' on all outgoing content
  SetOutputFilter DEFLATE
  # exclude uncompressible content via file type
  SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png|rar|zip)$ no-gzip dont-vary
  <IfModule mod_headers.c>
    # properly handle requests coming from behind proxies
    Header append Vary User-Agent
  </IfModule>
</IfModule>

# deflate.log.
# log compression ratio on each request
<IfModule mod_deflate.c>
  DeflateFilterNote Input instream
  DeflateFilterNote Output outstream
  DeflateFilterNote Ratio ratio
  LogFormat '"%r" %{outstream}n/%{instream}n (%{ratio}n%%)' deflate
  CustomLog logs/deflate.log deflate
</IfModule>

# Properly handle old browsers that do not support compression
<IfModule mod_deflate.c>
  BrowserMatch ^Mozilla/4 gzip-only-text/html
  BrowserMatch ^Mozilla/4\.0[678] no-gzip
  BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</IfModule>

—End Source Code—

h.] This is my final version. But, lets just say: ‘it’s a little bonus for everyone to enjoy…’

Notes: this “htaccess” script has browser support (for older browser), Log format and deflate compression level.

DeflateCompressionLevel 1

Warning: setting your “compression level + memory level” from 1 to 9, this could destroy your data, triggers errors and accessive bandwidth. So, please consider your compression level before you continue.
—Copy Source Code—

# Version: 45.1 [Final]
# mod_deflate engine
#*****************************
<IfModule mod_deflate.c>
        AddOutputFilterByType DEFLATE text/plain
        AddOutputFilterByType DEFLATE text/html
        AddOutputFilterByType DEFLATE text/xml
        AddOutputFilterByType DEFLATE text/css
        AddOutputFilterByType DEFLATE application/xml
        AddOutputFilterByType DEFLATE application/xhtml+xml
        AddOutputFilterByType DEFLATE application/rss+xml
        AddOutputFilterByType DEFLATE application/javascript
        AddOutputFilterByType DEFLATE application/x-javascript
        DeflateCompressionLevel 9
	DeflateMemlevel 9
        BrowserMatch ^Mozilla/4 gzip-only-text/html
        BrowserMatch ^Mozilla/4\.0[678] no-gzip
        BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
        DeflateFilterNote Input instream
        DeflateFilterNote Output outstream
        DeflateFilterNote Ratio ratio
        LogFormat '"%r" %{outstream}n/%{instream}n (%{ratio}n%%)' deflate
</IfModule>

—End Source Code—

i.] This version was created for advance users. However, please be careful about the compression level. They can also eat up your server’s memory and CPU usage!

—Copy Source Code—

<IfModule mod_deflate.c>
SetOutputFilter DEFLATE
DeflateFilterNote ratio
DeflateCompressionLevel 9
DeflateMemlevel 9
DeflateWindowSize 15
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar|Z)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
</IfModule>

—End Source Code—

3.] Save your “htaccess” file and upload it to your server.
But, don’t forget to delete the old version before uploading!!

4.] Done!

Notes: please check your website if you have compression enabled…

http://www.seoconsultants.com/tools/compression.asp

Tips: if you’re getting an error, please try this method…
—Copy Source Code—

<Location />
<IfModule mod_deflate.c>
SetOutputFilter DEFLATE
DeflateFilterNote ratio
DeflateCompressionLevel 9
DeflateMemlevel 9
DeflateWindowSize 15
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar|Z)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
</IfModule>
</Location>

—End Source Code—

Copyrighted by Lair360

Version: 43.1
Revision: 13 Build 11

Gzip – compress webpages and files

Introduction: when I was writing another article, I was thinking about a small box that could fit many things inside without force. So, I decided to write a big article that will enable you to compress your html, php, css and javascript files without looking at a book! However, you’ll need make sure that you have “mod_gzip.c” enabled by your server provider, if not, you’ll need to notify them or ask them if “Gzip.c” was enabled.

1.] Download notepad++ from the original author or from a mirror and install the software.
——————————-

http://sourceforge.net/projects/notepad-plus/

http://filehippo.com/download_notepad/

——————————-

2.] Copy one of these codes and insert at the very top of the “.htaccess” file.
However, please delete your old “.htaccess” files before uploading…

a.] Compress a certain file type – extension.
—Copy Source Code—

<IfModule mod_gzip.c>
<Files *.html>
    SetOutputFilter DEFLATE
</Files>
</IfModule>

—End Source Code—

b.] Compress multiple type of contents.

Notes: the lines: “no-gzip dont-vary” was added to exclude certain types of files.
This is useful if you don’t want a particular file to be compress…
—Copy Source Code—

<IfModule mod_gzip.c>
<Location />
    SetOutputFilter DEFLATE
      SetEnvIfNoCase Request_URI  \
	\.(?:gif|jpe?g|png)$ no-gzip dont-vary
    SetEnvIfNoCase Request_URI  \
	\.(?:exe|t?gz|zip|gz2|sit|rar)$ no-gzip dont-vary
</Location>
</IfModule>

—End Source Code—

c.] Compress certain types of extension in one slot.
—Copy Source Code—

<IfModule mod_gzip.c>
AddOutputFilterByType DEFLATE text/html
AddOutputFilterByType DEFLATE text/plain
AddOutputFilterByType DEFLATE text/css
AddOutputFilterByType DEFLATE text/xml
AddOutputFilterByType DEFLATE application/x-javascript
AddOutputFilterByType DEFLATE application/javascript
AddOutputFilterByType DEFLATE text/javascript
AddOutputFilterByType DEFLATE application/javascript
AddOutputFilterByType DEFLATE application/xhtml+xml
<FilesMatch "\\.(js|css|html|htm|xml)$">
    SetOutputFilter DEFLATE
	</FilesMatch>
</IfModule>

—End Source Code—

d.] This script is for older apache model (version: 1.3xx).
—Copy Source Code—

# GZIP FOR APACHE 1.3.x SERVERS
<IfModule mod_gzip.c>
mod_gzip_on       Yes
mod_gzip_dechunk  Yes
    mod_gzip_item_include file \.htm$
    mod_gzip_item_include file \.html$
    mod_gzip_item_include file \.php$
    mod_gzip_item_include file \.txt$
    mod_gzip_item_include mime ^text/.*
    mod_gzip_item_include file \.js$
    mod_gzip_item_include file \.css$
    mod_gzip_item_include file \.rdf$
    mod_gzip_item_include file \.xml$
    mod_gzip_item_include file \.rss$
    mod_gzip_item_include mime ^application/x-httpd-php
    mod_gzip_item_include mime ^application/x-javascript
    mod_gzip_item_include mime ^application/javascript
    mod_gzip_item_include mime ^text/css$
    mod_gzip_item_include mime ^text/plain$
    mod_gzip_item_include mime ^text/xml$
	mod_gzip_item_exclude mime      ^image/.*
	mod_gzip_item_exclude file \.flv$
	mod_gzip_item_exclude file \.pdf$

</IfModule>

—End Source Code—

e.] this is a portable version and it compress files that ends with a specific extension.
—Copy Source Code—

<IfModule mod_gzip.c>
  <FilesMatch "\.(css|js|x?html?)$">
	SetOutputFilter DEFLATE
  </FilesMatch>
</IfModule>

—End Source Code—

f.] This is another alternative and it does work.
But, this time, the compression engine will support older browser!
—Copy Source Code—

<Ifmodel mod_gzip.c>
<Location />
    SetOutputFilter DEFLATE
      SetEnvIfNoCase Request_URI  \
        \.(?:gif|jpe?g|png)$ no-gzip dont-vary
    SetEnvIfNoCase Request_URI  \
        \.(?:exe|t?gz|zip|gz2|sit|rar)$ no-gzip dont-vary
</Location>
# Deactivate compression for buggy browsers
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</IfModule>

—End Source Code—

g.] This is my last version which includes “cgi-script” and exclude”rspheader” for the compression engine.
—Copy Source Code—

<IfModule mod_gzip.c>
    mod_gzip_on       Yes
    mod_gzip_dechunk  Yes
    mod_gzip_item_include file      \.(html?|txt|css|js|php|ini)$
    mod_gzip_item_include handler   ^cgi-script$
    mod_gzip_item_include mime      ^text/.*
    mod_gzip_item_include mime      ^application/x-javascript.*
    mod_gzip_item_exclude mime     ^application/xml
    mod_gzip_item_exclude mime     ^image/.*
    mod_gzip_item_exclude rspheader ^Content-Encoding:.*gzip.*
</IfModule>

—End Source Code—

e.] This is my own favorite. But, guess what?
It works!
—Copy Source Code—

<IfModule mod_gzip.c>
SetOutputFilter DEFLATE
SetEnvIfNoCase Request_URI \.(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI \.pdf$ no-gzip dont-vary
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</IfModule>

—End Source Code—

Notes: if you want to modify your compression level, just add this code.
But, the maximum level – compression is 9.
—Copy Source Code—

DeflateCompressionLevel 3

—End Source Code—

3.] Save your “htaccess” file and upload it to your server.
But, don’t forget to delete the old version before uploading!!

4.] Done!

Notes: if you want to check your Apache’s information and installed module, then, please use this code…
—Copy Source Code—

<?php
phpinfo();
?>

—End Source Code—

Copyrighted by Lair360