Fail2ban + UFW not blocking IPs on ubuntu 15.04

The answer by @jtittle1 above is great! Here are the last details you should know:

• UFW might even still register the blocked attempts in /var/log/ufw.log after all of this setup. The trick is to take a look at your rules with iptables -L -n and see where the ufw and fail2ban chains exist (also the DOCKER chains if you are using swarm). If you want to block absolutely everything you need to add rules to your first CHAIN. Here is an example stopping attacks from hitting the UFW logs after they have been banned. Notice the match-set badbots src rule… which is explained below.

Chain INPUT (policy DROP)
target     prot opt source               destination
DROP       all  --  0.0.0.0/0            0.0.0.0/0            match-set badbots src
ufw-before-logging-input  all  --  0.0.0.0/0            0.0.0.0/0
ufw-before-input  all  --  0.0.0.0/0            0.0.0.0/0
ufw-after-input  all  --  0.0.0.0/0            0.0.0.0/0
ufw-after-logging-input  all  --  0.0.0.0/0            0.0.0.0/0
ufw-reject-input  all  --  0.0.0.0/0            0.0.0.0/0
ufw-track-input  all  --  0.0.0.0/0            0.0.0.0/0

• IPTABLES will start to slow down after many thousands of rules are added to the chains, and it will fall off a cliff (in terms of performance) at some point after that. There is a simple solution called IPSET http://ipset.netfilter.org/ that is a plugin to IPTABLES. Instead of pushing thousands of IP addresses into the IPTABLES chain, you can just add them to an IPSET ip hash, which uses a bintree lookup mechanism with average O(log n) search/insert/delete time complexity (Excellent!) , vs the IPTABLES O(n) time complexity (Fair). Take a look at the Big-O Complexity Chart to understand the performance difference. Here’s a quick-start guide to add IPSET to the setup that @jtittle1 gave above while being 100% certain the IPs are blocked from your entire server:

1. apt-get install ipset
2. ipset -exist create badbots iphash
3. iptables -I INPUT 1 -m set --match-set badbots src -j DROP

Then change /etc/fail2ban/action.d/ufw.conf to this:

[Definition]

actionstart =
actionstop =
actioncheck =
actionban = ipset -exist add badbots <ip>
actionunban = ipset -exist del badbots <ip>

NOTICE: one IPSET hash can hold up to 65536 IPv4 addresses. You can check how many IPs have been added to your hash with ipset list badbots | wc -l. If you start to approach 65k at some point just create a second IPSET hash and begin using it:

1. ipset -exist create badbots2 iphash
2. iptables -I INPUT 1 -m set --match-set badbots2 src -j DROP

Then edit ufw.conf

...
actionban = ipset -exist add badbots2 <ip>
actionunban = ipset -exist del badbots2 <ip>

@risarisa

The issue is that Fail2Ban uses iptables, not ufw (even if ufw is a wrapper for iptables). The order by which the rules are implemented is key as that’s the order they’ll be executed in. Any allow rule set by iptables that get’s executed before your ufw rules means that your ufw deny won’t do anything as the allow is already allowing the connection. If a block follows on down the list, that doesn’t matter either; the allow is still there before the deny or block.

To get around this, you can setup customized definitions for Fail2Ban. This is a more restrictive setup. It will ban any IP that is tagged with UFW BLOCK in the ufw log.

You can do this by creating a file:

/etc/fail2ban/action.d/ufw.conf

and to it add:

[Definition]
actionstart =
actionstop =
actioncheck =
actionban = ufw insert 1 deny in from <ip>
actionunban = ufw delete deny in from <ip>

What the insert 1 does is ensure that this rule is added to the top.

Now we need to create a filter file to tell fail2ban when to ban a user. We can create a file named:

/etc/fail2ban/filter.d/ufwscanban.conf

and to it add:

[Definition]
failregex = UFW BLOCK.* SRC=<HOST>
ignoreregex =

If you look at /var/log/ufw.log, you’ll see where this regex comes in to play. If you do not have a log file, try running ufw logging low or ufw logging medium. It seems in many cases, logging is either turned off by default or it’s on and the log file is never created. Running either of those commands will create that file.

Finally, we need to modify the jail.conf file and add:

[ufwscanban]
enabled  = true
filter   = ufwscanban
logpath  = /var/log/ufw.log
action   = ufw
maxretry = 5

This limits the maxrety attempts to 5. If this limit is exceeded, the actionban action is taken. You’ll notice that the filter is simply set to the name of the filter file we created, without the .conf extension and that we’re using /var/log/ufw.log as the logpath, which in this case, is the file we’ll be scanning (which is why it’s important to run the commands mentioned above to ensure that this file is created).

Of course, this is just an example. And as above, it’s not port specific. This will block any IP on any port that exceeds the maximums.

–

As a side note, if you’re having complications with ufw + fail2ban beyond the above, you may want to look at Config Server Firewall (CSF) which has it’s own Login Failure Detection (LFD). It’s commonly used on cPanel/WHM servers, though it can be used effectively as a standalone (with options available from the CLI).

http://configserver.com/cp/csf.html

…of course, you’d want to make sure that Fail2Ban & UFW are disabled fully before enabling this. I can say, from experience, that it works and in most cases, it works without any issues (and it bans!). Just make sure you whitelist your IP('s).

Hello there,

You can install CSF in order to manage the Firewall configuration of the droplet. CSF is extremely easy to use and configure.

To block an IP address or range just use:

csf -d IPaddress

We also have a tutorial which you can check here:

https://www.digitalocean.com/community/tutorials/how-to-install-and-configure-config-server-firewall-csf-on-ubuntu

Regards