Enable .htpasswd File for Subdirectories

I followed this tutorial to get .htpasswd working, however I think I’ve really confused this. I basically need .htpasswd files to work for any subfolder I stick one in.

I have my domain.conf setup like this:

<VirtualHost *:80>
        <Directory /var/www/domain.com>
                Options Indexes FollowSymLinks MultiViews
                AllowOverride All
                Order allow,deny
                allow from all
        </Directory>
        <Directory "/var/www/domain.com/public_html/secure”>
                AuthType Basic
                AuthName "Restricted Content"
                AuthUserFile /var/www/domain.com/public_html/secure/.htpasswd
                Require valid-user
        </Directory>
</VirtualHost>

But, I assume that listing directory twice wasn’t proper. Am I close?