Adding a location block to your Nginx configuration with a try_files directive like the one below will allow URLs without php or html extensions to work correctly:

    location / {
                try_files $uri $uri/ $uri.html $uri.php;
    }

For more information on how the try_files directive works, check out this tutorial:

• Understanding Nginx Server and Location Block Selection Algorithms