we have the following timeout for external seo bot connecting with our site https://clip2net.com/s/4lIWTcC
agency suggest increasing that timeout setting but we cannot find that under our droplet settings. We run Ubuntu 23.10 x64 on droplet, use cloudflare
can you suggest where we shall search for timeout settings please?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Hey there!
The timeout settings for external connections on your Ubuntu server aren’t managed directly through the Droplet settings on DigitalOcean but can be configured in a few key places on your server itself which you have root access to.
As you’re using Cloudflare and an Ubuntu Droplet, here’s where you can look to increase the timeout:
Cloudflare has a default timeout of 100 seconds for HTTP requests. Unfortunately, this is a fixed limit and can’t be extended directly through Cloudflare’s free plan. If you’re on a paid plan, you may have options to adjust this under “Load Balancing” or “Workers”, but it’s still limited. For more information check out their docs here: https://community.cloudflare.com/t/increase-cloudflare-max-request-duration/482873
Nginx or Apache Timeout Settings on your Droplet:
For Nginx:
/etc/nginx/nginx.conf
or within/etc/nginx/sites-available/
).For Apache:
/etc/apache2/apache2.conf
or in/etc/apache2/sites-available/
.PHP Timeout Settings:
php.ini
, often located at/etc/php/8.2/fpm/php.ini
or/etc/php/8.2/apache2/php.ini
).Feel free to share more details on the services that you are using if those are not the ones you use.
Also worth mentioning that, extending timeout settings too much can sometimes lead to performance issues, as long connections consume resources. Make sure these settings match your server’s capacity like RAM and CPU.
- Bobby
To adjust the timeout settings for connections to your site on Ubuntu 23.10 with Cloudflare, consider the following places to check and modify:
1. Nginx or Apache Web Server
If you’re using Nginx or Apache, these web servers have timeout settings you can adjust to accommodate longer connection times.
/etc/nginx/nginx.conf
or/etc/nginx/sites-available/your_site
), and look for these directives:Adjust the values as needed (e.g.,
60
seconds). After changes, restart Nginx:/etc/apache2/apache2.conf
or your specific virtual host file and set:Then, restart Apache:
2. Cloudflare Settings
Cloudflare also enforces its own timeouts. By default:
If you need a longer timeout than what your current Cloudflare plan allows, you may want to discuss options with Cloudflare support or upgrade to a plan with more flexible timeout settings.
3. Droplet Firewall or Proxy Settings
ufw
), verify that it doesn’t impose additional timeouts.4. Application-Specific Timeout Settings
If your application framework has its own timeout setting, check and adjust it as needed. For instance:
Heya, @salesc322b5c406a5cdf950441
On top of what’s already mentioned, it’s possible that a restrictive
robots.txt
file could be affecting how SEO bots interact with your site, but it wouldn’t typically cause a timeout.This is more a long shot, but it wont hurt checking that a robots file is not denying access to crawlers as well.
Regards