Server PHP Sites goes down

December 3, 2016 140 views
PHP Nginx CentOS

Our VM's which are in Act-Act Cluster with Apache Application Server hosts 22 PHP websites. Apache is behind nginx and for replication of data we use gluster cluster of 2 peers. Actually, we had 3 node cluster but because of some issue, we dis-connected 3rd node and brick is dis-connected now for gluster. Also we removed the configuration of this node from nginx.

Our sites GOES DOWN every 3-4 days due to heavy load on gluster. We have 16GB RAM over each CentOS 7.x VM's with 8vCPU's. Gluster is in replicated mode with 3 bricks out of which one is dis-connected. We are using FUSE client for Gluster.

Can you please help to tell what to look for in order not to have downtime for our sites? I am new in Gluster. I did some performance tuning of Gluster Volumes but seems its not working. I am ready to share more information if you need.

1 comment
  • I don't think Gluster has got anything to do with the website being down? If the website is down this means either

    • There are to many connections to the website and the server can't handle it all
    • You have bad written code and it crashes when more people load the site

    Use a loadbalancer for this and spread the connections to different servers?

1 Answer

Are you seeing the high load from the gluster service itself or related to the FUSE mount on the client side?

I would recommend starting with the things that @CrypticDesigns mentioned. If you can share some more details it might help narrow down the root cause. When your sites "go down" is apache returning an error page? Is anything recorded in Apache's error log? If the Apache service itself is crashing it may not be directly caused by the GlusterFS setup. When this occurs, what steps do you take to restore your site?

Have another answer? Share your knowledge.