Related

Join the DigitalOcean Community Community

Join 1M+ other developers and:

  • Get help and share knowledge in Q&A
  • Subscribe to topics of interest
  • Get courses & tools that help you grow as a developer or small business owner
 Join Now
How To Find php.ini? (Ubuntu LAMP on 18.04) Question Question
How to enable /wp-admin on subdomains Question Question

Question

Poor fsync performance on DO Block Storage

Posted May 24, 2020 969 views
MySQLBlock StorageStorage

Hi there!

I have noticed very poor MySQL (InnoDB) performance on my droplet.

I am running MySQL (Percona Server) 5.6 with fine tuned config.

Database directory placed on BlockStorage.

I used fio utility to test BlockStorage disk performance and everything is ok, if I running fio as described here https://www.digitalocean.com/community/tutorials/how-to-benchmark-digitalocean-volumes . Burst performance approximately near 7500 iops, after 1 minute test it slow down to approx. 5000 iops.

As InnoDB using fsync for each commit operation to compliant data consistency I tested fio performance with fsync for each IO operation (—fsync=1). In test with fsync=1 I noticed only 50-100 iops!

Can anybody answer me why performance so poor in my case?

Add a comment
vasval
By:
vasval

Related

Join the DigitalOcean Community Community

Join 1M+ other developers and:

  • Get help and share knowledge in Q&A
  • Subscribe to topics of interest
  • Get courses & tools that help you grow as a developer or small business owner
 Join Now
How To Find php.ini? (Ubuntu LAMP on 18.04) Question Question
How to enable /wp-admin on subdomains Question Question

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

×
Submit an Answer
1 answer
Simon501 September 29, 2020

I’ve found similar.

After some investigation (and reading up) I think the problem is that DO’s hypervisors do not use battery backed RAID controllers [would be nice if they verified this]. This means an fsync has to pysically flush to disk which is slow even on SSDs.

I see an average of about 20ms which matches your 50/sec. However, I am measuring from within the app which requires a localhost network round trip too… and I’m actually committing real data.

In a previous incarnation I used to manage database RAID arrays and one problem is that once the battery goes (which shows up as a tiny light on the controller and happens every year or two) the performance drops away.

Reply Report

Related

Looking for something else?

Ask a new question Search for more help