I have set up a Ceph cluster on DO. It worked, but I did not spend too much time using it. I don’t think it’s particularly well-suited for an environment where you don’t have full control over the network subnets and the storage attached to the server. You may also want to check out Gluster.

I’m interested in this as well, the main issue is that GlusterFS doesn’t handle metadata that well and with our websites (90-300k small files) it ends up exploding.
Openstack Swift is great, but the access is through a RESTful API

Cheers

I found the write performance on GlusterFS awful and would not use it again. Friends of mine have told me that with each new release the write performance is getting worse. GlusterFS seems to be Ok for object storage (though personally I would use DO’s solution instead as it is simpler and cheaper) , but definitely not as a filer layer.