Spaces sometimes slow to load assets?

Why does spaces cdn sometimes take 7-12 seconds to deliver a small asset?

Stack info:

Hardware: 8GM Ram 4 vCPUs

OS: Ubuntu 18

Webserver: nginx with cache setup, h2 working for resources served from NGINX, SSL w/ LE

Spaces CDN: All items have meta data for cache set properly, all files that can be gzipped are and working as expected

PHP: 7.2FPM

Website: Wordpress heavily optimized, 33 requests total, no blocking js/css, scoring 95% on gtmetrix, page size 900kbs

I tested my site and every 15-20 hits there is a single asset that takes 7-12 seconds to load (images, under 130kbs), and its coming from my spaces every time (not nginx). Its weird because my home page is 900kbs and the biggest file i have is 120kbs, so no way it should take 7-12s to load, what can i do to resolve this? I have no render blocking JS or CSS so site will still load but image will be missing for about 6 seconds before it finally received over the wire.