I have a python program that gathers some data from crypto exchanges but the problem is exchanges don’t allow too many requests from the same IP. Can i use my droplets as https proxies and how?
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Hey there,
What I thought of, when seeing “https proxies”, is a tool named ‘proxychains’. However, I browsed a little and noticed a lot of people are complaining proxychains is not working with Python scripts. I saw a solution on the web, you might be interested in:
Source: https://stackoverflow.com/questions/50891138/is-it-possible-to-set-a-proxy-chain-with-pythons-requests-library
Maybe you can try this solution and let me know if it worked? I recommend checking this tutorial of rotating proxies as well: https://www.scrapehero.com/how-to-rotate-proxies-and-ip-addresses-using-python-3/
Regards,