By urostadic
I have a python program that gathers some data from crypto exchanges but the problem is exchanges don’t allow too many requests from the same IP. Can i use my droplets as https proxies and how?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
Hey there,
What I thought of, when seeing “https proxies”, is a tool named ‘proxychains’. However, I browsed a little and noticed a lot of people are complaining proxychains is not working with Python scripts. I saw a solution on the web, you might be interested in:
import requests
proxies = {
'http': 'http://10.10.1.10:3128',
'https': 'http://10.10.1.10:1080',
}
requests.get('http://example.org', proxies=proxies)
Maybe you can try this solution and let me know if it worked? I recommend checking this tutorial of rotating proxies as well: https://www.scrapehero.com/how-to-rotate-proxies-and-ip-addresses-using-python-3/
Regards,
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
Full documentation for every DigitalOcean product.
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
Stay up to date by signing up for DigitalOcean’s Infrastructure as a Newsletter.
New accounts only. By submitting your email you agree to our Privacy Policy
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.