suggesitons for speed ,performance,memory , server optimization to run crawl web sites
i have a webcrawler (which i programmed it) it crawls www.yemeksepeti.com
it only crawls website and find link of including comments. after this process i am going to fetch comments.
i want to run it on cloud server. i am beginner and What would you recommend for speed, memory of server ?