Scrapy pipeline not showing errors but not inserting items in mysql (on local works)

Posted March 10, 2017
MySQL Python Ubuntu

I have a scrapy spider that is working correctly on local, but on the server is not adding the items to the database, it doesn’t show any error and all the modules are imported correctly, for the connection to mysql i use twisted adbapi. I checked over and over again the credentials of mysql, but the problem persist, i also changed the bind-address in mysql conf and restarted mysql, but with no luck, I really don’t know what can be the problem. Please help. Thanks.

ashram78

ashram78 • March 10, 2017

i solved by adding a debug to the query, mysql was translating warnings in errors. thanks

Flamber Hansen • March 10, 2017

@ashram78 Have a look in your log files or MySQL - in /var/log/mysql (usually) Otherwise, can you enable debug logging in the “scrapy spider”, which might tell you where things go wrong?

Submit an answer

You can type!ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Andrew SB • February 14, 2018

This question was answered by @ashram78: