Question

Scrapy pipeline not showing errors but not inserting items in mysql (on local works)

I have a scrapy spider that is working correctly on local, but on the server is not adding the items to the database, it doesn’t show any error and all the modules are imported correctly, for the connection to mysql i use twisted adbapi. I checked over and over again the credentials of mysql, but the problem persist, i also changed the bind-address in mysql conf and restarted mysql, but with no luck, I really don’t know what can be the problem. Please help. Thanks.

Subscribe
Share

i solved by adding a debug to the query, mysql was translating warnings in errors. thanks

@ashram78 Have a look in your log files or MySQL - in /var/log/mysql (usually) Otherwise, can you enable debug logging in the “scrapy spider”, which might tell you where things go wrong?


Submit an answer
You can type!ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

This question was answered by @ashram78:

i solved by adding a debug to the query, mysql was translating warnings in errors. thanks

View the original comment