I created the ssh key on linux and would like to use it to access my server on windows using filezilla. Is this possible?

Do I copy the idrsa and idrsa.pub files from linux to windows (using usb)?
If so, do I have to change the permissions? Because when I try and copy them to a usb it won't let me.

Once they are on my windows machine what do I have to do to get it working in filezilla?