How to set a formatter for file handler that will replace unwanted characters?

I have python logger set, which has 2 handlers – 1 for stdout, 1 for file.