Hey @Humble Fox!
I'm not sure I understand what you mean?
Do you mean that when you raid a specific channel, Nightbot sends an alert in the chat you raided that it was you?
In that case it's not possible to turn it off, it's the streamer you raid who set up that option.