Maybe he only said it once. It's definitely in the beginning of
Serenity.
Capt. Malcolm Reynolds: Bit of a rockety ride. Nothing to worry about.
Dr. Simon Tam: I'm not worried.
Capt. Malcolm Reynolds: [mocking Simon's seriousness] Fear's nothing to be ashamed of, Doctor.
Dr. Simon Tam: This isn't fear. This is anger.
Capt. Malcolm Reynolds: Well, kinda hard to tell one from t'other, face like yours.
Dr. Simon Tam: Yes, well, I imagine if it were fear, my eyes would be wider.
Capt. Malcolm Reynolds: I'll look for that next time.
link