To straightforwardly refuse to do what someone else expects you to do, and state why, is a clear message; a passive-aggressive action is a muddled message encoded in a hostile act. If the other person cares about your needs, the clear statement is enough.