It was simple enough to tell a lock to open, or a door to shut. These actions came naturally to those objects, and the universe was glad to oblige. But stuffed animals weren’t in the habit of reanimating to attack things.
I sense the rules for this magic will be strongly plot based