There’s no rule against such informality—trust your ear and your instincts. I only suggest avoiding one form—“I’d,” “he’d,” “we’d,” etc.—because “I’d” can mean both “I had” and “I would,” and readers can get well into a sentence before learning which meaning it is.