After you’ve set up your corporation, you’ll need to file annual tax and reporting returns with the state (the state tax or revenue office and the attorney general) as well as the Internal Revenue Service. Also, you will need to regularly prepare minutes of ongoing corporate meetings, and, occasionally, forms for amending articles and bylaws.