In these cases I write a note with the following words: Thank you so much for the wonderful opportunity. I wish I had time to participate. Please don’t interpret my lack of time for a lack of interest. This short message captures how much I appreciate the invitation and opens the door to potential future opportunities.
