Word Crafting

Have you ever wondered about the order we put words into while communicating? What makes one descriptive word come before another one? For example, the big red house is what most people would say if they are discussing a mansion that is red. If you were to say the red big house, you might be speaking about the prison that is red.
Some people say it is just something that one learns while learning the language. It definitely isn't something that is taught in school. You might diagram sentences or conjugate verbs, but no one ever talks about the proper order of adjectives in a sentence.
This is just a topic that I came across a while back. I didn't even realize that I had been doing this my whole life, but now that I'm aware of it, I often ponder about how we ever decided which one of these descriptors come first. I would dare say that it grew over time and as the culture shaped itself around the words it uses.
I don't think it is something that one needs to worry about, however. In fact, it probably isn't even a hairy, big, fat deal.