How Long is Long Enough?

I am a skimmer.  When I read, I skim all the descriptive stuff.  I am impatient and I just love the action and I need to get to the end and find out what was going on.  When I wrote my first book (Secrets) I left a lot of the stuff I tend to skim out.  My book ended up around 41k words, as opposed to the 50+ thousand for a typical book.

Is this wrong?

Are there people out there who also skim?  Who just want to stay with the action and don't care about what the house looks like or what the character is wearing?  I really tried to add to the story, but it just felt forced and slowed the story way down.
  
Which then begs the question, how long is long enough?  If a book description interests you, then you see the word count is small (not short story small which is a different category to me) does that make you want the book a little less?  Let's assume the price is low, say 0.99-2.99.

I'd really love to know how people feel about this, especially because my second book will be coming out this  summer and I'm doing the same thing. I think the story is killer and the pace is great and that's all I want from the books I read but...

You tell me...