I do sometimes. I usually just take Holly into pet friendly places like PetSmart, although I've taken her into a hardware store before. No one said anything about having her with me but they did look. lol One employee did ask me a question on my way out. He asked if she could say taco bell.

lol I also took her into a restaurant before. However, it isn't a typical restaurant and she had been in her carrier. I made sure to ask first, or rather I had my son ask. Who could resist a little boy and his dog? lol
I wouldn't worry too much about it. I've seen other people take their dogs into such places as Wal-Mart, the bank, and the mall. Most were little dogs, although I've seen a couple of large breeds as well. I don't think most places mind. As long as they are being carried around by their person the stores don't have a problem with it. The only time I saw someone get kicked out was at Wal-Mart and that was because their pup (a Rottie) was in a shopping cart. The other two large breeds were on leashes. One was even at the mall! I also saw a chi there!
PS Want to add that I took Holly to PetSmart again today. I also took her into Wal-Mart afterwards...her first trip there! She did beautifully! A perfect little angel! I again got some weird looks as well as some rude ones, but at least I wasn't kicked out! A few people even came up to us and pet her.
I'll have to try the mall one of these days.