Thank you both for your responses. I at first thought it might be anxiety, but this morning when I got up I saw that he had peed and pooed in the house. I'm starting to think he may have been pee pee pad trained in his prior home. That won't work for us. Neither of us can come home at lunch so we may have to try something like a playpen. I guess we have a long road ahead of us.
Thanks again for the help. You may be seeing more questions from me in the future. I've always had large dogs that were fairly easy to train so this little fella is quite the opposite.