I told him I uses to be a dancer and this was his reaction..?

I am 33, he's 45. We are both very successful in our careers. We both want a family. We have grown very close recently. Only been dating since January. I shared with him months ago that when I was 19 I worked as an exotic dancer at a night. I never share that with anyone, for I know how it sounds, but I wanted him to know me mire and the struggles I went through to be where I am today. He was shocked, but told me how hot he thought it was, but he did tell me he didn't think I should share that with just anyone. I told him that only few people know that, but I felt comfortable to confide in him. Well, this past weekend we were drinking and hanging out with his friends and we all ended up at a strip club. He then looked at me and told me NOT to say anything about what I had done previously or u would be gone! I was so upset! I confided in him and he used it against me. He then said he only meant that I was drinking and didn't want me getting loose lipped. I was like.. I have told 3 people that and never a guy I dated. I haven't spoken to him since the weekend because of it. He did apologize, but I am holding a grudge. I feel so hurt! I am thinking about calling it quits and lesson learned!! Never share that again.. Am I over reacting?