I want to get out of Verizon CS tangle

I had similar nightmare with Verizon CS. I ordered for high speed internet latenight and the first thing in the morning I called to cancel the order. Verizon rep was pushing me hard to use 30 days free dry loop. I could get connected to Internet from home. Whenever I called them, they would say internet is active and line is working fine. At the end 30 days, I called Verizon CS and canceled the account. He told, as the service is canceled within 30 days of free dry loop, I don't have to pay anything.

After 15 days, they charged my credit card for $51.91. When I called back to ask my money back, they are telling that the service is active, if they want to cancel this service, I would be charged for early termination free $79. What a fate? I called to get my $52 back and they are going to charge $79 more. :-)) Twice the Verizon reps disconnected while talking. Third time I was able to talk completely. She told that there is no note in my account of canceling the service. Its me who called Verizon CS and canceled. If they haven't noted down it, what should I do? For their mistake, do I need to pay $52?

After all this, I wanted to escalate this and was able to talk her supervisor. She was no less than her sub-ordinate. She bluntly told that there is no note of cancellation and $52 can not be waived. Whatever I asked her, she told the same. When I asked her what should I do to escalate further. She replied that it can't be done. After so much of talking, she gave me a confirmation number and told I would get a call withing 24-48 hours.

Any idea of how this should be handled to get out of this mess and also get my money back?