Preparedness Pro's dashboard

I have just switched from wordpress.com or wordpress.org and have enabled Intense Debate as my comment moderation tool. Unfortunately it is having me approve every single comment, even from people that have commented before, as I have requested in the Intense Debate Moderation options.

How can I change this? With the vast amount of comments that my site receives on a daily basis, it is a staggering time-consuming task in and of itself.

Thoughts?