When I do an ab exercise, after the first set my abs start to cramp up really badly. Should I stop this.?

You might need to... I don't know for how long have you been doing the exercise. If you just started it may be just the muscle sore from the exercise. With time this will improve. In any other case, you should seek medical care.