Are kegel exercises supposed to tickle?

No. Kegel exercises do not tickle as a rule. However only you know whether they tickle you.
Kegels. Because you may not be used to working out the muscles if the pelvic floor, you can have different sensations when beginning to do kegels exercises. In general, they do not "tickle.".