It's exactly what you think it is.
.. Cramping. When you bike, walk, jog, you are using your "core muscles" which include your abs. Like leg muscles, these can get tired and sore. Don't worry, it's nothing serious, and after a few weeks to months of exercising consistently, it shouldn't bother you as much.