If I had a CT scan without contrast would kidney stones show up. ..

Yes. In fact, ct scanning without contrast is becoming the gold standard evaluation for kidney stones. Contrast material frequently obscures stones and makes their identification difficult. Stones as small as 1 mm can be detected with unenhanced ct technique. Radiolucent stones which cannot be seen well with plain x-ray technique do show up well with unenhanced ct scan.