Poor diet affects it
The primary factor that affects cholesterol is genetics; your parents play a greater role in your "fasting" cholesterol that does diet
However, a diet high in cholesterol may not greatly affect the "fasting" level but it certainly raises your "peak" cholesterol level, the the highest level your cholesterol reaches throughout the day. Unfortunately, this is something we don't measure. Eat low fat.