The most important factor is, are you symptomatic? If you have any symptoms, surgical intervention is recommended.
50% of patients who develop symptoms from as will not survive more than 2 years. Other parameters to look at are the mean gradient > 40 , velocity > 4 m/s, and aortic valve area <1 cm2.
If any of these are met, you should consider surgery.