Is there any way I can grow bigger breast without gaining weight? I recently lost 20 pounds and I have nothing left. I don't want surgery

No. Breasts are made up of ductal tissue and fat. When the fat went away with the weight loss, then apparently there is very little ductal tissue left. There isn't a way to increase your breast size with out surgery.