Can late ovulation be caused by leftover corpus luteum cysts from the previous cycle?

Yes: Sometimes the ovary does not ovulate and the follicle cyst persists. It will continue to enlarge and can become as big as a baseball. Eventually it will break and the woman may not even be aware that this has happened. The period may be delayed because there is no Progesterone phase of the cycle to respond to. The corpus luteum can also become cystic.