Noticed some genital warts near anus opening. Also cold sore on lip. Any OTC medication I can apply?

HSV no, warts maybe. No OTC medications will have any significant benefit against an oral herpes outbreak (cold sore). For warts, there are OTC treatments, such as "Compound W" in the US; I have no idea about what is availalbe in Kenya. But you shouldn't self treat anal warts without professional care. Your diagnosis may be wrong; and in the anal area, significant irritation and ulceration can result.