Dizziness after taking hypertension medication

I developed high blood pressure after menopause and have been taking medication for 8 years. However, recently, when I go to the hospital and have my blood pressure checked, it shows low blood pressure, and I experience dizziness, causing me to stumble several times while walking. Even after adjusting the medication to a lower dose, I still feel some dizziness. I don't know what to do. I am afraid to completely stop the medication, so I haven't even tried to do so.