If muscle soreness persists while exercising consistently, is the intensity too excessive?

I have been consistently doing brisk walking and strength training, but sometimes muscle soreness lasts for several days. It’s unclear whether I should continue exercising or take a rest. If muscle soreness persists, what criteria should I use to adjust my exercise intensity? I am also wondering if it is okay to do light stretching or walking on my rest days.