Abdominal exercises to protect your lower back

My back isn't in very good condition.

Ironically, abdominal exercises are good because building core strength is beneficial for strengthening lower back muscles.

I'm too scared to even think about it because I'm afraid of hurting my back.

Are there any abdominal exercises that can build strength to protect my lower back without injuring it?