Should I have chosen mastectomy over lumpectomy to avoid callback anxiety?

I may be regretting keeping my breast. I was diagnosed with dic stage 1B, grade, 3 er+ her2- breast cancer last year. I treated it with a lumpectomy and 16 rounds of radiation. I went in for my yearly mamo last week and they called me back for further diagnostic imaging this week for a spot they found on the same breast. This is my third scan since my diagnosis last year. Each time, they think they see something, call me back and look into it and it ends up being nothing. But it puts me in absolute anxiety and turmoil for the 1-2 weeks while going through these screenings and call backs. Does it get better? Is this the rest of my life? Every year/6months I get to stress about the potential? Should’ve I just gotten a mastectomy?