I've learned to be a lot more fast and loose with it. These days I'm doing video AND audio. For video, we've settled on Riverside (paid). I use Magic Audio and make small edits via transcript.
For audio, I still run through Auphonic and edit in Garageband. I have spent tons of time EQing and the rest, but ultimately I just 80/20 it all, for better or worse.
I tend to edit same time as recording so I remember anything to snip ASAP.