Sounds like your starter needs a rebuild. The brushes inside wear out over time. I've had serveral cars over the years with the same symptoms (starter needing a bump from the battery directly or a tap with a hammer)
Rebuilds kits are pretty inexpensive.