Lapping the brass bushing with a drill comes AFTER it's removed and can be inserted reasonably easy. To get yours out if it's that tight you might heat the stuffing tube (put a wet rag around the tube where it enters the hull to prevent heat transfer damage) and grab the end in vice grips. You might need to sacrifice the end but a replacement brass bushing doesn't cost much.
OR much easier and will allow less stressful strut angle adjustment :
Cut stuffing tube so that only 1/4" or so enters the strut and press in one at the rear and one right after where the stuffing tube ends.
https://www.offshoreelectrics.com/pr...od=oct-oc6ltsb