Hal,
The real "fix" is to buy or borrow a morse taper hand reamer, and very carefully and gently deburr the galls off of the taper. ENCO.com sells them for about $28. If, however, you have a "nice" machineshop guy close by who will loan you one or a local turning club that has one to loan to members, you can do it for nuthin'. I know others who use a bit of sandpaper, files, etc., but a taper is a precision machined surface that depends on that accuracy for its usefulness and accuracy. Do it the right way!!
M