I ordered new heat set inserts that match the ones on my parts list from Ali Express a while ago and they showed up yesterday.  After measuring them I was able to resize the holes for them to make a better fit.  I went ahead and updated all my models on my thingiverse page to match the new size.  This should make things fit better.