I think the difference in diameters you are seeing is due to your inconsistent closing of the mold halves. I notice the same thing with my bullets. Some are harder to size than others. No biggie.
There is a guy who makes a cam-lock device that will close the mold like nothing else, but I can't think of the name right now.