When loading a  hard surface item like goggles that will be sitting on the head,  I don't "fit to"  but simply parent to the head bone then use the various adjustments to manual fit it to the character. Tends to work for eyeglasses too.