OpenAI's models started mentioning creatures like goblins and gremlins in their metaphors due to a subtle incentive from training for the personality customization feature, specifically the Nerdy personality. The behavior was amplified through transfer from Nerdy personality training and later spread to other contexts, requiring OpenAI to retire the Nerdy personality and implement new tools ...