The "wrong abstraction" problem occurs when code is modified to accommodate new requirements, leading to conditionals and duplicated logic, making it hard to understand and maintain. The solution is to "go back" and remove the abstraction, inlining code to make it easier to understand and add new features, rather than trying to preserve the existing code.