Go Back to What You Know