TDD: How do you handle loss of work when doing major refactoring?

In a true TDD method, we end up not writing any code at all until all the test cases are written and are working.

Primarily if you are working on a significant feature that takes 3-4 days of coding, writing test cases for it consumes even more time.

How do people who practice TDD properly handle such situations?