How can you tell if it’s imagination or memory?

Imagination is controllable. Memory is not. You can actively participate in imagination, while a memory just lives - it's not something you can actively control and change.