The lack of memory of past existence isn't evidence of anything. We have clear evidence that memories are physical things, stored as connections of neurons in the brain. They can be lost to disease or injury, and they're destructively modified every time we access them.