I’ve always been like this as well. I forget everything unless I think really hard about it and trace the events step by step.
There’s also the autism of not wanting to be observed, so if I am to remember I have to force myself to “observe” myself through asking my own mind what I did. Which might be the reason for the “forgetting” as a way of unconscious protection.
A way to remove friction here is robovacs. I have mine to run on a timer so I don’t even have to start it myself.