So, I have been asking myself this question for quite a while, Can AI actually remember what it sees? and tell a user later that "I saw X at place Y last", or for instance when a person goes to a cafe and forgets something. e.g let's say they actually forgot their charger. The system should be able to say, "Hey, I think you came here with a charger and now you are leaving without one, or you forgot your charger".
I think that will be really helpful, and it can also help a person when it observes that they skipped a step, then the system proceed to say, "I think you skipped step 5 in this process".
So the vision is: can AI maintain enough continuity about the physical world to notice when something important has been forgotten, misplaced, changed, or left unfinished?
I am exploring these four questions:
- Perception: what exactly is in the scene?
- Identity: is this the same physical object as before?
- Memory: what happened to it over time?
- Reasoning: does the current situation look wrong or incomplete?
This is Day 1 for me to actually take a step towards creating this, btw I did my research and found some amazing projects around this, so I am actually going to be looking at them (I already started).
What I did today, I just created a simple Python program that calls a simple YOLO model, and then lets it detect objects, I focused on detecting bottles, cause I wanted to just see if the system can remember the last time it actually saw the object and it did, it actually remembered the last time it saw the object, like the exact time.
My bottle demo has basically answered the perception + primitive memory question.
It shows that the system can actually see what is in a scene and then remember it and when last it saw it. So now I will be working on identity and reasoning, and testing it, I will also be documenting it all.
Thank you, I hope you follow the build process.
