This is not a simple assumption, here lies notes that helps us think on transformers, and observe its phennomena, from a inside-out view of attention (Human and LLMS Colliding).
A funny mind-game
Let me invite you to think…
You must choose 2 languages, one that you are fluent, and one that you have almost no idea, or ideally knows not how to spell ride a bicycle… Take your time, choose the language.
Count to 10, simulating 10 seconds.
Game is on : Think on word :
ROAD. Count to 3.
Given the choosen secondary language, search around for its translation. What is the translation for ROAD?
Estrada.
If you pick portuguese, don’t worry! Just accept, You saw a car driving towards “Estrada”.
And a tought emmerged in your mind, You saw a car driving in a Estrada and it was so real…
I can’t advocate or prove that this effect happens every single time, but hence, I invite you instead to reflect :
Is this what we call Attention?
Welcome, I hope you enjoy as much as I enjoy the challenge of the human mind.
Now the notes about causality I promised :
`The space time considered in acquiring context, When one try to express "I want to go to the supermarket."
Assumin Person1 talking to Person2: Can be asking info, talking about buying something, saw something ....
In a space-time of summarization, supermarket can only be causually related to "Buying, selling, acquiring,", "products", "viewing"... gradually break into each space ( grammatical, situational or any ) at a time ((figure of speech, person) Travelling, shopping ) "I", "Where". "
I" can be observed in the linear time-space of the person 2, even if the shotcaller is person1. Cause there is a causal collision of "personas_latent_time_space". Where persona 2 Cause I (P2) might need to give information to You (P1).
But You(P1) can be willing get infr This all can be summed up with a paralele space-time, as "Person1" is talking to "Person2", in a sense that "Where, "you" and third level cogna ( empathetic level etc ) space, such as ocuppying a place, directing to a place, getting a direction to a place, Throwing something at a place are more related to this second "Space-time".
Trying to explain the chain : When one thinks of supermarket, there is just some impulses that can be related to that, which will be gradually evaluated depending on the time-space ( variant ) then linear. Linear in a sense of subjugating all possibilitles into "context-space-times". Where I Supermarket Buy Food If the time-space is linear "Person1-Speaker-English" If the time-space is linear "Person2-Understands-English", then I Supermarket Directiong Give. Then the Time-space variant of the cogna ( P1+P2+Info+....) can be more related to Person1_linear[0]+Person2_linear[0] or Person1_linear[1]+Person2_linear[1] Which is essentially casuality of infor The theory I like to think about casuality is how being able to sum up the variable time-space of a conversation can implictly be converted into a line
`
