It's definitely not indexed, we use RAG architectures to add indexing to data stores that we want the model to have direct access to, the relevant information is injected directly in the context (prompt). This can somewhat be equated to short term memory

The rest of the information is approximated in the weights of the neural network which gives the model general knowledge and intuition..akin to long term memory