With the right context given to the AI (backstory, motivation, personality, specific plot points the character has to mention at certain points in the game) as is it can provide pretty decent responses. The hardware limitation exists for sure, but we already have online-only single player games, at least this would provide a functionality instead of just more drm.