Chief AI Scientist Josh Joseph is quoted in the Wall Street Journal's article considering the pros and cons of chatbots' long memories. Joseph notes that it can be difficult to track the subtle ways that an LLM's memory affects its outputs. "Say you mention you’re stressed about money in a conversation about something else entirely. Weeks later, you ask the chatbot for career advice, and it steers you toward higher-paying jobs rather than roles that might be a better fit, because it “knows” you’re financially anxious. You would never know why the advice felt off, because the chatbot hasn’t flagged which memories it is drawing on."
