LLMs and Contextual Integrity
Brief
I have been thinking a lot about AI and integrity. Part of that is contextual integrity. I recently found two papers on the topic.
“ CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMs “:
Abstract: Large Language Models (LLMs) increasingly use persistent memory from past interactions to enhance personalization and task performance. However, this memory introduces critical risks when sensitive information is revealed in inappropriate contexts. We present CIMemories, a benchmark for evaluating whether LLMs appropriately control information flow from memory based on task context.
CIMemories uses synthetic user profiles with over 100 attributes per user, paired with diverse task contexts in which each attribute may be essential for some tasks but inappropriate for others.