James Flemings

prof_picture.jpg

Los Angeles, CA

Hello! I am a fifth-year CS PhD student at the University of Southern California advised by Murali Annavaram in the SCIP (Super Computing In Pocket) lab. I’m graciously funded by the NSF Graduate Research Fellowship. My research addresses privacy concerns in Large Language Models (LLMs). My research aims to make Large Language Models (LLMs) safe to train and deploy on sensitive data. I work along three complementary directions: (1) developing formal, provable guarantees for the data used to train and query LLMs, (2) building LLM agents that make contextually appropriate data-sharing decisions, verifiably aligned with users’ privacy preferences, (3) adaptive policy generation to guarantee agent actions comply with privacy, security, and safety properties.

Previously, I interned at Google in the Federated Learning and Analytics team during Summer 2025, investigating personalized privacy in agents. I also interned at TikTok during Summer 2024 in the Privacy Innovation Lab, exploring hallucination and privacy in langauge models. Before graduate school, I received my BS in computer science and mathematics at the University of Alaska Anchorage in 2022. While there, I pursued research in a wide range of areas, including monochromatic colorings, charged coupled devices, federated learning, and out of distribution data performance in language models.

News

Sep 25, 2026 Our paper “PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior” has been accepted to NeurIPS 2026 ED Track!
Jul 26, 2026 Our paper “PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior” has been accepted to HAIPS @ COLM 2026 as an Oral talk!
Feb 01, 2026 Our paper “Personalizing Agent Privacy Decision via Logical Entailment” has been accepted to PETS 2026!
Jan 26, 2026 Our paper “Hubble: a Model Suite to Advance the Study of LLM Memorization” has been accepted to ICLR 2026!
May 15, 2025 Our paper “Estimating Privacy Leakage of Augmented Contextual Knowledge in Language Models” has been accepted to ACL 2025, Main!

Selected Publications

  1. NeurIPS
    PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior
    James Flemings, and Murali Annavaram
    Proceedings of Neural Information Processing Systems Track on Evaluations and Datasets, 2026
  2. PETS
    Personalizing Agent Privacy Decisions via Logical Entailment
    James Flemings, Ren Yi , Octavian Suciu , Kassem Fawaz , Murali Annavaram , and Marco Gruteser
    Proceedings of Privacy Enhancing Technologies, 2026
  3. ICLR
    Hubble: a Model Suite to Advance the Study of LLM Memorization
    Johnny Tian-Zheng Wei , Ameya Godbole , Mohammad Aflah Khan , Ryan Wang , Xiaoyuan Zhu , James Flemings, Nitya Kashyap , Krishna P Gummadi , Willie Neiswanger , and Robin Jia
    Proceedings of International Conference on Learning Representations, 2026
  4. ACL
    Estimating Privacy Leakage of Augmented Contextual Knowledge in Language Models
    James Flemings, Bo Jiang , Wanrong Zhang , Zafar Takhirov , and Murali Annavaram
    In Proceedings of ACL, 2025
  5. ACL
    Differentially Private Knowledge Distillation via Synthetic Text Generation
    James Flemings, and Murali Annavaram
    In Findings of ACL, 2024
  6. NAACL
    Differentially Private Next-Token Prediction of Large Language Models
    James Flemings, Meisam Razaviyayn , and Murali Annavaram
    In Proceedings of NAACL, 2024