James Flemings

prof_picture.jpg

Los Angeles, CA

Hello! I am a third-year CS PhD student at the University of Southern California working in the USC Meta research center, advised by Murali Annavaram in the SCIP (Super Computing In Pocket) lab. I’m graciously funded by the NSF Graduate Research Fellowship. My research broadly spans privacy in large language models (LLMs). Specifically, I’m looking into practically applying differential privacy to LLMs, and analyzing memorization of LLMs.

I received my BS in computer science and mathematics at the University of Alaska Anchorage in 2022. While there, I pursued research in a wide range of areas, including monochromatic colorings, charged coupled devices, federated learning, and out of distribution data performance in language models.

News

Jul 22, 2024 Gave two tech talks @ LinkedIn and TikTok on our work “Differentially Private Prediction of Large Language Models.”
May 15, 2024 Our paper “Differentially Private Knowledge Distillation via Synthetic Text Generation” has been accepted to ACL 2024, Findings
Mar 13, 2024 Our paper “Differentially Private Next-Token Prediction of Large Language Models” has been accepted to NAACL 2024, Main
Feb 17, 2024 I will be interning at TikTok as a research scientist this summer, working in the Privacy Innovation Lab.
Jul 06, 2023 USC news article detailing at a high-level the work I was awarded the NSF GRFP for.

Selected Publications

  1. preprint
    Characterizing Context Influence and Hallucinations in Sumimarization
    James Flemings, Wanrong Zhang ,  Jiang , Zafar Takhirov , and Murali Annavaram
    arxiv preprint, 2024
  2. ACL
    Differentially Private Knowledge Distillation via Synthetic Text Generation
    James Flemings, and Murali Annavaram
    In Findings of ACL, 2024
  3. NAACL
    Differentially Private Next-Token Prediction of Large Language Models
    James Flemings, Meisam Razaviyayn , and Murali Annavaram
    In Proceedings of NAACL, 2024