Aamir's presentation at PETS 2024!

Aamir Hamid did a great job today at #PETS2024 presenting our work (with Hemanth Reddy Samidi, Primal Pappachan, and Tim Finin) on designing a benchmark to evaluate GenAI systems answering questions about privacy.

First conference presentation of (hopefully) many! Amazing job Aamir Hamid!

GenAIPABench: A Benchmark for Generative AI-based Privacy Assistants

Aamir Hamid, Hemanth Reddy Samidi, Tim Finin (University of Maryland, Baltimore County,USA), Primal Pappachan (Portland State University,USA), Roberto Yus (University of Maryland, Baltimore County,USA)

The paper introduces GenAIPABench, a comprehensive benchmark designed to evaluate the performance of Generative AI-based Privacy Assistants in understanding and addressing privacy policy and data protection regulation queries. By providing a standardized framework for assessment, our work aims to propel forward the development of AI tools that support users in navigating privacy concerns more effectively. This acceptance not only highlights the importance of our research in the field of privacy technologies but also marks a significant milestone for our team’s ongoing efforts to improve digital privacy protection.