Responsible AI Learning Cohort: Session 1- Introduction and Cognitive Science for AI
by GradFUTURES
Friend Center 008
Friend Center 008, Princeton, NJ, United States
Registration
Details
Responsible AI dimensions. We will follow the definition and dimensions of Responsible AI as outlined by Microsoft. "Responsible AI is an approach to developing, assessing, and deploying AI systems in a safe, trustworthy, and ethical way. It's a framework for building AI systems according to six principles: fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability."
Session Description: In the first session, we will get to know the cohort, provide summary of syllabus and expectations for completion. Guest speaker will discuss how tool and insights from cognitive science can be applied to characterize and design AI systems.Guest Speaker: Ted Sumers (*23, COS), LLM Safety at Anthropic
Talk Title: Cognitive science for artificial intelligence.
Princeton alum Ted Sumers will discuss how tools and insights from cognitive science can be applied to characterize and design AI systems. He will first present work that uses models of human communication to uncover the latent values encoded in large language models. He will then discuss how decades of research into cognitive architectures can be used to structure language agents. Finally, time permitting, we’ll discuss some open questions in AI alignment.
Encouraged (but not required) pre-readings:
How do LLMs Navigate Conflicts between Honesty and Helpfulness? (ICML '24)
Cognitive architectures for language agents (TMLR '24)
Agenda
Upcoming Events
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
Title: Improving AI Governance by Carrot and by Stick
Description: AI governance involves the confluence of policies, procedures, norms, laws, and tools that bring together diverse stakeholders to ensure the risks associated with AI systems are effectively managed throughout their development, procurement, and deployment. Organizations can be motivated to enhance governance through two approaches: "sticks," meaning the threat of penalties, and "carrots," meaning the prospect of rewards. While accountability-focused stakeholders often focus on sticks such as regulation and enforcement, successful governance also depends on well-designed carrots. In this talk, I will use AI documentation as a case study to examine how both carrots and sticks can drive improvements in AI governance and discuss the pitfalls of relying too heavily on either.
Bio: Amy Winecoff brings a diverse background to her work on AI governance and policy, incorporating knowledge from both technical and social science disciplines. She is currently the AI Governance Fellow at the Center for Democracy & Technology, focusing on governance of AI systems.
Previously, Amy was a fellow at Princeton’s Center for Information Technology Policy, where she examined how cultural, organizational, and institutional factors shape emerging AI and blockchain companies. She has hands-on experience as a data scientist in the tech industry, having built and deployed recommender systems for e-commerce.
Amy obtained her Ph.D. in Psychology and Neuroscience from Duke University, where her research explored human reward processing and social decision-making.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
Speaker: Sabrina Shih, Responsible AI Institute
Title: Stress-Testing Responsible AI for Now and Later
Description: What are the theories of change behind Responsible AI, if there are any? Do we truly see them reflected in our evolving frameworks, regulation, and instruments? In this session, we will conduct a macro-analysis of the current AI landscape and cast a critical eye on the assumptions embedded within existing technical and social solutions. We will then look towards the future–whether we will be ready for the possible trajectories of AI technologies, what solution areas will need to advance or be redirected based on our own ideals, and what work lies ahead for us all, both as individuals and as a collective.
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.
Past Events
4:30 PM – 6:30 PM
Series Overview: Join us for GradFUTURES Ethics of AI. Leveraging the expertise of Princeton’s faculty, staff and alumni, this interdisciplinary cohort of grad students will be introduced to three pillars of the field of AI Ethics: technical understanding of AI design; business uses cases and causes for concern; and ethical/social theory. Through guest speakers, case studies and immersive capstone, students will learn, discuss and investigate the ethical implications of AI applications in diverse fields such as tech, healthcare, social media, etc.