Postdoctoral Fellow – Normativity Lab Full-time

Postdoctoral Fellow – Normativity Lab

Professor Gillian Hadfield is seeking highly-qualified postdoctoral scholars to join her team at the Normativity Lab at Johns Hopkins University. The Normativity lab examines the foundations of human normativity and leverages insights to inform the development of AI systems that align with human values. The ideal candidate will have a track record in experiments with multiagent systems using reinforcement learning and/or generative agents, interest and ideally experience in training models to interpret and align with norms, and a background in interdisciplinary research such as overlaps between AI and cognitive science, microeconomic theory, cultural evolution theory, or moral/normative/legal reasoning. Applicants with strong credentials and motivation should still apply even if they lack these qualifications. These are full-time positions with the potential for appointments 12-18 months in duration, and the possibility of further extension. Lab members have the option to work in either Baltimore, MD or Washington, D.C.

How can we ensure AI systems and agents align with human values and norms? Maintain and enhance the complex cooperative economic, political and social systems humans have built? What will it take to ensure that the AI transformation puts us on the path to improved human well-being and flourishing, and not catastrophe? Existing approaches to alignment, such as RLHF, constitutional AI and social choice methods, focus on eliciting human preferences, aggregating them across multiple, pluralistic values if necessary, and fine-tuning models to satisfy those preferences. In the Normativity Lab we believe these approaches are likely to prove too limited to address the alignment challenge and that the alignment questions will require studying the foundations of human normativity and human normative systems. We bridge computational modeling, specifically multi-agent reinforcement learning and generative agent simulations, and economic, political, and cultural evolutionary theory to explore the dynamics of normative systems and explore how to build AI systems and agents that have the normative infrastructure and normative competence to do as humans have learned to do: create stable rule-based groups that can adapt to change while ensuring group well-being.

Specific duties and responsibilities:

• Project Ownership: Take ownership of research projects, working independently and collaboratively with a diverse team of experts
• Model Development: Develop and refine multiagent systems to simulate and analyze normative behaviors in various contexts.
• Data Collection and Analysis: Design and implement empirical studies, including data collection, statistical analysis, and interpretation of results.
• Publication: Prepare and submit manuscripts for publication in high-impact academic journals and present findings at conferences and workshops.
• Collaborate with Team Members: Work closely with lab members and external collaborators to foster a productive research environment and contribute to interdisciplinary projects.
• Mentor Students: Provide guidance and mentorship to graduate and undergraduate students involved in related research projects.
• Contribute to Lab Activities: Participate in lab meetings, potentially take a leadership role in coordinating lab activities, contribute to grant writing, and engage in outreach activities to promote the lab's research initiatives.

Qualifications:

• Strong technical understanding of issues in the fields of AI safety and governance. Familiarity with the ethical implications of AI technologies and their alignment with human values and societal norms.
• Expertise in large language models, multi-agent reinforcement, or economic modeling and game theory.
• Knowledge of theories related to human normativity, including welfare economics, political theory, moral philosophy, cultural evolutionary theory, social norms, or legal systems is a strong asset; an interest in learning about these domains is essential.
• Proficiency in designing and implementing computational models to simulate normative behaviors and group dynamics.
• Strong capability in both qualitative and quantitative research methods, including statistical analysis and survey design.
• Experience conducting interdisciplinary research, including integrating perspectives from economics, law, and social sciences to analyze complex systems.
• Knowledge of the academic publishing process.

• Ability to independently lead and deliver on research projects.
• Capable of formulating and implementing research methodologies and procedures.
• Ability to make independent decisions regarding data quality, analysis, and interpretation.
• Capable of independently managing timelines and deliverables.

• Advanced Degree: A PhD in a relevant field such as computer science, economics, political science or cultural evolution
• Programming Skills: Proficiency in programming languages relevant to computational modeling (e.g., Python, R, or similar).
• Data Analysis Tools: Experience with statistical software and data visualization tools (e.g., SPSS, Stata, Tableau).
• AI Experience: Knowledge of AI frameworks and algorithms, particularly those related to decision-making and ethical AI.
• Machine Learning Experience: Knowledge of ML techniques, including reinforcement learning.
• Academic Excellence: Strong publication record in peer-reviewed journals relevant to normative systems, AI ethics, or related fields.
• Research Experience: Demonstrated experience conducting independent research, including project development and execution.
• Teaching and Mentorship: Experience in teaching or mentoring undergraduate or graduate students in a research or academic setting.
• Collaboration and Communication: Excellent teamwork skills with the ability to present research findings clearly and effectively to diverse audiences.

Applicants with some but not all of these qualifications are encouraged to apply.

Application instructions:

• CV
• Research statement identifying prior research projects, current interests, and sample research questions, aligned with the goals of the Normativity Lab, to be explored during the fellowship
• Unofficial university transcript
• Writing sample
• Letters of reference from and contact information from three (3) people who can speak to the applicant's professional experience and potential as a postdoctoral researcher