Regulation, Evaluation, and Governance Lab
About
Projects
Publications
Data
Contact
publications
Policy
The Bureaucratic Challenge to AI Governance: An Empirical Assessment of Implementation at U.S. Federal Agencies
AIES
August 2023
Policy
The Privacy-Bias Tradeoff: Data Minimization and Racial Disparity Assessments in U.S. Government
FAccT
June 2023
Policy
Integrating social services with disease investigation: A randomized trial of COVID-19 high-touch contact tracing
PLOS ONE
May 2023
Policy
Measuring and Mitigating Racial Disparities in Tax Audits
Working Paper
January 2023
Methods
Estimation of Racial Disparities When Race is Not Observed
Working Paper
January 2023
Policy
Automated vs. manual case investigation and contact tracing for pandemic surveillance: Evidence from a stepped wedge cluster randomized trial
Lancet: eClinicalMedicine
January 2023
Policy
Implementation Challenges to Three Pillars of America’s AI Strategy
HAI - RegLab White Paper
December 2022
Compliance
Integrating Water Quality Data with a Bayesian Network Model to Improve Spatial and Temporal Phosphorus Attribution: Application to the Maumee River Basin
Earth and Space Science Open Archive
November 2022
Policy
Entropy Regularization for Population Estimation
ACM AAAI (2023)
August 2022
Compliance
Detecting Environmental Violations with Satellite Imagery in Near Real Time: Land Application under the Clean Water Act
ACM CIKM
August 2022
Policy
Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
ACM AI, Ethics & Society
August 2022
Policy
How to Build Academic-Public Health Partnerships: The Stanford – Santa Clara County Experience with COVID-19 Response
Chapter for Brookings' Build Me the Evidence, (Tamar Bauer ed)
July 2022
Methods
Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
arXiv
July 2022
Policy
Algorithmic Fairness and Vertical Equity: Income Fairness with IRS Tax Audit Models
ACM FAccT 1479
June 2022
Policy
Integrating Reward Maximization and Population Estimation: Sequential Decision-Making for Internal Revenue Service Audit Selection
ACM AAAI (2023)
April 2022
Policy
Designing Accountable Health Care Algorithms: Lessons from Covid-19 Contact Tracing
NEJM Catalyst
March 2022
Policy
Science Translation During the COVID-19 Pandemic: An Academic-Public Health Partnership to Assess Capacity Limits in California
AJPH
February 2022
Adjudication
Artificial Intelligence for Adjudication: The Social Security Administration and AI Governance
Oxford Handbook on AI Governance
January 2022
Methods
,
Compliance
Mapping industrial poultry operations at scale with deep learning and aerial imagery
arXiv
December 2021
Policy
Building a National AI Research Resource: A Blueprint for the National Research Cloud
HAI White Paper
October 2021
Policy
A Language-Matching Model to Improve Equity and Efficiency of COVID-19 Contact Tracing
118 PNAS e2109443118
September 2021
Policy
Evaluation of Allocation Schemes of COVID-19 Testing Resources in a Community-Based Door-to-Door Testing Program
JAMA Health Forum , 2, 8, e212260
August 2021
Methods
,
Policy
On the Opportunities and Risks of Foundation Models
arXiv
August 2021
Compliance
Enhancing Environmental Enforcement with Near Real-Time Monitoring: Likelihood-Based Detection of Structural Expansion of Intensive Livestock Farms
International Journal of Applied Earth Observation and Geoinformation
July 2021
Methods
Context-Aware Legal Citation Recommendation Using Deep Learning
ICAIL 2021
April 2021
Policy
Executive Control of Agency Adjudication: Capacity, Selection and Precedential Rulemaking
Journal of Law, Economics, and Organization (2024, Forthcoming)
April 2021
Methods
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset
ICAIL 2021
April 2021
Policy
How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals
Nature Medicine
April 2021
Compliance
,
Policy
The Distributive Effects of Risk Prediction in Environmental Compliance: Algorithmic Design, Environmental Justice, and Public Policy
ACM FAccT 2021
March 2021
Policy
Leveraging Administrative Data for Bias Audits: Assessing Disparate Coverage with Mobility Data for COVID-19 Policy
ACM FAccT 2021
March 2021
Policy
How US Law Will Evaluate Artificial Intelligence for Covid-19
BMJ
March 2021
Methods
,
Compliance
Temporal Cluster Matching for Change Detection of Structures from Satellite Imagery
ACM COMPASS
March 2021
Adjudication
Disparate Limbo: How Administrative Law Erased Antidiscrimination
Yale Law Journal
January 2021
Policy
Evaluating Facial Recognition Technology: A Protocol for Performance Assessment in New Domains
Stanford's Institute for Human-centered Artificial Intelligence White Paper
November 2020
Policy
Affirmative Algorithms: The Legal Grounds for Fairness as Awareness
U. Chicago Law Review Online
October 2020
Policy
AI’s Promise and Peril for the U.S. Government
HAI Policy Briefs
September 2020
Policy
Algorithmic Accountability in the Administrative State
Yale Journal on Regulation
August 2020
Methods
,
Compliance
,
Policy
Feasible Policy Evaluation by Design: A Randomized Synthetic Stepped-Wedge Trial in King County
June 2020
Compliance
,
Adjudication
Improving Scientific Judgments in Law and Government: A Field Experiment of Patent Peer Review
Journal of Empirical Legal Studies
June 2020
Compliance
,
Adjudication
Menu Labeling, Calories, and Nutrient Density: Evidence from Chain Restaurants
PLOS ONE
May 2020
Policy
Artificially Intelligent Government: A Review and Agenda
Big Data Law (Roland Vogl, ed., 2021)
March 2020
Policy
What To Do About Artificially Intelligent Government
The Hill
February 2020
Compliance
Innovations for Environmental Compliance: Emerging Evidence and Opportunities
SIEPR Policy Brief
February 2020
Policy
Government by Algorithm: Artificial Intelligence in Federal Administrative Agencies
Report to the Administrative Conference of the United States
February 2020
Adjudication
Due Process and Mass Adjudication: Crisis and Reform
Stanford Law Review
January 2020
Policy
Did Restaurant Hygiene Grading in Los Angeles Immediately Reduce Foodborne Illness by 20% Across All of Southern California? A Response to Jin & Leslie
SIEPR Working Paper
November 2019
Policy
New Evidence on Information Disclosure through Restaurant Hygiene Grading
American Economic Journal: Economic Policy
November 2019
Compliance
,
Policy
Improving the Reliability of Food Safety Disclosure: Restaurant Grading in Seattle and King County, Washington
Journal of Environmental Health, 84, 2, 30-37
September 2019
Adjudication
Quality Review of Mass Adjudication: A Randomized Natural Experiment at the Board of Veterans Appeals, 2003-16
Journal of Law, Economics, & Organization
July 2019
Policy
Equity in the Bureaucracy
UC Irvine Law Review
June 2019
Methods
,
Compliance
Is Yelp Actually Cleaning Up the Restaurant Industry? A Re-Analysis on the Relative Usefulness of Consumer Reviews
WWW Proceedings
May 2019
Compliance
Deep Learning to Map Concentrated Animal Feeding Operations
Nature Sustainability
April 2019
Methods
,
Compliance
,
Policy
Making Street-Level Bureaucracy Work: Safer Food in Seattle and King County
Evidence Works: Cases Where Evidence Meaningfully Informed Policy
January 2019
Policy
When Algorithms Import Private Bias into Public Enforcement: The Promise and Limitations of Statistical Debiasing Solutions
Journal of Institutional and Theoretical Economics
January 2019
Compliance
Do Checklists Make a Difference? A Natural Experiment from Food Safety Enforcement
Journal of Empirical Legal Studies
June 2018
Methods
Judging Statistical Criticism
Observational Studies
January 2018
Compliance
Managing Street-Level Arbitrariness: The Evidence Base for Public Sector Quality Improvement
Annual Review of Law and Social Science
October 2017
Compliance
Does Peer Review Work? An Experiment of Experimentalism
Stanford Law Review
January 2017
Compliance
Government Under Review
Boston Review
June 2016
Policy
Designing Information Disclosure
Administrative and Regulatory Law News
December 2012
Policy
Fudging the Nudge: Information Disclosure and Restaurant Grading
The Yale Law Journal
December 2012
Policy
Improve Restaurant Report Cards
New York Times
March 2012
featured
projects
Compliance
Tax Enforcement
See All projects