Regulation, Evaluation, and Governance Lab
About
News
Projects
Publications
Data
Work With Us
Contact
Methods
Methods
,
Adjudication
Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risk of Language Models
Arxiv
August 2024
Methods
Statistical Uncertainty in Word Embeddings: GloVe-V
Empirical Methods in Natural Language Processing
June 2024
Methods
,
Adjudication
Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools
ArXiv
May 2024
Methods
,
Adjudication
Corpus Enigmas and Contradictory Linguistics: Tensions Between Empirical Semantic Meaning and Judicial Interpretation
Minnesota Journal of Law, Science & Technology
May 2024
Methods
,
Adjudication
MultiLegalPile: A 689GB Multilingual Legal Corpus
ACL 2024
May 2024
Methods
,
Policy
Not (Officially) in My Backyard: Characterizing Informal Accessory Dwelling Units and Informing Housing Policy With Remote Sensing
Journal of the American Planning Association
June 2024
Methods
Quantifying the Uncertainty of Imputed Demographic Disparity Estimates: The Dual-Bootstrap
March 2024
Methods
,
Policy
On the Societal Impact of Open Foundation Models
February 2024
Methods
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Journal of Legal Analysis
January 2024
Methods
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
NeurIPS D&B
August 2023
Methods
Leveraging genomic sequencing data to evaluate disease surveillance strategies
iScience
December 2023
Methods
Toward Operationalizing a Pipeline-aware Approach to ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools
ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization
September 2023
Methods
Estimating Racial Disparities When Race is Not Observed
Working Paper
March 2023
Methods
Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
arXiv
July 2022
Methods
,
Compliance
Mapping industrial poultry operations at scale with deep learning and aerial imagery
arXiv
December 2021
Methods
,
Policy
On the Opportunities and Risks of Foundation Models
arXiv
August 2021
Methods
Context-Aware Legal Citation Recommendation Using Deep Learning
ICAIL 2021
April 2021
Methods
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset
ICAIL 2021
April 2021
Methods
,
Compliance
Temporal Cluster Matching for Change Detection of Structures from Satellite Imagery
ACM COMPASS
March 2021
Methods
,
Compliance
Is Yelp Actually Cleaning Up the Restaurant Industry? A Re-Analysis on the Relative Usefulness of Consumer Reviews
WWW Proceedings
May 2019
Methods
,
Compliance
,
Policy
Making Street-Level Bureaucracy Work: Safer Food in Seattle and King County
Evidence Works: Cases Where Evidence Meaningfully Informed Policy
January 2019
Methods
,
Compliance
,
Policy
Feasible Policy Evaluation by Design: A Randomized Synthetic Stepped-Wedge Trial in King County
June 2020
Methods
Judging Statistical Criticism
Observational Studies
January 2018
featured
projects
Compliance
Tax Enforcement
See All projects