The State Bar of California has acknowledged that 23 questions on the February 2025 bar exam were generated using artificial intelligence instead of being crafted by licensed attorneys.
In light of this revelation, the bar is planning to petition the California Supreme Court to review and potentially adjust scores following the examination, which also faced numerous technical issues.
This pivotal licensing exam is essential for aspiring lawyers, yet it was plagued by AI-generated questions, technical failures, and subsequent lawsuits from students.
- 171 total scored multiple-choice questions
- 100 were sourced from Kaplan
- 48 originated from a prior first-year exam
- 23 were AI-assisted, created by ACS Ventures
- $8.25M: fee associated with Kaplan’s contract
- $22M: projected budget shortfall for the State Bar
The Aftermath
The legal education community is deeply unsettled.
“It’s shocking to think that the examination questions were generated by non-lawyers with the help of artificial intelligence,” remarked Mary Basick, assistant dean at UC Irvine Law.
“This startling admission raises serious concerns,” noted Katie Moran, a law professor at USF. “The same company that harnessed AI also validated its own questions.”
February test-takers reported:
- System crashes
- Inability to save essay submissions
- Issues with copy-pasting
- Questions that contained nonsensical phrasing or typographical errors
Meazure Learning, the platform providing the testing interface, is now facing legal challenges from students.
The Broader Implications
AI is already transforming the legal landscape, but insufficient oversight and cost-cutting measures have turned this initiative into a debacle. Dean Andrew Perlman of Suffolk Law believes AI could potentially contribute to exam design, but only if the outputs are rigorously evaluated by qualified professionals.
“In the future, we will need to debate the competency of lawyers who fail to utilize AI effectively,” predicted Perlman.
What’s On the Horizon:</