Hollywood Star's Failed Bar Exam Sparks Warning on Risks of Generative AI in High-Stakes Settings
The recent revelation that reality TV star Kim Kardashian failed her bar exam after relying on chatbot AI, ChatGPT, for legal advice has reignited concerns about the dangers of using generative artificial intelligence (AI) in high-stakes professional contexts. As AI adoption grows across various sectors, including law and medicine, experts are sounding the alarm that AI-generated hallucinations can undermine public trust, create liabilities, and mislead both students and practicing professionals.
Kardashian's failure on her bar exam has shed light on a growing trend among students and legal professionals who are increasingly relying on generative AI tools like ChatGPT for research, drafting briefs, and studying for exams. Despite being designed as prediction machines rather than factual databases, these tools often deliver plausible-sounding but incorrect information.
The risks of overreliance on generative AI in high-stakes settings have sparked warnings from experts, who caution that AI can sound confident while being completely wrong, creating a hazardous combination in law. "Passing the bar takes judgment, ethics, and experience: three things no algorithm has," warned Duncan Levin, former prosecutor and law lecturer at Harvard University.
Matthew Sag, a law professor at Emory University School of Law, emphasized that generative AI can be a useful tool for lawyers but only when used by those who actually know the law. "Everything ChatGPT tells you about the law will sound plausible, but that's dangerous if you don't have some expertise or context to see what it's missing and what it's hallucinating," he said.
The consequences of overreliance on AI in legal education and practice are also being highlighted by experts. Mark Bartholomew, a law professor at the University at Buffalo School of Law, noted that while Kardashian's approach may be fine, the danger lies in overreliance on AI tools that can hallucinate, make up cases, and get the law wrong.
As generative AI becomes increasingly integral to professional practice, experts are urging caution and emphasizing the need for rigorous human verification. "The best option is to ask a lawyer," said Harry Surden, a law professor at the University of Colorado Law School. However, he also noted that for basic legal questions where an attorney is not available, AI tools can be an improvement over guessing or bad advice from friends and family.
Ultimately, Kardashian's experience serves as a warning to both students and professionals: approach AI outputs with skepticism, maintain traditional standards of professional responsibility, and always prioritize qualified legal advice.
The recent revelation that reality TV star Kim Kardashian failed her bar exam after relying on chatbot AI, ChatGPT, for legal advice has reignited concerns about the dangers of using generative artificial intelligence (AI) in high-stakes professional contexts. As AI adoption grows across various sectors, including law and medicine, experts are sounding the alarm that AI-generated hallucinations can undermine public trust, create liabilities, and mislead both students and practicing professionals.
Kardashian's failure on her bar exam has shed light on a growing trend among students and legal professionals who are increasingly relying on generative AI tools like ChatGPT for research, drafting briefs, and studying for exams. Despite being designed as prediction machines rather than factual databases, these tools often deliver plausible-sounding but incorrect information.
The risks of overreliance on generative AI in high-stakes settings have sparked warnings from experts, who caution that AI can sound confident while being completely wrong, creating a hazardous combination in law. "Passing the bar takes judgment, ethics, and experience: three things no algorithm has," warned Duncan Levin, former prosecutor and law lecturer at Harvard University.
Matthew Sag, a law professor at Emory University School of Law, emphasized that generative AI can be a useful tool for lawyers but only when used by those who actually know the law. "Everything ChatGPT tells you about the law will sound plausible, but that's dangerous if you don't have some expertise or context to see what it's missing and what it's hallucinating," he said.
The consequences of overreliance on AI in legal education and practice are also being highlighted by experts. Mark Bartholomew, a law professor at the University at Buffalo School of Law, noted that while Kardashian's approach may be fine, the danger lies in overreliance on AI tools that can hallucinate, make up cases, and get the law wrong.
As generative AI becomes increasingly integral to professional practice, experts are urging caution and emphasizing the need for rigorous human verification. "The best option is to ask a lawyer," said Harry Surden, a law professor at the University of Colorado Law School. However, he also noted that for basic legal questions where an attorney is not available, AI tools can be an improvement over guessing or bad advice from friends and family.
Ultimately, Kardashian's experience serves as a warning to both students and professionals: approach AI outputs with skepticism, maintain traditional standards of professional responsibility, and always prioritize qualified legal advice.