ethicslegalLegal Ethics

The Pitfalls of AI in the Legal World: ChatGPT and the Case of the Bogus Affidavit

Introduction: Artificial intelligence (AI) has been gaining popularity in various industries, promising increased productivity and efficiency. However, recent events surrounding a New York lawyer, Steven Schwartz, have highlighted the potential dangers of relying too heavily on AI tools in the legal profession. After discovering that he had used ChatGPT, a generative AI program, to compose an affidavit for a personal injury lawsuit against an airline, Schwartz faced a sanction hearing. The affidavit contained fabricated court decisions, highlighting the risks of using AI in legal documentation. Oh well, a seemingly good idea gone very bad in the case of ChatGPT and the Case of the Bogus Affidavit!

The Rise of ChatGPT and AI in the Workplace: ChatGPT and similar AI tools have been celebrated for their potential to enhance productivity and streamline work processes across different industries. From generating real estate advice to providing business tips, these AI chatbots have shown promise in supporting various professional tasks. Their potential benefits have attracted significant investments as industry-specific AI tools aim to tackle complex challenges that sectors like healthcare and marketing face.

The Pitfalls of Relying on AI:
While AI tools can improve work processes, caution must be exercised when relying on them. The case of Steven Schwartz demonstrates that the output generated by AI programs is not infallible. The use of ChatGPT in drafting the affidavit resulted in the inclusion of entirely fabricated court decisions, leading to a serious breach of legal ethics.

Judge Castel’s Unprecedented Ruling:
Upon reviewing the affidavit, Judge Kevin Castel expressed astonishment at the fabricated court decisions presented. He described the situation as “an unprecedented circumstance.” The judge and lawyers involved in the case could not locate any of the cases mentioned, raising doubts about the credibility of the content within the affidavit.

The Impact on Schwartz and LoDuca: Steven Schwartz, the lawyer responsible for using ChatGPT to compose the affidavit, apologized to Judge Castel. Schwartz admitted to being unaware that the AI-generated content could be false, emphasizing that he had never used the AI tool before. Another attorney from the same law firm, Peter LoDuca, also faces sanctions regarding the affidavit. However, LoDuca denied any involvement in the research conducted for the affidavit.

The Need for Caution and Human Oversight:
The case involving Schwartz highlights the potential pitfalls of relying solely on AI tools in the legal profession. While AI can provide valuable assistance, it is essential to recognize that AI-generated content may not always be accurate or reliable. The responsibility for verifying the authenticity and accuracy of information ultimately falls on the legal practitioners themselves.

Lawyers and professionals should exercise caution and ensure proper human oversight when utilizing AI.

Conclusion:
The story of Steven Schwartz and the fabricated court decisions in the affidavit he drafted using ChatGPT serves as a stark reminder of the potential risks associated with overreliance on AI tools in the legal field. Legal professionals must remain vigilant, exercising caution and maintaining the ethical standards that underpin the legal profession. While AI can undoubtedly enhance productivity and streamline processes, it should be seen as a complement to human expertise rather than a replacement. With proper oversight and responsible use, AI tools can continue to offer valuable support to legal practitioners and other professionals in their respective fields.

Leave a Reply