A Wake-Up Call for India's Judiciary: AI's Dark Side Exposed
In a recent shocking development, India's Supreme Court has taken a firm stand against the misuse of artificial intelligence (AI) in legal proceedings. The incident, which has sparked widespread concern, involves a junior judge who relied on AI-generated fake judgments to adjudicate a property dispute.
But here's where it gets controversial... The top court, in response to an appeal by the defendants, is now scrutinizing the ruling made by a lower court in Andhra Pradesh. The Supreme Court has labeled this case as an "institutional concern," highlighting the direct impact of AI-generated judgments on the integrity of the adjudication process.
The story began in August last year when a civil judge in Vijaywada passed an order in a property dispute case. The judge, in an attempt to expedite the process, cited four past legal judgments, only to later discover that these were all AI-generated.
AI programs have undoubtedly revolutionized workplace efficiency, but generative AI systems have a dark side. They are notorious for "hallucinating" and presenting falsehoods as facts, sometimes even inventing sources to support their inaccurate claims.
The defendants, sensing something amiss, challenged the order in the state's high court. The high court acknowledged the fake citations but surprisingly sided with the trial court's decision, stating that the error was made in "good faith." The high court's order emphasized that the incorrect citations did not invalidate the decision if the principles of law were correctly applied.
And this is the part most people miss... The high court also sought a report from the junior judge, who admitted to using an AI tool for the first time and believing the citations to be genuine. She had no intention to mislead and attributed the mistake solely to her reliance on an automated source.
The high court's stance was clear: "Exercise actual intelligence over artificial intelligence." But the defendants, unsatisfied, took the matter to the Supreme Court, which took a sterner view.
Last Friday, the top court suspended the lower court's order on the property dispute, labeling the use of AI as an act of "misconduct" rather than a simple error. The court emphasized that this case was not about the decision's merits but about the adjudication process itself.
The Supreme Court's concerns are not isolated. In October, two federal judges in the US faced scrutiny for AI-related errors in their rulings. Similarly, in June 2025, the High Court of England and Wales issued a warning to lawyers against using AI-generated case material after several instances of fictitious or made-up rulings.
India's legal institutions, like many others worldwide, are grappling with the challenge of regulating and monitoring AI in courtrooms. The Supreme Court's white paper on AI in India's judiciary provides a starting point, offering best practices and guidelines for judicial institutions, lawyers, and clerks.
As we navigate the complexities of AI integration, it's crucial to maintain human oversight and institutional safeguards. The question remains: How can we strike a balance between leveraging AI's benefits and ensuring its responsible use in critical domains like the legal system? Feel free to share your thoughts in the comments below!
