Answering Legal Questions with LLMs

Hotseat attempted to tackle the limitations of using ChatGPT for legal questions by implementing advanced workflows and leveraging LLMs to answer complex questions about EU regulations in an unintuitive way. By breaking down the legal question into subtasks and structuring the documents with Markdown, GPT-4 was able to give quality answers. The system, although not perfect and with some limitations, showed promise when tested with lawyers. The system takes 5 to 10 minutes and costs about $2 to answer a legal question, making it an interesting approach to dividing complex jobs into simple tasks for improved reasoning capabilities of LLMs.

https://hugodutka.com/posts/answering-legal-questions-with-llms/

To top