
Putting AI to the test: It doesn’t know what it doesn’t know
I have been having lots of conversations about the powers – and limitations – of AI when it comes to legal document analysis. There is the camp that perceives AI as a tool for document analysis: AI without conceptual context is making us dumber. There is another camp that believes AI is the solution to their legal analysis needs – a panacea of sorts offering the holy grail of "upload the document and get all the answers." Why would someone want to invest in training for a skill that AI can complete with ease? It's a great question – so I decided to put AI to the test.