Blickstein Group: Law Students' AI Reality Check Reveals Skepticism

• A new `Blickstein Group AI report` reveals significant `legal tech student skepticism` regarding AI's advanced capabilities beyond basic research.
• The `Vera Grabow AI study` found that 71% of students use AI several times a week for schoolwork, often as a first stop for new concepts, replacing Google.
• Students primarily use AI for productivity tasks like research and proofreading, not for deep learning or complex work, highlighting a `law students AI reality check`.
• Less than 8% of students consider AI-generated drafts acceptable with only substantial edits, challenging the industry's vision of `next generation lawyers AI trust`.
• Most students report AI saves them between 10-49% of time on assignments, viewing it more as an assistant than a transformative tool.

If a majority of students enter the workforce with a skeptical view of AI's capabilities, it will be arduous to either attract AI enthusiasts or effectively re-educate those who are disbelievers.

The legal sector, often envisioning an "AI-native future" where advanced technology handles complex tasks, may face a significant challenge from its incoming talent. Contrary to the industry's substantial investments—amounting to millions, and in some cases, a billion dollars—aimed at developing AI tools capable of drafting full work products, the next generation of lawyers exhibits considerable skepticism regarding AI's broader capabilities. This `legal tech student skepticism` suggests that current college students largely perceive AI as little more than an enhanced research utility.

This `law students AI reality check` is detailed in a new publication titled "The College Student AI Reality Check," a `Blickstein Group AI report`. The study compiles responses from students across 37 colleges and universities, supplemented by five in-depth interviews. A key figure behind this initiative was `Vera Grabow AI study`, a college junior double majoring in History and Political Science and an intern at the Blickstein Group. Grabow conceived and spearheaded the project, driven by her personal observations of AI's impact on her education and the absence of a comprehensive survey of student opinions on the technology. Brad Blickstein, the CEO, lauded her efforts, confirming she developed the questionnaire, managed outreach, analyzed the data, and drafted the report, highlighting it as an exceptional student-led endeavor.

Despite their reservations about AI's transformative potential, students are actively integrating the technology into their academic routines. A significant 71% of respondents reported using AI several times weekly or more for their schoolwork, indicating a high level of engagement. Interestingly, AI has begun to displace traditional search engines as the initial resource for understanding new concepts, with 27.8% of students turning to an AI tool first, slightly surpassing the 25.3% who start with Google. Both these digital avenues far outstrip consulting professors or teaching assistants, which only 3.8% of students reported doing first.

Students primarily leverage AI for tasks such as research, proofreading, creating flashcards, and brainstorming. While these applications enhance productivity, they do not align with the ambitious visions of the broader AI industry or investors, who often anticipate technology that can fully replace human labor. A Stanford Earth Systems senior quoted in the report articulated this sentiment, stating that AI had improved their performance but not their intrinsic knowledge. This perspective underscores that while AI is seen as a valuable productivity enhancer, it is not viewed as a tool for deep learning or complex, independent work, which is a critical distinction for `AI in legal education`.

The findings present a stark contrast between the industry's aspirations for AI and the practical `next generation lawyers AI trust`. The legal tech sector often promotes AI with the promise of fully automated drafting, yet students remain wary of trusting AI for anything beyond a sophisticated search bar or advanced grammar checker. A crucial metric for legal technology is the degree to which AI-generated drafts are deemed acceptable with only substantial edits; the report indicates that less than 8% of students find AI output acceptable under such conditions, a figure described as "brutal" for the industry.

This inherent skepticism poses a considerable challenge for law firms and legal tech companies. While employers will undoubtedly strive to train new hires to trust AI, deeply ingrained habits and preconceptions are difficult to alter. If a majority of students enter the workforce with a skeptical view of AI's capabilities, it will be arduous to either attract AI enthusiasts or effectively re-educate those who are disbelievers. Regarding efficiency, the most common time savings reported by students on typical assignments ranged from 10-24% (32.4% of respondents), followed by 25-49% (28.2%). Only 8.5% reported saving 75% or more time, with an identical 8.5% saving less than 10%, reinforcing the view of AI as an assistant rather than a comprehensive solution.

Law firms and legal tech companies should recognize that incoming legal talent, as highlighted by the 'College Student AI Reality Check' report, approaches AI with significant skepticism regarding its ability to perform complex legal tasks. This implies that firms investing heavily in advanced AI solutions must develop robust training and integration strategies to overcome this inherent distrust, rather than assuming new associates will readily embrace AI for critical work beyond basic research and productivity tools.

Source: Original reporting via Above the Law