Evaluating AI Safety Through Local Policy: Findings from the UbuntuGuard benchmark
By Elana Banin
ABOUT THE COURSE
These free, online, at-your-own-pace courses are designed for public sector lawyers and legal support staff to enable safe and responsible use of GenAI in your day-to-day work.
Via hands-on activities and demonstrations that are consistent with guidance provided by the American Bar Association, these courses explore how AI is transforming the legal profession and how lawyers and their offices can responsibly use AI to better serve the public.
Want to offer these courses to your team for Continuing Legal Education (CLE) credit? Partner with InnovateUS to add live modules that fulfill your state's requirements. Contact us at hello@innovate-us.org
Watch the first lesson
Part 1
Master GenAI fundamentals for legal professionals, while learning to identify and mitigate risks specific to public sector legal practice.
Overview of the course, including its learning objectives and relevance for legal professionals in the public sector. The opening explains why you will want and need to know about AI. Suitable for government lawyers and legal staff at all levels, the course explores how AI is transforming the legal profession and how lawyers can responsibly use AI to better serve the public.
Describes the basics and capabilities of GenAI and machine learning and how these technologies differ. Explains what large language models (LLMs) are and how they process data and what’s happening under the hood when you type something in. Introduces how public sector lawyers can use GenAI to conduct their work more efficiently and effectively while safeguarding privacy.
Reviews ethical risks, including hallucination, mistakes, and privacy concerns, that are relevant to using GenAI in the context of public sector legal practice. Discusses practical approaches to addressing and mitigating risks.
Introduces typical use cases compatible with GenAI in public sector legal applications. Provides a framework for responsibly identifying suitable work tasks for its application, including emerging innovations and case studies.
Offers best practices for using GenAI with skills like prompt engineering, complemented by interactive exercises to test and confirm any acquired knowledge. Discusses retrieval augmented generation (RAG), how legal staff can use RAG technology to ensure privacy and reliability, and how this approach differs from large language models (LLM).
The final module summarizes learnings from across the course about the safe and responsible individual use of GenAI tools and their value for public sector legal professionals.
Part 2
Explore advanced topics for legal professionals, including data governance and AI project design, while addressing broader societal challenges.
Overview of the course, including its learning objectives and relevance for legal professionals in the public sector. The opening explains why you will want and need to know about AI. Suitable for government lawyers and legal staff at all levels, the course explores how AI is transforming the legal profession and how lawyers can responsibly use AI to better serve the public.
Discusses best practices for data segregation and the use of “walled gardens.” Discusses the Criminal Justice Information Security (CJIS) standard and how to ensure compliance. Distinguishes between tasks that require paid AI tools versus those that can be handled by free tools and how to evaluate AI vendors.
Guides learners through the process of identifying problems within their own work that AI tools can help to solve. Explains how to take these solutions from idea to implementation, covering the process of developing and implementing AI-enabled tools. Profiles several existing AI tools built by public sector legal offices.
Explores the ethical implications of employing GenAI at a societal level and dissects potential challenges like copyright infringement, deepfakes, astroturfing, issues related to private platforms, and the challenge of developing effective and proactive AI regulation. Additionally, this module delves into ongoing efforts aimed at mitigating these risks.
Guides legal professionals on how to develop and implement an AI acceptable use policy for their office in line with best practices for data governance when using AI tools.
The final module summarizes learnings from across the course about the safe and responsible design of AI policies and projects and their social impact.
Chief Privacy Officer and Attorney
Ohio Department of Job and Family Services, State of Ohio
Chief Counsel, California Department of Technology
State of California
AI Director, Georgia Technology Authority
State of Georgia
Principal Counsel – Assistant Attorney General
Department of Information Technology, State of Maryland
Chief Innovation Officer, Office of the County Executive, Innovation Team
State of Maryland
Associate Professor of Philosophy
Northeastern University
Sr. Assistant Attorney General
Colorado Attorney General’s Office, State of Colorado
Chief Counsel
Department of General Services, State of California
Liaison for Special Projects & Legal Librarian
San Francisco City Attorney’s Office
Human Rights Attorney III
Commission on Human Rights and Opportunities, State of Connecticut
General Counsel
Arizona Department of Administration, State of Arizona
Assistant Attorney General | Litigation Support Services & Records Division Manager
Office of the Minnesota Attorney General, State of Minnesota
Deputy General Counsel
Executive Office of Tech Services and Security, Commonwealth of Massachusetts
Chief Transformation Officer
Colorado Attorney General’s Office, State of Colorado
Director of Education and Development
Office of the New York State Attorney General, State of New York
General Counsel/Chief Privacy Officer, Executive Office of Technology Services and Security
Commonwealth of Massachusetts
Chief Counsel, California Government Operations Agency
State of California
Artificial Intelligence Analyst
Utah Department of Government Operations, State of Utah
Chief Legal Counsel, Opportunities for Ohioans with Disabilities
State of Ohio
Upskilling the Public Sector: Insights, Ideas, and Inspiration

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.