Supervising AI agents in a law firm: a permission checklist for Notion Custom Agents

What does 'agentic AI supervision' mean for a lawyer?

An AI agent is software that can take steps on its own, such as reading pages, creating tasks, drafting text or sending messages, rather than only replying to a prompt. Supervision means you are able to say what it may do, see what it did, and stop it. Professional rules on supervising staff and technology were written before agents, and regulators are now applying them.

Summaries of the California State Bar's 2026 practical guidance, which replaced its 2023 version, report two points relevant here: greater autonomy brings a greater oversight obligation, and nothing should be filed with a court without attorney review and approval. Law firm write-ups differ on whether the guidance is binding, and parts of related rule changes are described as proposals, so confirm status on calbar.ca.gov. ABA Formal Opinion 512 (July 2024) sets out general duties of competence, confidentiality, communication and supervision. Last reviewed: 30 October 2026.

What can Notion Custom Agents actually do?

Notion launched Custom Agents in beta in February 2026 and began charging credits on 4 May 2026. According to Notion's help page, credits cost $10 per 1,000 and are an add-on for Business and Enterprise plans; each run uses credits depending on task complexity. Notion's own example puts runs at roughly 45 to 90 per 1,000 credits, which depends on the agent, so treat it as illustrative.

Agents act on pages and databases the workspace gives them, and can be connected to outside tools. That is the point of this checklist: the lawyer decides which pages, which actions and which connections, and the answer is rarely 'everything'. Notion also publishes an agent template for law firm case intake, which states it does not provide legal advice.

Which actions should an agent be allowed to take?

Use a four-level matrix and start every task at level 1. Move it up only after you have reviewed its output for a few weeks.

A defensible default for a small firm: levels 1 to 3 on internal pages only, level 4 not enabled. Privileged matters and conflict-check data should be excluded from any agent's scope unless you have deliberately included them.

What is the supervision checklist?

1. Write a one-line purpose for each agent and name the lawyer responsible for it.
2. List the pages and databases it can read, and exclude privileged and conflict-sensitive ones by default.
3. Set its action level using the matrix above; keep external sending off unless a human approves each item.
4. Never let an agent file with a court or tribunal, or send advice to a client, without lawyer review and approval.
5. Require citations or page links in every agent output so a reviewer can check the source.
6. Run it in a test workspace with dummy data first and compare its output with what a person would do.
7. Review its activity weekly and keep a short log of errors and corrections.
8. Set a credit budget and an alert for unexpected spend; pause if usage spikes.
9. Tell staff what is permitted, and update your firm AI policy and, where your rules require it, client communications.
10. Re-review the setup whenever Notion changes agent features or your regulator updates guidance.

What about confidentiality and data retention?

Notion's AI security page says that on Enterprise plans its LLM providers use zero data retention by default, and that on other plans providers may retain customer data for up to 30 days before deletion. It also says Notion AI is in scope of its SOC 2 Type 2 report and ISO 27001 certification, and that contractual terms prohibit providers from training on customer data. Features such as External Agents may have different retention controls, so read the current page for the specific feature.

Whether that is enough is a professional-conduct decision, not a vendor claim. Consider client consent where your rules or engagement terms require it, and read the Data Processing Addendum rather than the help summary.

• Is Notion AI safe for confidential legal work?
• Client consent for AI use

Where LawyerOS fits

We make LawyerOS. LawyerOS Pro with AI ($39, one-time) includes a Custom AI Agents page alongside databases for matters, actions, time, research and clients. It is a template: it does not supervise agents for you, does not include Notion credits or a Notion AI plan, and does not provide legal advice. The matrix above is a way to set the rules before you switch anything on.

• LawyerOS Starter and Pro with AI: compare and buy
• What LawyerOS includes
• Notion Custom Agents: what they can and can't do

Frequently asked questions

Can a lawyer let an AI agent send emails to clients?

Regulators have not issued a blanket prohibition, but summaries of California's 2026 guidance say more autonomy requires more oversight. A safe approach is for the agent to draft and a lawyer to approve each message before it leaves, especially anything that could be read as legal advice.

Does California's 2026 AI guidance bind lawyers?

Law firm commentary disagrees on how binding it is, and some related rule changes are described as proposals. It is best treated as the Bar's expectation of good practice. Read the current document on calbar.ca.gov and your own state's rules before relying on any summary.

How much do Notion Custom Agents cost?

According to Notion's help page, credits cost $10 per 1,000 and are an add-on for Business and Enterprise, with billing starting 4 May 2026. How many credits a run uses depends on task complexity, so test with a small budget. Check Notion's pricing page for the current rate.

What is the difference between AI and an AI agent?

A chat assistant answers when asked. An agent can take multi-step actions, such as reading pages, updating records or sending messages, often without a new prompt each time. Because it acts, it needs permissions, logging and human approval points that a simple chatbot does not.

Should an AI agent ever file anything with a court?

No agent should file without attorney review and approval. Summaries of California's guidance say the same, and every reported hallucination case involves an unchecked document reaching a court. Keep filing a human action and keep a verification log.