Organizations are beginning to get serious about AI inventory.
They are trying to identify which models are in use, where agents are being deployed, which vendors have access to company data, and whether employees are using personal generative AI accounts for work. Security teams are examining agent identities, credentials, permissions, integrations, and technical controls. Governance groups are building registers, policies, assessment processes, and approval workflows.
This is necessary work. It may still leave a large part of the risk picture unresolved.
Every agent sits inside a network of human authority. People build it, approve it, configure it, connect it to systems, supervise it, use it, rely on its output, and decide whether its actions should be challenged. Those roles are frequently distributed across several functions, and the authority attached to them may not match anyone’s job title.
An organization can know that an agent exists without understanding who can change what it does.
The practical answer is that AI risk registers need a human permission layer. Organizations must map the people who can grant, expand, constrain, interpret, or rely on an agent’s authority—and understand how those relationships change the risk.
Technical identity tells you which agent accessed a system. The human permission layer helps explain why it had that access, who enabled it, who could have restricted it, and who believed someone else was responsible.
What is the human permission layer?
The human permission layer is the network of people, roles, decisions, and assumptions that determines what an AI agent is allowed to do.
It includes formal authority, such as the power to approve an AI use case, grant access, accept risk, or deploy software. It also includes practical authority: the ability to connect a new data source, modify an agent’s instructions, add a tool, increase automation, remove a review step, or begin using its output in a consequential process.
Some of this authority is visible in systems. Identity and access management platforms can show who assigned a credential or approved a role. Change-management tools may record who deployed an integration. AI registers may identify business and technical owners.
Other forms of permission are informal.
A manager tells a team to automate whatever it can. A senior sponsor describes a project as urgent. A developer assumes a product owner approved broader access. A business user begins using an agent’s recommendations as decisions because the recommendations have usually been correct. Nobody explicitly grants additional authority, but the agent’s practical influence grows.
That informal layer matters because organizational permission is not limited to a button marked Approve.
People infer permission through precedent, incentives, hierarchy, silence, and the absence of consequences. They also grant authority through use. An agent that formally offers “decision support” may effectively make the decision when employees stop questioning its recommendation.
This makes the human permission layer bidirectional.
Humans give authority to agents. Agents also influence the authority, judgment, and behavior of the humans interacting with them.
Why is everyone focused on the technical layer?
The technical layer is concrete.
An organization can scan for applications, inspect credentials, review API connections, classify data access, and record which systems an agent can reach. NIST’s current work on software and AI agent identity reflects the importance of this problem. It highlights identification, authorization, auditing, non-repudiation, and the risks created when agents receive access to data, tools, and applications.
Those controls are essential. They are also only one side of authorization.
A system can show that a person granted an agent access to a customer database. It may not show whether that person understood the scope of the access, whether they were formally entitled to approve it, whether another leader informally pressured the decision, or whether the agent’s use changed after approval.
The technology may faithfully enforce a poor human decision.
This is why the human permission layer is the peanut butter in the sandwich. It sits between the technical identity of the agent and the business outcome the organization wants. It connects governance, access, behavior, ownership, and use.
Everyone is quite rightly looking for the jelly: the agents, connections, identities, and technical controls. The less visible layer is what makes the whole thing stick together.
Is shadow AI becoming shadow authority?
Organizations usually discuss shadow AI in terms of undisclosed tool use.
An employee uses a personal generative AI account for company work. A team buys an application without involving procurement. Sensitive information is entered into an unapproved platform. A department experiments with a vendor that does not appear in the official technology inventory.
Those risks remain important, but Agentic AI expands the idea of shadow activity.
An employee may use an approved platform to build an unregistered agent. A business-system administrator may connect an agent to data that was approved for human users but never assessed for autonomous access. A team may gradually move from drafting recommendations to automatically executing them. A no-code builder may create a workflow that communicates externally, modifies records, or initiates financial activity.
What happens when the platform is approved, but the new authority may not be?
That is shadow authority: organizational power delegated to software without clear visibility, ownership, or reassessment.
It can emerge without malicious intent. Modern platforms are designed to make AI automation accessible. Employees can connect tools, create workflows, and build agents without waiting for a specialist engineering team. That accessibility creates value, particularly when people closest to a business problem can solve it themselves.
It also redistributes power.
The ability to configure an agent may give a person practical control over data, decisions, communications, and workflows that would previously have required several technical and managerial approvals.
Their job title may say marketing operations specialist. Their agent may be able to retrieve customer data, generate personalized communications, update campaign status, and trigger follow-up activity across thousands of records.
That employee has become an important AI risk actor whether the organization recognizes the role or not.
Why does the risk register need more than an agent owner?
Many AI inventories include an ownership field.
That is a good start, but “owner” can conceal several different relationships.
A business owner may sponsor the use case and accept the expected business outcome. A technical owner may maintain the system and integrations. A model provider may control major updates. An administrator may manage access. A product manager may define behavior. A developer may write instructions and tools. A team leader may supervise daily use.
Each person may believe another role owns the risk.
NIST’s AI Risk Management Framework explicitly recommends defining and differentiating human roles and responsibilities across AI governance, use, interaction, monitoring, and oversight. It also distinguishes the people who design, procure, deploy, operate, use, evaluate, and govern AI systems.
For agentic systems, four broad human relationships need particular attention.
The builders of agents
Builders create or materially configure the system.
They may be software engineers, data scientists, automation specialists, consultants, prompt designers, product managers, or business users working in a no-code environment. They define objectives, instructions, tools, workflows, boundaries, and escalation behavior.
Builders shape what the agent is capable of attempting.
Their decisions may include which systems the agent can call, how it responds to uncertainty, what it records, when it asks for approval, and whether it can create or modify information.
The risk register should identify who built the agent, which parts they control, and who can change the configuration after deployment.
The owners of agents
Owners are accountable for the agent’s purpose and operation.
A business owner should understand why the agent exists, who may be affected, and what level of risk is acceptable. A technical owner should understand access, dependencies, monitoring, safeguards, and incident response.
Ownership should include the authority to make decisions and the obligation to act when something changes.
A person named in a register who cannot explain the agent’s access, operating limits, or shutdown process is better described as a contact.
The users of agents
Users directly interact with the system.
They may prompt it, assign tasks, approve recommendations, review actions, or use it as part of a business process. Their behavior affects how the agent is used in practice.
Users may expand the agent’s influence without changing its formal permissions. They can begin applying it to new tasks, share access with colleagues, treat optional recommendations as mandatory, or stop performing the review the original process required.
They may also discover unexpected behavior before the formal owner does.
The organization needs to know which users require baseline awareness, which need role-specific capability, and which are effectively supervising consequential activity.
The consumers of AI output
Consumers may never interact with the agent itself.
They receive its reports, recommendations, summaries, decisions, alerts, or communications. They may be executives, customer service representatives, recruiters, analysts, healthcare professionals, finance teams, customers, or members of the public.
Their relationship matters because AI authority can increase through reliance.
An output presented as advice may become a de facto decision when the consumer assumes it has already been validated. A manager may repeatedly approve an agent’s recommendation without examining the evidence. An employee may defer to an automated score because challenging it requires more time or confidence than accepting it.
The system’s formal authority has not changed. Its practical authority has.
This is why the human permission layer must consider influence as well as access.
How does agent authority expand?
Agent authority rarely arrives fully formed.
It usually grows in small, reasonable-looking increments.
An agent begins by summarizing public information. It is then connected to internal documents. Later, it gains access to live customer data. A user asks it to draft messages. Sending is added to save time. A human initially approves every message, then reviews only exceptions. Eventually, the agent handles routine communication automatically.
Each step can be presented as a modest efficiency improvement.
The cumulative change is significant. The agent has moved from information retrieval to external representation of the company.
Authority creep can happen across several dimensions:
- Data authority: access expands from public to internal, sensitive, regulated, or personal data.
- Action authority: the agent moves from reading to creating, modifying, approving, purchasing, deploying, or communicating.
- Decision authority: recommendations begin influencing or replacing human judgment.
- Audience authority: internal outputs begin reaching customers, employees, partners, or the public.
- Duration: a short pilot becomes an embedded operational process.
- Scale: an agent used by one person becomes available to a department or enterprise.
- Autonomy: frequent human review becomes exception-based or disappears.
- Connectivity: the agent gains additional tools, systems, agents, and external services.
A mature risk process should treat material authority expansion as a new decision.
The original approval may no longer describe the system that now exists.
Why do job titles fail to reveal AI power?
Traditional access governance often begins with role.
Administrators receive administrative permissions. Finance staff receive access to financial systems. Developers receive development environments. Managers receive approval authority.
Agentic platforms can blur those categories.
A business user may be able to create a workflow that acts across several applications. A project manager may define the instructions governing automated customer communication. A platform administrator may authorize an agent without understanding the business consequences. A developer may expand capability without holding formal risk acceptance authority.
The most powerful person in the AI workflow may not be the most senior person or the one with the most obvious security privilege.
Power may sit with whoever can:
- alter the agent’s instructions;
- add a tool or integration;
- broaden access;
- change approval thresholds;
- modify the data used for decisions;
- redefine the business objective;
- override or ignore its outputs;
- decide which people rely on it;
- prevent or delay a shutdown.
These are forms of delegated organizational authority.
Human Risk Management should therefore look beyond titles and static access groups. It needs to understand who can shape the agent’s behavior and influence how its output is used.
What should be added to the AI risk register?
The risk register does not need to become a sociological novel for every internal assistant.
Material agents should have enough information to reveal both technical and human authority.
A useful record could include:
Agent identity and purpose
Record what the agent is, what it is intended to achieve, where it operates, and which business process it affects.
Business and technical ownership
Identify who owns the outcome, who owns the implementation, and who has authority to pause or retire the system.
Builders and change authorities
Record who developed or configured the agent and which people can alter instructions, tools, workflows, permissions, models, or integrations.
Users and operating roles
Identify who directly uses or supervises the agent, including elevated users who can assign consequential tasks or approve actions.
Output consumers and affected populations
Record who receives, relies on, or is affected by the agent’s output. This may include employees, leaders, customers, suppliers, applicants, or the public.
Delegated authority
Describe what the agent can read, create, modify, approve, purchase, communicate, deploy, or trigger.
Human approval requirements
Specify where human review occurs, who performs it, what evidence they receive, and which actions remain prohibited.
Decision rights
Record who can approve initial use, expand access, reduce controls, accept residual risk, authorize material changes, and close the system.
Capability requirements
Define what builders, owners, operators, approvers, and reviewers need to know and demonstrate.
Authority-change triggers
Identify which changes require reassessment. These might include new data, tools, models, users, external audiences, automated actions, or changes in scale.
Operational evidence
Link to approvals, assessments, training, monitoring, exceptions, incidents, reviews, and proof that identified issues were resolved.
NIST’s AI RMF calls for inventories, documented roles, clear lines of communication, trained personnel, human oversight, and continuous risk management throughout the AI lifecycle.
The human permission layer makes those expectations usable by connecting the system to the people whose decisions shape it.
What does this mean for Human Risk Management?
HRM teams should not arrive after the AI transformation team has selected the technology, designed the rollout, assigned ownership, and prepared the all-employee training.
By then, many of the important human-risk decisions have already been made.
Human Risk Management has useful expertise at the beginning of AI adoption:
- understanding organizational roles and informal influence;
- mapping human-system interactions;
- examining how people perceive authority and responsibility;
- identifying behavioral and cultural risk conditions;
- designing interventions around real decisions;
- measuring capability, confidence, judgment, and behavior;
- creating audiences based on role, risk, and activity;
- connecting signals to targeted action;
- verifying whether the intervention changed the condition.
NIST’s framework treats effective AI risk management as multidisciplinary and specifically includes human factors, socio-cultural expertise, governance, legal, technical, procurement, operations, and impacted communities among the relevant perspectives.
That multidisciplinary principle should extend to AI transformation programs.
Security teams understand threats, technical controls, architecture, and access. AI governance teams understand policy, regulatory obligations, model risk, and oversight. Transformation teams understand adoption, process change, and business value.
HRM brings the ability to unpack the human system around the technology.
That includes asking who believes they have permission, who truly has it, who influences the decision, who is equipped to exercise authority safely, and who may be relying on the agent in ways the formal design never anticipated.
What can risk intelligence reveal?
A static register tells the organization what was recorded at a point in time.
Risk intelligence helps show where the human permission layer is changing.
Useful signals may include:
- new users building agents or automated workflows;
- access requests associated with AI platforms;
- repeated additions of tools and data sources;
- agents operating outside their approved use case;
- users shifting from occasional to high-volume reliance;
- changes in human approval rates;
- teams with recurring AI exceptions;
- unclear or inactive ownership;
- overdue reassessments;
- employees unable to identify escalation routes;
- high confidence combined with weak capability;
- low willingness to challenge automated recommendations;
- concentration of agent-building authority in unrecognized roles;
- output influencing consequential decisions without documented oversight.
These signals should not automatically produce punishment or suspicion.
They should help the organization decide where to investigate, support, educate, restrict, review, or redesign.
A builder who creates an unregistered workflow may need a clearer disclosure route. An owner who cannot explain the agent’s authority may need role-specific training. A team relying heavily on automated recommendations may need stronger review design. A department repeatedly expanding access may need technical constraints or leadership attention.
Risk intelligence turns a general concern about shadow authority into an operational process.
How does behavioral design help?
Policies often assume that safe behavior follows naturally once expectations are stated.
Behavioral design asks whether the environment makes the expected action easy, timely, understandable, and socially supported.
Consider agent registration.
If employees must complete a lengthy form before they know whether an idea will work, many will delay disclosure. If registration is lightweight during experimentation and becomes more detailed as capability and access expand, people are more likely to engage early.
Consider human review.
If reviewers receive large volumes of low-context agent output, they may approve mechanically. Better workflow design can highlight uncertainty, risk factors, material changes, and the evidence needed for a meaningful decision.
Consider authority changes.
If adding a powerful integration requires only a few clicks, while requesting governance review requires finding the right committee and waiting several weeks, the environment is quietly encouraging shadow authority.
Behavioral design looks at these frictions and incentives without assuming that unsafe behavior results from bad intent.
People generally follow the path that helps them complete their work. The organization needs to ensure that the safe path is also a usable path.
What does risk psychology add?
Risk is not perceived objectively.
People judge risk through familiarity, confidence, trust, previous outcomes, social proof, time pressure, and their sense of control.
A team that built an agent may underestimate its risk because it understands the system and feels able to intervene. A user may over-trust the output because the system appears confident and has performed well before. A senior leader’s enthusiasm may reduce perceived permission to challenge the project. A temporary pilot may feel less serious despite having production access.
These are human factors that can shape the agent’s practical authority.
Risk psychology helps organizations investigate questions such as:
- Do builders view governance as support or obstruction?
- Do users understand the limits of the agent’s competence?
- Do owners feel personally responsible for monitoring?
- Are reviewers genuinely evaluating outputs or routinely approving them?
- Do employees believe they can question an agent backed by senior leadership?
- Does familiarity with the system create excessive confidence?
- Do people recognize when an advisory tool has become an operational decision-maker?
The answers help determine which controls, communications, training, and cultural interventions are likely to work.
How should training differ by relationship to the agent?
A single AI awareness course cannot prepare every person in the human permission layer.
Builders need to understand secure design, delegated authority, tool use, access boundaries, logging, change control, and foreseeable misuse.
Owners need to understand risk acceptance, affected populations, accountability, monitoring, escalation, and lifecycle oversight.
Users need to understand approved use, instructions, limitations, verification, unexpected behavior, and reporting.
Approvers need to evaluate purpose, authority, access, impact, reversibility, and evidence.
Consumers of AI output need to understand how much weight the output should carry, when independent judgment is required, and how to challenge or escalate questionable results.
Administrators need to understand that enabling a technical permission can create business and legal consequences outside their immediate field of view.
Human Risk Management should define these audiences and build interventions around the decisions they actually make.
Completion can show that the intervention was delivered. Assurance requires evidence that the person can perform their role.
What should AI transformation leaders ask?
AI transformation teams should work with Security, governance, Human Risk Management, Legal, Privacy, IT, and business leaders to answer several questions early:
- Who can build or configure agents in the proposed platforms?
- Who can connect them to data, tools, identities, and external services?
- Who approves their purpose and authority?
- Which people can materially change them after approval?
- Who owns the business outcome, technical operation, and continuing oversight?
- Which users directly interact with the agent?
- Who consumes or relies on its output?
- How might advisory output become practical decision authority?
- What changes trigger renewed review?
- What evidence shows that each role is prepared to perform its responsibilities?
- How will the organization detect shadow authority?
- What happens when ownership changes or disappears?
These questions reveal gaps that a technical inventory alone may miss.
They also create a shared language for transformation and risk teams, which is considerably more useful than meeting for the first time after an incident.
The agent is only half the system
AI agents require identities, credentials, authorization controls, monitoring, and technical boundaries. The industry is rightly investing significant effort in those areas.
The other half of the system is human.
People decide what the agent is for. They grant access. They change the instructions. They approve autonomy. They interpret output. They stop questioning recommendations. They expand use. They inherit systems built by colleagues who have moved on.
Those relationships create a human permission layer around every material agent.
Organizations that fail to map it may know which agents they have while remaining unclear about where the actual power sits. They may identify shadow AI while overlooking shadow authority. They may name an owner while missing the builders, users, administrators, approvers, and consumers who shape the system’s behavior and influence.
The next generation of AI risk management needs to connect technical identity with human authority.
That means bringing Human Risk Management into AI transformation early, while roles, workflows, controls, and adoption patterns can still be designed deliberately.
Build the human permission layer into AI readiness
Cybermaniacs’ AI Enablement and Culture Model (AIECM) and AI Readiness and Capability Framework (ARC) help organizations understand the human system surrounding AI adoption.
They examine how authority, ownership, workforce capability, leadership behavior, psychological safety, risk perception, governance, and culture affect the way AI is built, introduced, used, and supervised.
Together, AIECM and ARC help organizations identify:
- who holds formal and informal AI decision rights;
- where agent ownership and accountability are unclear;
- which roles can create or expand shadow authority;
- whether builders, owners, users, and reviewers are ready for their responsibilities;
- where organizational culture encourages unsafe reliance or workarounds;
- which human-risk signals should be measured as AI adoption expands.
This allows transformation teams to build human readiness alongside technical capability, rather than trying to retrofit accountability after agents are already operating across the business.
Explore Cybermaniacs’ AIECM and ARC frameworks to map the human permission layer and build safer, faster, and more effective AI adoption.
[Learn more about AIECM and ARC]
Frequently asked questions
What is the human permission layer in AI?
The human permission layer is the network of people, roles, decisions, and assumptions that determines what an AI agent can do, how its authority can change, and how its outputs influence human decisions.
What is shadow authority?
Shadow authority occurs when organizational power is delegated to an AI system without clear visibility, approval, ownership, or reassessment. It may involve approved platforms being used to create unregistered agents, expand access, automate actions, or influence decisions beyond the original use case.
Who should be included in an AI risk register?
Material AI systems should identify builders, business and technical owners, administrators, approvers, direct users, supervisors, and the people or groups that consume or are affected by AI outputs.
How is an agent owner different from an agent builder?
The builder creates or configures the agent. The owner remains accountable for its purpose, operation, risk, and oversight. One person may perform both roles, but they require different authority and capability.
Why do consumers of AI output matter?
Consumers determine how much practical authority the output receives. An advisory system can become a de facto decision-maker when people routinely accept its recommendations without meaningful review.
How can Human Risk Management support AI transformation?
Human Risk Management can map human roles and decision rights, assess capability and risk perception, identify shadow authority, design role-based interventions, monitor behavioral signals, and verify that identified risks are addressed.
What should trigger reassessment of an AI agent?
Reassessment should occur when the agent gains new data, tools, users, integrations, audiences, autonomy, scale, or decision-making influence—or when ownership, models, business purpose, or oversight arrangements materially change.
Practical takeaway
For every material agent, ask:
- Who built it?
- Who owns it?
- Who can change it?
- Who grants its access?
- Who uses it?
- Who relies on its output?
- Who can increase its authority?
- Who can stop it?
The agent inventory tells you what exists. The human permission layer tells you how the risk can grow.