Darktrace Releases SECURE AI to Monitor Sessions and Agent Permissions

The security product is designed to help companies track AI use across providers, from employee prompts to the permissions granted while agents are built.

By 3 min read
Darktrace Releases SECURE AI to Monitor Sessions and Agent Permissions
Darktrace Releases SECURE AI to Monitor Sessions and Agent Permissions

Listen to this story

The audio brief

About 1:35
0:001:35
Read transcript
Darktrace has made SECURE AI generally available, giving companies a way to monitor how employees and AI agents use services from multiple providers. The product watches live sessions in ChatGPT Enterprise, Claude, Microsoft Copilot, and Amazon Bedrock, looking for jailbreak attempts, sensitive-data exposure, and indirect prompt injection. It can also identify unsanctioned AI services, block them, or quarantine a device through integrations such as Microsoft Entra Global Secure Access. The need for that coverage is growing. Darktrace says telemetry from roughly 8,200 deployments in August showed that more than 80% of monitored customer accounts were using generative AI. On average, each organization used five providers, creating a mix of approved assistants, employee-selected tools, and internal agents for security teams to track. SECURE AI also reaches into agent development. In environments including Amazon Bedrock and Microsoft Copilot Studio, it checks for overly broad permissions and configuration mistakes. Administrators can map an agent back to its human user, review what it can access, and apply behavioral baselines to flag activity that looks abnormal. Customers can upload policies in plain language and check them against compliance frameworks, although Darktrace has not named which frameworks are supported. The product is available standalone or through Darktrace’s Behavioral Defense Platform. Its related work with OpenAI on the Daybreak Defense Network remains under development, leaving the key question of how far monitoring and enforcement will extend across everyday AI use.

Story brief

3 key points

Darktrace has made SECURE AI generally available to monitor enterprise AI use across sessions, services, and agent-building environments. The product uses behavioral baselines to detect jailbreaks, prompt injection, sensitive-data exposure, unsanctioned tools, and excessive agent permissions, with enforcement options including service blocking and device quarantine. Darktrace’s August telemetry across roughly 8,200...

  1. 01

    SECURE AI covers ChatGPT Enterprise, Claude, Microsoft Copilot, Amazon Bedrock, and Microsoft Copilot Studio.

  2. 02

    Administrators can map agents to human users, review access, and identify permission or configuration problems during development.

  3. 03

    Darktrace supports standalone deployment or inclusion in its Behavioral Defense Platform for new and existing customers.

Companies using AI tools across their workforce now have a new monitoring option: Darktrace has made SECURE AI generally available as a standalone product or part of its Behavioral Defense Platform. The offering is built to identify risky AI activity, including sensitive-data exposure, jailbreak attempts, unsanctioned services and agent misconfigurations.

The release addresses a visibility problem. Darktrace says telemetry from about 8,200 deployments showed that more than 80% of monitored customer accounts used generative AI services in August. The average organization used five AI providers, leaving security teams to manage approved assistants, employee-selected tools and internal agents at once.

From AI conversations to device controls

SECURE AI applies Darktrace’s behavioral-detection approach to corporate AI use. The company’s security products establish a picture of normal activity within each customer environment; this product uses that approach to flag activity that departs from that baseline. Its general-availability release includes integrations spanning AWS, Anthropic, Microsoft and OpenAI services.

The controls Darktrace says it adds

  • It scans sessions in ChatGPT Enterprise, Claude, Microsoft Copilot and Amazon Bedrock in real time for jailbreak attempts, sensitive-data exposure and indirect prompt injection.
  • It ranks sessions by risk, detects unsanctioned AI services and can block those services or quarantine a device through integrations including Microsoft Entra Global Secure Access.
  • It maps AI agents to their human users, records what each agent can access and checks development environments for excessive permissions and misconfigurations while agents are being built.

The product reaches into agent creation

The development-side coverage is a notable part of the pitch. SECURE AI monitors environments including Amazon Bedrock and Microsoft Copilot Studio, where companies build agents, for permissions that are too broad and configuration mistakes. Mapping an agent to a person and its allowed access is meant to give administrators a trail from automated activity back to an accountable user.

A policy layer beside the detection

Darktrace says customers can upload AI policies in plain language and have SECURE AI check them against regulatory and compliance frameworks. Darktrace did not identify the supported frameworks in its announcement.

A broader security partnership remains in development

The release also sits alongside Darktrace’s work with OpenAI through the Daybreak Defense Network. Darktrace is developing capabilities that combine OpenAI’s Daybreak models with its behavioral data. The stated goal is to show defenders which people and systems an AI-related incident has affected.

SECURE AI is available now to new and existing Darktrace customers, either on its own or through the Behavioral Defense Platform. For companies confronting a growing inventory of AI services and agents, the central question is less whether activity exists than how far monitoring and enforcement should extend into everyday use.

Sources

  1. siliconangle.comExclusive: Darktrace makes SECURE AI generally available to monitor enterprise AI use - SiliconANGLE

Loading discussion...

YOUR READING SPACE

Notifications

Darktrace Releases SECURE AI to Monitor Sessions and Agent Permissions | Superpower Daily