AWS Brings GPT-5.6 Cross-Region Inference, With a Data-Location Choice

The new Bedrock profiles let applications draw from a wider compute pool without changing their core model calls. The trade-off is explicit: global routing offers the broadest capacity, while US routing keeps processing within that geography.

By 3 min read
AWS Brings GPT-5.6 Cross-Region Inference, With a Data-Location Choice
AWS Brings GPT-5.6 Cross-Region Inference, With a Data-Location Choice

Listen to this story

The audio brief

About 1:30
0:001:30
Read transcript
Amazon Bedrock is adding cross-Region inference for OpenAI’s GPT-5.6 Sol, Terra, and Luna across more than 25 AWS Regions. The key decision is where requests are allowed to run. A US profile keeps processing inside predefined US Regions. A global profile can send each request to supported commercial Regions with available capacity, which gives applications a wider compute pool when one location is under load, but may move data across Regions. The change works through inference profiles: logical IDs that an application passes instead of a raw model ID. For teams already using OpenAI formats, the integration can be narrow. Bedrock supports the Responses and Chat Completions APIs, along with its Converse and ConverseStream interfaces. The three models accept text and images, return text, and offer one-million-token context windows, reasoning, tool calling, and prompt caching. The operational details are more consequential than the API change. Cross-Region access requires IAM permission for both the inference profile and the foundation model in every eligible destination Region. CloudTrail logs the source Region and records the processing location in an inferenceRegion field. Requests can also use a private VPC endpoint. There is one retention condition to review: AWS says content flagged by GPT-5.6’s automated abuse classifiers may be retained for up to 30 days. The constraint to watch is simple: does the extra capacity of global routing fit the workload’s data-location rules?

Story brief

3 key points

AWS is adding cross-Region inference for OpenAI’s GPT-5.6 Sol, Terra, and Luna on Amazon Bedrock, giving developers a choice between US-only geographic routing and a global capacity pool spanning supported commercial Regions. The tradeoff is operational: global routing can improve throughput under load but may move data across Regions. Teams must configure IAM access across eligible Regions and review GPT-5.6’s...

  1. 01

    The three models accept text and images, return text, and offer one-million-token context windows, reasoning, tool calling, and prompt caching.

  2. 02

    US profiles keep processing within predefined US Regions; global profiles can route wherever supported capacity is available.

  3. 03

    IAM permissions are required for both the inference profile and foundation model in every eligible destination Region.

Amazon Bedrock now offers OpenAI’s GPT-5.6 Sol, Terra, and Luna through cross-Region inference in more than 25 AWS Regions. Developers can select a US profile that keeps processing within that geography or a global profile that routes to available capacity across supported commercial Regions. The choice turns data-location requirements into an operational constraint on capacity.

The feature works through inference profiles: logical identifiers passed in place of a raw model ID. An application sends its request from a source Region, and Bedrock can process it in a permitted destination Region. AWS describes the system as a capacity mechanism, designed to draw on a broader compute pool and help maintain throughput under load rather than leave a workload bound to one Region’s capacity.

That distinction matters most for workloads with residency rules. AWS says customers whose processing must remain in a specified geography should use the corresponding geographic profile or call a single Region directly; the global option is for workloads without geographic processing requirements. Billing and quota consumption remain associated with the customer account regardless of the backend Region that handled a request.

A model family built for existing application paths

The three general-purpose variants accept text and image inputs, return text, and list a one-million-token context window. They support reasoning mode, server-side tool calling, and prompt caching. AWS says Sol, Terra, and Luna are tuned for different capability-and-cost balances, but this launch’s routing rules apply to all three.

Integration options

  • Use the OpenAI Responses API or Chat Completions API through Bedrock’s OpenAI-compatible endpoint, replacing the model parameter with a geographic or global inference-profile ID.
  • Use Bedrock’s Converse API or ConverseStream when an application already uses Bedrock’s common interface for model calls and streaming.
  • Authenticate with AWS credentials or a Bedrock API key; AWS recommends programmatically generated short-term keys for production rather than long-term keys intended for exploration.

The routing choice reaches security operations

Cross-Region access requires IAM permissions for both the inference profile and the foundation model in every Region that profile may use. Requests appear in CloudTrail in the source Region, and an inferenceRegion field identifies the Region that processed each request. AWS also says calls can reach Bedrock privately through a VPC endpoint and remain governed by IAM policies.

One retention condition deserves separate review. For GPT-5.6, AWS says content flagged by its automated abuse-detection classifiers may be retained for up to 30 days for offline abuse detection. That condition sits alongside AWS’s stated zero-operator-access security model, which it says prevents AWS operators from accessing prompts or completions.

For teams already using OpenAI request formats, the practical change can be narrow: point the client at Bedrock and choose the profile ID that matches the workload’s processing boundary. The harder decision is not API syntax, but whether a wider capacity pool is compatible with the application’s data-handling rules.

Editorial analysis

Our Read

AWS is making deployment policy part of the model-selection step. A team can retain an OpenAI-style client while choosing a US geographic or global Bedrock profile, but that convenience does not erase the governance decision behind where requests may be processed. The more consequential evidence to watch is how customers use those two options under real load: global routing has the widest pool, while the US profile offers a clearer processing boundary. The launch itself establishes the mechanism, not a measured performance advantage for either choice.

Sources

  1. aws.amazon.comIntroducing cross-Region inference for OpenAI GPT-5.6 models on Amazon Bedrock | Amazon Web Services

Loading discussion...