---
format: "aidr-story-markdown/v1"
id: "48003ca6dcdc0ce99136315953226619104e6b66f4e27d176b590cd9074833a7"
canonical_url: "https://aidr.today/48003ca6?lang=en"
title: "Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-11-20T22:35:24.000Z"
category: "Tools"
topics: ["amazon","inference","devtools"]
source_urls: ["https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/"]
summary: "Amazon SageMaker HyperPod has introduced the Global Inference Gateway, a managed endpoint that routes inference requests across HyperPod clusters within or across Regions. The gateway selects the best cluster, provides automatic failover, and authenticates requests with SigV4 and IAM over AWS PrivateLink."
---

# Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

> [Open the canonical story](<https://aidr.today/48003ca6?lang=en>)

**Published:** 2026-11-20T22:35:24.000Z
**Category:** Tools
**Topics:** amazon, inference, devtools

## Summary

Amazon SageMaker HyperPod has introduced the Global Inference Gateway, a managed endpoint that routes inference requests across HyperPod clusters within or across Regions\. The gateway selects the best cluster, provides automatic failover, and authenticates requests with SigV4 and IAM over AWS PrivateLink\.

## Sources

- [Story source](<https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/>)

