1. A company uses Amazon Bedrock with the on-demand pricing model. During a product launch, traffic spikes dramatically, and the team observes throttling and high latency for their most critical inference workloads. The model they use is available for provisioned throughput. What is the PRIMARY benefit of switching to provisioned throughput for this workload?
- A. Provisioned throughput eliminates all per-token costs, making inference free after purchase
- B. Provisioned throughput guarantees a reserved level of model units (throughput), preventing throttling for predictable high-volume workloads✓ Correct
- C. Provisioned throughput allows the company to use any foundation model across all AWS regions simultaneously
- D. Provisioned throughput automatically scales capacity up and down based on real-time traffic with no commitment
Explanation
Provisioned throughput in Amazon Bedrock allows customers to purchase a fixed number of model units, guaranteeing a consistent throughput level that prevents throttling — ideal for high-volume, predictable workloads. It does not eliminate per-token costs; customers pay for the committed capacity regardless of actual usage, which is a commitment cost, not free inference. Provisioned throughput applies to a specific model in specific regions; it does not grant cross-region access to all models. Provisioned throughput is a committed capacity purchase with a minimum term (e.g., 1 month or 6 months) and does not auto-scale — that characteristic describes on-demand pricing.