Reserved Capacity

No: we'll never use or train on your data. Reserved Capacity adheres to our Enterprise Privacy commitments.⁠

**_What happens when the pay-as-you-go price of a model changes?_**Reserved Capacity pricing is based on raw compute costs. Sometimes price changes are enabled by improved price efficiency, in which case updating to that model will yield more throughput on your reserved instances. Sometimes pay-as-you-go price changes are made for reasons separate from model efficiency in which case your reserved capacity throughput will be unaffected.

Throughput on a reserved instance - and the total units and instances you decide to use - will depend on your request pattern. Shared capacity API calls use a “blended” per-request “cost” across all traffic. With reserved instances, your performance is a function of the underlying performance of the hardware and your workload. We will provide a benchmarking instance and tooling for you to determine how many reserved units to purchase for your specific workloads and requirements.

The 2 instance minimum for GPT-4 is the minimum compute budget needed in order to achieve a high level of reliability for this model. Additional instances of GPT-4 can be purchased one at a time.

If reserved instance prices increase, you’ll keep the negotiated price for the instances you already purchased for the lifetime of their contract (up to 12 months). If prices decrease, we will update your pricing to the lower price for the remainder of your term. If you purchased a 1-year commit paid annually, we will credit you the difference prorated for the remainder of your term.

**_Are compute units fungible between instances? If I want to switch from running two GPT-4 Turbo instances to six GPT-3.5 Turbo instances, can I? How?_**Yes. You will still be charged for any compute units that are not provisioned to a model instance. Please reach out to your Account Director to request any changes.

After the Order Form is executed, compute units will be provisioned by an agreed-upon date. Billing starts when compute units are first provisioned to an instance and on a daily basis, commencing at midnight UTC the day after the compute units are provisioned. For billing, a 3 month Term is defined as 90 days and a 12 month Term is defined as 365 days. Invoices will be sent monthly in arrears.

Yes, the minimum required compute unit is 100 today.

There is no explicit cap, but the number of compute units is subject to availability.

Reach out to us to increase the compute unit quota. Order fulfillment is subject to availability.

If you’d need to reduce your commitment for the remainder of the term, please contact us.

During this phase of the product, we will email you confirming the instance is ready. We expect compute unit tracking and automated provisioning to be rolled out in Q2 2023.