You do not need an AI gateway to see OpenAI cost per customer.
A gateway is a different product. If you only need OpenAI cost by customer and feature, you do not need one.
Gateways route, cache, fall back, and often issue virtual keys. What is an AI gateway? CostSlice does none of that. We are a pass-through in front of OpenAI and a customer P&L.
Keep the OpenAI API key in your product’s environment variables. Change the address to https://api.costslice.com/v1. Send x-cs-key, x-cs-tenant, x-cs-feature, x-cs-env.
Completions still go to OpenAI. We count. You see which customer is unprofitable. Starter is $0. Pro is $79/mo. Scale is $199/mo.
vs Helicone. vs Portkey. vs LiteLLM. Demo: sample P&L.
Worked example: the sample is a report. It does not route models. acme-health is Unprofitable because cost beat the plan, not because a gateway picked a cheaper provider.
Starter is free. No credit card. Operator: Media Yard LLC, PO Box 73, Pennsauken, NJ 08110. hello@costslice.com
Questions
- Is CostSlice an AI gateway?
- No. Pass-through OpenAI plus a customer P&L. No routing, cache, or virtual keys.
- Do I need a gateway to see cost per customer?
- No. Tag the request. Keep your OpenAI API key. You do not need routing to see which customer is unprofitable.
- What is an AI gateway?
- A box that sits in front of many models: routing, cache, virtual keys, often logs. See What is an AI gateway.
- Do you store prompts?
- No. We meter tagged usage. Prompt and completion bodies are not stored.