# Portkey Docs > Comprehensive documentation for Portkey's AI Gateway, Guardrails, Observability, Prompts, and Governance features. ## Docs - [How to Contribute](https://portkey-docs-guide-prompt-api.mintlify.site/README.md) - [Get cache hit latency data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-latency-data.md) - [Get cache hit rate data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-rate-data.md) - [Get cost data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cost-data.md) - [Get error rate data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-error-rate-data.md) - [Get errors data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-errors-data.md) - [Get feedback data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-data.md) - [Get feedback per ai models data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-per-ai-models-data.md) - [Get feedback score distribution data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-score-distribution-data.md) - [Get latency data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-latency-data.md) - [Get requests data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-data.md) - [Get requests per user data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-per-user-data.md) - [Get rescued requests data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-rescued-requests-data.md) - [Get status code data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-status-code-data.md) - [Get tokens data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-tokens-data.md) - [Get unique status code data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-unique-status-code-data.md) - [Get users data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-users-data.md) - [Get weighted feedback data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-weighted-feedback-data.md) - [Get Metadata Grouped Data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-metadata-grouped-data.md) - [Get Model Grouped Data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-model-grouped-data.md) - [Get User Grouped Data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-user-grouped-data.md) - [Get User Grouped Data](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/analytics/summary/get-all-cache-data.md) - [Create API Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/api-keys/create-api-key.md): Creates a new API key. - [Delete an API Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/api-keys/delete-an-api-key.md) - [List API Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/api-keys/list-api-keys.md) - [Retrieve an API Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/api-keys/retrieve-an-api-key.md) - [Update API Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/api-keys/update-api-key.md): Updates an existing API key.… - [List Audit Logs](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/audit-logs/list-audit-logs.md) - [Create Config](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/create-config.md) - [Delete Config](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/delete-config.md) - [List Config Versions](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/list-config-versions.md) - [List Configs](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/list-configs.md) - [Retrieve Config](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/retrieve-config.md) - [Update Config](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/configs/update-config.md) - [Create Guardrail](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/guardrails/create-guardrail.md): Creates a new guardrail with… - [Delete Guardrail](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/guardrails/delete-guardrail.md): Deletes an existing guardrail - [List Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/guardrails/list-guardrails.md): Retrieves a paginated list of… - [Retrieve Guardrail](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/guardrails/retrieve-guardrail.md): Retrieves details of a specif… - [Update Guardrail](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/guardrails/update-guardrail.md): Updates an existing guardrail… - [Create Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/create-integration.md) - [Delete Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/delete-integration.md) - [List Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/list-integrations.md) - [Delete Custom Model](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/models/delete-custom-model.md): Removes multiple custom model… - [List Model Access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/models/list-model-access.md): Retrieves all model access fo… - [Update Model Access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/models/update-model-access.md): Updates model access, pricing… - [Retrieve Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/retrieve-integration.md) - [Update Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/update-integration.md) - [List Workspace Access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/workspaces/list-workspace-access.md): Retrieves workspace access co… - [Update Workspace Access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/integrations/workspaces/update-workspace-access.md): Updates workspace access perm… - [List MCP Integration Capabilities](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/capabilities/list-mcp-integration-capabilities.md) - [Update MCP Integration Capabilities](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/capabilities/update-mcp-integration-capabilities.md) - [Create MCP Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/create-mcp-integration.md): Create a new MCP Integration.… - [Delete MCP Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/delete-mcp-integration.md) - [List MCP Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/list-mcp-integrations.md): List MCP Integrations for the… - [Retrieve MCP Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/retrieve-mcp-integration.md) - [Retrieve MCP Integration Metadata](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/retrieve-mcp-integration-metadata.md) - [Update MCP Integration](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/update-mcp-integration.md) - [List MCP Integration Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/workspaces/list-mcp-integration-workspaces.md) - [Update MCP Integration Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-integrations/workspaces/update-mcp-integration-workspaces.md) - [Bulk update MCP Server capability overrides](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/capabilities/bulk-update-mcp-server-capabilities.md) - [List MCP Server capabilities](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/capabilities/list-mcp-server-capabilities.md) - [Create MCP Server](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/create-mcp-server.md): Create a new MCP Server (work… - [Delete MCP Server](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/delete-mcp-server.md) - [List MCP Servers](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/list-mcp-servers.md): List MCP Servers for the work… - [Retrieve MCP Server](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/retrieve-mcp-server.md) - [Test MCP Server connection](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/test-mcp-server.md): Test connectivity to the MCP… - [Update MCP Server](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/update-mcp-server.md) - [Bulk update MCP Server user access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/user-access/bulk-update-mcp-server-user-access.md) - [List MCP Server user access](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/mcp-servers/user-access/list-mcp-server-user-access.md) - [Create Rate Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/rate-limits/create-rate-limits-policy.md): Create a new rate limits poli… - [Delete Rate Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/rate-limits/delete-rate-limits-policy.md): Delete a rate limits policy. - [List Rate Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/rate-limits/list-rate-limits-policy.md): List all rate limits policies… - [Retrieve Rate Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/rate-limits/retrieve-rate-limits-policy.md): Get a single rate limits poli… - [Update Rate Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/rate-limits/update-rate-limits-policy.md): Update an existing rate limit… - [Create Usage Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/create-usage-limits-policy.md): Create a new usage limits pol… - [Delete Usage Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/delete-usage-limits-policy.md): Archive (soft delete) a usage… - [List Usage Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/list-usage-limits-policy.md): List all usage limits policie… - [List Usage Limits Policy Entities](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/list-usage-limits-policy-entities.md): List entities tracked by a us… - [Reset Usage Limits Policy Entity](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/reset-usage-limits-policy-entity.md): Reset the current usage for a… - [Retrieve Usage Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/retrieve-usage-limits-policy.md): Get a single usage limits pol… - [Update Usage Limits Policy](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/policies/usage-limits/update-usage-limits-policy.md): Update an existing usage limi… - [Create Prompt Collection](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/create-collection.md): Creates a new collection in t… - [Delete Prompt Collection](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/delete-collection.md): Deletes a collection - [List Prompt Collections](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/list-collections.md): Lists all collections in the… - [Retrieve Prompt Collection](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/retrieve-collection.md): Retrieves details of a specif… - [Update Prompt Collection](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/update-collection.md): Updates a collection's details - [Create Prompt](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/create-prompt.md) - [Delete Prompt](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/delete-prompt.md) - [Create Label](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/create-label.md): Creates a new label in the sy… - [Delete Label](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/delete-label.md): Deletes a label - [List Labels](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/list-labels.md): Returns a list of labels base… - [Retrieve Label](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/retrieve-label.md): Returns a specific label by i… - [Update Label](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/update-label.md): Updates an existing label - [List Prompt Versions](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/list-prompt-versions.md) - [List Prompts](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/list-prompts.md) - [Create Partial](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/create-partial.md) - [Delete Partial](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/delete-partial.md) - [List Partial Versions](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/list-partial-versions.md) - [List Partials](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/list-partials.md) - [Publish Partial](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/publish-partial.md) - [Retrieve Partial](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/retrieve-partial.md) - [Update Partial](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/update-partial.md) - [Publish Prompt](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/publish-prompt.md) - [Retrieve Prompt](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/retrieve-prompt.md) - [Retrieve Prompt Version](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/retrieve-prompt-version.md) - [Update Prompt](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/update-prompt.md): Update a prompt's metadata an… - [Update Prompt Version](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/prompts/update-prompt-version.md): Updates metadata for a specif… - [Create Provider](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/providers/create-provider.md) - [Delete Provider](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/providers/delete-provider.md) - [List Providers](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/providers/list-providers.md) - [Retrieve Provider](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/providers/retrieve-provider.md) - [Update Provider](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/providers/update-provider.md) - [Create Secret Reference](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/secret-references/create-secret-reference.md) - [Delete Secret Reference](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/secret-references/delete-secret-reference.md) - [List Secret References](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/secret-references/list-secret-references.md) - [Retrieve Secret Reference](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/secret-references/retrieve-secret-reference.md) - [Update Secret Reference](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/secret-references/update-secret-reference.md) - [Delete a user invite](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/user-invites/delete-a-user-invite.md) - [Invite a User](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/user-invites/invite-a-user.md): Send an invite to user for yo… - [Resend a user invite](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/user-invites/resend-a-user-invite.md): Resend an invite to user for… - [Retrieve all user invite](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/user-invites/retrieve-all-user-invites.md) - [Retrieve an user invite](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/user-invites/retrieve-an-invite.md) - [Remove a user](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/users/remove-a-user.md) - [Retrieve a user](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/users/retrieve-a-user.md) - [Retrieve all users](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/users/retrieve-all-users.md) - [Update a user](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/users/update-a-user.md) - [Create Virtual Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/create-virtual-key.md) - [Delete Virtual Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/delete-virtual-key.md) - [List Virtual Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/list-virtual-keys.md) - [Retrieve Virtual Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/retrieve-virtual-key.md) - [Update Virtual Key](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/update-virtual-key.md) - [Add a Workspace Member](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspace-members/add-a-workspace-member.md) - [Remove Workspace Member](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspace-members/remove-workspace-member.md) - [Retrieve a Workspace Member](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspace-members/retrieve-a-workspace-member.md) - [Retrieve all Workspace Member](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspace-members/retrieve-all-workspace-members.md) - [Update Workspace Member](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspace-members/update-workspace-member.md) - [Create Workspace](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspaces/create-workspace.md) - [Delete a Workspace](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspaces/delete-a-workspace.md) - [Retrieve a Workspace](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspaces/retrieve-a-workspace.md) - [Retrieve all Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspaces/retrieve-all-workspaces.md) - [Update Workspace](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/control-plane/workspaces/update-workspace.md) - [Create Feedback](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/feedback/create-feedback.md): This endpoint allows users to… - [Update Feedback](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/feedback/update-feedback.md): This endpoint allows users to… - [Insert a Log](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/insert-a-log.md): Submit one or more log entries - [Cancel a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/cancel-a-log-export.md) - [Create a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/create-a-log-export.md) - [Download a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/download-a-log-export.md) - [List a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/list-log-exports.md) - [Retrieve a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/retrieve-a-log-export.md) - [Start a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/start-a-log-export.md) - [Update a Log Export](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/update-a-log-export.md) - [Errors](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/error.md): Error codes returned by the A… - [Introduction](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/introduction.md): Manage your Portkey organizat… - [OpenAPI Specification](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/admin-api/open-api-specification.md) - [Agentic Usage](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/agentic-usage.md): Add Portkey SDK skills to you… - [Create Assistant](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/assistants/create-assistant.md) - [Delete Assistant](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/assistants/delete-assistant.md) - [List Assistant](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/assistants/list-assistants.md) - [Modify Assistant](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/assistants/modify-assistant.md) - [Retrieve Assistant](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/assistants/retrieve-assistant.md) - [Create Message](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/messages/create-message.md) - [Delete Message](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/messages/delete-message.md) - [List Message](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/messages/list-messages.md) - [Modify Message](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/messages/modify-message.md) - [Retrieve Message](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/messages/retrieve-message.md) - [List Run Steps](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/run-steps/list-run-steps.md) - [Retrieve Run Steps](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/run-steps/retrieve-run-steps.md) - [Cancel Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/cancel-run.md) - [Create Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/create-run.md) - [Create thread and Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/create-thread-and-run.md) - [list Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/list-runs.md) - [Modify Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/modify-run.md) - [Retrieve Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/retrieve-run.md) - [Submit Tool Outputs to Run](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/runs/submit-tool-outputs-to-run.md) - [Create Thread](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/threads/create-thread.md) - [Delete Thread](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/threads/delete-thread.md) - [Modify Thread](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/threads/modify-thread.md) - [Retrieve Thread](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/assistants-api/threads/retrieve-thread.md) - [Create Speech](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/audio/create-speech.md) - [Create Transcription](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/audio/create-transcription.md) - [Create Translation](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/audio/create-translation.md) - [Authentication](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/authentication.md) - [Cancel Batch](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/batch/cancel-batch.md) - [Create Batch](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/batch/create-batch.md) - [List Batch](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/batch/list-batch.md) - [Retrieve Batch](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/batch/retrieve-batch.md) - [Chat](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/chat.md) - [Completions](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/completions.md) - [Gateway Config Object](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/config-object.md) - [Embeddings](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/embeddings.md) - [Errors](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/error-codes.md) - [Delete File](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/files/delete-file.md) - [List Files](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/files/list-files.md) - [Retrieve File](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/files/retrieve-file.md) - [Retrieve File Content](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/files/retrieve-file-content.md) - [Upload File](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/files/upload-file.md) - [Cancel Fine-tuning](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/cancel-fine-tuning.md) - [Create Fine-tuning Job](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/create-fine-tuning-job.md): Finetune a provider model - [List Fine-tuning Checkpoints](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-checkpoints.md) - [List Fine-tuning Events](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-events.md) - [List Fine-tuning Jobs](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-jobs.md) - [Retrieve Fine-tuning Job](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/fine-tuning/retrieve-fine-tuning-job.md) - [Gateway to Other APIs](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/gateway-for-other-apis.md): Access any custom provider en… - [Headers](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/headers.md): Header requirements and optio… - [Create Image](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/images/create-image.md) - [Create Image Edit](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/images/create-image-edit.md) - [Create Image Variation](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/images/create-image-variation.md) - [Introduction](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/introduction.md): This documentation provides d… - [Models](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/models/models.md): Lists the currently available… - [Moderations](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/moderations.md) - [OpenAPI Specification](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/open-api-specification.md) - [Prompt Completions](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/prompts/prompt-completion.md): Execute your saved prompt tem… - [Prompt Render](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/prompts/render.md): Renders a prompt template wit… - [Response Schema](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/response-schema.md) - [Delete a Response](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/responses/delete-response.md) - [Create a Response](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/responses/responses.md) - [List Input Items](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/responses/retrieve-inputs.md) - [Get a Response](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/responses/retrieve-response.md) - [Supported Providers](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/inference-api/supported-providers.md) - [C# (.NET)](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/sdk/c-sharp.md): Integrate Portkey in your `.N… - [Supported SDKs](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/sdk/list.md): Find the best way to use Port… - [Node.js](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/sdk/node.md): Official Portkey Node.js SDK… - [Python](https://portkey-docs-guide-prompt-api.mintlify.site/api-reference/sdk/python.md): Official Portkey Python SDK t… - [December](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2024/dec.md) - [November](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2024/nov.md) - [October](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2024/oct.md) - [April](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/apr.md) - [August](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/august.md) - [December](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/december.md) - [February](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/feb.md) - [January](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/jan.md) - [July](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/july.md) - [June](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/june.md) - [March](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/mar.md) - [May](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/may.md) - [November](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/november.md) - [October](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/october.md) - [September](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2025/september.md) - [February](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2026/february.md) - [January](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/2026/january.md) - [Backend](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/backend.md) - [Data Service](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/data-service.md) - [Enterprise Gateway](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/enterprise.md) - [Frontend](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/frontend.md) - [Helm Chart](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/helm-chart.md) - [Node.js](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/node-sdk-changelog.md) - [Latest Updates](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/product.md) - [Python](https://portkey-docs-guide-prompt-api.mintlify.site/changelog/python-sdk-changelog.md) - [Converting STDIO to Remote MCP Servers](https://portkey-docs-guide-prompt-api.mintlify.site/guides/converting-stdio-to-streamable-http.md): Step-by-step guide to convert… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started.md) - [101 on Portkey's Gateway Configs](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/101-on-portkey-s-gateway-configs.md): You are likely familiar with… - [A/B Test Prompts and Models](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/a-b-test-prompts-and-models.md): A/B testing with large langua… - [Function Calling](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/function-calling.md): Get the LLM to interact with… - [Getting Started with AI Gateway](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/getting-started-with-ai-gateway.md): Connect to 1,600+ LLMs throug… - [Image Generation](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/image-generation.md) - [Llama 3 on Groq](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/llama-3-on-groq.md) - [Return Repeat Requests from Cache](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/return-repeat-requests-from-cache.md): If you have multiple users of… - [Tackling Rate Limiting](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/tackling-rate-limiting.md): LLMs are **costly** to run. A… - [Trigger Automatic Retries on LLM Failures](https://portkey-docs-guide-prompt-api.mintlify.site/guides/getting-started/trigger-automatic-retries-on-llm-failures.md) - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations.md) - [Anyscale](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/anyscale.md): Portkey helps bring Anyscale… - [Deepinfra](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/deepinfra.md) - [Groq](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/groq.md) - [Introduction to GPT-4o](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/introduction-to-gpt-4o.md) - [Langchain](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/langchain.md) - [Llama 3 on Portkey + Together AI](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/llama-3-on-portkey-+-together-ai.md): Try out the new Llama 3 model… - [Mistral](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/mistral.md): Portkey helps bring Mistral's… - [Mixtral 8x22b](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/mixtral-8x22b.md) - [Sync Open WebUI Feedback → Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/openwebui-to-portkey.md): How to export thumbs-up/down… - [Segmind](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/segmind.md) - [Vercel AI](https://portkey-docs-guide-prompt-api.mintlify.site/guides/integrations/vercel-ai.md): Portkey is a control panel fo… - [Prompts](https://portkey-docs-guide-prompt-api.mintlify.site/guides/prompts.md) - [Build a chatbot using Portkey's Prompt Templates](https://portkey-docs-guide-prompt-api.mintlify.site/guides/prompts/build-a-chatbot-using-portkeys-prompt-templates.md): Portkey's prompt templates of… - [Optimizing Prompts for Customer Support using Portkey | LLama Prompt Ops Integration](https://portkey-docs-guide-prompt-api.mintlify.site/guides/prompts/llama-prompts.md) - [Building an LLM-as-a-Judge System for AI (Customer Support) Agent](https://portkey-docs-guide-prompt-api.mintlify.site/guides/prompts/llm-as-a-judge.md) - [Ultimate AI SDR](https://portkey-docs-guide-prompt-api.mintlify.site/guides/prompts/ultimate-ai-sdr.md): Building a sophisticated AI S… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases.md) - [Automated Prompt Replication](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/automated-prompt-replication.md): Bulk-copy Portkey prompts and… - [Build an article suggestion app with Supabase pgvector, and Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/build-an-article-suggestion-app-with-supabase-pgvector-and-portkey.md): Consider that you have list o… - [Combining Routing Strategies: Conditional, Load Balancing & Fallbacks](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/combining-routing-strategies.md): Every Portkey routing strateg… - [Comparing Top10 LMSYS Models with Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/comparing-top10-lmsys-models-with-portkey.md) - [Comparing DeepSeek Models Against OpenAI, Anthropic & More Using Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/deepseek-r1.md) - [Detecting Emotions with GPT-4o](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/emotions-with-gpt-4o.md) - [Enforcing JSON Schema with Anyscale & Together](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/enforcing-json-schema-with-anyscale-and-together.md): Get the LLM to adhere to your… - [Unified LLM API with Automatic Failover & Error Handling](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/enterprise-ready-unified-api.md): Build a single API interface… - [Fallback from SDXL to Dall-e-3](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/fallback-from-sdxl-to-dall-e-3.md): Generative AI models have rev… - [Testing Application Resilience with Fallbacks](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/fallbacks-test.md) - [Few-Shot Prompting](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/few-shot-prompting.md): LLMs are highly capable of fo… - [How to use Portkey Guardrails for PII Protection](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/guardrail-pii-use-case.md): Portkey Guardrails is a power… - [How to use OpenAI SDK with Portkey Prompt Templates](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/how-to-use-openai-sdk-with-portkey-prompt-templates.md): Portkeys Prompt Playground al… - [Web Search for Any LLM in LibreChat](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/librechat-web-search.md) - [Multi-Tenant LLM Access with Enterprise Control for Customer-Facing Apps](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/multi-tenant-ai-feature.md) - [Portkey with OpenAI Computer Use](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/openai-computer-use.md): Leverage Portkey with OpenAI'… - [Using Private MCP Servers with Responses API](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/private-mcp-servers.md): Client-side tool handling for… - [How to Run Structured Output Evals at Scale](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/run-batch-evals.md) - [Run Portkey on Prompts from Langchain Hub](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/run-portkey-on-prompts-from-langchain-hub.md): Writing the right prompt is o… - [Setting up resilient Load balancers with failure-mitigating Fallbacks](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/setting-up-resilient-load-balancers-with-failure-mitigating-fallbacks.md): Companies often face challeng… - [Setup OpenAI -> Azure OpenAI Fallback](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/setup-openai-greater-than-azure-openai-fallback.md): Portkey Fallbacks can automat… - [Smart Fallback with Model-Optimized Prompts](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/smart-fallback-with-model-optimized-prompts.md): Portkey can help you easily c… - [Tracking LLM Costs Per User with Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/guides/use-cases/track-costs-using-metadata.md): Monitor and analyze user-leve… - [4. Advanced Strategies for Performance Improvement](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/advanced-strategies.md) - [5. Architectural Considerations](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/architectural-considerations.md) - [10. Conclusion and Key Takeaways](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/conclusion-and-key-takeaways.md): Summarizing the key strategie… - [7. Cost Effective Development Practices](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/cost-effective-development.md) - [Executive Summary](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/executive-summary.md): Overview of LLM cost optimiza… - [3. FrugalGPT Techniques for Cost Optimization](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/frugalgpt-techniques.md) - [9. Future Trends in LLM Cost Optimization](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/future-trends.md) - [1. Introduction](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/introduction.md): An overview of the challenges… - [2. Understanding LLM Cost Drivers](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/llm-cost-drivers.md): An overview of the factors th… - [6. Operational Best Pracitces](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/operational-best-practices.md) - [8. User Education and Change Management](https://portkey-docs-guide-prompt-api.mintlify.site/guides/whitepapers/optimizing-llm-costs/user-education.md) - [Error AB03: You do not have enough permissions](https://portkey-docs-guide-prompt-api.mintlify.site/help-center/you-do-not-have-enough-permissions.md): Troubleshoot and resolve the… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents.md): Portkey helps bring your agen… - [AWS AgentCore](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/agentcore.md): Run Portkey-powered agents in… - [Agno AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/agno-ai.md): Use Portkey with Agno to buil… - [Autogen](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/autogen.md): Use Portkey with Autogen to t… - [Bring Your own Agents](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/bring-your-own-agents.md): You can also use Portkey if y… - [Claude Agent SDK](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/claude-agent-sdk.md): Use Portkey with Claude Agent… - [Control Flow](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/control-flow.md): Use Portkey with Control Flow… - [CrewAI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/crewai.md): Use Portkey with CrewAI to ta… - [Langchain Agents](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/langchain-agents.md) - [LangGraph](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/langgraph.md): Use Portkey with LangGraph to… - [Langroid](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/langroid.md) - [LiveKit](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/livekit.md): Build production-ready voice… - [Llama Agents by Llamaindex](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/llama-agents.md): Use Portkey with Llama Agents… - [Mastra Agents](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/mastra-agents.md): Use Portkey with Mastra to ta… - [OpenAI Agents SDK (Python)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/openai-agents.md): Use Portkey with OpenAI Agent… - [OpenAI Agents SDK (TypeScript)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/openai-agents-ts.md): Use Portkey with OpenAI Agent… - [OpenAI Swarm](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/openai-swarm.md): The Portkey x Swarm integrati… - [Phidata](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/phidata.md): Use Portkey with Phidata to t… - [Pydantic AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/pydantic-ai.md): Use Portkey with PydanticAI t… - [Strands Agents](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/agents/strands.md): Use Portkey with AWS's Strand… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/ai-apps.md) - [Microsoft Azure](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/cloud/azure.md): Discover how you can build yo… - [Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/ecosystem.md) - [Acuvity](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/acuvity.md): Acuvity is model agnostic Gen… - [Akto](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/akto.md): Akto Agentic Security provide… - [Aporia](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/aporia.md) - [Azure Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/azure-guardrails.md): Integrate Microsoft Azure's p… - [AWS Bedrock Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/bedrock-guardrails.md): Secure your AI applications w… - [Bring Your Own Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/bring-your-own-guardrails.md): Integrate your custom guardra… - [CrowdStrike AIDR](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/crowdstrike-aidr.md): CrowdStrike AI Detection and… - [F5 Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/f5-guardrails.md): F5 Guardrails (powered by Cal… - [Javelin (Highflame)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/javelin.md): Javelin provides comprehensiv… - [JWT Token Validator](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/jwt.md): Validate JWT tokens with sign… - [Lasso Security](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/lasso.md): Lasso Security protects your… - [Mistral](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/mistral.md): Mistral moderation service he… - [Palo Alto Networks Prisma AIRS](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/palo-alto-panw-prisma.md): Comprehensive AI security pla… - [Pangea](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/pangea.md): Pangea AI Guard helps analyze… - [Patronus AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/patronus-ai.md): Patronus excels in industry-s… - [Pillar](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/pillar.md) - [Prompt Security](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/prompt-security.md): Prompt Security detects and p… - [Qualifire](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/qualifire.md): Qualifire provides comprehens… - [Replace Custom Regex Patterns](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/regex.md): Redact custom patterns with R… - [Zscaler AI Guard](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/guardrails/zscaler.md): Zscaler AI Guard integration… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries.md) - [Android Studio](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/android-studio.md): Add observability, governance… - [Anthropic Computer Use](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/anthropic-computer-use.md) - [AnythingLLM](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/anythingllm.md): Add usage tracking, cost cont… - [Autogen (DEPRECATED)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/autogen.md): AutoGen is a framework that e… - [Claude Code](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/claude-code.md): Integrate Portkey with Claude… - [Claude Code with Anthropic](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/claude-code-anthropic.md): Route Claude Code through Ant… - [Claude Code with Amazon Bedrock](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/claude-code-bedrock.md): Route Claude Code through Ama… - [Claude Code with Google Vertex AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/claude-code-vertex.md): Route Claude Code through Goo… - [Cline](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/cline.md): Add enterprise-grade observab… - [OpenAI Codex](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/codex.md): Add usage tracking, cost cont… - [Cursor](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/cursor.md): Add observability, governance… - [DSPy](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/dspy.md): Integrate DSPy with Portkey f… - [GitHub Copilot](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/github-copilot.md): Add observability, governance… - [Goose](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/goose.md): Add usage tracking, cost cont… - [Instructor](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/instructor.md): Add observability and reliabi… - [Jan](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/janhq.md): Add usage tracking, cost cont… - [Langchain (JS/TS)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/langchain-js.md): Add Portkey's enterprise feat… - [Langchain (Python)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/langchain-python.md): Add Portkey's enterprise feat… - [Langflow](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/langflow.md): Add enterprise-grade features… - [LibreChat](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/librechat.md): Cost tracking, observability,… - [LlamaIndex (Python)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/llama-index-python.md): Add Portkey's enterprise feat… - [Microsoft Semantic Kernel](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/microsoft-semantic-kernel.md) - [MindsDB](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/mindsdb.md): Integrate MindsDB with Portke… - [MongoDB](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/mongodb.md): Store Portkey logs in MongoDB… - [n8n](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/n8n.md): Add observability, cost contr… - [OpenAI Agent Builder (TypeScript)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openai-agent-builder.md): Add Portkey to visual agent w… - [OpenAI Agent Builder (Python)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openai-agent-builder-python.md): Add Portkey to visual agent w… - [Any OpenAI-Compatible Project](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openai-compatible.md): Add Portkey to any OpenAI-com… - [OpenClaw](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openclaw.md): Route OpenClaw through Portke… - [OpenCode](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/opencode.md): centralised cost monitoring f… - [Open WebUI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openwebui.md): Enterprise-grade cost trackin… - [Image Generation with Open WebUI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/openwebui/image-generation-with-openwebui.md) - [Promptfoo](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/promptfoo.md): Run Promptfoo evals on 1600+… - [Roo Code](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/roo-code.md): Add enterprise-grade observab… - [Supabase](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/supabase.md): Generate embeddings with Port… - [ToolJet](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/tooljet.md): Add AI capabilities to ToolJe… - [Vercel AI SDK](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/vercel.md): Use Portkey with Vercel AI SD… - [Zed](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/libraries/zed.md): Learn how to integrate Portke… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms.md): Portkey connects with all maj… - [AI21](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/ai21.md): Integrate AI21 models with Po… - [Anthropic](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic.md): Integrate Anthropic's Claude… - [Computer use tool](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic/computer-use.md) - [Count Tokens](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic/count-tokens.md) - [Prompt Caching](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic/prompt-caching.md) - [Remote MCP Support](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic/remote-mcp.md) - [Structured Outputs](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anthropic/structured-outputs.md): Direct models to return data… - [Anyscale](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/anyscale-llama2-mistral-zephyr.md): Use Anyscale's serverless end… - [AWS SageMaker](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/aws-sagemaker.md): Route to your AWS Sagemaker m… - [Azure AI Foundry](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-foundry.md): Learn how to integrate Azure… - [Azure Government Cloud](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-openai/azure-govcloud.md) - [Azure OpenAI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-openai/azure-openai.md): Azure OpenAI is a great alter… - [Batches](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-openai/batches.md): Perform batch inference with… - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-openai/files.md): Upload files to Azure OpenAI - [Fine-tune](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/azure-openai/fine-tuning.md): Fine-tune your models with Az… - [AWS Bedrock](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/aws-bedrock.md) - [AWS GovCloud with Bedrock](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/aws-govcloud.md) - [Batches](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/batches.md): Perform batch inference with… - [AWS Bedrock Knowledge Bases](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/bedrock-knowledgebase.md): Create, manage, and connect y… - [Embeddings](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/embeddings.md): Get embeddings from Bedrock - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/files.md): Upload files to S3 for Bedroc… - [Fine-tune](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/fine-tuning.md): Fine-tune your models with Be… - [Prompt Caching on Bedrock](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/prompt-caching.md) - [Rerank](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/rerank.md): Rerank documents with Bedrock - [Structured Outputs](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/bedrock/structured-outputs.md): Direct models to return data… - [Bring Your Own LLM](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/byollm.md): Integrate your privately host… - [Cerebras](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/cerebras.md): Integrate Cerebras models wit… - [Cohere](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/cohere.md): Integrate Cohere models with… - [Dashscope](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/dashscope.md): Integrate Dashscope with Port… - [Databricks](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/databricks.md): Integrate Databricks Model Se… - [Deepbricks](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/deepbricks.md): Use Deepbricks' AI inference… - [Deepgram](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/deepgram.md): Use Deepgram's Speech-to-Text… - [Deepinfra](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/deepinfra.md): Integrate Deepinfra models wi… - [DeepSeek](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/deepseek.md): Integrate DeepSeek models wit… - [Featherless AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/featherless.md): Access 11,900+ open-source mo… - [Fireworks](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/fireworks.md): Use Fireworks for chat, visio… - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/fireworks/files.md): Upload files to Fireworks - [Fine-tune](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/fireworks/fine-tuning.md): Fine-tune your models with Be… - [Google Gemini](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/gemini.md) - [GitHub Models](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/github.md): Use GitHub Models Marketplace… - [Groq](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/groq.md): Use Groq's ultra-fast inferen… - [Hugging Face](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/huggingface.md): Use Hugging Face Inference en… - [Inference.net](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/inference.net.md): Use Inference.net's distribut… - [Jina AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/jina-ai.md): Use Jina AI's embedding and r… - [Lambda Labs](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/lambda.md): Use Lambda's GPU-powered infe… - [Lemonfox-AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/lemon-fox.md): Integrate LemonFox with Portk… - [Lepton AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/lepton.md): Use Lepton AI's serverless AI… - [Lingyi (01.ai)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/lingyi-01.ai.md): Use Lingyi's Yi models throug… - [LocalAI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/local-ai.md): Integrate LocalAI-hosted mode… - [Mistral AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/mistral-ai.md): Integrate Mistral AI models w… - [Modal Labs](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/modal.md): Integrate Modal with Portkey… - [Monster API](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/monster-api.md): Access generative AI models a… - [Moonshot](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/moonshot.md): Use Moonshot's AI models thro… - [Ncompass](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/ncompass.md): Use Ncompass's AI models thro… - [Nebius](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/nebius.md): Use Nebius AI's inference pla… - [Nomic](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/nomic.md): Use Nomic's superior embeddin… - [Novita AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/novita-ai.md): Use Novita AI's inference pla… - [Nscale (EU Sovereign)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/nscale.md): Use Nscale's EU-based soverei… - [Ollama](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/ollama.md): Integrate Ollama-hosted model… - [OpenAI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai.md): Integrate OpenAI's GPT models… - [Batches](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/batches.md): Perform batch inference with… - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/files.md): Upload files to OpenAI - [Fine-tune](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/fine-tuning.md): Fine-tune your models with Op… - [Prompt Caching](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/prompt-caching-openai.md) - [Remote MCP Support](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/remote-mcp.md) - [Structured Outputs](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openai/structured-outputs.md): Structured Outputs ensure tha… - [OpenRouter](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/openrouter.md): Integrate OpenRouter models w… - [Oracle Cloud Infrastructure](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/oracle.md) - [OVHcloud AI Endpoints](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/ovhcloud.md) - [Passthrough](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/passthrough.md): Send requests directly to a c… - [Perplexity AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/perplexity-ai.md): Use Perplexity's online reaso… - [Predibase](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/predibase.md): Use Predibase's open-source a… - [Recraft AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/recraft-ai.md): Use Recraft AI's advanced ima… - [Reka AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/reka-ai.md): Integrate Reka AI models with… - [Replicate](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/replicate.md): Use Portkey as a proxy to Rep… - [SambaNova](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/sambanova.md): Use SambaNova's fast inferenc… - [Segmind](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/segmind.md): Use Segmind's Stable Diffusio… - [SiliconFlow](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/siliconflow.md): Use SiliconFlow's AI inferenc… - [Snowflake Cortex](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/snowflake-cortex.md): Use Snowflake Cortex AI model… - [Stability AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/stability-ai.md): Use Stability AI's Stable Dif… - [Suggest a new integration!](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/suggest-a-new-integration.md) - [Together AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/together-ai.md): Integrate Together AI models… - [Triton Inference Server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/triton.md): Integrate Triton-hosted custo… - [Upstage AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/upstage.md): Integrate Upstage with Portke… - [Google Vertex AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai.md) - [Batches](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai/batches.md): Perform batch inference with… - [Controlled Generations](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai/controlled-generations.md): Controlled Generations ensure… - [Embeddings](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai/embeddings.md): Get embeddings from Vertex AI - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai/files.md): Upload files to Google Cloud… - [Fine-tune](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vertex-ai/fine-tuning.md): Fine-tune your models with Ve… - [vLLM](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/vllm.md): Integrate vLLM-hosted custom… - [Voyage AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/voyage-ai.md): Use Voyage AI's embeddings an… - [Workers AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/workers-ai.md): Use Cloudflare Workers AI mod… - [xAI (Grok)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/x-ai.md): Use xAI's Grok models through… - [Z.AI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/z-ai.md): Use Z.AI's GLM models through… - [ZhipuAI / ChatGLM / BigModel](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/llms/zhipu.md): Use ZhipuAI's GLM models thro… - [Claude Desktop](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-clients/claude.md): Connect your MCP servers to C… - [Claude Code](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-clients/claude-code.md): Connect your MCP servers to C… - [Cursor](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-clients/cursor.md): Connect your MCP servers to C… - [LibreChat](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-clients/librechat.md): Connect your MCP servers to L… - [VS Code](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-clients/vs-code.md): Connect your MCP servers to V… - [Atlassian Remote MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/atlassian-mcp-server.md): The Atlassian Remote MCP Serv… - [Cerebras Code MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/cerebras-code-mcp-server.md): The **Cerebras Code MCP Serve… - [Datadog MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/datadog-mcp-server.md): The Datadog MCP server enable… - [Figma MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/figma-mcp-server.md): The Figma MCP server connects… - [Firebase MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/firebase-mcp-server.md): The Firebase MCP server gives… - [Firecrawl MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/firecrawl-mcp-server.md): The Firecrawl MCP server enab… - [GitHub MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/github-mcp-server.md): The GitHub MCP server enables… - [Gitlab MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/gitlab-mcp-server.md): The GitLab MCP server enables… - [Grafana MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/grafana-mcp-server.md): The Grafana MCP server enable… - [Kubernetes MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/kubernetes-mcp-server.md): The Kubernetes MCP server pro… - [Linear MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/linear-mcp-server.md): The Linear MCP server provide… - [Notion MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/notion-mcp-server.md): The Notion MCP server enables… - [Open Library MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/open-library-mcp-server.md): The Open Library MCP server p… - [Playwright MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/playwright-mcp-server.md): The Playwright MCP server pro… - [Postman MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/postman-mcp-server.md): The Postman MCP Server connec… - [Qdrant MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/qdrant-mcp-server.md): The Qdrant MCP server enables… - [Stripe MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/stripe-mcp-server.md): The Stripe MCP server exposes… - [Vectara MCP server](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/mcp-servers/vectara-mcp-server.md): The Vectara MCP server provid… - [Submit an Integration](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/partner.md) - [Exa Online Search](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/plugins/exa.md): Transform offline LLMs into o… - [Arize Phoenix](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/arize.md): Extend Portkey’s powerful AI… - [FutureAGI](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/future-agi.md): Integrate FutureAGI with Port… - [HoneyHive](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/honeyhive.md): Integrate HoneyHive observabi… - [Langfuse](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/langfuse.md): Integrate Langfuse observabil… - [Langsmith](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/langsmith.md): Integrate LangSmith observabi… - [Pydantic Logfire](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/logfire.md): Modern Python observability w… - [MLflow Tracing](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/ml-flow.md): Enhance LLM observability wit… - [OpenLIT](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/openlit.md): Simplify AI development with… - [OpenTelemetry Python SDK](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/opentelemetry-python-sdk.md): Direct OpenTelemetry instrume… - [Phoenix(Arize) Open-Telemetry](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/phoenix.md): AI observability and debuggin… - [Traceloop (OpenLLMetry)](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/tracing-providers/traceloop.md) - [Milvus](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/vector-databases/milvus.md) - [Qdrant](https://portkey-docs-guide-prompt-api.mintlify.site/integrations/vector-databases/qdrant.md) - [Portkey Features](https://portkey-docs-guide-prompt-api.mintlify.site/introduction/feature-overview.md): Explore the powerful features… - [Make Your First Request](https://portkey-docs-guide-prompt-api.mintlify.site/introduction/make-your-first-request.md): Integrate Portkey and analyze… - [What is Portkey?](https://portkey-docs-guide-prompt-api.mintlify.site/introduction/what-is-portkey.md): Portkey AI is a comprehensive… - [Configure Analytics Access Permissions for Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-analytics-access-permissions.md) - [Configure API Key Access Permissions for Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-api-key-access-permissions.md) - [Configure Data Visibility Settings for Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-data-visibility-settings.md) - [Configure Logs Access Permissions for Workspace](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-logs-access-permissions-in-workspace.md) - [Configure Model Access Permissioning for AI Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-model-access-permissioning-for-ai-integratinon.md) - [Configure Prompt Access Permissions for Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-prompt-access-permissions.md) - [Configure Provider Access Permissions](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-virtual-key-access-permissions.md) - [Configure Workspace Provisioning for Your AI Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configure-workspace-provisioning-for-your-ai-integrations.md) - [Configure Request Logging](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/configuring-request-logging.md): Control what data is stored f… - [Enforce Budget Limits and Rate Limits for Your API Keys](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-budget-and-rate-limit.md): Configure budget and rate lim… - [Enforce Budget Limits on Your AI Provider](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-budget-limits-on-your-ai-provider.md) - [Enforcing Default Configs on API Keys](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-default-config.md): Learn how to attach default c… - [Enforcing Org Level Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-orgnization-level-guardrails.md) - [Enforce Rate Limits on Your AI Provider](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-rate-limits-on-your-ai-provider.md) - [Enforce Workspace Budget and Rate Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-workspace-budget-limts-and-rate-limits.md): Configure budget and rate lim… - [Enforcing Workspace Level Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforce-workspace-level-guardials.md) - [Enforcing Request Metadata](https://portkey-docs-guide-prompt-api.mintlify.site/product/administration/enforcing-request-metadata.md) - [AI Gateway](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway.md): The world's fastest AI Gatewa… - [Automatic Retries](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/automatic-retries.md): Automatically retry failed LL… - [Unified Batch Inference](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/batches.md): Run large‑scale inference job… - [Cache (Simple & Semantic)](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/cache-simple-and-semantic.md): Speed up requests and reduce… - [Canary Testing](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/canary-testing.md): You can use Portkey's AI gate… - [Chat Completions](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/chat-completions.md): Use OpenAI-compatible Chat Co… - [Circuit Breaker](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/circuit-breaker.md): Automatically stop routing to… - [Conditional Routing](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/conditional-routing.md) - [Configs](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/configs.md): This feature is available on… - [Custom hosts](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/custom-hosts.md): Route requests to privately h… - [Fallbacks](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/fallbacks.md): Automatically switch to backu… - [Files](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/files.md): Upload files to Portkey and r… - [Fine-tuning](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/fine-tuning.md): Run your fine-tuning jobs wit… - [gRPC (Beta)](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/grpc.md): Use gRPC as an alternative tr… - [Load Balancing](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/load-balancing.md): Distribute traffic across mul… - [Messages](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/messages-api.md): Use Anthropic's Messages form… - [Multimodal Capabilities](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities.md) - [Function Calling](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/function-calling.md): Portkey's AI Gateway supports… - [Image Generation](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/image-generation.md): Portkey's AI gateway supports… - [Speech-to-Text](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/speech-to-text.md): Use Portkey's AI gateway to t… - [Text-to-Speech](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/text-to-speech.md): Portkey's AI gateway currentl… - [Thinking Mode](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/thinking-mode.md) - [Vision](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/multimodal-capabilities/vision.md): Portkey's AI gateway supports… - [Nitro Mode (Beta)](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/nitro-mode.md): Forward the request body dire… - [Realtime API](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/realtime-api.md): Use OpenAI's Realtime API wit… - [Remote MCP](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/remote-mcp.md): Portkey's AI gateway has MCP… - [Request Timeouts](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/request-timeouts.md): Manage unpredictable LLM late… - [Open Responses](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/responses-api.md): Use the Responses API with an… - [Strict OpenAI Compliance](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/strict-open-ai-compliance.md) - [Universal API](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/universal-api.md): One API for 200+ LLMs across… - [Virtual Keys](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/virtual-keys.md): Virtual Keys have been migrat… - [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role.md): How to create a new integrati… - [Budget Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/virtual-keys/budget-limits.md): Budget Limits lets you set co… - [Rate Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/ai-gateway/virtual-keys/rate-limits.md): Set Rate Limts to your Integr… - [Enterprise Offering](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering.md) - [Access Control Management](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/access-control-management.md): With customizable user roles,… - [Audit Logs](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/audit-logs.md): Track and monitor all adminis… - [Budget Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/budget-limits.md) - [Usage & Rate Limit Policies](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/budget-policies.md): Create fine-grained controls… - [Enterprise Components](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/components.md) - [KMS Integration](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/kms.md): Customers can bring their own… - [Logs Export](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/logs-export.md) - [Org Management](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management.md): A high-level introduction to… - [API Keys (AuthN and AuthZ)](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/api-keys-authn-and-authz.md): Discover how Admin and Worksp… - [JWT Authentication](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/jwt.md): Configure JWT-based authentic… - [Organizations](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/organizations.md): Understand the role and featu… - [Azure Entra](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/scim/azure-ad.md): Setup Azure Entra for SCIM pr… - [SCIM Group Management](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/scim/group-management.md): Map SCIM groups to Portkey wo… - [Okta](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/scim/okta.md): Set up Okta for SCIM provisio… - [Overview](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/scim/scim.md): SCIM integration with Portkey. - [SSO](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/sso.md): SSO support for enterprises - [User Roles & Permissions](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/user-roles-and-permissions.md): Learn about Portkey's compreh… - [Workspaces](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/org-management/workspaces.md): Explore Workspaces, the sub-o… - [Analytics Export](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/otel/analytics.md): Export Portkey analytics data… - [Complete Logs Export](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/otel/complete-logs.md): Export complete LLM request/r… - [OpenTelemetry(OTel) Export](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/otel/otel.md): Export Portkey data to OpenTe… - [Secret References](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/secret-references.md): Reference secrets stored in e… - [Security @ Portkey](https://portkey-docs-guide-prompt-api.mintlify.site/product/enterprise-offering/security-portkey.md): Portkey AI provides a secure,… - [Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails.md): Ship to production confidentl… - [Supported Endpoints & Capabilities](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails/capabilities.md): Which endpoints, providers, i… - [Creating Raw Guardrails (in JSON)](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails/creating-raw-guardrails-in-json.md): With the raw Guardrails mode,… - [Guardrails for Embedding Requests](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails/embedding-guardrails.md): Apply security and data valid… - [List of Guardrail Checks](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails/list-of-guardrail-checks.md) - [PII Redaction](https://portkey-docs-guide-prompt-api.mintlify.site/product/guardrails/pii-redaction.md): Replace any sensitive data in… - [MCP](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp.md) - [MCP Gateway](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway.md): Centralized authentication, a… - [Team Provisioning](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/access-control.md): Control which workspaces and… - [MCP Advanced Configuration](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/advanced-configuration.md): Control how the gateway authe… - [Custom Auth](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/custom-auth.md): Configure custom authenticati… - [Bring Your Own Auth](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/external-oauth.md): Use your own identity provide… - [Forwarding Headers](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/forwarding-headers.md): Pass headers from agent reque… - [Identity Forwarding](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/identity-forwarding.md): Pass authenticated user ident… - [JWT Validation](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/jwt.md): Validate JWTs from external i… - [OAuth](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/oauth.md): Portkey's built-in OAuth 2.1… - [OAuth Client Metadata](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authentication/oauth-client-metadata.md): Customize OAuth client metada… - [Authorization](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/authorization.md): Control what users can access… - [Circuit Breakers](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/circuit-breakers.md): Automatic failure handling fo… - [Add External MCP Servers](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/external-mcp-servers.md): Connect third-party MCP serve… - [Guardrails](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/guardrails.md): Apply policies to MCP request… - [Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/integrations.md): Connect MCP servers to AI age… - [Add Internal MCP Servers](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/internal-mcp-servers.md): Add your internal MCP servers… - [MCP Registry](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/mcp-registry.md): Add, manage, and govern MCP s… - [Observability](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/observability.md): Log, monitor, and debug MCP i… - [Quickstart](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/quickstart.md): Add DeepWiki to Portkey MCP G… - [Rate Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/rate-limits.md): Throttle requests per user, t… - [Tool Provisioning](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/tool-provisioning.md): Control which tools, resource… - [Using MCP Servers](https://portkey-docs-guide-prompt-api.mintlify.site/product/mcp-gateway/using-mcp-servers.md): Connect to MCP servers from A… - [Model Catalog](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog.md): A single pane to view and man… - [Budget Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/budget-limits.md) - [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/connect-bedrock-with-amazon-assumed-role.md): How to create an integrate Be… - [Adding Custom Models](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/custom-models.md): Learn how to add custom and f… - [Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/integrations.md): Securely store and manage AI… - [Overriding Model Details](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/model-overrides.md): Learn how to set custom prici… - [AI Model Provisioning](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/model-provisioning.md) - [Portkey Models](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/portkey-models.md): Open-source pricing and confi… - [Rate Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/rate-limits.md) - [Workspace Provisioning](https://portkey-docs-guide-prompt-api.mintlify.site/product/model-catalog/workspace-provisioning.md) - [Observability (OpenTelemetry)](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability.md): Gain real-time insights, trac… - [Analytics](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/analytics.md) - [Auto-Instrumentation [BETA]](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/auto-instrumentation.md): Portkey's auto-instrumentatio… - [Budget Limits](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/budget-limits.md) - [Model Pricing and Cost Management](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/cost-management.md): Learn how Portkey handles pri… - [Feedback](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/feedback.md): Portkey's Feedback APIs provi… - [Filters](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/filters.md) - [Logs](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/logs.md): The Logs section presents a c… - [Logs Export](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/logs-export.md): Easily access your Portkey lo… - [Metadata](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/metadata.md): Add custom context to your AI… - [OpenTelemetry for LLM Observability](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/opentelemetry.md): Leverage OpenTelemetry with P… - [Supported OTel Libraries](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/opentelemetry/list-of-supported-otel-instrumenters.md): Portkey works with any OpenTe… - [Tracing](https://portkey-docs-guide-prompt-api.mintlify.site/product/observability/traces.md): The **Tracing** capabilities… - [Open Source](https://portkey-docs-guide-prompt-api.mintlify.site/product/open-source.md) - [Feature Comparison](https://portkey-docs-guide-prompt-api.mintlify.site/product/product-feature-comparison.md): Comparing Portkey's Open-sour… - [Prompt Engineering Studio](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio.md) - [Prompt API](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-api.md): Learn how to integrate Portke… - [Guides](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-guides.md): Learn how to get the most out… - [Integrations](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-integration.md) - [Prompt Library](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-library.md) - [Prompt Observability](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-observability.md) - [Prompt Partials](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-partial.md): With Prompt Partials, you can… - [Prompt Playground](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-playground.md) - [Prompt Versioning & Labels](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/prompt-versioning.md) - [Tool Library](https://portkey-docs-guide-prompt-api.mintlify.site/product/prompt-engineering-studio/tool-library.md) - [Model Pricing for Air-Gapped Deployments](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/airgapped/model-pricing.md): Configure model pricing and c… - [Cache Behavior](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/cache-behavior.md): How the Gateway cache works:… - [Enterprise Architecture](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/architecture.md): Comprehensive guide to Portke… - [EKS](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/aws/eks.md): This enterprise-focused docum… - [AWS Marketplace](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/aws/marketplace.md): This enterprise-focused docum… - [ACA](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/azure/aca.md): This enterprise-focused docum… - [AKS](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/azure/aks.md): This enterprise-focused docum… - [GCP](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/hybrid-deployments/gcp.md): This enterprise-focused docum… - [Prometheus Metrics](https://portkey-docs-guide-prompt-api.mintlify.site/self-hosting/prometheus-metrics.md): Comprehensive monitoring and… - [Common Errors & Resolutions](https://portkey-docs-guide-prompt-api.mintlify.site/support/common-errors-and-resolutions.md): Since Portkey functions as a… - [Contact Us](https://portkey-docs-guide-prompt-api.mintlify.site/support/contact-us.md) - [Developer Forum](https://portkey-docs-guide-prompt-api.mintlify.site/support/developer-forum.md): Are you navigating the challe… - [December '23 Migration](https://portkey-docs-guide-prompt-api.mintlify.site/support/portkeys-december-migration.md) - [Upgrade to Model Catalog](https://portkey-docs-guide-prompt-api.mintlify.site/support/upgrade-to-model-catalog.md): Learn how to upgrade to Model… ## OpenAPI Specs - [openapi](https://raw.githubusercontent.com/Portkey-AI/openapi/refs/heads/master/openapi.yaml) - [portkey-models](https://portkey-docs-guide-prompt-api.mintlify.site/openapi/portkey-models.json)