Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
🎉 Portkey raises Series A - $15M to build AI that never breaks  Read announcement →
Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including the models hosted on Inference.net.
inference-netnpm install --save portkey-ai
pip install portkey-ai
provider name as inference-netAuthorization headerimport Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
provider: "inference-net",
Authorization: "Bearer INFERENCE-NET API KEY"
})
from portkey_ai import Portkey
portkey = Portkey(
api_key="PORTKEY_API_KEY", # Replace with your Portkey API key
provider="inference-net",
Authorization="Bearer INFERENCE-NET API KEY"
)
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'llama3',
});
console.log(chatCompletion.choices);
completion = portkey.chat.completions.create(
messages= [{ "role": 'user', "content": 'Say this is a test' }],
model= 'llama3'
)
print(completion)
Was this page helpful?