Skicka anrop till DeepSeek-modeller

Arbeta med DeepSeek i Python

James Chapman

AI Curriculum Lead, DataCamp

Sammanfattning

En dator som skickar en förfrågan till Together.ai API, som innehåller modellen samt eventuell data och modellparametrar.

Skapa en förfrågan

from openai import OpenAI

# To send to DeepSeek API: base_url="https://api.deepseek.com"
client = OpenAI(api_key="<TogetherAI API Key>", base_url="https://api.together.xyz/v1")

Skapa förfrågningar med openai-biblioteket
OpenAI: utvecklare av AI-modeller och appar (t.ex. ChatGPT)
base_url: omdirigerar förfrågan från OpenAI till DeepSeeks modellleverantör
api_key: API-autentisering (se leverantörens dokumentation)

¹ https://platform.deepseek.com/api_keys

Skapa en förfrågan

from openai import OpenAI
# To send to DeepSeek API: base_url="https://api.deepseek.com"
client = OpenAI(api_key="<TogetherAI API Key>", base_url="https://api.together.xyz/v1")


response = client.chat.completions.create(

    model="deepseek-ai/DeepSeek-V4-Pro-0813",

    messages=[{"role": "user",
               "content": "In one sentence, what is hallucination in AI?"}]

)


print(response)

Svaret

ChatCompletion(id='onVWeEx-gBAtS-a09121fcae54578c', choices=[Choice(finish_reason='stop', index=0,
logprobs=None, message=ChatCompletionMessage(content='Hallucination in AI is when a model confidently
generates information that sounds plausible but is factually incorrect, misleading, or entirely
fabricated.', refusal=None, role='assistant', annotations=None, audio=None, function_call=None,
tool_calls=[]), seed=None)], created=1781018557, model='deepseek-ai/DeepSeek-V4-Pro-0813',
object='chat.completion', moderation=None, service_tier=None, system_fingerprint='default',
usage=CompletionUsage(completion_tokens=28, prompt_tokens=15, total_tokens=43,
completion_tokens_details=None, prompt_tokens_details=PromptTokensDetails(audio_tokens=None,
cached_tokens=0)), prompt=[])

Svaret

ChatCompletion(id='onVWeEx-gBAtS-a09121fcae54578c',
               choices=[Choice(finish_reason='stop', index=0, logprobs=None,
                               message=ChatCompletionMessage(content='Hallucination in AI refers...',
                               refusal=None, role='assistant', annotations=None, audio=None,
                               function_call=None, tool_calls=[]), seed=None)],
               created=1781018557,
               model='deepseek-ai/DeepSeek-V4-Pro-0813',
               object='chat.completion',
               moderation=None,
               service_tier=None,
               system_fingerprint='default',
               usage=CompletionUsage(completion_tokens=28, prompt_tokens=15, total_tokens=43,
                                     completion_tokens_details=None,
                                     prompt_tokens_details=PromptTokensDetails(audio_tokens=None,
                                          cached_tokens=0)),
               prompt=[])

Tolka svaret

print(response.choices)

[Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(
content='Hallucination in AI refers to the generation of false or nonsensical information
that is presented as factual, often due to limitations in training data, model biases, or
inference errors.', refusal=None, role='assistant', annotations=None, audio=None,
function_call=None, tool_calls=[]), seed=None)]

Tolka svaret

print(response.choices[0])

Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(
content='Hallucination in AI refers to the generation of false or nonsensical information
that is presented as factual, often due to limitations in training data, model biases, or
inference errors.', refusal=None, role='assistant', annotations=None, audio=None,
function_call=None, tool_calls=[]), seed=None)

Tolka svaret

print(response.choices[0].message)

ChatCompletionMessage(content='Hallucination in AI refers to the generation of false or
nonsensical information that is presented as factual, often due to limitations in training
data, model biases, or inference errors.', refusal=None, role='assistant', annotations=None,
audio=None, function_call=None, tool_calls=[])

print(response.choices[0].message.content)

Hallucination in AI refers to the generation of false or nonsensical information that is
presented as factual, often due to limitations in training data, model biases, or inference
errors.

Kostnader för API-användning

För DeepSeek:
- Leverantör (t.ex. together.ai)
- Modell
- Större indata + utdata = högre kostnad

En avgiftsbelagd väg.

¹ https://api-docs.deepseek.com/quick_start/pricing

Nu kör vi en övning!

Arbeta med DeepSeek i Python