Shrnutí a úprava textu

Práce s OpenAI API

James Chapman

Curriculum Manager, DataCamp

Shrnutí...

Otázky a odpovědi

response = client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", "content": "How many days are in October?"}]
)

print(response.choices[0].message.content)

October has 31 days.

Úprava textu

Příklad: úprava jména, zájmen a pracovní pozice

prompt = """
Update name to Maarten, pronouns to he/him, and job title to Senior Content Developer
in the following text:

Joanne is a Content Developer at DataCamp. Her favorite programming language is R,
which she uses for her statistical analyses.
"""

Úprava textu

response = client.chat.completions.create(
    model="gpt-4o-mini",

    messages=[{"role": "user", "content": prompt}]

)

print(response.choices[0].message.content)

Maarten is a Senior Content Developer at DataCamp. His favorite programming language
is R, which he uses for his statistical analyses.

Shrnutí textu

Příklad: shrnutí přepisů chatů se zákazníky

Tým zákaznické podpory

text = """
Customer: Hi, I'm trying to log into 
my account, but it keeps saying 
my password is incorrect. I'm sure 
I'm entering the right one.  

Support: I'm sorry to hear that! 
Have you tried resetting your password?  
...
"""

Shrnutí textu

prompt = f"""Summarize the customer support chat 
             in three concise key points: {text}"""


response = client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", "content": prompt}]
)
print(response.choices[0].message.content)

1. Customer couldn't log in due to a password issue and missing reset link.  
2. Support resent the reset email after confirming it was sent.  
3. Customer resolved the issue by using Google sign-in.

Řízení délky odpovědi

max_completion_tokens = 5

response = client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", 
  "content": "Write a haiku about AI."}],
  max_completion_tokens=5
)

AI so powerful
Computers

max_completion_tokens = 30

response = client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", 
  "content": "Write a haiku about AI."}],
  max_completion_tokens=30
)

A machine mind thinks
Logic dictates its choices
Mankind ponders anew

Tokeny v praxi

Tokeny: jednotky textu, které pomáhají AI rozumět textu a interpretovat ho

Věta "How can the OpenAI API deliver business value?" s každým tokenem zvýrazněným jinou barvou.

¹ https://platform.openai.com/tokenizer

Výpočet nákladů

Náklady závisí na modelu a počtu tokenů 💰
- Modely se účtují podle ceny/tokenů
- Vstupní a výstupní tokeny mohou mít odlišné ceny
Vyšší max_completion_tokens zvyšuje náklady 📈

Screenshot 2025-03-05 at 11.46.54.png

Výpočet nákladů

prompt = f"""Summarize the customer support chat 
             in three concise key points: {text}"""

max_completion_tokens = 500

response = client.chat.completions.create(
  model="gpt-4o-mini",
  messages=[{"role": "user", "content": prompt}], 
  max_completion_tokens=max_completion_tokens
  )

Výpočet nákladů

# Define price per token
input_token_price = 0.15 / 1_000_000
output_token_price = 0.6 / 1_000_000

# Extract token usage
input_tokens = response.usage.prompt_tokens

output_tokens = max_completion_tokens

# Calculate cost
cost = (input_tokens * input_token_price + output_tokens * output_token_price)
print(f"Estimated cost: ${cost}")

Estimated cost: $0.00124

¹ https://openai.com/pricing

Pojďme cvičit!

Práce s OpenAI API