Llama 3 を使いこなす
Imtihan Ahmed
Machine Learning Engineer

from llama_cpp import Llama
llm = Llama(model_path = "path/to/model.gguf")

$$
temperature、top_k、top_p パラメータ
message_list = [{"role": "system", "content": system_message},
{"role": "user", "content": user_message}]

stop ワード
$$
response_format = {"type": "json_object"}

Conversation クラス.create_completion() メソッドLlama 3 を使いこなす