मॉडल सर्विंग

MLflow परिचय

Weston Bassler

Senior MLOps Engineer

MLflow Models

मॉडल पैकेजिंग मानकीकृत करें
मॉडल लॉग करें
मॉडल मूल्यांकन

मॉडल डिप्लॉयमेंट

एमएल-लाइफसाइकल

¹ datacamp.com

REST API

/ping - हेल्थ चेक के लिए
/health - हेल्थ चेक के लिए
/version - MLflow का वर्ज़न पाने के लिए
/invocations - मॉडल स्कोरिंग के लिए
पोर्ट 5000

Invocations endpoint

/invocations

No,Name,Subject
1,Bill Johnson,English
2,Gary Valentine,Mathematics

Content-Type:application/json या application/csv

{
    "1": {
        "No": "1",
        "Name": "Bill Johnson",
        "Subject": "English"
    },
    "2": {
        "No": "2",
        "Name": "Gary Valentine",
        "Subject": "Mathematics"
    }
}

CSV फॉर्मेट

Pandas DataFrame
pandas_df.to_csv()

JSON फॉर्मेट

dataframe_split - pandas DataFrame का split orientation
dataframe_records - pandas DataFrame का records orientation

DataFrame split

# DataFrame split orientation
{
  "dataframe_split": {
      "columns": ["sex", "age", "weight"],
      "data": [["male", 23, 160], ["female", 33, 120]]
  }
}

मॉडल सर्व करना

# MLflow serve कमांड
mlflow models serve --help
Usage: mlflow models serve [OPTIONS]

Serve URI

# लोकल फाइलसिस्टम
mlflow models serve -m relative/path/to/local/model

# Run ID
mlflow models serve -m runs:/<mlflow_run_id>/artifacts/model

# AWS S3
mlflow models serve -m s3://my_bucket/path/to/model

Serve उदाहरण

# रन से मॉडल सर्व करें
mlflow models serve -m runs:/e84a122920de4bdeaedb54146deeb429/artifacts/model

2023/03/12 16:28:28 INFO mlflow.models.flavor_backend_registry: 
Selected backend for flavor 'python_function'
2023/03/12 16:28:28 INFO mlflow.pyfunc.backend: === Running command 
'exec gunicorn --timeout=60 -b 127.0.0.1:5000 -w 1 ${GUNICORN_CMD_ARGS} -- 
mlflow.pyfunc.scoring_server.wsgi:app'
[2023-03-12 16:28:29 -0400] [48431] [INFO] Starting gunicorn 20.1.0
[2023-03-12 16:28:29 -0400] [48431] [INFO] Listening at: http://127.0.0.1:5000 
(48431)
[2023-03-12 16:28:29 -0400] [48431] [INFO] Using worker: sync
[2023-03-12 16:28:29 -0400] [48432] [INFO] Booting worker with pid: 48432

Invocations रिक्वेस्ट

# dataframe_split orientation payload MLflow को भेजें
curl http://127.0.0.1:5000/invocations -H 'Content-Type: application/json' -d '{
  "dataframe_split": {
      "columns": ["sex", "age", "weight"],
      "data": [["male", 23, 160], ["female", 33, 120]]
  }
}'

{"predictions": [1, 0]}

अभ्यास करते हैं!

MLflow परिचय