Kiểm thử A/B & phân khúc

Phân tích chiến dịch Marketing với pandas

Jill Rosok

Data Scientist

Đừng quên phân khúc!

Kiểm thử cá nhân hóa theo ngôn ngữ

for language in np.unique(marketing['language_displayed'].values):
    print(language)

Tách dữ liệu liên quan

for language in np.unique(marketing['language_displayed'].values):
    print(language)

    language_data = marketing[(marketing['marketing_channel'] == 'Email') & 
                              (marketing['language_displayed'] == language)]

Tách người đăng ký

for language in np.unique(marketing['language_displayed'].values):
    print(language)

    language_data = marketing[(marketing['marketing_channel'] == 'Email') & 
                              (marketing['language_displayed'] == language)]

    subscribers = language_data.groupby(['user_id', 'variant'])['converted']\
                                                                      .max()

Tách nhóm control và personalization

for language in np.unique(marketing['language_displayed'].values):
    print(language)

    language_data = marketing[(marketing['marketing_channel'] == 'Email') & 
                              (marketing['language_displayed'] == language)]

    subscribers = language_data.groupby(['user_id', 'variant'])['converted']\
                                                                      .max()
    subscribers = pd.DataFrame(subscribers.unstack(level=1)) 
    control = subscribers['control'].dropna()
    personalization = subscribers['personalization'].dropna()

Vòng lặp đầy đủ

for language in np.unique(marketing['language_displayed'].values):
    print(language)

    language_data = marketing[(marketing['marketing_channel'] == 'Email') & 
                              (marketing['language_displayed'] == language)]

    subscribers = language_data.groupby(['user_id', 'variant'])['converted']\
                                                                      .max()
    subscribers = pd.DataFrame(subscribers.unstack(level=1)) 
    control = subscribers['control'].dropna()
    personalization = subscribers['personalization'].dropna()  

    print('lift:', lift(control, personalization))
    print('t-statistic:', stats.ttest_ind(control, personalization), '\n\n')

Kết quả

Arabic
lift: 50.0%
t-statistic: TtestResult(statistic=-0.58, pvalue=0.58, df=8.0) 

English
lift: 39.0%
t-statistic: TtestResult(statistic=-2.22, pvalue=0.03, df=486.0) 

German
lift: -1.62%
t-statistic: TtestResult(statistic=0.19, pvalue=0.85, df=42.0) 

Spanish
lift: 166.67%
t-statistic: TtestResult(statistic=-2.36, pvalue=0.04, df=10.0)

Ayo berlatih!

Phân tích chiến dịch Marketing với pandas