ループの代わりになる pandas

効率的なPythonコードの書き方

Logan Thomas

Scientific Software Technical Trainer, Enthought

print(baseball_df.head())

  Team League  Year   RS   RA   W    G  Playoffs
0  ARI     NL  2012  734  688  81  162         0
1  ATL     NL  2012  700  600  94  162         1
2  BAL     AL  2012  712  705  93  162         1
3  BOS     AL  2012  734  806  69  162         0
4  CHC     NL  2012  613  759  61  162         0

def calc_run_diff(runs_scored, runs_allowed):

    run_diff = runs_scored - runs_allowed

    return run_diff

ループで得失点差を計算

run_diffs_iterrows = []

for i,row in baseball_df.iterrows():
    run_diff = calc_run_diff(row['RS'], row['RA'])
    run_diffs_iterrows.append(run_diff)

baseball_df['RD'] = run_diffs_iterrows
print(baseball_df)

     Team League  Year   RS   RA    W    G  Playoffs   RD
0     ARI     NL  2012  734  688   81  162         0   46
1     ATL     NL  2012  700  600   94  162         1  100
2     BAL     AL  2012  712  705   93  162         1    7
...

pandas の .apply() メソッド

関数を受け取り、DataFrame に適用します
- 適用する軸を指定（列は 0、行は 1）
無名関数（lambda）も使用可能
例:

baseball_df.apply(

    lambda row: calc_run_diff(row['RS'], row['RA']),

    axis=1
)

.apply() で得失点差を計算

run_diffs_apply = baseball_df.apply(
         lambda row: calc_run_diff(row['RS'], row['RA']),
         axis=1)

baseball_df['RD'] = run_diffs_apply
print(baseball_df)

     Team League  Year   RS   RA    W    G  Playoffs   RD
0     ARI     NL  2012  734  688   81  162         0   46
1     ATL     NL  2012  700  600   94  162         1  100
2     BAL     AL  2012  712  705   93  162         1    7
...

手法の比較

%%timeit
run_diffs_iterrows = []

for i,row in baseball_df.iterrows():
    run_diff = calc_run_diff(row['RS'], row['RA'])
    run_diffs_iterrows.append(run_diff)

baseball_df['RD'] = run_diffs_iterrows

1 ループあたり 86.8 ms ± 3 ms（7 回の平均 ± 標準偏差、各 10 ループ）

手法の比較

%%timeit
run_diffs_apply = baseball_df.apply(
         lambda row: calc_run_diff(row['RS'], row['RA']),
         axis=1)

baseball_df['RD'] = run_diffs_apply

1 ループあたり 30.1 ms ± 1.75 ms（7 回の平均 ± 標準偏差、各 10 ループ）

pandas の .apply() を使って練習しましょう！

効率的なPythonコードの書き方