効率的なコーディングの必要性 I

pandasで効率的にコードを書く

Leonidas Souliotis

PhD Researcher

時間をどう測るか

time.time(): 1970年1月1日0時からの経過秒を返します

import time

# 実行前の時刻を記録
start_time = time.time()

# 処理を実行
result = 5 + 2

# 実行後の時刻を記録
end_time = time.time()

print("Result calculated in {} sec".format(end_time - start_time))

Result calculated in 9.48905944824e-05 sec

forループ vs リスト内包表記

リスト内包表記:

list_comp_start_time = time.time()
result = [i*i for i in range(0,1000000)]
list_comp_end_time = time.time()
print("Time using the list_comprehension: {} sec".format(list_comp_end_time - 
list_comp_start_time))

forループ:

for_loop_start_time= time.time()
result=[]
for i in range(0,1000000):
  result.append(i*i)
for_loop_end_time= time.time()
print("Time using the for loop: {} sec".format(for_loop_end_time - for_loop_start_time))

forループ vs リスト内包表記 II

Time using the list comprehension: 0.11042404174804688 sec

Time using the for loop: 0.2071230411529541 sec

list_comp_time = list_comp_end_time - list_comp_start_time
for_loop_time = for_loop_end_time - for_loop_start_time
print("Difference in time: {} %".format((for_loop_time - list_comp_time)/
list_comp_time*100))

Difference in time: 87.55527367398622 %

時間が重要な場面 I

$1+2+...+1000000$ を計算します。

1つずつ加算:

def sum_brute_force(N):
    res = 0
    for i in range(1,N+1):
        res+=i
    return res

$\footnotesize 1 + 2 +... + N = \dfrac{N\cdot(N+1)}{2}$ を使用

def sum_formula(N):
    return N*(N+1)/2

時間が重要な場面 II

公式を使用:

# Using the formula
formula_start_time = time.time()
formula_result = formula(1000000)
formula_end_time = time.time()

print("Time using the formula: {} 
sec".format(formula_end_time - formula_start_time))

Using the formula: 0.000108957290649 sec

総当たり法を使用:

# Using brute force
bf_start_time = time.time()
bf_result = sum_brute_force(1000000)
bf_end_time = time.time()

print("Time using brute force: {} 
sec".format(bf_end_time - start_time))

Time using brute force: 0.174870967865 sec

Difference in speed: 160,394.967179%

やってみましょう！

pandasで効率的にコードを書く