高效编码的必要性 I

使用 pandas 编写高效代码

Leonidas Souliotis

PhD Researcher

如何测量时间?

time.time(): 返回自 1970 年 1 月 1 日 0:00 起的秒数

import time

# 记录执行前时间 start_time = time.time()
# 执行操作 result = 5 + 2
# 记录执行后时间 end_time = time.time()
print("Result calculated in {} sec".format(end_time - start_time))
Result calculated in 9.48905944824e-05 sec
使用 pandas 编写高效代码

for 循环 vs 列表推导

  • 列表推导:
    list_comp_start_time = time.time()
    result = [i*i for i in range(0,1000000)]
    list_comp_end_time = time.time()
    print("Time using the list_comprehension: {} sec".format(list_comp_end_time - 
    list_comp_start_time))
    
  • for 循环:
    for_loop_start_time= time.time()
    result=[]
    for i in range(0,1000000):
      result.append(i*i)
    for_loop_end_time= time.time()
    print("Time using the for loop: {} sec".format(for_loop_end_time - for_loop_start_time))
    
使用 pandas 编写高效代码

for 循环 vs 列表推导 II

Time using the list comprehension: 0.11042404174804688 sec

Time using the for loop: 0.2071230411529541 sec
list_comp_time = list_comp_end_time - list_comp_start_time
for_loop_time = for_loop_end_time - for_loop_start_time
print("Difference in time: {} %".format((for_loop_time - list_comp_time)/
list_comp_time*100))
Difference in time: 87.55527367398622 %
使用 pandas 编写高效代码

时间至关重要 I

计算 $1+2+...+1000000$。

  • 逐个相加:
def sum_brute_force(N):
    res = 0
    for i in range(1,N+1):
        res+=i
    return res
  • 使用 $\footnotesize 1 + 2 +... + N = \dfrac{N\cdot(N+1)}{2}$
def sum_formula(N):
    return N*(N+1)/2
使用 pandas 编写高效代码

时间至关重要 II

  • 使用公式:
# Using the formula
formula_start_time = time.time()
formula_result = formula(1000000)
formula_end_time = time.time()

print("Time using the formula: {} 
sec".format(formula_end_time - formula_start_time))
Using the formula: 0.000108957290649 sec
  • 使用暴力法:
# Using brute force
bf_start_time = time.time()
bf_result = sum_brute_force(1000000)
bf_end_time = time.time()

print("Time using brute force: {} 
sec".format(bf_end_time - start_time))
Time using brute force: 0.174870967865 sec
Difference in speed: 160,394.967179%
使用 pandas 编写高效代码

开始动手!

使用 pandas 编写高效代码

Preparing Video For Download...