計算名次與相關係數
使用 Polars 進行資料轉換
Liam Brannigan
Data Scientist & Polars Contributor
名次排序
名次排序
名次排序
場館資料
venues
shape: (4, 6)
| business | location | review | price | type | hygiene_rating |
| --- | --- | --- | --- | --- | --- |
| str | str | f64 | i64 | str | i64 |
|-----------------|-------------|--------|-------|------------|----------------|
| 7burgers | Wakey Wakey | 4.2 | 15 | restaurant | 4 |
| Costa Coffee | City Point | 4.5 | 8 | café | 5 |
| The Queens Head | Denman St. | 4.7 | 25 | bar | 5 |
| Costa Coffee | Waterloo | 4.1 | 8 | café | 3 |
依價格為場館排名
venues.with_columns(
)
依價格為場館排名
venues.with_columns(
pl.col("price").rank()
)
依價格為場館排名
venues.with_columns(
pl.col("price").rank(descending=False)
)
依價格為場館排名
venues.with_columns(
pl.col("price").rank(descending=False).alias("rank_default")
)
排序後的場館
shape: (4, 7)
| business | location | review | price | ... | rank_default |
| --- | --- | --- | --- | --- | --- |
| str | str | f64 | i64 | ... | f64 |
|-----------------|-------------|--------|-------|-------|--------------|
| 7burgers | Wakey Wakey | 4.2 | 15 | ... | 3.0 |
| Costa Coffee | City Point | 4.5 | 8 | ... | 1.5 |
| The Queens Head | Denman St. | 4.7 | 25 | ... | 4.0 |
| Costa Coffee | Waterloo | 4.1 | 8 | ... | 1.5 |
場館排名：加入最小名次
venues.with_columns(
pl.col("price").rank(descending=False).alias("rank_default"),
pl.col("price").rank(method="min", descending=False).alias("rank_min")
)
shape: (4, 8)
| business | ... | price | rank_default | rank_min |
| --- | --- | --- | --- | --- |
| str | ... | i64 | f64 | i64 |
|-----------------|-----|-------|--------------|----------|
| 7burgers | ... | 15 | 3.0 | 3 |
| Costa Coffee | ... | 8 | 1.5 | 1 |
| The Queens Head | ... | 25 | 4.0 | 4 |
| Costa Coffee | ... | 8 | 1.5 | 1 |
該用哪種排名風格？
$$
預設名次
- 浮點數輸出
- 適合分析用途
$$
最小名次
- 類整數輸出
- 適合 top-N 呈現
使用者評分相關性
user_reviews = pl.read_csv("user_reviews.csv")
shape: (4, 4)
| business | Alice | Bob | Charlie |
| --- | --- | --- | --- |
| str | i64 | i64 | i64 |
|-----------------|-------|------|---------|
| 7burgers | 9 | 6 | 8 |
| Costa Coffee | 3 | 9 | 5 |
| The Queens Head | 9 | 7 | 9 |
| Nando's | 7 | 8 | 8 |
計算相關性
correlations = user_reviews.select( )
計算相關性
correlations = user_reviews.select(pl.selectors.integer())
計算相關性
correlations = user_reviews.select(pl.selectors.integer()).corr()
correlations
shape: (3, 3)
| Alice | Bob | Charlie |
| --- | --- | --- |
| f64 | f64 | f64 |
|---------|---------|---------|
| 1.0 | -0.913 | 0.953 |
| -0.913 | 1.0 | -0.745 |
| 0.953 | -0.745 | 1.0 |
加入使用者欄
correlations.with_columns(pl.Series("user", correlations.columns))
shape: (3, 4)
| user | Alice | Bob | Charlie |
| --- | --- | --- | --- |
| str | f64 | f64 | f64 |
|---------|---------|---------|---------|
| Alice | 1.00 | -0.91 | 0.95 |
| Bob | -0.91 | 1.00 | -0.74 |
| Charlie | 0.95 | -0.74 | 1.00 |
使用 .describe() 快速摘要
venues.select("review", "price").describe( )
使用 .describe() 快速摘要
venues.select("review", "price").describe(percentiles=[0.33, 0.67])
使用 .describe() 快速摘要
shape: (8, 3)
| statistic | review | price |
| --- | --- | --- |
| str | f64 | f64 |
|------------|----------|----------|
| count | 4.0 | 4.0 |
| null_count | 0.0 | 0.0 |
| mean | 4.3 | 15.0 |
| std | 0.391578 | 7.25718 |
| min | 3.8 | 8.0 |
| 33% | 4.2 | 12.0 |
| 67% | 4.5 | 15.0 |
| max | 4.7 | 25.0 |
一起來練習吧！
使用 Polars 進行資料轉換
