RBF 核：生成复杂数据集

R 中的支持向量机

Kailash Awati

Instructor

RBF 核简介

高度灵活的核。
- 可拟合复杂决策边界。
实践中常用。

生成复杂数据集

600 个点 (x1, x2)
x1 与 x2 分布不同

n <- 600
set.seed(42)

df <- data.frame(x1 = rnorm(n, mean = -0.5, sd = 1),
                 x2 = runif(n, min = -1, max = 1))

生成边界

边界由两条等半径圆组成，且有一个公共点。

# Set radius and centers
radius <- 0.7
radius_squared <- radius ^ 2
center_1 <- c(-0.7, 0)
center_2 <- c(0.7, 0)

# Classify points
df$y <- 
    factor(ifelse(
        (df$x1 - center_1[1]) ^ 2 + (df$x2 - center_1[2]) ^ 2 < radius_squared |
        (df$x1 - center_2[1]) ^ 2 + (df$x2 - center_2[2]) ^ 2 < radius_squared,
        -1, 1), levels = c(-1, 1))

可视化数据集

使用 ggplot 可视化数据集；用颜色区分类别

library(ggplot2)

p <- ggplot(data = df, aes(x = x1, y = x2, color = y)) + 
     geom_point() + 
     guides(color = "none") +
     scale_color_manual(values = c("red", "blue"))

p

第 4.1 章 - 复杂数据集

# Function to generate points on a circle
circle <- function(x1_center, x2_center, r, npoint = 100) {
   theta <- seq(0, 2 * pi, length.out = npoint)
   x1_circ <- x1_center + r * cos(theta)
   x2_circ <- x2_center + r * sin(theta)
   data.frame(x1c = x1_circ, x2c = x2_circ)
}

# Generate boundary and plot it
boundary_1 <- circle(x1_center = center_1[1], x2_center = center_1[2], r = radius)
p <- p + 
     geom_path(data = boundary_1,
               aes(x = x1c, y = x2c),
               inherit.aes = FALSE)
boundary_2 <- circle(x1_center = center_2[1], x2_center = center_2[2], r = radius)
p <- p + 
     geom_path(data = boundary_2,
               aes(x = x1c, y = x2c),
               inherit.aes = FALSE)
p

第 4.1 章 - 带决策边界的复杂数据集

该练习了！

R 中的支持向量机