r - 使用 tidymodels 调整工作流集时如何正确设置参数网格?
问题描述
我尝试使用 tidymodels 来调整带有配方和模型参数的工作流程。调整单个工作流程时没有问题。但是,当调整具有多个工作流的工作流集时,它总是会失败。这是我的代码:
# read the training data
train <- read_csv("../../train.csv")
train <- train %>%
mutate(
id = row_number(),
across(where(is.double), as.integer),
across(where(is.character), as.factor),
r_yn = fct_relevel(r_yn, "yes")) %>%
select(id, r_yn, everything())
# setting the recipes
# no precess
rec_no <- recipe(r_yn ~ ., data = train) %>%
update_role(id, new_role = "ID")
# downsample: tuning the under_ratio
rec_ds_tune <- rec_no %>%
step_downsample(r_yn, under_ratio = tune(), skip = TRUE, seed = 100) %>%
step_nzv(all_predictors(), freq_cut = 100)
# setting the models
# randomforest
spec_rf_tune <- rand_forest(trees = 100, mtry = tune(), min_n = tune()) %>%
set_engine("ranger", seed = 100) %>%
set_mode("classification")
# xgboost
spec_xgb_tune <- boost_tree(trees = 100, mtry = tune(), tree_depth = tune(), learn_rate = tune(), min_n = tune()) %>%
set_engine("xgboost") %>%
set_mode("classification")
# setting the workflowsets
wf_tune_list <- workflow_set(
preproc = list(no = rec_no, ds = rec_ds_tune),
models = list(rf = spec_rf_tune, xgb = spec_xgb_tune),
cross = TRUE)
# finalize the parameters, I'm not sure it is correct or not
rf_params <- spec_rf_tune %>% parameters() %>% update(mtry = mtry(c(1, 15)))
xgb_params <- spec_xgb_tune %>% parameters() %>% update(mtry = mtry(c(1, 15)))
ds_params <- rec_ds_tune %>% parameters() %>% update(under_ratio = under_ratio(c(1, 5)))
wf_tune_list_finalize <- wf_tune_list %>%
option_add(param = ds_params, id = c("ds_rf", "ds_xgb")) %>%
option_add(param = rf_params, id = c("no_rf", "ds_rf")) %>%
option_add(param = xgb_params, id = c("no_xgb", "ds_xgb"))
我检查了wf_tune_list_finalize中的选项,它显示:
> wf_tune_list_finalize$option
[[1]]
a list of options with names: 'param'
[[2]]
a list of options with names: 'param'
[[3]]
a list of options with names: 'param'
[[4]]
a list of options with names: 'param'
然后我调整这个工作流集:
# tuning the workflowset
cl <- makeCluster(detectCores())
registerDoParallel(cl)
wf_tune_race <- wf_tune_list_finalize %>%
workflow_map(fn = "tune_race_anova",
seed = 100,
resamples = cv_5,
grid = 3,
metrics = metric_auc,
control = control_race(parallel_over = "everything"),
verbose = TRUE)
stopCluster(cl)
详细消息表明我在工作流ds_rf和ds_xgb中的参数有问题:
i 1 of 4 tuning: no_rf
i Creating pre-processing data to finalize unknown parameter: mtry
�� 1 of 4 tuning: no_rf (1m 44.4s)
i 2 of 4 tuning: no_xgb
i Creating pre-processing data to finalize unknown parameter: mtry
�� 2 of 4 tuning: no_xgb (28.9s)
i 3 of 4 tuning: ds_rf
x 3 of 4 tuning: ds_rf failed with: Some tuning parameters require finalization but there are recipe parameters that require tuning. Please use `parameters()` to finalize the parameter ranges.
i 4 of 4 tuning: ds_xgb
x 4 of 4 tuning: ds_xgb failed with: Some tuning parameters require finalization but there are recipe parameters that require tuning. Please use `parameters()` to finalize the parameter ranges.
结果是:
> wf_tune_race
# A workflow set/tibble: 4 x 4
wflow_id info option result
<chr> <list> <list> <list>
1 no_rf <tibble [1 x 4]> <wrkflw__ > <race[+]>
2 no_xgb <tibble [1 x 4]> <wrkflw__ > <race[+]>
3 ds_rf <tibble [1 x 4]> <wrkflw__ > <try-errr [1]>
4 ds_xgb <tibble [1 x 4]> <wrkflw__ > <try-errr [1]>
更重要的是,虽然no_rf和no_xgb有调优结果,但是我发现这两个工作流中mtry的范围不是我上面设置的范围,也就是说参数范围设置步骤完全失败。我已按照https://www.tmwr.org/workflow-sets.html和https://workflowsets.tidymodels.org/的教程进行操作,但仍然没有任何想法。
那么在调整工作流集时如何正确设置配方和模型参数呢?
我的代码中的train.csv在这里:https ://github.com/liuyifeikim/Some-data
解决方案
我修改了参数设置步骤,现在调优结果是正确的:
# setting the parameters on each workflow seperately
no_rf_params <- wf_set_tune_list %>%
extract_workflow("no_rf") %>%
parameters() %>%
update(mtry = mtry(c(1, 15)))
no_xgb_params <- wf_set_tune_list %>%
extract_workflow("no_xgb") %>%
parameters() %>%
update(mtry = mtry(c(1, 15)))
ds_rf_params <- wf_set_tune_list %>%
extract_workflow("ds_rf") %>%
parameters() %>%
update(mtry = mtry(c(1, 15)), under_ratio = under_ratio(c(1, 5)))
ds_xgb_params <- wf_set_tune_list %>%
extract_workflow("ds_xgb") %>%
parameters() %>%
update(mtry = mtry(c(1, 15)), under_ratio = under_ratio(c(1, 5)))
# update the workflowset
wf_set_tune_list_finalize <- wf_set_tune_list %>%
option_add(param_info = no_rf_params, id = "no_rf") %>%
option_add(param_info = no_xgb_params, id = "no_xgb") %>%
option_add(param_info = ds_rf_params, id = "ds_rf") %>%
option_add(param_info = ds_xgb_params, id = "ds_xgb")
其余的保持不变。我认为可能有一些有效的方法来设置参数。
推荐阅读
- javascript - 试图至少存在一个可选参数,但它的存在排除了其他参数
- owl - 如何配置 Protégé 执行封闭世界推理?
- 2sxc - 2SXC Web API - 为 ADAM 资产创建内容项元数据
- java - 如何使用 XPath 从网页中获取某些 Html 元素
- c++ - 关于“if”“elseif”“else”语句的良好做法是什么
- php - 如何以编程方式将 Photoshop 滤镜 Pixelate > Crystallize 应用于图像?
- wpf - 为什么 Point3DCollection 的绑定不起作用?
- jquery - 按钮点击影响所有按钮
- python-3.x - Python 中的 OOP 快速排序
- html - 屏幕阅读器在到达锚标记时停止阅读段落