首页 > 解决方案 > 如何整理包含多个信息的列的数据集-Sample data put?

问题描述

请帮助我整理我的数据。谢谢。总观测值是 394,有 26 列。数据从 ms excel 导出。数据样本如下。在这个样本中,实际上应该只有三个观察/行。在向量 d1..d2..no 和 Farmer.Name 中,对应于 v1 的 NA 的观测值应被清除并添加到前一行值中。d1..d2..no 对应于三个观测值(两个日期观测值一个唯一标识号),Farmer.Name 向量也是如此。样本是

d1..d2..no<-c("27/01/2020", "43832", "KE004421", "43832", "43832", 
              "KE003443", "31/12/2019", "43832", "KE0001512")

Farmer.Name<-c("S Jacob Gender:male","farmer type :marginal","farmer category :general", 
               "J Isac Gender :Female","farmer type: large","farmer category :general",
               "P Kumar Gender :Male","farmer type:small","farmer category :general")

adress<-c("k11",NA,NA,"k12",NA,NA,"k13",NA,NA)

amount<-c(25,NA,NA,25,NA,NA,32,NA,NA)

mydata<-data.frame(v1=v1, d1..d2..no=d1..d2..no, Farmer.Name=Farmer.Name, 
               adress=adress, amount=amount)

在向量 d1..d2..no 和 Farmer.Name 中,对应于 v1 的 NA 的观测值应被清除并添加到前一行值中。d1..d2..no 对应于三个观测值(两个日期观测值一个唯一标识号),Farmer.Name 向量也是如此。也就是说,我的预期结果就像来自这段代码

v1<-c(1,2,3)

d1<-c("27/01/2020","43832","31/12/2019")
d2<-c("43832","43832","43832")
no<-c("KE004421","KE003443","KE0001512")
Farmer.Name1<-c("S Jacob","J Isac","P Kumar")
Gender<-c("male","female","male")
farmer_type <-c("marginal","large","small")
farmer_category <-c("general", "general", "general")
adress<-c("k11","k12","k13")
amount<-c(25,25,32)

myfinaldata<-data.frame(v1=v1,d1=d1,d2=d2,no=no,
                    Farmer.Name1=Farmer.Name1,
                    farmer_type=farmer_type,
                    farmer_category=farmer_category,
                    adress=adress,amount=amount)

结果应该是

  v1         d1    d2        no Farmer.Name1 farmer_type farmer_category adress amount
1  1 27/01/2020 43832  KE004421      S Jacob    marginal         general    k11     25
2  2      43832 43832  KE003443       J Isac       large         general    k12     25
3  3 31/12/2019 43832 KE0001512      P Kumar       small         general    k13     32  

我是编程和 r 的新手,通过在线资源学习。也是我在这个平台上的第一篇文章。请原谅任何错误。

我在整理 vesre 的传播、分离等方面做了很多乱七八糟的事情。但坚持如何进行。

标签: rtidy

解决方案


杂乱无章的数据可能是一个挑战。这是一种tidyverse方法。

首先,为d1d2和增加了建议的列名no。假设行按此顺序排列。

Farmer.Nameseparated 分成两列,由:.

Name本身在单词之前是分开的Gender

fill允许为同一个人填写共同值(例如v1adressamountName)。

pivot_wider这样做是为了将数据广泛分布,首先,按d1d2no,然后按其他列,包括Genderfarmer_typefarmer_category

library(tidyverse)

df1 <- mydata %>%
  mutate(d_var = rep(c("d1", "d2", "no"), times = 3)) %>%
  separate(Farmer.Name, into = c("Var", "Val"), sep = ":") %>%
  separate(Var, into = c("Name", "Var"), sep = "(?=Gender)", fill = "left") %>%
  mutate_at(c("Name", "Var"), trimws) %>%
  fill(v1, adress, amount, Name, .direction = "down") %>%
  mutate(Var = gsub(" ", "_", Var)) 

df1 %>%
  pivot_wider(id_cols = c(v1, Name, adress, amount), names_from = d_var, values_from = d1..d2..no) %>%
  left_join(pivot_wider(df1, id_cols = c(v1, Name, adress, amount), names_from = Var, values_from = Val))

输出

# A tibble: 3 x 10
     v1 Name    adress amount d1         d2    no        Gender farmer_type farmer_category
  <dbl> <chr>   <chr>   <dbl> <chr>      <chr> <chr>     <chr>  <chr>       <chr>          
1     1 S Jacob k11        25 27/01/2020 43832 KE004421  male   "marginal"  general        
2     2 J Isac  k12        25 43832      43832 KE003443  Female " large"    general        
3     3 P Kumar k13        32 31/12/2019 43832 KE0001512 Male   "small"     general

推荐阅读