首页 > 解决方案 > 如何将使用多个分隔符的奇怪文件类型读入 R?

问题描述

我的源文件来自一台较旧的测试机器,它会输出“*.ctf”文件。当我使用 readLines() 打开文件时,我得到一个长向量,其前面有“[header_name]”的部分,并且在部分内(在标题之间)4 列由选项卡“\t”分隔。

理想情况下,我想将每个部分分成自己的列表/数据框,每列 4 列。

这是使用 readLines() 将向量读入 R 后的向量示例(请注意,我从第 5 行跳到第 21 行)

vector
    [1] "[HEADER]" "Created by Sigma-1 ICON Version 4.5.3; Copyright 2005, GEOTAC"
    [3] "Project:\tACC#1210004 \tLoad Frame Name:\tLoad Frame" "Date:\t1/1/2002 \tTime:\t12:39:01 AM "                                      
    [5] "Boring:\tBoring2\tSample:\tSample7"
    
    ...
    
    [21] "" "[STEP 1]\t850\t0"                                                          
    [23] "Time\tExternal Load Cell\tDCDT\tPlaten Position" "1/1/2002 12:40:52 AM\t-2.31623424260761E-04 \t 3.45233241577262 \t 3150948 "
    [25] "1/1/2002 12:41:07 AM\t-3.22715023139608E-04 \t 3.45440429846349 \t 3157103 " "1/1/2002 12:41:22 AM\t-3.2964900303341E-04 \t 3.4553244755898 \t 3158611 " 

理想情况下,读取文件会产生多个由 [header] 命名的列表,并由 "\t" 分隔为 4 列,前 4 列是列标题。例如,[STEP 1] 在 EXCEL 中看起来像这样,将类似的东西作为数据框将是完美的。

来自 Excel 的片段

我希望像 read.table 这样的东西可以使用制表符分隔符来处理这个问题,但它会引发错误,因为有多个列在彼此的顶部。

编辑回应评论:

    > dput(head(vector, 40))
c("[HEADER]", "Created by Sigma-1 ICON Version 4.5.3; Copyright 2005, GEOTAC", 
"Project:\tACC#1210004 \tLoad Frame Name:\tLoad Frame", "Date:\t1/1/2002 \tTime:\t12:39:01 AM ", 
"Boring:\tBoring2\tSample:\tSample7", "Specimen:\tSpecimen1\tDepth (ft):\t 21 ", 
"Diameter (inch):\t 2.5025 \tHeight (inch):\t 1.00825 ", "Comments:\tTare J 217.028 paper .311 .463  wet weight 379.024g", 
"", "[SENSORS]", "Name\tExternal Load Cell\tDCDT\tLoad Frame Encoder", 
"ID\t227396\tLP183\tN/A", "Module\tLoad Frame ADIO\tLoad Frame ADIO\tN/A", 
"Channel\t 1 \t 2 \tN/A", "Unit\tlbs\tinch\tinch", "Cal. Factor\t-796107.1205 \t 3.02704684 \t 3940000 ", 
"Excitation\t 9.98139953613281 \t 9.98139953613281 \tN/A", "Zero\t 3.38862647549831E-05 \t 3.10994816131097 \tN/A", 
"Min. Reading\t-1000 \t-0.05 \t0.0", "Max. Reading\t 2000 \t 3 \t 1.5 ", 
"", "[STEP 1]\t850\t0", "Time          \tExternal Load Cell\tDCDT\tPlaten Position", 
"1/1/2002 12:40:52 AM\t-2.31623424260761E-04 \t 3.45233241577262 \t 3150948 ", 
"1/1/2002 12:41:07 AM\t-3.22715023139608E-04 \t 3.45440429846349 \t 3157103 ", 
"1/1/2002 12:41:22 AM\t-3.2964900303341E-04 \t 3.4553244755898 \t 3158611 ", 
"1/1/2002 12:41:38 AM\t-3.35823094719672E-04 \t 3.45592288755324 \t 3159627 ", 
"1/1/2002 12:41:53 AM\t-3.34113346252707E-04 \t 3.45707221846715 \t 3160244 ", 
"1/1/2002 12:42:24 AM\t-3.25707082956796E-04 \t 3.45724794261514 \t 3160806 ", 
"1/1/2002 12:42:54 AM\t-3.34350811317563E-04 \t 3.45749134430662 \t 3161526 ", 
"1/1/2002 12:43:24 AM\t-3.32652936103841E-04 \t 3.4578036108669 \t 3161849 ", 
"1/1/2002 12:43:54 AM\t-3.31216272461461E-04 \t 3.45799833222009 \t 3162033 ", 
"1/1/2002 12:44:54 AM\t-3.2508967378817E-04 \t 3.45834978051607 \t 3162380 ", 
"1/1/2002 12:45:54 AM\t-3.28473550962372E-04 \t 3.45827497902064 \t 3162464 ", 
"1/1/2002 12:46:54 AM\t-3.32878527915454E-04 \t 3.4585171933868 \t 3162704 ", 
"1/1/2002 12:47:54 AM\t-3.23534277613362E-04 \t 3.45914291383269 \t 3161933 ", 
"1/1/2002 12:49:54 AM\t-3.38494576699304E-04 \t 3.45977932020651 \t 3162452 ", 
"1/1/2002 12:50:56 AM\t-3.31038173662819E-04 \t 3.45979950473702 \t 3159002 ", 
"", "[STEP 2]\t1700\t0")

标签: rdelimiter

解决方案


如果您的数据遵循模式 [STEP1][COLUMNNAMES][DATA][STEP2][COLUMNNAMES][DATA].... 我认为这会起作用。

start <- grep('^Time', vector)
end <- grep('\\[STEP', vector)[-1] - 2
result <- do.call(rbind, Map(function(x, y) 
             read.csv(text = paste0(vector[x:y], collapse = '\n'), sep = '\t'), 
             start, end))
result

这里的逻辑是我们假设第一个列名是'Time'并且数据从那里开始直到找到下一个STEP。


推荐阅读