时间戳

首页 > 解决方案 > 如何根据句子长度在 2 个数据帧之间建立连接，并根据 ID 将其屏蔽到另一个数据帧

python - 如何根据句子长度在 2 个数据帧之间建立连接，并根据 ID 将其屏蔽到另一个数据帧

问题描述

我有 2 个 csv 文件，其中包含其中的句子，并尝试制作一个程序来根据单词检查句子长度，如果句子有超过 3 个单词，则将其添加到另一个 csv 并从第二个 csv 获取相同的 ID 到一个新的 csv 也是如此，据我所知，我需要在第二部分使用掩码，但它对我不起作用这是我正在尝试的

我的代码返回 true 和 false 而不是长度为 3 个或更多单词的句子


fdata = pd.read_csv(firstinput, names=['sentences'], skiprows=skip)

firstdata= fdata['sentences'].str.split().str.len().gt(3)

sdata = pd.read_csv(secondtinput, names=['sentences'], skiprows=skip)
seconddata=sdata[sdata.index.isin(firstdata.index)]

firstdata.to_csv("new_data.csv", index=False, header=False)
seconddata.to_csv("new_data2.csv", index=False, header=False)



----------------------
#first dataframe example 
----------------------
#bye
#how are you 
#I want to die
#I was home
#I went to sleep at work
#he have a bad reputation
#it was me who went to him 
#have  good sleep home
#hi you
#hi

----------------------
#second  dataframe example 
----------------------
#bye
#halaw kuy bashii
#damawe bmrm 
#la malawa bum
#la  
#aw kabraya bash nya 
#awa mn bum chum bo lay
#xaweki xosh basar bba la malawa 
# halaw you
#hi


----------------------
#first dataframe output 
----------------------

#how are you 
#I want to die
#I was home
#I went to sleep at work
#he have a bad reputation
#it was me who went to him 
#have  good sleep home

----------------------
#second  dataframe output 
----------------------

#halaw kuy bashii
#damawe bmrm 
#la malawa bum
#la 
#aw kabraya bash nya 
#awa mn bum chum bo lay
#xaweki xosh basar bba la malawa

标签： pythonpandasdataframe

解决方案

我认为这行代码有问题：

firstdata= fdata['sentences'].str.split().str.len().gt(3)

试试这个：

firstdata = fdata.loc[df1['sentences'].str.split().str.len().gt(2)]

firstdata输出：

    sentences
1   how are you
2   I want to die
3   I was home
4   I went to sleep at work
5   he have a bad reputation
6   it was me who went to him
7   have good sleep home

seconddata输出：

    sentences
1   halaw kuy bashii
2   damawe bmrm
3   la malawa bum
4   la esh nustm
5   aw kabraya bash nya
6   awa mn bum chum bo lay
7   xaweki xosh basar bba la malawa

推荐阅读