首页 > 解决方案 > 如果匹配列表中的单词,则计算 unigrams 和 bigrams

问题描述

如果单词出现在列表中,我正在尝试计算字符串中的所有单词。但是,我的代码仅适用于一元组,而不适用于二元组或三元组。我如何计算所有三个?

text_df = [['take time'], ['spend extra time adjust schedule'], ['work more hour extend hour']]
text_df = pd.DataFrame(text_df, columns = ['answer1'])

time_words = ['time', 'extra time', 'adjust schedule', 'extend']

##I tried this but it only counts unigrams
text_df['time_wordcount'] = text_df['answer1'].apply(lambda x: len([wrd for wrd in x.split() if wrd in time_words]))

##Update: This works but it is really long hand
text_df['split'] = text_df['answer1'].apply(lambda x: x.split())
text_df['split2'] = text_df['split'].apply(lambda x: [' '.join(pair) for pair in zip(x, x[1:])])
text_df['split3'] = text_df['split'] + text_df['split2'] 
text_df['time_wordcount'] = text_df['split3'].apply(lambda x: len([wrd for wrd in x if wrd in time_words]))

有任何想法吗?

标签: pandasstringdataframesplitword-count

解决方案


推荐阅读