python - 我无法从 arabert.preprocess_arabert 导入预处理

Question

import pandas as pd
from farasa.segmenter import FarasaSegmenter
from arabert.preprocess import ArabertPreprocessor
from transformers import AutoTokenizer, AutoModel
from arabert.preprocess_arabert import never_split_tokens, preprocess
from sklearn.model_selection import train_test_split

我收到此错误 ModuleNotFoundError: No module named 'arabert.preprocess_arabert' 请帮我解决这个问题！

标签： pythonlibraries

Answer 1

我希望这还不算太晚，但这里有一个修复以供将来参考：

from arabert.preprocess import ArabertPreprocessor, never_split_tokens