python - Jupyter notebook is extremely slow when re-running cells

Question

I have a relatively large Jupyter/Notebook (about 40GB of Pandas DFs in RAM). I'm running a Python 3.6 kernel installed with Conda.

I have about 115 cells that I'm executing. If I restart the kernel and run the cells, my whole notebook runs in about 3 minutes. If I re-run a simple cell that's not doing much work (i.e. a function definition), it takes an extremely long time to execute (~15 minutes).

I cannot find any documentation online that has Jupyer notebook installation best practices. My disk usage is low, available RAM is high and CPU load is very low.

My swap space does seem to be maxed out, but I'm not sure what would be causing this.

Any recommendations on troubleshooting a poor-performing Jupyter notebook server? This seems to be related to re-running cells only.

标签： pythonpython-3.xjupyter-notebook

Answer 1

如果变量检查器 nbextension 被激活，当内存中有大量变量（例如 Pandas 数据帧）时，它可能会减慢笔记本的速度。

见：https ://github.com/ipython-contrib/jupyter_contrib_nbextensions/issues/1275

如果是这种情况，请尝试在Edit -> nbextensions config.