"No space left on device" error while fitting Sklearn model
Had the same problem with LatentDirichletAllocation
. It seems, that your are running out of shared memory (/dev/shm
when you run df -h
). Try setting JOBLIB_TEMP_FOLDER
environment variable to something different: e.g., to /tmp
. In my case it has solved the problem.
Or just increase the size of the shared memory, if you have the appropriate rights for the machine you are training the LDA on.
This problem occurs when shared memory is consumed and no I/O operation is permissible. This is a frustrating problem that occurs to most of the Kaggle users while fitting machine learning models.
I overcame this problem by setting JOBLIB_TEMP_FOLDER variable using following code.
%env JOBLIB_TEMP_FOLDER=/tmp