Community

Problem with MNB_classifier from NLTK learning tutorial

Hey I followed through your NLTK tutorial. I am trying to run the classifiers for the first time and I keep getting a memory error. I copied the code from the webpage but I cant figure out what is causing the memory error and it seems to be within the sklearn package.

Traceback (most recent call last):
  File "C:UserssamueDocumentsDataMiningsentiment.py", line 109, in <module>
    MNB_classifier.train(training_set)
  File "C:UserssamueAppDataLocalProgramsPythonPython36-32libsite-packagesnltkclassifyscikitlearn.py", line 117, in train
    X = self._vectorizer.fit_transform(X)
  File "C:UserssamueAppDataLocalProgramsPythonPython36-32libsite-packagessklearnfeature_extractiondict_vectorizer.py", line 230, in fit_transform
    return self._transform(X, fitting=True)
  File "C:UserssamueAppDataLocalProgramsPythonPython36-32libsite-packagessklearnfeature_extractiondict_vectorizer.py", line 172, in _transform
    values.append(dtype(v))
MemoryError

Any idea what I need to do to make this work?

 word_features = list(all_words.keys())[:1300]