In digital pathology diagnosis, accurate recognition and quantification of the tissue structure is an important factor for computer-aided diagnosis. However, the classification accuracy of cytoplasm is low in Hematoxylin and eosin (HE) stained liver pathology specimens because the RGB color values of cytoplasm are almost similar to that of fibers. In this paper, we propose a new tissue classification method for HE stained liver pathology specimens by using hyperspectral image. At first we select valid spectra from the image to make a clear distinction between fibers and cytoplasm, and then classify five types of tissue based on the bag of features (BoF). The average classification accuracy for all tissues was improved by 11% in the case of using BoF of RGB and selected spectra bands in comparison with using only RGB. In particular, the improvement reached to 24% for fibers and 5% for cytoplasm.