In order to solve the problem of the long-term survival of the astronauts in the space station, the research of space plants becomes more and more important. At present, there are some problems in image recognition field, such as the method of the shallow images recognition is difficult to extract hierarchical features of space plant images, and deep convolution neural network has fixed size input and long recognition time. To deal with these problems, a method based on fully convolutional networks is proposed in this study, and the networks have the ability to extract features from the shallow to deep, deep fusion spectrum features, and spatial features to achieve an efficient and accurate representation of the space plants image, so as to achieve fast and accurate recognition of the space plants image.