In the field of brain computer interface (BCI), effective classification of motor imagery (MI) tasks is an important issue. Deep learning (DL) has attracted lots of attention and has been widely used in a great deal of areas such as speech recognition, object detection, and natural language processing (NLP). However, the use of deep learning approaches in BCI fields is remaining relatively lacking. In this paper, we introduce a method, combined the one-dimensional convolutional neural network (1D CNN) with long short-term memory (LSTM) to classify MI tasks, a novel deep learning network is formed. CNN and LSTM are used to extract the time representation of MI tasks. Performance of the put forward method has been estimated in the BCI competition IV dataset 2a. The outcomes demonstrate that our proposed method is capable of enhancing the classification accuracy compared to state of art approaches.