Aiming at the problem of short text clustering, this paper proposes a method to process text representations and clustering simultaneously. The method can be divided into two stages. In the first stage, the method uses the deep neural network to initialize parameters. In the second stage, the method also studies the text representation and clustering target through the deep neural network. The experimental results show that the proposed method achieves better results than the benchmark algorithm in a certain degree.