The present paper is concerned with various aspects of Gaussian semimartingales. Firstly, generalizing a result of Stricker (1983), we provide a convenient representation of Gaussian semimartingales $X_t=X_0+M_t+A_t$ as an $(\mathcal{F}^M_t)_{t\geq 0}$-semimartingale plus a process of bounded variation which is independent of $(M_t)_{t\geq 0}$. Secondly, we study stationary Gaussian semimartingales and their canonical decomposition. Thirdly, we give a new characterisation of the covariance function of Gaussian semimartingales which enable us to characterize the class of martingales and the processes of bounded variation among the Gaussian semimartingales. We conclude with two applications of the results.