In this paper, the well-known LQR problems are mainly investigated. In both of the continuous-time and discrete-time representations, an explicit solution of the LQR problems are analytically determined with the proposed method. This procedure which, based on the state transition matrix, is used in two numerical examples to show the applicability of proposed method.