In practice, a high-dynamic vibration sensor is often plagued by the problem of drift, which is caused by thermal effects. Conversely, low-drift sensors typically have a limited sample rate range. This paper presents a system combining different types of sensors to address general drift problems that occur in measurements for high-dynamic vibration signals. In this paper, the hardware structure and algorithms for fusing high-dynamic and low-drift sensors are described. The algorithms include a drift state estimation and a Kalman filter based on a linear prediction model. Key issues such as the dimension of the drift state vector, the order of the linear prediction model, are analyzed in the design of algorithm. The performance of the algorithm is illustrated by a simulation example and experiments. The simulation and experimental results show that the drift can be removed while the high-dynamic measuring ability is retained. A high-dynamic vibration measuring system with the frequency range starting from 0 Hz is achieved. Meanwhile, measurement noise was improved 9.3 dB through using the linear-prediction-based Kalman filter.