  Pulsars are the most stable natural frequency standards. They can be applied
to a number of principal problems of modern astronomy and time-keeping
metrology. The full exploration of pulsar properties requires obtaining
unbiased estimates of the spin and orbital parameters. These estimates depend
essentially on the random noise component being revealed in the residuals of
time of arrivals (TOA). In the present paper, the influence of low-frequency
("red") timing noise with spectral indices from 1 to 6 on TOA residuals,
variances, and covariances of estimates of measured parameters of single and
binary pulsars are studied. In order to determine their functional dependence
on time, an analytic technique of processing of observational data in time
domain is developed which takes into account both stationary and non-stationary
components of noise. Our analysis includes a simplified timing model of a
binary pulsar in a circular orbit and procedure of estimation of pulsar
parameters and residuals under the influence of red noise. We reconfirm that
uncorrelated white noise of errors of measurements of TOA brings on gradually
decreasing residuals, variances and covariances of all parameters. On the other
hand, we show that any red noise causes the residuals, variances, and
covariances of certain parameters to increase with time. Hence, the low
frequency noise corrupts our observations and reduces experimental
possibilities for better tests of General Relativity Theory. We also treat in
detail the influence of a polynomial drift of noise on the residuals and
fitting parameters. Results of the analitic analysis are used for discussion of
a statistic describing stabilities of kinematic and dynamic pulsar time scales.
