Ttyjukl

I do not understand a concept about the Nyquist - Shannon sampling theorem.

It says that it is possibile to perfectly get the original analog signal from the signal obtained by sampling if and only if the sampling frequency is higher than twice the maximum frequency of the initial signal.

I can understand it if I think at what happens in the frequency domain, in which the sampling produces replicas of the initial spectrum and therefore a low pass filter reconstructor can delete them and keep the original spectrum.

But in time domain sampling simply means to extract values of the original signal at instants separated by the sampling time T.

Once I have extracted these values, I have lost all the informations about the points between two consecutive instants of sampling. How can the reconstructor device perfectly obtain the original signal? It does not know how to connect the sampled points (they can be connected by infinite mathematical curves and all the information inside T time are lost). For example, it can connect them as in figure 1 (the correct original signal), or as in figure 2.

figure 1

figure 2

This makes me think that a very high sampling frequency is surely a good thing, since the points are very close together, but there is not a frequency that if overcome, allows a 100% perfect reconstruction, since sampling implies losing information.

You can think of any perfectly bandlimited signal as the superposition of a set of $frac{sin(t)}{t} = text{sinc}(t)$ curves, with their peaks positioned uniformly along the time axis. Their spacing is $frac{2}{BW}$.

sinc(x) also happens to be the time-domain response of a perfect low-pass filter, and it explains how the continuous-time reconstruction (interpolation) is accomplished from a series of discrete samples.

When we uniformly sample a signal, each sample is a direct measurement of the amplitude of one of those sinc() waves. This works because it is a property of the sinc() function that it is zero at every sampling point, except at its own peak. In other words, when you take a measurement, you're not getting any "interference" from any of the other sinc() functions. Therefore, the set of N discrete measurements contains all of the information in the continuous-time signal represented by that collection of sinc() waves.

Now, it gets even weirder than what TimWestcott was alluding to — the samples do not even have to be uniformly spaced in time! It turns out that ANY N unique samples taken within a window of time (with certain limitations) of a perfectly bandlimited signal can be used to reconstruct that signal. It takes a lot more math to do it, though!

With nonuniform sampling, you are no longer getting a clean measurement of just one of the sinc() amplitudes. Instead, you're getting a mix of many, if not all of them. However, since you know exactly where you are on each one (obviously, each sample must be time-stamped), it is possible to solve the large system of linear equations to find the actual amplitudes and therefore reconstruct the original signal. Of course, this process is very sensitive to small perturbations (noise and math errors, for example), and I'm hand-waving away some details about constraints on the set of samples, but the general principle holds.

If the signal is perfectly bandlimited, then there is no additional information to be gotten out of it by sampling faster than twice the bandwidth. So perfect reconstruction must be possible. It's as @DanMills said: there's one and only one curve that'll pass through the sampled points and be correct, and that's the curve that you'd get from a perfect reconstruction filter.

(Note that it gets weirder -- at least in theory, if the bandwidth is $B$, then you don't need to sample $x(t)$ at $2B$ -- you can sample $x(t)$ and $frac{d x(t)}{dt}$ simultaneously at $B$, or sample out to the third derivative (i.e., collect four samples) at $frac{B}{2}$, or commit various other crimes to the signal before sampling an $N$ wide vector at $frac{2B}{N}$. Most such schemes (definitely the derivatives that I mention) would be horribly impractical, but in theory they'll work, and you do occasionally stumble across schemes that are actually used in reality.)