Comment by hackinthebochs

Yes, that is a degenerate case. We can always encode an arbitrary amount of data into the basis functions to get a maximally simple representation for some target signal. If the signal is simple (carries little information) or the basis functions are constructed from the target signal, you can get this kind of degeneracy. But degenerate cases do not invalidate the rule for the general case.