Comment by kkylin

One can still define a map by taking the fractional part of the matrix-vector product, but the resulting map won't be continuous (with respect to the topology of the torus). In addition, if one wants the map be a homeomorphism (continuous with continuous inverse) then the determinant must have absolute value 1.