It is true; keep in mind that real computers are strictly speaking FSMs, not Turing machines, due to having a finite "tape". It's just vastly more useful to think of them as such when programming.