The short story "The Discrete Charm of the Turing Machine" by Greg Egan deals with this nicely. I won't give away the ending though.