– Do you believe in God?
– If you ask me if there is a God, perhaps I can answer that.
– Is there a God?
– If there is, he erased all possible traces, making it impossible to construct a proof. I don’t know why he did that. He must know better.
On 22 March 1954 Einstein received a letter from J. Dispentiere, an Italian immigrant who had worked as an experimental machinist in New Jersey. Dispentiere had declared himself an atheist and was disappointed by a news report which had cast Einstein as conventionally religious. Einstein replied on 24 March 1954:
It was, of course, a lie what you read about my religious convictions, a lie which is being systematically repeated. I do not believe in a personal God and I have never denied this but have expressed it clearly. If something is in me which can be called religious then it is the unbounded admiration for the structure of the world so far as our science can reveal it.
Einstein generally spoke and wrote in German, definitely in his earlier years but even after he moved to the US and worked at IAS in Princeton. However, this comment was indeed in English. Page 43 in Albert Einstein, The Human Side: New Glimpses From His Archives, Edited by Banesh Hoffman and Helen Dukas.