The flaw to that logic is that you could flip the statement and make the opposite arguement - the New Testament at no point refers to Jesus as married is, in fact, proof that he was unmarried.
Given that the new testament is basically a collection of stories about his life and quotes by the guy, don't ya think that somewhere in there he would have at least once been quoted as saying "Like I said to my wife the other day...."?
