Under pressure ... David Curry outside the Yorkshire cottage last night
Mr Curry - facing a probe into £30,000 of claims - turned up last night at the cottage wife Anne allegedly banned him from using.
He confessed yesterday to a fling with a headmistress in his constituency.
But he denied Anne had vetoed his return to the house in Fearby, North Yorks, that he used for romps with Cherry Edwards four years ago.
Asked about her husband's problems at the family home in Saffron Walden, Essex, stony-faced Anne said: "It's his problem, I have nothing to say."
Mr Curry, 65, had to step down as head of a Commons expenses watchdog after just a month. He referred himself to the Parliamentary Commissioner for Standards, but denied any fiddling and said his expenses were "very modest".
He claimed almost £30,000 of taxpayers' cash for the Yorkshire home, but spends most of his time in Essex.
Last night he insisted: "My wife hasn't banned me from doing anything. I had an affair, there's no point denying it. We pulled together our marriage, and when you're doing that you want to see as much as you can of each other."
He said he had stayed in the cottage "hundreds, if not thousands, of times".
However, neighbours last night said they had NEVER seen him there. One said: "Until I saw the news coverage I just assumed it was empty."
TORY leader David Cameron said Mr Curry "did the right thing" in quitting the watchdog role and putting his expenses under the microscope.