FRED Richmond – the Brooklyn congressman who resigned in disgrace 27 years ago – is 85, but he’s not slowing down. He’s off to Patagonia and Antarctica, according to designer Mary McFadden, who recently dined with him at Primola. “Isn’t it wonderful? He’s in great shape and does something different each year,” she told us. Richmond was once charged with soliciting sex from a 16-year-old boy but charges were dropped after he agreed to counseling. He quit in his fourth term and did nine months in jail after pleading to income-tax evasion, possessing marijuana and making an illegal payment to a government employee. McFadden, 70, who recently had kidney stones, said she’s “doing much better.”