Mencius - Book 5, Part 1, Chapter 8A

Wan Chang asked Mencius, saying, 'Some say that Confucius, when he was in Wei, lived with the ulcer-doctor, and when he was in Ch'î, with the attendant, Ch'î Hwan; was it so?' Mencius replied, 'No; it was not so. Those are the inventions of men fond of strange things.

'When he was in Wei, he lived with Yen Ch'âu-yû. The wives of the officer Mî and Tsze-lû were sisters, and Mî told Tsze-lû, "If Confucius will lodge with me, he may attain to the dignity of a high noble of Wei." Tsze-lû informed Confucius of this, and he said, "That is as ordered by Heaven." Confucius went into office according to propriety, and retired from it according to righteousness. In regard to his obtaining office or not obtaining it, he said, "That is as ordered." But if he had lodged with the attendant Chî Hwan, that would neither have been according to righteousness, nor any ordering of Heaven.
~ James Legge translation via nothingistic.org ~

Go here to read the introductory post to this serialized version of the Works of Mencius.