The Château de Champs, at Champs-sur-Marne was built in its present form for the treasurer Charles Renouard de la Touane in 1699 by Pierre Bullet, architecte du roi. After the first proprietor's bankruptcy, another financier, Paul Poisson de Bourvalais, took up the project. Jean-Baptiste Bullet de Chamblain, the son of Pierre Bullet, finished Champs in 1706.

Ten years later, Paul Poisson was in the Bastille on charges of embezzlement and the château was seized by the Crown. In 1718, it was sold to the princesse de Conti, natural daughter of King Louis XIV of France and his first official mistress, Louise de La Vallière. That same year, however, the princess cancelled a debt by deeding Champs to her first cousin, the duc de la Vallière. When the duke died in 1739, he left the château to his son and heir, the famous bibliophile, Louis César de La Baume Le Blanc. The new duc de La Vallière was later to become a trusted friend of King Louis XV and his mistress, Madame de Pompadour.

Around 1750, the duke added a beautiful rococo salon chinois (Chinese salon) to the château with wall paintings by noted artist Christophe Huet. At the château, Louis César entertained many of the famous writers of the day, including Diderot, Voltaire, d'Alembert and François-Augustin de Paradis de Moncrif, with whom he also corresponded regularly.