Lady Annabel was born in London to an aristocratic Anglo-Irish family. Her parents were Robin Vane-Tempest-Stewart, Viscount Castlereagh, later 8th Marquess of Londonderry, and his wife Romaine Combe. She grew up on her family's estates of Mount Stewart in Northern Ireland and Wynyard Park in northeast England, and at Londonderry House in London, and was educated at private schools in Sussex and Oxford. She made her debut in society in 1952. At age 19, she married Mark Birley, a businessman with whom she had six children. He created Annabel's, a Mayfair nightclub named for her that became a landmark of the "Swinging Sixties." Lady Annabel helped publicize the club and was a well-known society hostess. She separated from Birley in 1972; they divorced in 1975, following the birth of her second child with Sir James Goldsmith, with whom she had been having an affair for many years. She married Sir James in 1978 and their third child was born in 1980. She lives at Ormeley Lodge, a magnificent Queen Anne mansion on the edge of Richmond Park that he bought for her. She wrote an autobiography, Annabel: An Unconventional Life (2004), Copper: A Dog's Life (2006) and a book of essays called Memoir (2009). and founded the Democracy Movement, a Eurosceptic political group.