By the time the third divorce was final, Olive Paget had learned the lesson well enough that she no longer needed anyone to teach it to her. Three marriages, three divorces, and after each one the castle remained where it had always been, in her name. Leeds Castle in Kent, a medieval fortress surrounded by a moat, had been the residence of six English queens, from Eleanor of Castile in the thirteenth century to Catherine of Aragon in the sixteenth. The woman who kept it was an American heiress born in Manhattan in 1899, whose Standard Oil and Whitney fortune was large enough to buy the estate, restore it at a cost of millions, and fill its weekend guest list with names ranging from Charlie Chaplin and Errol Flynn to the Prince of Wales and the future King George VI.
Unlike nearly every other dollar princess of her era, Olive never allowed her fortune or her property to fall into the hands of her husbands. She married the younger son of a Yorkshire baron, divorced him, and kept the money. She married the grandson of a shipping magnate, bought the castle with her own funds, divorced him, and kept the castle. She married a baronet, hosted the most talked-about country house parties in England for a decade, divorced him, and kept the castle again.
When she died in 1974, she did not leave Leeds Castle to her husband’s family. She left it to a charitable trust of her own invention, ensuring that it would never again depend on the fate of any marriage. The money behind that independence came from two sources, both rooted in the mechanisms of the Gilded Age that produced the largest private fortunes in America. Her maternal grandfather, William Collins Whitney, was born in Conway, Massachusetts, educated at Yale and Harvard Law, and made his first fortune through quintessential American urban infrastructure politics.
As counsel to New York City he fought the remnants of the Tweed Ring before joining a syndicate with Thomas Fortune Ryan and Peter Widener that took control of the Manhattan streetcar franchise. As Secretary of the Navy under President Grover Cleveland, he and his wife Flora were said to have hosted 60,000 guests over four years in Washington. By his death in 1904 his fortune was estimated at $23 million, an amount contemporaries calculated as roughly one nine-hundred-and-ninety-third of American gross national product. His properties included a Fifth Avenue mansion redesigned by McKim, Mead and White at a cost of three and a half million dollars, a 5,000-acre Long Island estate, a 10,000-acre Adirondack game preserve, and a 69-room winter home in Aiken, South Carolina.
Whitney’s 1902 will divided his fortune into ten shares administered through trusts. Five-tenths went to his elder son Harry Payne Whitney, one-tenth to his younger son Payne Whitney, three-tenths to his younger daughter Dorothy, and one-tenth to Pauline, Olive’s mother. Pauline’s comparatively modest share reflected a family division. When Whitney remarried after Flora’s death to a woman rumored to have been his mistress, Oliver Hazard Payne was so furious on behalf of his dead sister that he promised to favor any of Whitney’s children who stood against their father.
Pauline sided with Payne, and that family political calculation almost certainly increased what she and Olive later received from the vast Standard Oil fortune owned by Uncle Oliver. The second and more important source of Olive’s wealth was her great-uncle, Colonel Oliver Hazard Payne, Flora Whitney’s brother, a director and treasurer of Standard Oil whose fortune ranked twenty-sixth on American Heritage’s list of the forty richest Americans in history, with assets exceeding one hundred million dollars. Payne never married and had no children, a fact that proved decisive for Olive’s future. His principal heir was his nephew Payne Whitney, who received roughly $63 million from the estate.
But Pauline and her daughters were already named beneficiaries in his will, which meant that the Standard Oil money flowing through decades of trust arrangements eventually reached Olive and made the purchase of Leeds Castle possible. Those trusts were typically structured so that income was distributed to beneficiaries while the capital was protected from the beneficiaries’ husbands. It was a design that proved essential when Olive began her journey of marriage and divorce. American fortunes of this size were usually settled in trusts, partly to ease taxation and partly as a deliberate protection mechanism against fortune-seeking spouses.
That exact concern fueled the entire dollar princess phenomenon. The legal structure that allowed Olive to exit three marriages with her castle intact was designed by the generation before her specifically for the kind of situation she would face. Pauline Payne Whitney, Olive’s mother, was born in New York in 1874 and made her society debut in December 1892 at a reception attended by 300 guests representing the political and social elite of the age. Contemporary newspapers noted with disapproval that Pauline belonged to a small circle of wealthy young women dubbed the suffragettes, including her close friend Consuelo Vanderbilt, who inclined toward socialist views and the demand for women’s voting rights.
On 12 November 1895, Pauline married Almeric Hugh Paget, an Englishman twelve years her senior who had reinvented himself from a cattle rancher in Le Mars, Iowa, to a property man in Saint Paul, Minnesota, to a New York society figure through the connections of his brother Arthur. Almeric was the sixth and youngest son among the fourteen children of Lord Alfred Paget, which meant he had impeccable lineage reaching back to the Marquess of Anglesey, who had led the British cavalry at Waterloo, but he had inherited almost nothing. The marriage embodied exactly what the transatlantic marriage market of the 1890s was designed to achieve: an Englishman with a title and no money meets an American heiress with more money than she can spend. President Grover Cleveland attended the wedding at St.
Thomas’s Church in New York, one week after Consuelo Vanderbilt’s more famous marriage to the Duke of Marlborough. Contemporaries said it was a much better party. The Pagets moved to England in 1901, officially for Pauline’s frail health, though they were by then building an English social and political life centered on London and country house circles. Pauline inherited an additional two and a half million dollars upon her father’s death in 1904.
Almeric was elected Unionist MP for Cambridge in January 1910 and held the seat until 1917. The couple lived between a London house at 39 Berkeley Square, rented country houses, and a villa in Cannes. Despite her health, Pauline rode and played billiards, and was among the early members of the Automobile Club of Great Britain. By 1907 the marriage had cooled noticeably, though Pauline continued to support Almeric’s political ambitions.
Pauline’s most significant independent legacy was her wartime charity. In August 1914 she organized the Almeric Paget Massage Corps, recruiting trained masseuses to provide physical therapy to wounded soldiers. She established a convalescent camp at Summerdown, near Eastbourne, where wounded soldiers called her the Angel of Summerdown. Pauline Paget died at Esher, Surrey, on 22 November 1916, at the age of forty-two, after an illness lasting three weeks, and the wounded soldiers she had helped carried her coffin.
She was buried at Hertingfordbury in Hertfordshire. Sources differ on the exact amounts bequeathed. One account holds that Pauline set aside $4 million for her two daughters combined, while another records that she left nearly $5 million to each daughter individually, a material difference that available evidence does not resolve. Both figures agree that the money belonged entirely to Olive, beyond any husband’s reach, in addition to her existing status as heir to the immense Oliver Hazard Payne Standard Oil fortune.
The two daughters were left independently wealthy while still in their teens, and the money was organized in the most important way possible. It was theirs, not their father’s. Almeric Paget, after Pauline’s death, resigned his seat in the House of Commons and was raised to the peerage as Baron Queenborough in January 1918. The medical charity instincts Pauline displayed at Summerdown, an American heiress who turned her houses and money to the care of wounded soldiers, would reappear with striking symmetry at Leeds Castle a generation later.
Olive Cecilia Paget was born in Manhattan on 24 September 1899, the elder of Pauline and Almeric’s two daughters. Her younger sister, Dorothy Wyndham Paget, was born in 1905. Her childhood was transatlantic by nature, with Whitney grandparents in New York and an English aristocratic network on her father’s side that included diplomats and generals and the painter Sidney Paget. Her mother’s chronic ill health moved the family to England when Olive was a small child, so she grew up in the orbit of the English countryside and London society, even as her wealth, her relatives, and much of her extended family remained in New York.
She was educated in France and served briefly as a wartime nurse in 1918 near the end of the First World War, and later as a nurse in the Voluntary Aid Detachment of the Red Cross, following in the medical charity tradition of her mother. Her father remarried in 1921 to Edith Starr Miller, an American heiress with a bent for conspiracy theories and antisemitic agitation, who published a book in 1933 claiming a communist-Masonic plot to control Europe. That marriage produced three more daughters before ending in divorce in 1932. Almeric had already been raised to the peerage as Baron Queenborough in January 1918, which meant Olive held the courtesy title Lady Olive Paget from the age of eighteen.
Her father himself, by the late 1930s, was an ardent supporter of Francisco Franco and Adolf Hitler, praising the dictator as late as 1939. A family political background worth noting for context, though it should not be confused with Olive’s own views, which are not independently documented. Biographies agree in portraying her as a reserved, secretive figure who shunned the spotlight, even as she hosted the most raucous house parties in England, a coordinator of experiences for others rather than a personality seeking drama. A BBC report on the castle’s design history described Lady Baillie as a reticent character who avoided the limelight, even while working precisely with designer Stéphane Boudin to coordinate every detail of her castle.
That privacy was real and consistent for a woman accustomed to hosting Charlie Chaplin, Edward VIII, and the future King George VI at weekend parties. Olive left no personal correspondence in public records, gave no press interviews, and appears in documents only through property transactions, marriage settlements, and the notes of her guests. Her lifelong habit of chain-smoking cigarettes ultimately contributed to her declining health and lung disease in her later years. In 1919 she was nineteen, independently wealthy, educated in France, and about to enter her first of three marriages.
On 21 July 1919, Olive married Charles John Frederick Winn, the younger son of Rowland Winn, the second Baron St Oswald, whose family seat was the famous Nostell Priory estate in Yorkshire. The New York Times headline captured the story as American journalism cared about it: Lady Olive Paget Weds Captain Winn. Granddaughter of the Late William C. Whitney Marries Brother of Lord St Oswald in London.
Her Mother Left Her Her Fortune. Even in 1919, the press understood that Olive’s identity was tied to her Whitney inheritance more than to her husband’s lineage, the headline reading like a financial disclosure rather than a wedding announcement. Winn had served with the Tenth Hussars in France during the war and later worked as assistant to the British military representative at Marshal Foch’s headquarters in 1918. Before the Second World War he managed the Winn family estate at Nostell Priory, one of Robert Adam’s finest houses in Yorkshire, famous for its collection of Chippendale furniture.
The couple had two daughters, Pauline Catherine Winn, born in 1920, and Susan Mary Sheila Winn, born in 1923. The Winn marriage collapsed in 1924, and divorce proceedings were completed in 1925. Olive had proven the pattern that would define the rest of her life. She married and divorced, and the money stayed where it was, inside the trust structures her grandfather and great-uncle had built to protect her.
Winn married twice more, and Olive’s two daughters from Winn would live lives tied to the castle she was about to buy. Susan in particular spent her childhood at Leeds Castle after her mother’s third marriage, served as a volunteer nurse in the castle hospital during the war, and remained part of the Leeds entity into old age, living in the Maiden’s Tower and helping oversee the castle’s transition from private home to public institution. Pauline married four times, ending with Edward Lee Cave in 1974. Susan, after two marriages of her own, first to Geoffrey Russell, later the fourth Baron Ampthill, then to Colonel Edward Remington-Hobbs, lived in the castle until her death.
The next marriage was shorter and would produce the most significant acquisition of Olive’s life. A 900-year-old castle was about to change owners, and the woman who bought it would keep it for the next half century. The site of Leeds Castle had been occupied since at least 857 AD, when a Saxon nobleman named Led or Ledian built a wooden structure on two islands in the River Len. The castle’s nine centuries of recorded history read like a condensed timeline of English power.
Robert de Crevecoeur rebuilt the site in stone as a Norman fortress in 1119. In 1278, Eleanor of Castile acquired the castle. For more than two centuries after that, the castle formed part of the dower, the property guaranteed for life to successive English queens. In 1321, Margaret de Clare, Lady Badlesmere, left in charge of the castle by her husband, refused entry to Queen Isabella of France and ordered archers to open fire when the queen’s retinue tried to force its way in, killing six of the royal party.
For that, King Edward II besieged and captured the castle and imprisoned Lady Badlesmere in the Tower of London. Anne of Bohemia, Richard II’s first wife, spent the winter of 1381 at Leeds on her way to her wedding. In 1395, Richard entertained the French chronicler Jean Froissart there, an event Froissart himself recorded in his famous Chronicles. Henry VIII converted the castle in 1519 for the residence of Catherine of Aragon.
In 1520, the royal procession set out from Leeds on its way to the diplomatic summit with Francis I of France known as the Field of the Cloth of Gold. The Crown granted Leeds Castle in 1552 to Sir Anthony St Leger, and ownership eventually passed in 1632 to the Culpeper family of Hollingbourne, whose land grants in Virginia exceeding five million acres created a transatlantic link between the castle and the American colonies, still remembered by a memorial sundial at Leeds showing the corresponding time at Belvoir, Virginia. Thomas Fairfax, the sixth Lord Fairfax of Cameron, was born at Leeds Castle in 1693 and later emigrated to America to oversee the Culpeper family’s holdings. Through marriage the castle passed to the Fairfax family and eventually to the Wykeham-Martin family, who rebuilt the main block in Tudor Gothic Revival style in the 1820s, partly from the proceeds of selling the Virginia estates.
The Wykeham-Martins kept the castle until death duties forced its sale in 1924. The castle sat empty for nearly two years, deteriorating from lack of maintenance, and all sources agree on its dilapidated condition. Parts of the grounds were overgrown, the castle had no modern plumbing, and the prospect of living in it seemed remote to anyone who inspected it. William Randolph Hearst considered buying it but backed away after his agent cabled that the castle was unique as an ancient monument but required enormous expense, lacked bathrooms, depended on oil lamps, and described the servants’ quarters as a dark cellar.
In 1926, using Olive’s money for the most part, she and her second husband, Arthur Wilson Filmer, bought Leeds Castle for £180,000, roughly equivalent to seven and a half million pounds in today’s currency. The castle was in bad condition, empty since 1924, with overgrown grounds, no bathrooms, lighting dependent only on oil lamps, and servants’ quarters described as a dark cellar. Olive rented nearby Mott Park until Leeds was made habitable in 1928, and the restoration work she began at that stage continued across three designers and two more husbands for nearly five decades. The castle that queens had owned for centuries was now in the hands of an American heiress, and the restoration she began would continue for the next half century.
Owen Little, an architect from Surrey, oversaw Olive’s initial restoration, handling the gatehouse and stable courtyard and converting the Great Hall into a library. For the more ambitious work she turned to the French designer Armand-Albert Rateau, known for his Art Deco interiors, who worked at Leeds from roughly 1927 to 1929 and produced what the Leeds Castle Foundation describes as a fantastic Gothic fantasy. The Banqueting Hall was restored to its original size after having been divided into small pantries and kitchens. The chapel was dismantled and rebuilt as a music room, and an ancient original spiral staircase imported from France was installed against the south wall of the Fountain Court.
As Olive’s taste matured and changed, she engaged Stéphane Boudin, head of the Paris decorating firm Maison Jansen, who worked at Leeds from the early 1930s until 1967, moving away from Rateau’s medieval fantasy toward a more modern neo-Georgian style, executed with supreme skill and no constraint on expense. Boudin was considered the foremost decorator of luxurious French-style interiors, and his other clients included the Duke and Duchess of Windsor. The most prominent station of his career came with Jacqueline Kennedy, whom he helped restore the White House in 1961. Surviving Boudin interiors at Leeds include the Yellow Drawing Room designed in mid-eighteenth-century Palladian style with French touches, the Thorpe Hall Room, an entirely wooden 1654 Mannerist interior moved from Thorpe Hall in Huntingdonshire, a library copied from an engraved design by the French designer Daniel Marot, and Lady Baillie’s bedroom suite veneered in thin Louis XVI-style wood panels, considered the pinnacle of Boudin’s surviving work.
There is an interesting link between the two projects. According to castle staff, the young John F. Kennedy visited Leeds Castle in July 1938 with his sister and other guests at the time Boudin was redesigning the interiors, years before Kennedy’s political career and decades before his wife independently chose the same designer for the White House. The curator is careful to frame this as an interesting coincidence rather than a documented cause, and any account should present it that way.
Beyond the interiors, Olive built tennis courts, a squash court, and a swimming pool with a wave-making machine imported from America, counted among the wonders of English country houses. She converted the Maiden’s Tower into bachelor apartments and a private cinema for her weekend guests. The grounds were redesigned in different phases to include llamas and a zebra. The total cost of the restoration over its span from the 1920s to the 1960s has been estimated at around two million dollars in contemporary currency, a figure representing many multiples of that value today.
Although that number is presented without archival reference in the sources that repeat it, and should be treated as a collective estimate rather than a precisely verified total, the scale of the work, the complete modernization of plumbing and services, the importation of historic architectural elements from France, the employment of skilled artisans from three countries, and the constant renewal of furnishings over four decades make a figure in the millions entirely plausible. From 1957 onward she built an extensive and systematic aviary for rare species, particularly Australian finches and parrots, which became among the most complete private collections in Britain. The castle was ready for the guests who would make it famous. In May 1925, immediately after her divorce from Winn, Olive married Arthur Wilson Filmer, the son of an MP and grandson of the shipping magnate Arthur Wilson and Sir Edmund Filmer, the ninth baronet.
The purchase deed named Filmer, but the money was Olive’s, and the couple bought Leeds Castle in 1926. The decisive legal fact was that the castle’s ownership belonged to Olive personally or to trustees acting for her benefit from the beginning. The Filmer marriage did not survive the restoration, and available sources offer no detailed explanation for why it ended, only that it did. They divorced in late 1930 or 1931.
Sources differ on the exact month. Olive retained full ownership of the castle. The second marriage ended, and the fortune and the castle remained as they were. On 4 November 1931, at Holy Trinity Church in London, Olive married Sir Adrian William Maxwell Baillie, the sixth baronet.
The New York Times reported the wedding under the headline Mrs. Wilson-Filmer Weds a Baronet, noting explicitly that the bride was the granddaughter of the late William C. Whitney and that this was her third marriage. Adrian had inherited the baronetcy as a teenager in 1914, after his elder brother, Sir Garway George Stuart Baillie, was killed in the first weeks of the First World War.
The family seat, Polkemnett House in West Lothian, sat above a coal mine that had begun producing in 1921, which augmented the Baillie family fortune even before Adrian married into the far larger Whitney-Payne wealth. Adrian was educated at Eton and Sandhurst, served with the Royal Scots Greys in France, and worked in the diplomatic service as second secretary at the British embassy in Washington from 1924 to 1928, a post that deepened his connections to the transatlantic social world Olive inhabited. His political career was more turbulent than his marriage. He lost the Linlithgowshire seat to Manny Shinwell of the Labour Party in 1929, won it back in 1931, lost it again in 1935, and returned to represent Tonbridge in Kent, near Leeds Castle itself, in a by-election in 1937, holding the seat until 1945.
He devoted himself to his constituents and fought for improved conditions for agricultural workers, a cause reflecting his background as a landowner. His friendship with Douglas Fairbanks Sr. placed him at the intersection of English political life and the Hollywood glamour that Leeds Castle itself embodied. The couple had one child, Gawaine George Hope Baillie, born on 8 March 1934, who later became an amateur racing driver and engineer.
After his death in 2003, it emerged that he had secretly assembled one of the greatest collections of former British Empire stamps ever amassed. Adrian and Olive divorced in 1944, and Adrian died of pneumonia during a harsh winter in January 1947. For the third time, Olive emerged from a dissolved marriage in full possession of Leeds Castle, a pattern so consistent that it could only be the product of deliberate legal design. She never married again.
For the remaining thirty years of her life, she kept the castle on her own terms, answerable to no husband, constrained by no marriage settlement. This consistent retention of Leeds Castle across three divorces was the product of a specific legal and financial structure that Olive maintained, or more precisely that the family lawyers and trustees who managed the Whitney-Payne money on her behalf maintained, from the beginning. The Whitney and Payne fortunes that reached Olive through her mother were structured largely as American trusts, arrangements that named income beneficiaries and often isolated the capital from the beneficiary’s spouse, a common feature of large American fortunes of that era, designed partly as a convenient tax vehicle and partly as a deliberate protection mechanism against fortune-seeking husbands. In England, the Married Women’s Property Act of 1882 had already established that a married woman had the right to hold property, real and personal, acquired before or during marriage, as her own, abolishing the earlier common law doctrine of coverture under which a wife’s property passed automatically to her husband.
The 1882 Act was still relatively new by the standards of the English legal system when Olive first married in 1919, which meant she was among the first generation of wealthy women to benefit fully from its protection. The Whitney-Payne trustees appear to have structured their arrangements to maximize that advantage. Contemporary legal commentary confirms that assets settled in trust for the benefit of one spouse are generally protected from division upon divorce in a way that jointly held or commingled marital property is not. That principle applied in Olive’s era and continues to apply today.
The combination meant that the money her mother and great-uncle settled on Olive remained legally hers, administered separately from any husband’s estate, supported by both American trust law and English legislation. The contrast with Consuelo Vanderbilt’s fate is instructive. Consuelo’s marriage settlement with the Duke of Marlborough granted two and a half million dollars in railway stock and a guaranteed annual income of one hundred thousand dollars under her husband’s direct control as part of the marriage contract itself. Olive’s genius, or rather the genius of the Whitney-Payne trustees, lay in keeping the castle within the protected sphere of her own property at every stage.
It was a structure noticeably different from the traditional dollar princess arrangement, in which American capital was handed over in exchange for a title. Olive received the titles, acquired the castle, and kept the money because the legal structure of her wealth had been designed in the previous generation to ensure no husband could reach it. The typical dollar princess pattern ended with the money absorbed into a European estate and the woman absorbed into a European family. Consuelo’s marriage settlement delivered the capital directly into the Duke of Marlborough’s control, and she spent a quarter century as a nominally separate duchess before her marriage was annulled.
Anna Gould’s husband, Count Boni de Castellane, spent an estimated $10 million of her family fortune on Parisian parties before she divorced him. Olive avoided both fates. She reversed the pattern entirely. The European estate was incorporated into her American fortune, and the European husbands were absorbed into her social world and then expelled from it when the marriage ended, without taking a single room with them.
No husband, government, or divorce court was able to make a claim on the castle because the legal sphere Olive’s trustees had built around her was designed to withstand exactly the pressures that had drained the fortunes of earlier dollar princesses, and it succeeded. During the 1930s, Leeds Castle became one of the greatest country houses in England and a center of lavish hospitality that mixed European royalty, Hollywood film stars, and British political insiders in combinations no other hostess of that era could achieve. The Baillies lived in London during the week and moved to Leeds for weekend parties, the classic English interwar social rhythm, powered by Olive’s American money and her Hollywood connections. The guest list was truly extraordinary and is well documented across multiple confirming sources.
Royal visitors included the Prince of Wales with Wallis Simpson, the Duke of York, Princess Marina, Queen Marie of Romania, King Alfonso XIII of Spain in exile, and Grand Duke Dmitri Pavlovich of Russia. On the political side, guests included Foreign Secretary and future Prime Minister Anthony Eden, and in a detail that later cast an uncomfortable shadow over the decade’s glamour, the German ambassador to Britain, Joachim von Ribbentrop. Ribbentrop’s presence inevitably invites comparison with the Cliveden Set, the group associated with Nancy Astor’s riverside house on the Thames, a term coined by the left-wing journalist Claud Cockburn claiming that the Astor circle formed a pro-appeasement conspiracy. Later scholarship has largely debunked that conspiratorial framework, and the discovery of the Nazi Black Book, which listed the British figures to be arrested after a successful invasion, included every alleged member of the Cliveden Set, a fact Nancy Astor herself cited as a definitive answer to that slander.
The political orientation of Leeds Castle during the same period has received far less scrutiny, and one noted history blog suggests with some caution that Adrian Baillie may have been an active element in fascist circles in the early 1930s, though this should be understood as part of the broader climate of the British upper class in that decade rather than anything unique to Leeds Castle. Olive’s close political friends included David Margesson, who later became Chief Whip in Churchill’s government and Secretary of State for War, and Geoffrey Lloyd, both of whom became lifelong friends and continued visiting her long after the war. It was the Hollywood delegation that gave Leeds Castle its unique glamour among English country houses of the period. A cinema lover herself, Olive’s guest list included Douglas Fairbanks Sr.
and Jr. , Charlie Chaplin, Errol Flynn, Fredric March, Robert Taylor, James Stewart, Gertrude Lawrence, Barbara Hutton, and author Ian Fleming. Leeds Castle Foundation promotional material explicitly names Errol Flynn, Charlie Chaplin, Douglas Fairbanks Jr. , and David Niven among regular weekend visitors.
Lady Baillie built a private cinema in the Maiden’s Tower for her guests. Adrian Baillie himself was a personal friend of Douglas Fairbanks Sr. and was involved in a car accident in Fairbanks’s own vehicle on the road from Los Angeles to Palm Springs in 1939, a detail that illustrates how deeply the Baillies were integrated into the Anglo-American entertainment world. Contemporary and later commentary compared interwar Leeds Castle to F.
Scott Fitzgerald’s The Great Gatsby, and a BBC Radio 4 program described it as the English Great Gatsby. That framework captures both the lavish spending on a dilapidated estate and the bright young things spirit that characterized the age. The Gilded Age was not destined to survive the decade, because the war itself that scattered the guest list would turn the castle into a hospital. With the outbreak of the Second World War, Leeds Castle was requisitioned for wartime medical use under a special arrangement between Lady Baillie and the British Red Cross Society, and the family moved to the rear half of the castle, known as the Gloriette, for most of the war.
Lady Baillie, who had served as a VAD nurse in 1918, donned the uniform again in 1940, this time in a ceremonial role, while her daughter Susan trained as an actual nurse on the wards. From July 1940, the Tenth Company of the Royal Army Medical Corps occupied the castle, and throughout the Battle of Britain the hospital treated air war casualties from both sides, British and German. An operating theatre was established in what is now the Green Bedroom, and one of the first patients treated there was a German pilot who had parachuted from his aircraft and needed a leg amputation. A VAD nurse named Barbara Harper later recalled that all their patients at that time were pilots, English and German alike, and the wounds they treated were fractures of limbs and burns to hands and faces, treated with gentian violet dye.
Once the Battle of Britain was decided and the immediate invasion threat receded, the hospital was evacuated of patients and reopened at a lower intensity as an officers’ convalescent facility. The castle’s most significant wartime connection was the Guinea Pig Club, a social and mutual support network founded by pioneering plastic surgeon Archibald McIndoe at Queen Victoria Hospital in East Grinstead for British and Allied aircrew who had undergone his experimental reconstructive surgery for severe burns. Susan Remington-Hobbs provided the details of that link. During the war, a large part of the castle was set aside to house pilots recovering from surgery at McIndoe’s burns unit, and the lake was drained lest its reflection attract Luftwaffe aircraft.
Leeds Castle functioned as a convalescent annex to McIndoe’s surgical program, a country house recovery environment where recuperating pilots could continue their healing under the hospitality of Lady Baillie and her two daughters, and survivors remembered the experience fondly. This distinction matters for accuracy. Leeds was the recovery site, not the surgical site, which remained principally at Queen Victoria Hospital in East Grinstead. The castle should be presented as linked to the Guinea Pig Club story through its convalescent role.
A small anecdote from the castle archive captures the transition from ballroom to ward. When the first VAD nurses arrived in June 1940, before any patients were admitted, Lady Baillie took weekend guests to visit patients she thought were in the beds, only to find instead the young nurses who had settled there, so she immediately moved them to the vaulted rooms of the stable courtyard, which had previously housed the unmarried male staff. The Guinea Pig Club was founded informally in June 1941 by McIndoe at East Grinstead, pioneering a then-radical approach to burn treatment that focused on psychological and social rehabilitation alongside surgery, encouraging patients to wear their ordinary clothes rather than convalescent uniform and fostering an informal group spirit. The local town became known as the town that doesn’t stare.
Leeds Castle’s contribution to that recovery program, by providing a country house atmosphere where burned pilots could continue healing among the medieval walls and watery grounds of one of England’s most beautiful estates, was Olivia’s distinctive contribution. The castle’s beauty was itself the therapy. The castle that had hosted Charlie Chaplin and the heir to the throne now hosted burned pilots. And the woman who paid for both was the same woman whose mother had earned the name the Angel of Summerdown for caring for wounded soldiers a generation before.
Hospitality resumed after the war on a smaller scale than in the 1930s. David Margesson and Geoffrey Lloyd remained regular visitors and lifelong friends. Royal family members continued to be entertained, including the Queen Mother and Princess Marina. And Olive’s American cousin, John Hay Whitney, who served as United States Ambassador to Great Britain from 1957 to 1961, brought a renewed diplomatic presence to the castle’s social life.
Olive continued her collaboration with Boudin on the interiors, completing plans interrupted by the war. A new dining room and library were created in 1948, a Gloriette bedroom suite for her son Gawaine, a new dressing room for herself, and the Maiden’s Tower was converted into a family home for Susan and her growing family. Her passion for exotic birds increased in these years, with a systematic aviary-building program beginning in 1957, ultimately producing a particularly distinguished collection of Australian parrots, cockatoos, and the rare blue-banded lorikeet found only in captivity. Available records suggest family relationships remained close and functional despite the unconventional marital history.
Susan lived on the same estate for the rest of her life, sharing hosting duties with her mother and later helping manage the transition to the Leeds Castle Foundation. Gawaine received a generous gift of 3,400 acres of the castle’s wider estate from his mother in 1966 before her death, though she deliberately excluded the castle building itself from any inheritance to him. That decision separated the castle’s fate from the Baillie family’s fate and ensured its transfer to the public. After Gawaine’s death in 2003, his secret stamp collection was revealed as one of the greatest collections of former British Empire stamps ever assembled.
Sotheby’s sold it across ten auctions whose combined total exceeded initial estimates by more than four million pounds. The secrecy of the collection was itself a Baillie family trait. Gawaine told almost no one about the stamps, just as his mother told no one about the legal arrangements that kept the castle in her name through three divorces. The family instinct for privacy was consistent across both generations.
And the wealth it protected was always measured by what the currency bought, never by the currency itself. Olive continued to entertain selectively into the 1960s. The appointment of her American relative John Hay Whitney as ambassador from 1957 to 1961 added a renewed diplomatic presence to the castle’s social life, connecting Leeds directly to the transatlantic Kennedy-era circles. Her health declined steadily from the 1950s onward, the result of a lifetime of heavy smoking that had been constant in every decade of her adult life.
By the early 1970s she required supplemental oxygen and a resident nurse. She assembled large collections of French and English furniture, furnishings, and paintings over four decades, connecting her to the broader Whitney family pattern of art collecting, which included her relative Gertrude Vanderbilt Whitney, founder of the Whitney Museum of American Art. Her sister Dorothy Paget, who had inherited a similar fortune, became one of the most successful racehorse owners in the history of British racing, winning the Champion Hurdle five times and the Cheltenham Gold Cup four times, proof that the Payne-Whitney money could fund obsessions of entirely different kinds across the same generation. Olive had spent fifty years restoring a castle that queens had owned for centuries, and the question she now faced was what would become of it after her death.
Olive, Lady Baillie, died in London on 9 September 1974, fifteen days before her seventy-fifth birthday. Her estate was estimated at approximately £4. 08 million. The most important decision of her later life was her explicit refusal to allow Leeds Castle to pass to the British National Trust, the traditional destination for great English country houses whose families could no longer afford them.
Instead she arranged for the castle to be administered by a charity of her own creation, the Leeds Castle Foundation, formally registered as a charity on 29 October 1974, just seven weeks after her death. The foundation’s stated purpose was the preservation of the castle, its collections, and its grounds for the benefit of the public, with a secondary purpose reflecting Olive’s interests and the castle’s wartime medical history: to provide a place for discussion and debate on medical science and a forum for the arts. Geoffrey Lloyd, Olive’s close friend since her 1930s house-party days, served as the foundation’s first chairman, and Lord Aldington served as chairman in a later period. The foundation’s mandate in medical science reflected Olive’s own wartime experience and the castle’s connection to the Guinea Pig Club.
Leeds Castle hosted international medical conferences in the decades that followed, including events linked to the discovery of the polio vaccine and developments in burn treatment. Even Olive’s generous gift, augmented by roughly £400,000 from the sale of furniture, was not enough to maintain the castle as a purely charitable legacy. The foundation quickly realized it needed commercial income. Since then, Leeds Castle has operated as both a tourist destination and a conference venue, a pragmatic commercial reality that shapes the castle’s operations to this day.
The foundation opened the gardens to the public in 1975 and the castle itself in 1976. By the 2020s it recorded annual income of around £12 million, employed more than two hundred staff, and was administered by nine trustees. Olive’s arrangement deliberately separated the castle building and its contents, bequeathed to the foundation, from the surrounding extensive lands she had given to Gawaine in 1966. This meant the Baillie family kept the land while the castle itself became public property.
It was the final and most distinctive expression of the pattern that had defined her adult life. She kept the thing she valued most under her own control, protected it from every marriage, every divorce, and every family claim that might have consumed it. And when she died, she gave it away on her own terms. The land surrounding the castle still belongs to the Baillie family to this day, meaning Olive’s arrangement created a permanent division between the public castle and the private land, a structure that has lasted half a century and shows no sign of changing.
Three husbands came and went, and the castle outlasted them all. The woman who owned it learned from the generation before her that the only wealth a woman could trust was the wealth no husband could touch. And the foundation she created in her final years ensured that the lesson she learned would protect the castle long after the last marriage, the last divorce, and the last signature on a trust deed had become nothing more than archive.
