Friends,

Locals call it America’s Most Haunted House, but the Whaley House legacy is more than a simple family home in Old Town San Diego. Before Thomas Whaley laid the foundation stones, “Yankee Jim” Robinson swung from a gallows on that very ground. The Whaley’s moved in anyway. Soon after, young Thomas Jr.’s bedroom fell silent to scarlet fever. Daughter Violet took her own life. Between bankruptcy and a fire that nearly consumed everything, visitors now whisper of footsteps in empty hallways and phantom figures glimpsed through doorways—stories that cling to the museum walls to this day.

Yankee Jim Robinson

In the summer of 1852, a tall, fair-haired Canadian known as Yankee Jim Robinson stepped foot in San Diego. The origin of his nickname remains unclear—some accounts suggest he earned it during his naval service before arriving in California in 1842, while others claim he acquired it later while searching for gold up north.

Yankee Jim’s motives for settling in San Diego remain contested. Some historians paint him as an affable fellow who, alongside two companions, simply sought new prospects in the growing coastal town. Others view his arrival more cynically—as a calculated stop on a criminal expedition that would culminate in a comfortable Mexican hideaway.

Public opinion of Yankee Jim would go from bad to worse when he attempted to steal a pilot boat docked in the San Diego Bay. Pursued by townsmen Yankee Jim escaped by stealing a rowboat and rowing himself across the bay to Point Loma. He was captured several hours later when he stopped at a ranch asking for food and water.

Hasty Trial

The county authorities wasted no time after the capture, bringing Yankee Jim and his companions to trial within days. Yankee Jim initially dismissed the proceedings as an elaborate prank meant to frighten him into contrition. How could he take it seriously? The very men who had pursued him across the bay now sat the jury box, and Judge Benjamin Hayes swayed visibly on the bench, obviously drunk during the whole proceedings.

Prosecutor James W. Robinson (no relation) opened the trial by accusing Yankee Jim of plotting to commandeer San Diego’s sole vessel for acts of piracy. Throughout the proceedings, Yankee Jim’s laughter disrupted the courtroom multiple times, requiring repeated admonishment. His amusement faded when, following brief deliberation, the jury delivered their verdict: death. Judge Hayes concurred, sentencing Yankee Jim to hang by the neck the following day.

Photo Credit: Richard Schulte. Website: Cool San Diego Sights!

On August 18th, at the future site of the Whaley House, Yankee Jim’s laughter finally ceased. The sight of the hemp noose erased any lingering belief that this was all some elaborate prank. Standing at six-foot-three, the Canadian towered over his executioners, a height that would prove fatal in the most gruesome way—the hastily constructed gallows lacked sufficient drop. For thirty agonizing minutes, his toes brushing the wagon below, Yankee Jim dangled between life and death, his breaths coming in ragged gasps until the final one escaped.

The earliest known photograph of the Whaley House, taken c. 1872. Courtesy SOHO collectionBuilding on Bloody Ground

Thomas Whaley broke ground on his ambitious residence on May 6, 1856, boasting it would surpass any dwelling within a 150-mile radius in beauty, comfort, and convenience. He personally designed the Greek Revival structure, a two-story edifice constructed from bricks manufactured at his own Conde Street brickyard. When finished, the home—adorned with mahogany and rosewood furnishings, elegant Brussels carpets, and representing an investment exceeding $10,000—earned widespread acclaim as Southern California’s premier residence, unprecedented in its refinement.

But all that glitters is not gold.

Tragedy Begins

Tragedy struck the Whaleys in the winter of 1858 when scarlet fever claimed their infant son Tommy before he reached his second birthday. Though summer brought new life with the birth of their daughter Anna Amelia within the brick walls of their home, autumn delivered yet another blow—flames, deliberately set by an unknown hand, reduced Mr. Whaley’s profitable storefront to ashes.

Grief-stricken by Tommy’s death and financially devastated by the fire, the Whaleys accepted an invitation from friends to rebuild their lives in San Francisco. Their house in Old Town remained unsold, prompting Whaley to entrust its care to his associate Squire Ensworth, who took up residence and supplemented his income by letting rooms to boarders.

Alaska Bound

The Whaley family expanded with the arrival of three more children in San Francisco: George Hay Ringgold, Violet Eloise (known as Vi), and Corinne Lillian. While serving briefly as a U.S. Army Commissary Storekeeper, Whaley’s duties took him to Sitka in Alaska Territory. There, he oversaw three government supply transports just before the American acquisition of October 18, 1867. Whaley participated in the ceremonial raising of the American flag on Japonski Island across from Sitka, and his standing in the community led to his unanimous election as a councilman.

Whaley journeyed back to San Diego, determined to persuade his family to abandon San Francisco and once again stake their future on the brick house that embodied his ambitions. His wife would not be moved.

The Show Must Go On

Desperate to find someone who would help with the financial burden of two households, Whaley crossed paths with Thomas Tanner, a showman who led the renowned Tanner Troupe of circus and vaudeville performers. By October 1868, the second floor of Whaley’s building had become home to the Tanners, with what had once been the family’s parlor and dining rooms on the western side now serving as San Diego’s first commercial theater.

The Whaley House Theater as it is today, restored in 2001. Photo by Sandé Lollis

Promising weekly entertainment for the community, the Tanner Troupe Theater raised its curtains for the first time on December 2. Patrons paid 75 cents for reserved seating or 50 cents for general admission, with children’s tickets available at half price. Following the premiere, the San Diego Union published the following review:

THE TANNER TROUPE. The performance of this troupe on last Wednesday evening, considering the circumstances, was very creditable. The house was filled to utmost capacity; which is a matter of congratulation to the manager; and all seemed pleased with this first attempt in this place, at least, at a theatrical performance. Notwithstanding the perfectly apparent indisposition of Mr. Tanner, the bronchial affliction of Miss Soledad, the rawness of the novices, the defective musical arrangements, the want of capacity in the seating room, and the smallness of the stage, we may be pardoned for saying that our theater is a success. Owing to the continued indisposition of Mr. Tanner the performance which he announced for tonight is postponed until Wednesday evening next, after which the troupe will perform nightly. –The San Diego Union, December 5, 1868.

Returning Home

The earth beneath San Francisco shuddered violently on October 21, 1868, and Anna Whaley’s resolve to stay crumbled with it. By December, she had gathered the children and boarded the steamship Orizaba bound for San Diego. The Tanner Troupe had barely established themselves, their October opening still fresh when tragedy struck. Merely a week after Anna’s return, Thomas Tanner, at fifty-six, took his final bow—found lifeless in his bed following an evening performance. With their leader gone, the troupe’s curtain fell for good in early 1869.

The Whaley family returned to the main two-story building in late 1869. Shortly thereafter, San Diego County officials transformed the old theater into meeting chambers for the Board of Supervisors. Meanwhile, the building found new purpose as the county’s second courthouse.

Whaley discovered more profit in transforming his failing general store into a drinking establishment. Writing to Anna on October 18, 1870, Thomas explained,

“I am writing this in my Saloon and as the Court is in session, I am very busy, therefore you will excuse the shortness of this. I shall do very well keeping bar when the Court sits at other times, it will not pay to keep open, and as it now is I am open only from 9 to 5. I can take in from $20 to $30 per day, half of which is profit. Better than storekeeping.”

Tragedy Strikes Again

In 1885, the house witnessed tragedy when Thomas Whaley’s 22-year-old daughter Violet ended her life within its walls. She turned her father’s .32 caliber revolver on herself after enduring months of melancholy and social disgrace. The young woman had fallen prey to George T. Bertolacci.

Weekly Los Angeles Mirror
Los Angeles, California • Sat, Aug 22, 1885 Page 4

On February 13th, Bertolacci sat at his desk and composed a letter to Violet, whom he had married just a month prior. He wrote the opening line: “When I married you, I meant to have been good.” The pages that followed revealed the lies of his family history, acknowledged the existence of a daughter born out of wedlock, admitted to encounters with a woman of questionable profession who had depleted his finances, and offered the familiar refrain that alcohol, not character, was to blame for his failings.

When her sister died, Corinne Lillian was planning her wedding. The scandal that followed proved too much for her betrothed, who returned his ring and withdrew his promises.

The End of a EraLillian Whaley, December 16, 1945- Photo Courtesy SOHO collection

After burying Violet and Corinne Lillian’s heartbreak, the Whaleys couldn’t bear to stay. They relocated to New Town, where Mr. Whaley constructed a modest single-story residence at 933 State Street. Meanwhile, their brick home in Old Town stood empty most seasons, hosting only temporary tenants who invariably departed before their leases expired, due to unexplainable noises and occurrences.

After decades of tenants and neglect, the Whaley House in Old Town stood faded and crumbling by 1909. That year, Frank Whaley—the eldest son—returned to his childhood home of weathered brick and began its painstaking revival. Living within its restored walls, he transformed the building into a living museum, hanging hand-painted signs that boasted of its historical significance. Visitors who wandered through the former courtroom, now filled with carefully arranged artifacts, often lingered into the evening as Frank’s guitar melodies drifted through the rooms his father had built.

George and Lillian returned to the Whaley homestead in Old Town, leaving their State Street residence behind to serve as a rental property. The old house claimed Anna Whaley first, taking her at eighty-one on February 24, 1913. Her eldest, Frank, followed on November 19, 1914. George’s time came on Christmas Day, 1928. Only Lillian remained, keeping company with the family home and filling notebooks with her recollections until September 14, 1953, when she too departed at eighty-nine years of age.

Hauntings at the Whaley House

Though Yankee Jim earned his place as the Whaley House’s first documented ghost, visitors have since encountered other unearthly residents. The distant cries of an infant pierce the silence without explanation, while a forlorn young woman materializes in the empty courtroom only to vanish moments later. In the parlor especially, guests often find themselves seized by an inexplicable sadness, their skin prickling with the certainty that unseen eyes follow their every move.

During guided tours, flashlights have inexplicably gone dark in visitors’ hands, while the distinct sound of wooden joints straining under invisible weight has emanated from vacant chairs. Guests with no prior medical conditions have experienced sudden vertigo and a creeping sense of dread that vanished the moment they stepped beyond the property line.

Final Thoughts

The Whaley House was a childhood sanctuary for me, a regular pilgrimage whenever my mother shepherded my sister and me through Old Town. She’d weave tales of her youth in the area, stories that shimmered with strange possibilities. Have I encountered the spirits said to haunt those historic halls? I’ll keep that between myself and those weathered walls. But I can tell you this much—I’ve never questioned the legends that draw crowds of tourists to San Diego’s most notorious residence.

RIP Whaley Family- you will never be forgotten.

Father Thomas: Died in 1888 Mother Anna: Died in 1913 Corinne Lillian: Died in 1953 Thomas Jr. Died in 1858 of scarlet fever at 18 months Violet: Died by suicide at age 22 in 1885 Francis: Died in 1914 

Until next time, Keep Reading and Stay Caffeinated.

Subscribe below to stay up to date on myths, legends, mysteries, and the chaos of history.

Subscribe

FacebookThreadsInstagramAmazonX

If you’re looking for your next favorite read, I invite you to check out my book, The Raven Society. This spellbinding historical fantasy series takes us on a heart-pounding journey through forgotten legends and distorted history. Uncover the chilling secrets of mythology and confront the horrifying truths that transformed myths into monstrous realities. How far will you go to learn the truth?

The Writer and The Librarian (Book 1):

Amazon

Barnes and Noble

Signed copies at:

https://rlgeerrobbins.com/product/the-writer-and-the-librarian-the-raven-society-book-1/

Explore more blogs here:

October 8, 2025Unveiling Skull & Bones: America’s Secret SocietyEach year, fifteen of Yale's most promising seniors receive a tap on the shoulder—an invitation to join Skull and Bones, the … October 5, 2025Unveiling the Knights Templar: Secrets of a Shadowy BrotherhoodThe Knights Templar, a powerful brotherhood formed to protect pilgrims, amassed considerable influence and wealth, leaving an enduring legacy. But do … September 14, 2025Exploring Washington’s Legendary CreaturesLurking in the shadows of Washington’s dense forests and misty coastlines is a distinction many overlook: a bestiary of legendary creatures.August 5, 2025The Haunting of Myrtles PlantationLets head to the deep south to uncover the truth behind the events that earned the Myrtle Plantation the reputation of …

Sources:

Paper Ghosts: The Ephemeral Legacy of the Thomas Whaley Family

#1 San Diego Haunted House | Whaley House Haunted Night Tour

lessonspioneerwhaleyfamily.pdf

Historic Whaley House to Hold Court for the First Time in 151 Years | Superior Court of California – County of San Diego

Historic Resources Inventory.xls

The post Exploring One Of America’s Most Haunted House: The Whaley House appeared first on Chasing History.