An edifice or five

Temples & Tuk-Tuks by Lydia Laube
Rumpole and the Penge Bungalow Murders by John Mortimer
The White Palazzo by Ellen Cooney
The Caliph's House by Tahir Shah
The Wicked Pavilion by Dawn Powell

About the house by W.H. Auden
Blandings Castle, and elsewhere by P.G. Wodehouse
Gaudí Afternoon by Barbara Wilson (architect...)
Anthills of the Savannah by Chinua Achebe (...no-one said anything about human edifices)
Northanger Abbey by Jane Austen

...nice subject choice -- something we can all have fun with out of our own libraries!

Hmm, let's see if I can do this without resort to books on architecture:

The Castle of Crossed Destinies, by Italo Calvino
The House of Paper, by Carlos María Domínguez
Nightmare Abbey, and Crotchet Castle, by Thomas Love Peacock
Palace of Varieties, by Julian Critchley
Letters from the Palazzo Barbaro, by Henry James, et al.

Well this will be a first try for me soo...

House of Sand and Fog by Andre Dubus III
The Dragon King's Palace by Laura Joh Rowland
The Glass Castle by Jeannette Walls
The Church of Dead Girls by Stephen Dobyns
The Acid House by Irvine Welsh

bleak house by charles dickens
house of chains by steven erikson
deadhouse gates by steven erikson
temple of the winds by terry goodkind
castle by garth nix

Sounion: The Temple of Poseidon by A. B. Tataki
Amboise Castle by Jacqueline Melet-Sanson
Ghosts of the Tower of London by Geoffrey Abbott
Battle Abbey: An Illustrated Historical Sketch by Sir Harold Brakspear
Chartres Cathedral - The Medieval Stained Glass and Sculpture by Malcolm Miller

The Far Pavilions by M.M. Kaye
Sleeping at the Starlite Motel by Bailey White
Folly by Laurie R. King
Pilgrim's Inn by Elizabeth Goudge
I Capture the Castle by Dodie Smith

The Castle of Otranto by Horace Walpole
The Glass Menagerie by Tennessee Williams
No 10 Rillington Place by Ludovic Kennedy
A House for Mr Biswas by V S Naipaul
Barchester Towers by Anthony Trollope

Story House
Palace of Desire
Fortress of Solitude
The Birth House
The Mill on the Floss

The Interior Castle
Castle Richmond
The Inn at the Edge of the World
Mr. Blandings Builds His Dream House
The Professor's House by Willa Cather

Making Great Gingerbread Houses: Delicious Designs from Cabins to Castles, from Lighthouses to Tree Houses by Aaron Morgan and Paige Gilchrist
A Plague on Both Your Houses by Susanna Gregory
The Haunted Hotel by Wilkie Collins
The Temple of Dawn by Yukio Mishima
The Towers of Trebizond by Rose Macaulay

Mr. Blandings Builds His Dream House by Eric Hodgins
King Solomon's Mines by H.Rider Haggard
The Lady Chapel by Candace M. Robb
The London Ritz Book of Christmas by Jennie Reekie
Man Eater's Motel by Denis Boyles

Pomfret Towers by Angela Thirkell
The Haunting of Hill House by Shirley Jackson
The Small House at Allington by Anthony Trollope
The Villa by Nora Roberts
The House Without the Door by Elizabeth Daly

The Haunting of Hill House by Shirley Jackson
The King of the Castle by Jean Plaidy
Mansions of Darkness by Chelsea Quinn Yarbro
The Lunatic Cafe by Laurell K. Hamilton
The Shelters of Stone by Jean M. Auel

The Citadel of the Autarch and The Castle of the Otter by Gene Wolfe
The General in His Labyrinth by Gabriel Garcia Marquez
The Castle of Llyr by Lylod Alexander
Cohousing by Kathryn McCamant, et al.
Harry Potter and the Chamber of Secrets by J. K. Rowling
The Tenant of Wildfell Hall by Anne Bronte
The Tombs of Atuan by Ursula K. LeGuin
The Two Towers by J. R. R. Tolkien

Masada by Ernest Kellog Gann

The Castle of Contentment - Letters from a Jutland Farm by Gunnar Nislev (Jaegernester Plov)

Justice Hall by Laurie R. King

The Bronski House by Philip Marsden

The House at Old Vine by Norah Lofts

Armed Madhouse - Greg Palast
Set This House On Fire - William Styron
Upstairs At The Crazy House - Pat Capponi
House On The Lagoon - Rosario Ferre
Blow The House Down - Robert Baer

Digital Fortress - Dan Brown
Green Mansions - W.H. Hudson
Who Will Run The Frog Hospital? - Lorrie Moore
Theatre Of Fish: Travels Through Newfoundland - J. Gimlette
House Divided - Ben Ames Williams
The Temple Of The Jaguar: Travels In The Yucatan - D. Schueler

House of Niccolo - Dorothy Dunnett
Jalna - Mazo de la Roche
The Cider House Rules - John Irving
To The Lighthouse - Virginia Woolf
The Looming Tower: Al Queda & The Road To 9/11 - Lawrence Wright

House Of Bush, House Of Saud - Craig Unger
The Spider's House - Paul Bowles
The Real Animal House - Chris Miller
Behind The Embassy Door - James Blanchard
Asylum - Patrick McGrath

The Hacienda - Lisa St. Aubin de Teran
Letters From The Hive - Stephen Buchmann
A House In Sicily - Daphne Phelps
A House Somewhere - D. George and A. Sattin
The Palace Thief - Ethan Canin

Anne of Green Gables by L.M. Montgomery
The House of the Seven Gables by Nathaniel Hawthorne
The Fall of the House of Usher by Edgar Allen Poe
A Room of One's Own by Virginia Woolf
A Wind in the Door by Madeliene L'Engle

Noble House by James Clavell
Hotel Paradise by Martha Grimes
Cathedral by Nelson DeMille
Behind the Scenes at the Museum by Kate Atkinson
The Cursed Towers by Kate Forsyth

A Good House by Bonnie Burnard
The Birth House by Ami McKay
The Blue Castle by L.M. Montgomery
House of Five Talents by Louis Auchincloss
House of Sand and Fog by Andre Dubus III

Mr. Pine's Purple House by Leonard P. Kessler
The House on the Borderland by William Hope Hodgson
Castle Perilous by John DeChancie
Castle Roogna by Piers Anthony
Black House by stephen King and Peter Straub