The Wanderer by Jan Irving
Doctor Jude Evans has built a safe but barren life for himself in a small western town where he pours all his passion into caring for his patients while hiding his secret yearning to love another man. Gabriel Fontenot is a drifter who is handy with a gun, prospecting for gold, and trying to forget the night the letter "O" was carved into his hip. Suffering from hard living, he is cared for by Jude, but Gabriel is aroused by Jude's gentle touch and offers to service the innocent doctor. Can Jude let himself accept the gift of passion his gunfighter wants to give him?