As he's talking with Dr. Wilson around seven minutes into the episode, House mentions a "guitar player from an English band," revealing it as being Pink Floyd. That is a reference to Syd Barrett, a former guitar player who left the band in 1968 due to his deteriorating mental condition after struggling with LSD and mental health problems.
The poem book read by Lucas Palmeiro, House, and Lucas's mother, is "The Wild Swans at Coole," written by William Butler Yeats in 1917.
Hugh Laurie has an English accent, as he is from Oxford, England. In "The Socratic Method," there is a moment where House pretends to have an English accent while on the phone. Hugh Laurie was able to use his accent (or an accent close to his own) for this moment.
At the end of this episode, we see that Dr. House's birth date is 11 June 1959, the same as Hugh Laurie. However, we could disregard this date as revealed during House's hallucination. The season one episode, 'The Socratic Method,' made several references to House's birth date in the winter.
During the differential (at approx 17 minutes), Chase sarcastically says "Why not scurvy or the plague." Both of these conditions will be the correct diagnosis in future episodes.