It would appear the story I was thinking of is "Sunday Dinner in Brooklyn." I wonder where I read it: I seem to remember a paperback. My parents had a lot of old copies of Partisan Review and suchlike lying around the house; maybe that's where I came across it.