Gerrymandering and decade redistricting would make this a doozy.
Yeah, it would only work if districts were drawn with COIs heavily in mind. Smaller states would be easier to name, as redistricting doesn't completely change the map and even district numbers (here's looking at you California) every ten years. One easy district name that came to mind is Nancy Pelosi's 12th district in California since it's wholly in the City of San Francisco and covers all of it except Southwest corner of the city.