From 9th circuit
https://cdn.ca9.uscourts.gov/datastore/uploads/rules/frap.pdfSelection of Panels. The Clerk of Court sets the time and place of the calendars.
The Clerk utilizes a matrix composed of all active judges and those senior judges
who have indicated their availability. The aim is to enable each active judge to sit
with every other active and senior judge approximately the same number of times
over a two-year period and
to assign active judges an equal number of times to
each of the locations at which the Court holds hearings.
It seems judges are indeed expected to travel around so that "an equal number of times to
each of the locations at which the Court holds hearings". Namely, the location of the chamber of the judge does't really matter at all?