If I was writing something formal, I would just call them the Roman Empire, or Eastern Roman Empire if I really need to be specific. Although to be fair, I usually just call them the Byzantine Empire because it's what everyone else calls them.
Why would it be the Eastern Roman Empire when it didn't even include Rome?
Rome (the city) stopped being the most important city in the Roman Empire long before it split up.
I would say Eastern Roman Empire until 635. Didn't Latin stop being a linga fraca then? Byzantine was a name made up after the fact by a 100 years. So I guess I would just have considered them the Greek Empire after Heraclius.
They spoke Greek, but they did not identify themselves as "Greek" so calling them that is just as ahistorical as Byzantine.