You might try painters’ tape for labeling. It’s pretty easy to write on and peels off without residue. It commonly comes in blue (3M or generic) or green (FrogTape). You could also try dry-erase markers to write on the glass — but those can erase/smudge if you touch what you wrote (like on a white-board, which is what they’re for)