I have just (temporarily ) lost Guild Master postion. I've noticed that in my followers screen it said "selected followers 5/4". It looks like that's not automatically adjusted. I had to remove 2 followers and the re-add one of them to get that corrected.