I definitely hear that. I think that if my job was perfect, I'd probably be freaking out about the fact that I didn't have more kids, or something else.
But I should also point out that your job is super important and meaningful! So, from my POV, it makes sense that you're not itchy there. I actually used to be an assistant principal, too, and would have happily done it forever if I'd had a better boss.