Nah, most of humanity at least is either living idyllic lives, or chose to live on a frontier world or research station or something. Starfleet’s just the exploratory arm of the Federation; but that’s where most of the fun stories are!