they check for things like alcohol abuse, drug habits, sexual behavior, debt, gang affiliations, and any other dark secrets that could make you susceptible to bribery or blackmail

Yes. When I was interviewed by the FBI, because a friend of mine was seeking a clearance, this kind of thing was all they wanted to talk about. That was a couple decades ago, though.