To Binge or Not To Binge

I binge. I binge without even thinking about it. When there is a 'treat' or something calling my name, I usually can't just have one, I usually can't just have one handful...this is a problem. It's partly a matter of self control, it's also partly a matter of not allowing myself to have 'treats' - so when I fall off the wagon, so to speak, I fall hard (and eat everything I shouldn't on the way down). I binge when I'm frustrated. I binge when I'm sad or lonely. Binging makes me feel out of control, which ultimately ends up making me binge some more. Vicious. Cycle.
So how can I do better? To start I can really truly get rid of the crap in our house. The 'treats', the temptations, the junk that whispers my name every time I walk into the kitchen. I can also try other things before I go to the junky snack; like drinking a whole bottle of water before to see if maybe I was just thirsty; or eating an apple if I need a sweet fix.
My biggest hurdle to overcome will be getting my hubby on board. He SAYS he'd like to start eating better and getting rid of the junk... but the junk keeps sneaking it's way back into the cart, into the cupboard. Both of us don't like to waste, so the idea of throwing out perfectly good (junk) food, is a little hard to swallow. Slowly, but surely, the bad stuff is disappearing - but now we need to find good alternatives so that we don't feel like we're missing out, thus leading to the crap coming back in.
What are your healthy alternatives when you need a salty fix? A sweet treat? A crunchie snack?