Smoking, like any addiction, controls your life.
I was that way with sugar. When I gave up almost all of it, my kids said that I was cranky for weeks. For a while, I felt like I was starving some nights. I still have to be careful to limit quantities.
After limiting or stopping any addiction, cravings may come and go for the rest of your life, creating additional anxiety.
The real question: Can you control it or does it control you. How many actions are driven by the addiction?
Everything else is secondary.