@chinmay.eth
I struggle with the same -- especially lower back chair.
2 weeks ago, I got kneeling chair on a friend's recommendation, so far, it has been great.
Try with the cheapest one to try it out first. If it works for you, you can buy an expensive one.