At the end of the day, you will put in and get out of yoga what you want. You can follow a more spiritual path or not. You can make yoga a part of your religious or spiritual practice or not. You can simply do the asanas and nothing more, or take yoga off the mat and integrate the elements of the practice into your daily life. The choice is yours and yours alone, which is the beauty of yoga! No one, least of all you, should judge you for how you practice yoga.