Can Levothyroxin cause you to be jittery after 4 days?

I started out on 100 mcg and it was giving me panic attacks so my doctor is working me up from 25 mcg. Everyday since I have been on this I have been jittery and feel horrible. I dont drink caffiene or take any other meds so I dont know what else could be causing this. My doctor doesnt seem think its anything. Is this normal the first few days? what do I do?