I know Tylenol is safe to take during pregnancy right?

Your ob/gyn should have given you a list of safe medicines. I kept my list with me religiously. Tylenol is safe, however it probably will not help as much, you should call your ob/gyn and explain that you suffer migraines (I also have migraines) and you can not take your normal meds...most likely he or she will write you a new prescription for something more effective, that will not harm your baby.