I assume you are talking about the Foria suppository for menstrual cramps, called Relief, as that is the only one I am aware of. If not, disregard the rest of this post. You can absolutely continue however you can also use it as a rectal suppository. Suppositories taken rectally absorb more quickly and have a slightly higher uptake.
I am not a doctor and this represents my personal opinion, research and experience. I hope this helps!