Thus far, CBD consumtion is not associated with an increased risk of birth defects or pregnancy complications. However, we are all born with an endocannabinoid system which evolves over time. And because we are unsure about the effects prenatal CBD exposure may have on the developing fetus, I strongly advise that you abstain.
CBD appears in the breast milk, so your baby will be getting it along with you. Although we are not aware of any particular problems this may present, we generally advise avoiding unnecessary exposures in children and this is probably one.