Umbilical Hernia Baby - After birth, the umbilical cord is no longer necessary, and the opening in the abdominal muscles closes as the baby matures. Umbilical Hernia Baby / An umbilical hernia usually appears in the belly button area during the first few weeks or months of a baby's life.