Umbilical Cord Fell Off Gooey Underneath : Even if it falls off. Umbilical Cord Fell Off Gooey Underneath - Still, you would want to look out for immediate signs of infection in your baby's belly button.