The couple's official Instagram account posted three adorable shots of the new family on Wednesday. "Today the Duke and Duchess of Sussex are delighted to share their first public moment as a family," the post said.
"They are so incredibly grateful for the warm wishes and support they've received from everyone around the world, since welcoming their son two days ago."
According to NBC, the former actress went into labor early Monday morning and delivered that afternoon. The baby weighed 7.3 lbs.
Proud new father Prince Harry said, "It was amazing. As every father and parent will every say your baby is absolutely amazing… I'm just over thee moon," in his first statement after welcoming their son.
The baby's name has not yet been announced.
The new addition is Queen Elizabeth II’s eighth great-grandchild and seventh in line to the British throne; Prince Charles, Prince William, Prince George, Princess Charlotte, Prince Louis and Prince Harry are ahead of him.