As a Liberian man diagnosed with Ebola was fighting to survive Sunday in a Texas hospital, his worried family members and others who were in contact with him said they are being ostracized by the local Liberian community, which is struggling to cope with fear, isolation and the stigma associated with the deadly disease.

Thomas Eric Duncan, who traveled to Dallas from Liberia more than a week ago after coming in contact with Ebola in the West African country, was in critical condition in an isolated hospital ward and “fighting for his life,” Tom Frieden, director of the U.S. Centers for Disease Control and Prevention, said Sunday. “We understand that his situation has taken a turn for the worse,” he said.