Only a few minor injuries to emergency personnel have been reported in what's being called the Garfield Road Fire, according to the Florida Forest Service. It has burned an estimated 696 acres near Bryceville, about 20 miles west of Jacksonville.
Officials said in a news conference Thursday the wildfire was 80% contained.
Six other homes were damaged and at least 19 sheds and other structures were severely damaged or considered a total loss, Billy Estep, director of emergency management in Nassau County, told reporters at the news conference.
Firefighters will continue to work in the area for days. Authorities will be watching strong winds predicted for the afternoon to see how they may affect the fire, Estep said.
The fire started when a man was burning paperback books, said Annaleasa Winter of the Florida Forest Service, in a briefing Wednesday night.
"It was an illegal burn," she said, adding that it's against the law to burn household garbage in Florida. "It was paper. It got away from him."
The man's intention was to burn some trash, Estep told CNN.
"(It was) purely an accident," he said.
The fire spiraled to about five acres and began spreading out of control, fueled by windy conditions, Winter said.
The man has been issued a notice of violation and will be sent a forestry bill for all the equipment and personnel used into fighting the fire, which could be several thousands of dollars, Winter said. He could be held civilly liable for any damage caused by the fire.
The fire wreaked havoc in the neighborhood, forcing residents to flee their homes as flames closed in.
One man told CNN affiliate WFOX
that he had just arrived home when his family was told to evacuate.
"By the time we were pulling stuff out of the house into the trucks, the fire was already taking out (the) gazebo, taking out the pool deck. It was already in the backyard," Randy Hoke told the station.
This is the largest and most destructive wildland fire in Nassau County since 1998.
"It's been a long time since we've had an intense fire through the area," Winter said.
Raging wildfires across Florida in 1998 -- including in Nassau County -- caused one of largest wildfires losses in the United States
, estimated today at nearly $600 million.
Authorities are asking residents to comply with burn restrictions because a longer than normal fire season is anticipated across Florida, Texas and Oklahoma as warmer weather and drought lingers, according to the National Interagency Fire Center.
Correction: An earlier version of this article incorrectly described the extent of the damage. Authorities initially said 10 structures were destroyed.