Police said the gunman began shooting inside the church shortly before 2 p.m. and briefly held 25 to 50 hostages, until police officers entered the church and took him into custody, according to CNN.

Dave McCracken, Neosho police chief, said the number of confirmed wounded persons is four to five, but several others who were also injured fled the scene during the attack.

Some injured people were taken to hospital.

The shooting happened during an afternoon service held in the Spanish language, and approximately 50 people were in the church when it happened.

The suspect, whose identity had not been released by authorities, is in custody in a local jail.

Charges against him may not be filed until Monday morning.

McCracken said the gunman surrendered within "five to 10 minutes" after policemen entered the church.

The gunman had two small caliber handguns, and one 9 mm semi-automatic pistol with a large magazine.

McCracken said he can not confirm if the gunman was a member of the church or if he is of Hispanic descendant, but a Neosho city official said he is related to someone inside the church at the time.