Those charges include second-degree arson; breaking and entering; larceny after breaking and entering, and possession of stolen goods.
The charges stem from a fire call Monday around 9 p.m. in the 300 block of Jefferson Street.
The origin of the fire appeared to be suspicious and Investigator B.L. Martin was called in to further investigate.
Martin developed Holstein as the alleged suspect and applied for arrest warrants.
He contacted law enforcement in Virginia, who located Holstein.
Holstein is being held without the opportunity for bond pending extradition back to North Carolina.
Hasty said the motive appears to be related to a domestic issue.
On Wednesday around 11:45 p.m., Lieutenant Perry Parks arrested Dana Lee High, 39, of Roanoke Rapids, on outstanding warrants for attempted first-degree arson.
The charges stem from a fire and disturbance call reported on August 20 in the 1000 block of Vance Street.
Officer Scott Blythe responded to investigate along with Parks and Master Officer Roy Ball. Investigator Frankie Griffin was assigned the case and learned the victim and High were in an argument that turned physical.
After the altercation High allegedly set a fire near the rear of the residence.
High received a $10,000 bond and an October 10 court date.