"
Now, I only pray when it all goes down
I’ll be surrounded by all of the ones I've loved and cared about
And then burn it down
He is stating he only has faith when bad goes to worst, hence if there was a bad fight, abuse etc, and the part of his family and burning it down, is like him saying he will end up by letting his family down on accident or on purpose. Also, it could mean that with his family at his side he feels like he could do anything he wants to do no matter the crime the fight, the anything. Just my opinion.