"
But between the drinks and subtle things
And the holes in my apologies
You know I'm trying hard to take it back
This is the singer attempting to reconcile with whomever he managed to wound, trying to do whatever he can to ensure the woman can successfully "try to forget" what happened. To put it simply, he is trying to fix a mistake that he made, and, based on the line "the holes in my apologies" he is not doing nearly as good a job as he hopes.