I was in the same boat and had 1 CCP (the only CCP on site) in my HACCP plan and it actually isn't a CCP at all, it is a quality control. During the HACCP review I just kept getting no on the decision tree and the other members of the team backed me up.
I just completed BRC and they noticed the CCP was removed. They were more than happy as I was fit to justify why it wasn't a critical control point, I had flow challenges completed by all HACCP members and all relevant information was noted on the HACCP review minutes.
The auditor and his witness both said they have no right to tell me whether or not it is a CCP - if i can justify it, they cant argue it. Have your story straight and maybe back it up with industry knowledge and you wont have any issues.
ILGo to the full post