It's true and it's like the retailers can't back away from it because of not being able to trust the auditors or suppliers but ultimately trust is about risk assessment and lack of trust costs money. Perhaps there could be a system, like BRC or any of the GFSI schemes but in several tiers. Then to supply one retailer you may only need tier 1 but to supply some of the more picky ones you need tier 3 or something?
Dear GMO,
even more 
I agree with yr comment but I would take it one step further.
I think a fundamental problem is that many "knowledgeable" buyers don't trust the (audited) "risk assessments" which they see placed in front of them. Others are technically incapable/lack time for understanding the information given so have to repeat it anyway, and possibly in some cases simply don't care also, just another piece of paper for the file. The latter may be the ones who don't bug for their own audits ? 
As an example, we get so many queries here on when should a PRP replace a CCP or vice-versa. The trite replies are, for example, by risk assessment, risk matrix, Codex tree, or an OPRP but in truth these are all avoidances of the real issue since there is no standard reference point to "GO or NOT TO GO". The ever-lengthening lists of self-designatable PRPs can also (intentionally?) promote burying what may be genuine FS deficiencies within a morass of PRP waffle. The true (risk) answer IMO minimally includes an appreciation/analysis of the continuing day-to-day data/incidents generated within a facility regarding its hygiene/process which the FS standard hopefully offers ie an audit. Anything else is ultimately guesswork/generic based on some respectable reference(s).
As far as the audit goes, based on my own experiences, it is unfortunately simply unrealistic to expect that the average auditor will possess extensive capabilities in the subtleties of practical Food Safety for the massive range of products they are obliged to encounter. The problem becomes even more acute for non-simple processes/ FS sensitive products.
Such factors are maybe what makes the "genuine" buyers uneasy and feel obliged to further persevere. They need the certification evidence for their diligence" but their (bitter) experience has shown it is not reliable. Between a rock and ......
Rgds / Charles.C
