The wonderful thing about much of EU food regulation is that it isn't prescriptive, and so it rarely says "though shalt do x".
The more challenging thing about much of EU food regulation is that it isn't prescriptive, and so it rarely says "though shalt do x".
Regulation (EC) 1881/2006 does indeed not say that testing shall occur, or define a frequency at which it should occur, but your supplier's position raises an obvious question, and it is one that is fitting given the overall ethos of the approach taken in much of the EU food regulation - the onus is on the food business operator to show that they're making safe compliant product (as opposed to an approach of saying "do x and we will then consider the product safe for regulatory purposes"). I'd assume you've already asked as much, but if not then the query I'd be putting to your supplier is: if they aren't doing any sort of analysis, how do they know if their product actually complies with the contaminants limits that apply for the EU market?
The micro one is perhaps more subtle, but I still disagree with your supplier 
The argument about the raw chicken is reasonable until one looks at it more closely. For example, it should be noted that:
1) A subsequent mandatory cooking step does not give carte-blanche for unlimited microbiological growth to be present in a raw material. Consider e.g. the potential for toxin formation in some cases, but also the chicken example itself seems moderately pertinent, given the recent significant FSA interest in Campylobacter on raw chicken...
2) I can't really imagine anyone eating raw chicken (notwithstanding the occasional case of people thinking that chicken cooked "rare" is an undiscovered delicacy...), whereas it is fairly foreseeable that consumers may use spices/herbs in applications that do not have a subsequent cook step. The spice/herb may still be a "raw material", but there is little way to know that consumers won't use it in a way that they and others would seem reasonable, whilst not actually cooking it. I did notice a bit of discussion on this in the HPA's Guidelines for Assessing the Microbiological Safety of Ready-to-Eat Foods Placed on the Market: https://assets.publi..._the_market.pdf
3) Irrespective of what happens with the herbs/spices at the consumer level, if a food business is using them as a raw material then they might reasonably want to understand the micro levels of their raw materials as it may have an impact on their own handling/processing requirements.
Honestly your supplier sounds like they'd be best avoided if possible...