I'm not convinced that the layman has much understanding of food labeling. My wife still struggles with comparisons and she's had me to guide her for 30 years!
The general consensus in the UK is that using E numbers to identify approved food additives is not a good idea; use the name instead. There was a lot of bad publicity about E numbers a while ago and it's now embedded into folk memory. They're almost seen as poisons and dangerous chemicals. The same is often true of artificial sweeteners (but "natural" ones are fine). It doesn't matter that they undergo a lengthy approval process, a simple campaign in a newspaper or popular website is sufficient to make them unacceptable.