Jump to content

  • Quick Navigation
Photo

How to evaluate Internal audit effectiveness?

Share this

  • You cannot start a new topic
  • Please log in to reply
9 replies to this topic

teodymayojr

    Grade - AIFSQN

  • IFSQN Associate
  • 26 posts
  • 6 thanks
2
Neutral

  • Philippines
    Philippines
  • Gender:Male

Posted 23 July 2014 - 01:58 AM

One of our auditor raised an improvement in the evaluation of internal audit effectiveness. Actually, what we are doing is to identify if the audit cycle is complete - ex: CAR completed, forms are filled out, etc. 

 

Can someone please help how to evaluate if internal audit is effective?

 

is it a form of report? a checklist? quantifying the findings (ex: major and minor)  and comparing them against previous audit result? 

 

thanks. Will appreciate feedback. 


Edited by teody, 23 July 2014 - 02:04 AM.


trubertq

    Grade - PIFSQN

  • IFSQN Principal
  • 658 posts
  • 281 thanks
137
Excellent

  • Ireland
    Ireland
  • Gender:Female
  • Location:Donegal

Posted 23 July 2014 - 11:58 AM

I trend non-conformances annually, differentiation between documentary and implementation. Then it is compared to previous years results. This is then reviewed at the Management review Meeting.

 

I do the same with non-conformances from Hygiene audits , process audits, Complaints etc...


I'm entitled to my opinion, even a stopped clock is right twice a day

Thanked by 1 Member:

Mr. Incognito

    "Mostly Harmless"

  • IFSQN Fellow
  • 1,571 posts
  • 272 thanks
131
Excellent

  • Earth
    Earth
  • Gender:Male

Posted 23 July 2014 - 12:02 PM

Well Teody,

 

You haven't said who was auditing so all I can offer is what we do.  We were hit on internal auditing on our first FSSC 22000 audit so we adjusted our method some and it's going much better.

 

I run the internal audit program.  I created a tentative schedule based on the code sections and assigned them to a month.  Most months have 10 audits some have a few less during our winter season.  I have an internal auditor meeting every 2 - 3 months and schedule the next 2 - 3 months of audits.  Then the auditor goes out and performs the audit and returns the completed audit to the office manager.  She takes it to the next Food Safety Team meeting and we review the audit and decide if any of the discrepancies are CAPA items or non-CAPA items that need to be fixed (CAPA - Corrective Action Preventative Action - being any item of direct food safety concern).  Then we assign a due date for any deficiencies and someone responsible and we follow up every meeting on any change/correction.  Then when it's closed out we note that in our CAPA system for CAPA items or just internally for non-CAPA items.

 

We review the internal audit system at management reviews.


Edited by Mr. Incognito, 23 July 2014 - 12:03 PM.

____________________________________________________________________________________________________

Mr. Incognito


:tardis:

Mr. Incognito is a cool frood who can travel the width and breadth of the galaxy and still know where his towel is.

cazyncymru

    Grade - FIFSQN

  • Banned
  • 1,604 posts
  • 341 thanks
130
Excellent

  • Earth
    Earth
  • Gender:Male

Posted 23 July 2014 - 12:05 PM

I keep a RAG report of all non conformances, regardless of how they are raised (3rd party audit, internal audit, customer audit) and  can trend from here any recurring issues. these become my priorities for any continuous improvement projects.

 

Caz x



Thanked by 1 Member:

john.kukoly

    Grade - MIFSQN

  • IFSQN Member
  • 90 posts
  • 56 thanks
18
Good

  • Canada
    Canada
  • Gender:Male
  • Location:Canada

Posted 24 July 2014 - 12:51 PM

The best way to look at it is to ask yourself the question "why are we doing internal audits?" The answer is your KPI.

 

Be careful not to get into the trap of doing audits for the sake of doing audits, or to search for nonexistant problems to keep the NC list big; these simply look at the activity and the immediate output, but ignores the value, intent and funtionality of the exercise. Look at it as an outcome based exercise - and how does the investment in the internal audit process add value to the company?

 

Typically the inernal audit program has two key goals:

- reduce the NC's on an external audit (certification or customer)

- reduce problems (non-conforming product, downtime, customer complaints, cost, etc)

 

The first is fairly straight forward, the second you may need to work on to ensure you have a valid measure (preferably internal audits are proactive, catching potential issues rtehr than non-conformances).

 

John

 

 

 



Thanked by 1 Member:

fgjuadi

    Grade - PIFSQN

  • Banned
  • 898 posts
  • 203 thanks
28
Excellent

  • United States
    United States
  • Gender:Male

Posted 24 July 2014 - 06:28 PM

I have a column on my CAPA log that's (probably incorrectly) labeled root cause - and in this program there are three options- No program, ineffective program, and training.  But really it's my "I am gauging effectiveness" column.  If there is a program with a large amount of ineffective program items, that's the program I would focus on.  So if I had quite a few items on my CAPA log for internal auditing not being completed on time, or major NCs being missed during an internal audit, that's when the program would become ineffective and need serious attention.  

 

I'm not at an ISO factory now, so it's essentially useless, but I relied on it so heavily to determine which program to focus on that I still use it.  


.--. .- -. - ... / --- .--. - .. --- -. .- .-..

Thanked by 1 Member:

sheoran.rajnish

    Grade - Active

  • IFSQN Associate
  • 14 posts
  • 3 thanks
1
Neutral

  • India
    India

Posted 26 July 2014 - 06:29 AM

Now a days CAPA is replaced by CAR (corrective Action Report)



Tony-C

    Grade - FIFSQN

  • IFSQN Fellow
  • 4,223 posts
  • 1288 thanks
608
Excellent

  • United Kingdom
    United Kingdom
  • Gender:Male
  • Location:World
  • Interests:My main interests are sports particularly football, pool, scuba diving, skiing and ten pin bowling.

Posted 27 July 2014 - 05:03 AM

The best way to look at it is to ask yourself the question "why are we doing internal audits?" The answer is your KPI.

 

Be careful not to get into the trap of doing audits for the sake of doing audits, or to search for nonexistant problems to keep the NC list big; these simply look at the activity and the immediate output, but ignores the value, intent and funtionality of the exercise. Look at it as an outcome based exercise - and how does the investment in the internal audit process add value to the company?

 

Typically the inernal audit program has two key goals:

- reduce the NC's on an external audit (certification or customer)

- reduce problems (non-conforming product, downtime, customer complaints, cost, etc)

 

The first is fairly straight forward, the second you may need to work on to ensure you have a valid measure (preferably internal audits are proactive, catching potential issues rtehr than non-conformances).

 

John

 

Good points here John,

 

I would say that one of key goals of internal audits is to confirm compliance* which will ultimately lead to the two key goals you have identified which are certainly KPI's I would look at when assessing the effectiveness of internal audits.

 

Regards,

 

Tony

 

* Quote ISO 22000 Clause 8.4.1 Internal audit
The organization shall conduct internal audits at planned intervals to determine whether the food safety management system
a) conforms to the planned arrangements, to the food safety management system requirements established by the organization, and to the requirements of this International Standard, and
b) is effectively implemented and updated.



teodymayojr

    Grade - AIFSQN

  • IFSQN Associate
  • 26 posts
  • 6 thanks
2
Neutral

  • Philippines
    Philippines
  • Gender:Male

Posted 07 August 2014 - 07:22 AM

Thanks!

 

Good points here John,

 

I would say that one of key goals of internal audits is to confirm compliance* which will ultimately lead to the two key goals you have identified which are certainly KPI's I would look at when assessing the effectiveness of internal audits.

 

Regards,

 

Tony

 

* Quote ISO 22000 Clause 8.4.1 Internal audit
The organization shall conduct internal audits at planned intervals to determine whether the food safety management system
a) conforms to the planned arrangements, to the food safety management system requirements established by the organization, and to the requirements of this International Standard, and
b) is effectively implemented and updated.



teodymayojr

    Grade - AIFSQN

  • IFSQN Associate
  • 26 posts
  • 6 thanks
2
Neutral

  • Philippines
    Philippines
  • Gender:Male

Posted 07 August 2014 - 07:27 AM

The best way to look at it is to ask yourself the question "why are we doing internal audits?" The answer is your KPI.

 

Be careful not to get into the trap of doing audits for the sake of doing audits, or to search for nonexistant problems to keep the NC list big; these simply look at the activity and the immediate output, but ignores the value, intent and funtionality of the exercise. Look at it as an outcome based exercise - and how does the investment in the internal audit process add value to the company?

 

Typically the inernal audit program has two key goals:

- reduce the NC's on an external audit (certification or customer)

- reduce problems (non-conforming product, downtime, customer complaints, cost, etc)

 

The first is fairly straight forward, the second you may need to work on to ensure you have a valid measure (preferably internal audits are proactive, catching potential issues rtehr than non-conformances).

 

John

 

Thanks everybody for your input. 

 

It becomes clear now how to approach it, trending NCs and looking at the weaknesses to focus give an accurate overview of how effective the Internal audit is. 

 

Mr. Incognito - it is an internal audit (our team). I do the schedule and CAR monitoring and report them to Management review. 

 

Linking the trend to its effectiveness makes an excellent point - thanks trubertq. 

 

Thanks John -- 

 

We also have targets for external audits which i can see to be improving every year. 

 

However,  - "The first is fairly straight forward, the second you may need to work on to ensure you have a valid measure (preferably internal audits are proactive, catching potential issues rtehr than non-conformances)." <  :shades: 

 

thanks!





Share this


0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users