Chapter 3

Australian Crime Commission performance measurement

3.1        This chapter considers the performance of the Australian Crime Commission (ACC) against the outcomes found in the Attorney-General's Department Portfolio Budget Statement (PBS) and the ACC's key performance indicators (KPIs). It examines the measurement tools utilised to inform the KPIs and to track performance over time. The committee notes that 2015–16 marks the third year of reporting against the current KPIs.

Portfolio Budget Statement

3.2        The ACC is required, by the PBS, to contribute to outcomes that are intended results, impacts or consequences of actions by the Commonwealth government:

Commonwealth programmes are the primary vehicle by which government entities achieve the intended results of their outcome statements. Entities are required to identify the programmes that contribute to government outcomes over the budget and forward years.[1]

Outcome 1

3.3        The ACC is required to reduce:

Reduced serious and organised crime threats of most harm to Australians and the national interest including through providing the ability to discover, understand and respond to such threats.[2]

3.4        The PBS describes the ACC's approach to achieving this outcome:

The ACC’s strategic approach of discovering new and emerging threats, understanding them more deeply, and initiating preventative or disruptive responses with partners, will direct the allocation of resources and ACC capabilities to the serious and organised crime threats of most harm to Australians and the national interest. Core elements of this strategy include providing national strategic advice on serious and organised crime threats and coordinating and participating in national responses with partners. A highly developed understanding of the threats posed by serious and organised crime will underpin the ACC’s provision of specialised criminal intelligence capabilities including special coercive powers and will focus response strategies on targets that pose the highest risk to Australians. The ACC will specifically focus on two core areas—building capability and working with partners—to deliver its outcomes and guide internal strategy development.[3]

Key performance indicators

3.5        As noted earlier, this is the third year that the ACC has reported against the current KPIs. As noted in the annual report, the ACC:

...will continue to develop [its] ability to capture and report on [its] performance in both qualitative and quantitative terms and to build relevant comparisons over the coming years.[4]

3.6        The KPIs align with the performance framework outlined in the ACC's Strategic Plan 2013–18.[5]

3.7        The ACC has provided data from the two previous reporting periods for all KPIs in the 2015–16 annual report.[6] The information in the annual report is presented by reference to analysis and results of qualitative and quantitative achievements.  

3.8        The committee has not reproduced all of the measures within each KPI, but has selected notable highlights that are demonstrative of the ACC's work and effectiveness against each KPI.

KPI 1—Producing useful intelligence that identifies and provides insights on new and emerging serious and organised crime threats

3.9        The ACC worked towards this KPI through numerous achievements, including:

3.10      The annual report notes that 85 per cent of stakeholders agreed or strongly agreed that the ACC achieved this KPI.[8] This is a three per cent reduction from the last reporting period (88 per cent).[9]

KPI 2—Fills intelligence gaps through the identification of vulnerabilities and indicators of serious and organised crime

3.11      The ACC worked towards this KPI through, for example:

3.12      The annual report notes that 76 per cent of the ACC's stakeholder survey respondents agreed or strongly agreed that the ACC achieved this KPI, a two per cent decrease from the result in 2014–15 (78 per cent).[12]

KPI 3—Collects and maintains national holdings of serious and organised crime threats and targets

3.13      The work of the ACC towards this KPI included:

3.14      The annual report notes that 90 per cent of respondents to the ACC's stakeholder survey agreed or strongly agreed that the ACC met this KPI, a decline of one per cent from the result in 2014–15 (91 per cent).[14]

KPI 4—Interprets and analyses national holdings to create a national serious and organised crime intelligence picture

3.15      The ACC worked towards this KPI through its production of numerous publications, including the Organised Crime Threat Assessment, Illicit Drug Data Report and the Precursor Chemicals Information Resource 2016. The ACC also:

3.16      The annual report notes that 79 per cent of the ACC's stakeholders agreed or strongly agreed that the ACC had achieved KPI 4, a decrease from 88 per cent in 2014–15.[16] The annual report notes that the ACC 'will be exploring the decline in performance against this KPI during the coming year' and in its next stakeholder survey.[17]

KPI 5—Informs and influences the hardening of the environment against serious and organised crime

3.17      The ACC worked towards this KPI through, for example:

3.18      The annual report notes that 66 per cent of stakeholders surveyed agreed or strongly agreed that the ACC had achieved KPI 5, a decrease from 78 per cent in 2014–15.[19] The annual report notes that the ACC will also explore this decline in performance during the coming year and in its next stakeholder survey.[20]

KPI 6—Influences or enables the disruption, disabling or dismantling of serious and organised crime

3.19      The ACC worked towards this KPI though, for example:

3.20      The annual report notes that 76 per cent of respondents to the ACC's survey agreed or strongly agreed that the ACC had achieved KPI 6, a decline of seven per cent from 2014–15 (83 per cent).[22] The annual report notes that '[t]he reasons behind this decline in stakeholder perception are not clear and will be further explored during the coming year and in next year’s stakeholder survey'.[23]

KPI 7—Participates in or coordinates collaboration in joint operations and investigations to prevent and disrupt serious and organised crime

3.21      The ACC worked towards this KPI through its leadership or participation in a variety of joint operations and investigations, including:

3.22      The annual report notes that 83 per cent of respondents to the stakeholder survey agreed or strongly agreed that the ACC had met KPI 7, a decrease of two per cent from 2014–15 (85 per cent).[25]

Analysis of results

3.23      As noted in paragraph 3.7, the ACC possesses data to compare its performance scorecard between each reporting period. An analysis provides a review of its qualitative and quantitative results, and an overall summary of the ACC's performance for each KPI. In the results and analysis of all KPIs, the ACC has included other comparable quantitative results. Data is primarily from the last two reporting periods; however, in some cases the ACC has included data from 2012–13.[26]

3.24      The ACC provides commentary on the both the qualitative and quantitative results for the 2015–16 KPIs. As in the 2014–15 annual report, these comments include the expansion of existing activities and new performance measures.

Stakeholder survey responses

3.25      All comparable quantitative results for each KPI are inclusive of the ACC's stakeholder survey responses. All reported results from this survey are lower than the 2014–15 reporting period. Where the decline is marginal, the annual report comments that the overall results are 'solid', 'strong' or 'very strong'. The annual report notes that the more significant declines against KPIs 4, 5 and 6 will be further explored during the coming year and in next year’s stakeholder survey.

Committee view

3.26      As in the 2014–15 annual report, the 2015–16 annual report shows a significant shift from primarily focusing on qualitative data to include quantitative KPIs. This change has addressed the committee's concern and commentary that previous reports lacked quantitative KPIs. The committee congratulates the ACC for continuing with this form of reporting.

3.27      The committee continues to acknowledge the ongoing complexity of the new qualitative KPIs the ACC has developed, and acknowledges that some of the ACC's work remains unquantifiable.

3.28      The committee notes that the ACC's stakeholder survey indicates that generally the ACC has maintained a high level of satisfaction, despite all results being slightly lower in this reporting period than in the previous two reporting periods. The committee acknowledges the ACC's commitment to explore the more significant decline in results in respect of KPIs 4, 5 and 6, and looks forward to the analysis and conclusions in the ACC's next annual report.

Navigation: Previous Page | Contents | Next Page