APPENDICES > Appendix A |
<< Previous | APPENDIX A: Review of Internal Overheads | Next >> | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
APPENDIX A DPRS Client Survey 2003
|
CLIENTS | NO OF RESPONSES | RESPONSE RATE |
---|---|---|
Members of Parliament |
64 |
43% |
TOTAL | 145 | 54% |
Stage 2: Follow-up interviews
DPRS clients were invited to participate in a series of follow-up interviews to elaborate on their views and to contribute their ideas about service improvements. Follow-up interviews were held with 31 Senators and Members or their staff, and 14 senior managers in Parliamentary Departments.
The purpose of these follow up interviews was to explore in more depth issues arising from the survey and suggestions for future priorities and directions for DPRS.
Stage 3: Data analysis and reporting
A comprehensive analysis was undertaken of the quantitative and qualitative data from the questionnaire and follow-up interviews.
The frequency tables for the client survey are presented as cross-tabulations across three respondent categories:
Client satisfaction was measured in the survey on a four-point scale:
DPRS measures client satisfaction in terms of proportion of clients who rate services as very good or good. This definition reflects the departments focus on services that fully meet the needs and expectations of clients, and was adopted because of the historically high levels of client satisfaction. On this scale, a rating of adequate is interpreted as an area for improvements and poor is interpreted as a sign of serious problems.
A small number of survey respondents commented that they would prefer to have responded on a five-point very good; good; neither good nor poor; poor; very poor. These views will need to be considered prior to the design of the next client survey.
2.1 Key findings
The results of the 2003 DPRS client survey highlighted the following key points:
Seamlessness was raised in terms of:
2.2 Client Satisfaction KPIs
Client satisfaction was high against all seven client satisfaction performance indicators used in the DPRS Portfolio Budget Statement 2002-2003. Overall 89% of clients were satisfied with the services of the Client Services Group (compared to 83% in 2000) and 79% were satisfied with the Technical Services Group (compared to 82% in 2000) [Table 2.1]. A detailed breakdown of all indicators is presented in Table 2.2.
Table 2.1: Summary client satisfaction performance indicators
Source: DPRS Client Survey 2003
Proportion of clients with different levels of satisfaction |
2003 KPIs data (% clients who rated DPRS services as very good or good) |
||
---|---|---|---|
Client Services Group (Hansard, Broadcasting, Client Liaison) | Very good Good Adequate Poor |
46% 44% 9% 1% |
89% |
Technical Services Group (Infrastructure, Technical Services) | Very good Good Adequate Poor |
31% 48% 17% 4% |
79% |
KPI DATA (% RATING SERVICE AS VERY GOOD OR GOOD) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% RATING SERVICE AS POOR) |
||||
---|---|---|---|---|---|
1 CLIENT SERVICES GROUP | 2003 | 2000 | 2003 | 2000 | |
Overall1 | Proportion of clients satisfied with services | 89% | 83% | 1% | 3% |
Transcription2 | Proportion of clients satisfied with services | 90% | 79% | 1% | 4% |
Broadcast production3 | Proportion of clients satisfied with services based on:
|
90% | 40% | 1% | 1% |
Client liaison4 | Proportion of clients who are satisfied with:
|
82% | 85% | 3% | 3% |
2 TECHNICAL SERVICES GROUP | |||||
Overall5 | Proportion of clients satisfied with:
|
79% | 82% | 4% | 4% |
Infrastructure6 | Proportion of clients satisfied6 with infrastructure:
|
79% | 80% | 3% | 4% |
Technical services7 | Proportion of clients who are satisfied with:
|
80% | 83% | 4% | 3% |
1: Average rating across 14 questions - Q1.1-Q1.5, Q1.7, Q2.1-Q2.5, Q5.2-Q5.4
2: Average rating across 6 questions - Q1.1-Q1.5, Q1.7
3: Average rating across 3 questions - Q2.1-Q2.5
4: Average rating across 3 questions Q5.2-Q5.4
5: Average rating across 4 questions - Q3.1, Q3.2, Q3.5 and Q3.10
6: Average rating across 2 questions - Q3.1 and Q3.2
7: Average rating across 2 questions - Q3.5 and Q3.10
PIs calculated on ratings weighted as 60% (Senators and Members); 25% (senior managers in Parliamentary Departments); and
15% (Parliamentary Officers)
In terms of the services provided by the Client Services Group, there has been an increase in the proportion of clients expressing satisfaction compared to the 2000 survey. In addition, almost half (46%) of all clients rated the services as very good and only 1% indicated that the services were poor. The improvement in perceptions of transcription services was particularly notable, with satisfaction levels increasing from 79% in 2000 to 90% in 2003 (see Section 3).
There was little change in the proportion of clients satisfied with Infrastructure and Technology services, although satisfaction was slightly lower for the availability and reliability of computer systems and the ability to resolve problems. In each case, the changes reflect a slightly higher number of clients rating the services as adequate, rather than good or very good. Issues related to computer services are explored in detail in Section 5 and 6.
2.3 Client Service Standards
Client feedback against the client service standards confirms that DPRS continues to be perceived as a highly professional, client-focussed organisation. The results of the 2003 survey compare favourably to the results of the 2000 client survey, with increased satisfaction across all standards (Figure 2.1).
Figure 2.1: Responses against the client service standards
Among survey respondents the majority agreed that:
93% of clients [97% of Senators and Members] agreed that DPRS provides professional and helpful service at a good or very good standard. All remaining clients were satisfied that the professionalism and helpfulness of DPRS services was adequate [Client Survey Q7.1]. This is similar to the 2000 survey results, where 92% of clients were fully satisfied.
93% of clients [96% of Senators and Members] agreed that DPRS responds promptly and courteously to client requests. All remaining clients were satisfied that the promptness and courteousness of service delivery was adequate [Client Survey Q7.2]. This compares favourably to 2000 results, where 87% of clients [89% of Senators and Members] were fully satisfied.
DPRS remains innovative in finding more cost-effective ways of meeting clients needs 81% of clients agreed that DPRS was innovative in finding more cost-effective ways of meeting clients needs, which is a considerable increase in the proportion of satisfied clients compared to the 2000 survey when 66% were satisfied. Moreover, the proportion of senior managers of Parliamentary Departments satisfied that DPRS is innovative in finding more cost-effective ways of meeting clients needs has more than doubled (69% compared to 31% in 2000).
80% of clients [89% of Senators and Members] agreed that DPRS services were easily accessible, including the provision of appropriate after hour support for critical business systems. This is an increase on the 2000 results, when 75% of clients [79% of Senators and Members] were fully satisfied [Client Survey Q7.3].
78% of clients [86% of Senators and Members] agreed that DPRS appreciates the time-constraints that clients are subject to. This is an improvement on the 2000 results, where 73% of clients [81% of Senators and Members] were fully satisfied. [Client Survey Q7.4].
76% of clients [84% of Senators and Members] agreed that DPRS was proactive in anticipating the needs of Senators and Members and the Parliament (with a further 14% viewing that the response of DPRS was adequate) - an increase on the 2000 survey, when 67% were satisfied. However, as in 2000, only around half (53%) of senior managers of Parliamentary Departments, were fully satisfied with this area [Client Survey Q7.5].
Clients were generally satisfied with the transcription services provided by DPRS including pink and green drafts, accuracy of transcripts and the ease of getting help relating to transcription services. Most aspects of these transcription services had client satisfaction of 90% or more, although the proportion who rated the services as very good or good was lower in regard to the timeliness of the Committee transcripts (74%) and the user-friendliness of electronic Hansard (82%).
Compared to the 2000 survey, the proportion of clients satisfied with transcription services has increased across all facets of the service (Figure 3.1, Table 3.1).
Figure 3.1 Transcription services client feedback 2000 and 2003
Table 3.1 Client satisfaction with transcription services
TIMELINESS | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Timeliness of the Pink and Green draft | 93% | 77% | 1% | 6% | |
Timeliness of electronic proof Hansard | 90% | 81% | 3% | 5% | |
Timeliness of the Committee transcripts | 74% | 67% | 4% | 9% | |
Accuracy of chamber transcripts | 97% | 83% | 0% | 0% | |
Accuracy of committee transcripts | 94% | 83% | 93% | 0% | |
User-friendliness of electronic Hansard | 82% | 67% | 93% | 11% | |
Ease of getting info, help or resolving problems | 93% | 84% | 93% | 6% |
The two key issues raised by client remain the same as the issues raised in 2000 survey - the timeliness of committee transcripts and the utility of the user interface of electronic Hansard. Other issues identified by a small number of clients include the timeliness of the pinks and greens and the electronic proof and the accuracy of transcripts.
Transcription services are highly respected with improvements in timeliness since the last survey. However there are two risk areas for DPRS - the lower satisfaction rate for timeliness of committee transcripts and the gap between the potential and actual added value of electronic Hansard (timing, formatting, functionality or utility, search-ability).
The first is a short-to-medium term issue but may have high operational cost implications. The second is a longer term issue, although more current for high-end users ('early adopters'). Inflation of expectations is common in the provision of electronic services, and it can be anticipated that the transition to electronic Hansard will need continuing attention, not just in terms of technical improvement, but also fundamental understandings of the 'value' in the service.
Clients indicated a high level of satisfaction with most of the broadcasting services provided by DPRS including radio and television coverage of parliamentary proceedings and customised broadcasting services (eg press conferences, pieces-to-air, tapes of proceedings). All aspects of these broadcasting services had a base of client satisfaction close to 100%, except the quality of audio coverage of remote Committee proceedings. (Figure 4.1, Table 4.1)
Figure 4.1 Client Satisfaction with broadcasting services
Table 4.1 Client satisfaction with broadcasting services
BROADCASTING SERVICES | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Quality of radio and TV broadcasting | 96% | 96% | 1% | 0% | |
Quality of audio and video coverage of Committee proceedings | 96% | n/a | 0% | n/a | |
Quality of audio coverage of remote Committee proceedings | 79% | n/a | 1% | n/a | |
Quality of customised broadcasting services | 94% | 89% | 0% | 1% | |
Ease of getting info, help or resolving problems | 91% | 84% | 1% | 3% |
The key issue identified by clients who responded to the survey was the quality of audio coverage of remote Committee proceedings (outside of Parliament House), with only 79% of respondents satisfied with this service. Senior departmental staff were even less satisfied (50%) (the question was not asked in the 2000 survey). In terms of the coverage, a few clients noted that some remote hearings are better suited to television than radio.
In other cases, specific incidents had undermined client confidence in the service. A small number of clients cited examples of delays in commencing hearings due to the late arrival of DPRS staff, and in another case, where broadcasting equipment was left on during a break in committee hearing. These incidents had led a small number of clients to question the reliability of the service and to express concern that some DPRS staff may not sufficiently understand their crucial role to the parliament.
Senators and Members and senior managers made several suggestions regarding broadcasting services. Several requested a permanent broadcasting facility in at least one of the small committee rooms in Parliament House and others suggested that the names of witnesses at committee hearing appear on screen more frequently, and in the chambers, the speakers name and electorate appear for the duration of the speech and the name of the Bill being discussed also appear.
Two clients requested improved access for people who are deaf or hearing impaired by including captions/teletext on broadcasts and hearing loops for remote all Committee hearings.
Other suggestions include:
With the possible exception of the issue of cost-effective coverage of committee hearings, either remote or from committee rooms without fixed facilities, broadcasting is an area of high satisfaction, with little room to improve services. As such it should not be seen as an area of high risk to DPRS, but one where the continuing importance of committees to Senators and Members is likely to maintain pressure for a seamless service. However, isolated examples of problems demonstrated how quickly client confidence can be undermined.
Clients were generally satisfied with most of the computing and information services provided by DPRS in Parliament House, expressing similar levels of satisfaction to 2002. The ease of remote and mobile access to the Parliament House computer network remained an area of lower satisfaction, and slightly lower proportions of clients rated the reliability of computer facilities and the ease of getting help or resolving computer as good or very good (Figure 5.1 and Table 5.1).
Figure 5.1 Client satisfaction with computing and information services in Parliament House
Table 5.1 Client satisfaction with computing and information services in Parliament House
COMPUTING AND INFORMATION SERVICES | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Range and quality of computing facilities | 83% | 81% | 3% | 4% | |
Reliability of computer facilities | 74% | 79% | 4% | 4% | |
Ease of remote and mobile access | 57% | 54% | 14% | 13% | |
Usefulness of information services and databases | 85% | 81% | 3% | 5% | |
Ease of getting help relating to computers and related devises | 80% | 85% | 4% | 1% | |
Ability of staff answering help desk calls to resolve problems | 83% | n/a | 1% | n/a |
COMPUTING AND INFORMATION SERVICES | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Ability of staff visiting your office to resolve problems | 88% | n/a | 2% | n/a | |
Scheduling of computer training courses | 75% | 71% | 3% | 5% | |
Relevance of computer training | 83% | 76% | 2% | 3% | |
Extent computer-related service meet need | 79% | 81% | 4% | 2% |
When the 2003 client survey was undertaken, computer services in Electorate
Offices were provided by CSC under contract to the Department of Finance and Administration.
However from July 2003, DPRS will take over responsibility for front-line computer
support in Electorate Offices.
Given this change, the 2003 Client Survey included a number of questions on Senators
and Members satisfaction with current services. While this satisfaction data
relates solely to the services provided by CSC, it was collected so as to provide
a baseline from which DPRS can monitor their performance in the future.
Data from the survey highlighted that while Senators and Members were generally satisfied with the
range and quality of computer facilities in Electorate Offices and the ease of access to the Internet
and the Parliament House network, there was significant dissatisfaction with current front-line
computer support services in Electorate Offices.
Less than half the respondents rated as good or very good the ease of getting help to resolve
Electorate Office computing problems (37%), the ability of CSC staff to resolve their problems over
the phone (45%) and the timeliness of CSC help provided (34%). Slightly more than half (55%) of
Senators and Members were satisfied with the ability of staff attending electorate offices to resolve
computing problems. Around one-quarter of Senators and Members rated these services are poor
(Table 5.2)
COMPUTING SERVICES IN ELECTORATE OFFICES |
CURRENT CSC PERFORMANCE (% rating service as very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION WITH CSC (% rating service as poor) |
---|---|---|
range and quality of computer facilities in EO | 80% | 6% |
ease of access to the Parliament House network via the desktop PC | 80% | 4% |
ease of electorate office access to emails via the Internet | 86% | 2% |
ease of getting help and resolving problems relating to using computers in electorate offices | 37% | 26% |
ability of staff answering help desk calls to resolve problems | 45% | 22% |
ability of staff attending electorate office to resolve problems | 55% | 17% |
timeliness of resolving electorate office computing problems | 34% | 27% |
Senators and Members highlighted the significant delays experienced in having computer problems resolved and equipment repaired or replaced, the poor communication and multiple handling of the problems and the lack of direct and immediate contact with specialists. There was also frustration with visiting technicians arriving without a familiarity of the particular office equipment layout, the history of support requests and a sufficient understanding of the business of electorate offices and the urgency of the support required. A key concern of Senators and Members was the seamlessness of the service to Electorate Offices and Parliament House offices, to avoid the need for multiple phone calls and arguments about support responsibilities.
While the shift to DPRS as the provider from July 2003 was widely welcomed, front-line support to electorate offices presents a reasonably high risk to DPRSs reputation because of the expectation of an Senators and Members that the service delivered in Electorate Offices will match that provided by in Parliament House. As with CSC, DPRS will also not have direct control over visiting technicians. Senators and Members indicated that they expected assistance from x2020 within 2 hours of request being made and where a site visit was required, this should occur within 24 hours.
Senators and Members identified a number of priorities for DPRS in taking on responsibility for service support in Electorate Offices, these include:
There is strong recognition of the quality of computer services provided by DPRS and relief that DPRS is taking over front-line support in Electoral Offices.
Clients are still highly sensitive to any delays in service provisions or barriers to seamlessness as evidenced by views on remote and mobile computing. More broadly, clients spoke about continuing improvements in DPRS services in terms of the capacity of the department to tailor services to their individual business requirements. Several clients identified the need for DPRS to expand its consultative approach both in terms of the introduction of new technology and systems and more broadly in terms of supporting individual clients to improve their business functions and systems. Nonetheless, the degree and style of consultation needs to continue to be increasingly tailored to the differing needs and expectations amongst clients.
The new role of DPRS in Electoral Offices is relatively high-risk as clients expectations are high. Senators and Members saw their Electoral Office as of no less importance to their business than Parliament House, and seek similar levels of understanding of their business, and similar responses to their business needs in terms of timeliness, seamlessness, and equipment functionality.
Over three-quarters (81%) of clients who responded to the survey indicated that they always or usually used the x 2020 service to get information, help or resolve problems with DPRS services with higher regular usage reported by Senators and Members (85%). The proportion of Senators and Members using the x2020 service has increased considerably since the 2000 survey when 53% indicated they used x2020 on a regular basis.
Overall, satisfaction levels were high and similar to the results in the 2000 survey. (Figure 6.1 and Table 6.1)
Figure 6.1 Client satisfaction with the x2020 service
Table 6.1 Client satisfaction with the x2020 service
X2020 SERVICES | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Professionalism of x2020 support officers | 89% | 90% | 1% | 3% | |
Kept informed about progress of request by x2020 | 76% | 82% | 5% | 2% | |
Resolution of problem in the best possible way | 83% | 83% | 2% | 5% | |
Ease of getting information, help regarding transcription services | 93% | 84% | 0% | 6% | |
Ease of getting information, help regarding broadcasting services | 91% | 84% | 1% | 3% | |
Ease of getting information, help regarding computer-related services | 80% | 85% | 4% | 1% |
In particular 89% of respondents (92% of Senators and Members) rated the professionalism and helpfulness of x2020 support officers as good or very good. In addition 83% of respondents (91% of Senators and Members) were satisfied that the outcome of their call to x2020 resolved their problem or meet their need in the best possible way.
However, a lower proportion (76%) rated DPRS as good or very good at keeping them informed about the progress of their x2020 support request, compared to 82% in 2000. In fact the proportion of respondents who rated this aspect of the x 2020 service as poor increased from 2% in 2000 to 5% in 2003. Moreover while these criticisms were only expressed by a very small number of clients, they highlight the importance placed on consistency in service delivery and tailoring services to clients specific needs.
While satisfaction with the ease of getting information and help regarding transcription and broadcasting services has increased since the 2000 survey (84% in 2000 to about 92% in 2003), satisfaction with getting information and help regarding computer services has decreased (85% in 2000 to about 80% in 2003). No issues were widely raised to explain these changes although a small number of Senators and Members cited examples where they experienced considerable frustration in attempting to get computing support via x2020 or perceived inconsistencies in the performance of x2020 in handling and resolving their problems.
Particular issues raised including the:
While these examples were isolated, they highlighted the high standard of service that clients are accustomed to, and the potential impact on client satisfaction if any problems arise.
There was a strong base of satisfaction with the other communication services provided by DPRS, including telecommunication facilities (89%), division lights and bells (98%), sound reinforcement in chambers and committee rooms (87%) and webcasting of parliamentary proceedings (85%). In each case, the proportion of clients satisfied with these services is greater than in 2000 (Figure 7.1, Table 7.1).
Figure 7.1 Client satisfaction with DPRS communication services
Table 7.1 Client satisfaction with other DPRS services
COMMUNICATION SERVICES | KPI DATA (% rating service very good or good) |
% OF CLIENTS EXPRESSING DISSATISFACTION (% rating service as poor) |
|||
---|---|---|---|---|---|
2003 | 2000 | 2003 | 2000 | ||
Adequacy of telecommunication facilities (phone, fax, pagers) | 89% | 85% | 2% | 7% | |
Coverage of the Division lights and bells | 98% | 83% | 0% | 4% | |
Quality of sound reinforcement in chambers and committee rooms | 87% | 72% | 0% | 6% | |
Availability and quality of webcasting of parliamentary proceedings | 85% | 79% | 2% | 5% |
While no major issues were raised in relation to communication services, individual clients cited a number of minor concerns:
It is important to note that concerns about the functionality and support for the new telephone system identified in the 2002 client feedback report have substantially reduced with 89% of clients reporting satisfaction with the current telecommunication facilities.