Many IT departments are failing to meet their own service level agreements, according to a recent survey from Forrester.

The research, sponsored by Compuware, found that more than a quarter of IT departments with SLAs do not meet the conditions laid out in the agreement. In addition, 41 percent of respondents agreed that their insights into service levels is basic and they don't provide SLA information to executives on a regular basis. On top of that, 40 percent of those surveyed agreed that their service level reporting lacks information that executives have requested.

Forrester believes that often the business unit has expectations out of the reach of IT, and says that the reason for the mismatch in expectations in the use of SLAs is that these agreements are IT-centric and not compatible with business objectives. It found that the majority of IT departments work with IT-centric metrics like network and server availability, or number of incidents reported.

"26 percent of the time, IT are failing to meet their SLAs," said Michael Allen, European director of IT service management at Compuware. "Business expectations being too high is cited as the reason for IT not meeting expectations a quarter of the time.

"But an SLA is supposed to be an agreement reached by both parties to the same thing," he added. "So one wonders how they can say that. It is down to IT measuring the success of business objectives. Technical metrics, network and server uptime etc, which are important to businesses, are not really important to end-users."

Forrester thinks that there is still too little co-ordination and dialogue between IT and its business colleagues. "The ultimate judge of IT and business alignment is the end-user," said Jean-Pierre Garbani, vice president and principal analyst at Forrester. "If alignment is viewed as conformity to user expectations in terms of availability, performance, usability, and accuracy, then monitoring end-user performance is the only way IT knows that it is meeting these expectations."


The survey found that 87 percent of the respondents said they are using end-user experience monitoring tools for at least some business-critical applications, but in a later question, 64 percent of them admitted that they know end-user are experiencing performance or availability problems only when end-users register a complaint to the help desk.

"41 percent of respondents don't even provide reporting to executives, so how can IT remain relevant when it is not communicating to the business about service delivery?" asked Allen. "Unfortunately, IT often only finds out about problems from helpdesk calls from users, and not the system management tool."

Allen argued that IT needs to get a handle on end-user perceptive, especially as more and more companies are rolling out end-user experience policies.

"When an application is unavailable, a user may go away for hour or so, and then come back, before reporting the problem," he said. "Indeed, performance problems (such as slow network or internet connection) often go unreported."