Poor testing blamed for buggy software

A software maker and a software analyst agree – application vendors are saddling users with bug-ridden products in order to get to market faster.

Dennis Gaughan, research director at AMR Research in Boston and author of a recent report, For Software Vendors, Quality Is Job 1000, said in the rush to compete, new software releases go out the door with little thought to thorough testing for quality and compatibility. Gaughan said the evidence for this report came directly from frustrated end users.

“One of the themes just kept coming back, the fact the general available software is always so buggy and there are just so many issues relating to maintaining software,” he said.

According to the report, because enterprise customers depend on a single software vendor to provide the functionality to achieve business goals, they are left with an unreasonable burden of integration.

Gaughan said the main problems include vendors releasing bug-ridden software as production-ready, the constant need for patches to correct coding problems, missing commitment dates for new releases and poor customer support. He added that this frustration is seen “right across the board.”

“The point of the piece wasn’t to single out vendors, but it is a frustration that end users are dealing with. When we talked about some of the biggest challenges that people face, quality of software kept coming back as a recurring theme.”

John Fisher, president of Borland Canada, a Markham, Ont.-based packaged software maker, said he agrees with a number of Gaughan’s points.

“From a general perspective, exclusive of Borland, I think there is a lot of truth in what he has to say,” Fisher said. “A lot of companies have been bringing products to market that haven’t necessarily been fully bug tested, where the gold master was cut Thursday and brought to manufacturers on Friday.”

Fisher said the problem often stems from companies that don’t produce products frequently and end up calling a new product an upgrade.

Alister Sutherland, software director at IDC Canada, said software readiness has actually improved over the past years, not degraded. What’s more, he added, it would be competitive “suicide” for companies to release buggy software that isn’t market-ready.

“There is no such thing as perfect code,” he said. “Software will always be subject to faults and some of those faults can’t be identified until it is out there in the field.”

Sutherland said it would be expensive and a poor business decision to bring software developments back in-house, as Gaughan suggests, because “you end up siloed off from the rest of the world.”