How We Assess Boilers
By Matthew Knight
Here you can find out more about how Which? assesses boiler brands to reveal Best Buy boilers that we recommend.
Most people want to buy a new boiler that will give them years of reliable service and that they'd be happy to recommend to a friend. They may also want to know whether their boiler has the respect of the experts who work with boilers every single day.
Only boilers that have a good reliability record, are loved by their owners and are highly regarded by Which? Trusted Trader-endorsed heating engineers are given our Best Buy recommendation.
Below we explain in detail how we rate and review boilers.
If you just want to find out which models are best, head straight to our Best Buy boilers.
How does Which? rate and review boiler brands?
To help you choose a boiler, we get the lowdown on popular boiler brands by asking thousands of boiler owners – all Which? members - about their experiences. We run this independent customer survey every year.
Our most recent survey of boiler brands was carried out in May 2016. We surveyed 10,779 Which? members in total, all of whom had installed a gas or oil boiler within the previous six and a half years. We analysed their responses to give each of the main boiler brands an overall customer score and a brand reliability score.
Which? boiler brand reliability score
We asked Which? members about their brand of gas or oil condensing boiler, and to tell us the faults they'd experienced and whether they had ever had a repair.
The Which? reliability score is based on the proportion of boilers that have had repairs, adjusted by age to ensure that all brands are compared on an equal basis. We need at least 30 responses per brand to calculate a reliability score.
Our results cover all of the major boiler brands. Only those with less than 2% market share are too small to be included.
The reliability scores include the brands of gas boilers owned by 90% of Which? members and two thirds of the oil boilers owned by our members. We cover all of the major brands. Only brands with less than 2% of market share are too small to be included in our reliability survey.
Which? boiler brands customer scoreWe also asked members to assess how satisfied they were, and how likely they would be to recommend their brand of gas or oil boiler (regardless of their experience of getting the boiler installed). These two questions form the basis of the Which? customer score, which is included in our boiler reviews.
Heating engineers' views on boiler brands
We collected the views of 179 Which? Trusted Trader heating engineers (April 16) about the boilers brands that are available in the UK.
Which? Trusted Trader heating engineers have all been through a rigorous vetting procedure to prove their expertise and the quality of their work before they qualify for Trusted Trader status.
We ask these heating engineers whether they would recommend each brand of boiler, what the build quality is like, how easy it is to fix a common fault (replacing a domestic hot water heat exchanger) and how easy it is to get hold of parts and spares.
This enables us to give you a unique insight into the reputation of each boiler brand amongst heating engineers, and to find out whether you're likely to get hit with a higher repair bill.
Why doesn't Which? test boilers?
We no longer test individual boilers for the following reasons:
Boiler efficiency is tightly controlled
Improving the energy efficiency of the UK's homes is a major target for the government, and it has imposed strict regulations on the energy efficiency of new boilers. New boilers must be 88% or more efficient to comply with Building Regulations.
But there's a limit to how efficient a gas or oil boiler can be, giving most people little choice between the most and least efficient boiler. Efficiencies typically range from 88.3% to 92% across all gas combination boilers. This range is so narrow that you wouldn't expect to see a difference in your gas or oil consumption if you were to choose the most over the least efficient boiler.
Claimed efficiencies for new boilers are generally accurate
Our previous tests of boilers showed that the efficiency claims made by manufacturers, which are tested by an independent lab according to a strict standard protocol, are generally accurate (within the limits of the testing method).
Feedback from you
Feedback from Which? members shows that what you really want to know is whether a boiler is reliable and which brands to consider.
Boiler efficiency depends on your central heating system
A boiler is an unusual product; unlike other home appliances, its performance is not entirely dictated by the product itself - it's heavily influenced by the heating system that you connect it to. So if the system is poorly designed or has inadequate controls, the boiler will not work effectively.
Every home should be individually assessed for its heat and hot water requirements. The type of performance tests that we could conduct in a lab would not give us the answer to the main question that you want answered: 'Which is the best boiler for my home?'.
However, all of our boiler reviews contain the full specification, any customer views and our own expert analysis to help you find the best boiler for your home.