bugpot

Field notes

What feedback analytics tell you about your website

4 min readThe Bugpot team

Individual bug reports tell you what broke. Feedback analytics tell you where your website breaks, which is a different and more useful sentence. One report about checkout is a bug. Nine reports about checkout in a fortnight is an architecture conversation.

The Bugpot analytics overview with report volume and resolution metrics
The analytics overview: volume, resolution, and where reports come from.

Counting bugs is not the point

A raw bug count rises when you install a feedback widget, and that is a good sign, not a bad one. Those bugs existed before; now they are visible. The number to actually watch is the trend after the first month, once the backlog of long-standing issues has been flushed out.

Where reports cluster

Group reports by page and the picture changes. Most sites discover that three or four templates generate the majority of their feedback. Group by browser and you find the Safari-only rendering bug that your team, all on Chrome, has never once seen. The clusters tell you where to spend testing effort before the next release, not after it.

Time to resolve is a team habit

Median time from report to resolved is the most honest number in the dashboard. It is hard to game and easy to feel. When it creeps up, triage is falling behind. When it drops after you connect an issue tracker, that is the integration paying for itself in a way you can show someone.

Watching a release settle

The most practical use we see: deploy on Tuesday, watch the report volume for the rest of the week. A release that settles shows a small bump then a return to baseline. A release with a problem shows the bump and then a slope. You will know by Thursday either way, which beats finding out in a client meeting the following month.

One report is a bug. Nine reports about the same page is a roadmap item.

Keep reading

More field notes

Try the tool the post is about

Install in two minutes. Solo and Studio start with a 14-day free trial.