Only 2-way coverage graphs?

  • 1
  • Question
  • Updated 3 years ago
I love the matrix graph. But I don't see this chart for anything except 2-way coverage reports for my pairwise tests. Should the matrix coverage graph also be showing up for 3-way and other strengths?
Photo of Matt Dengler

Matt Dengler

  • 10 Posts
  • 0 Reply Likes

Posted 3 years ago

  • 1
Photo of Sean Johnson

Sean Johnson, CTO

  • 270 Posts
  • 26 Reply Likes

I'm glad you like it. It is a pretty neat feature! We like it a lot.

Unfortunately a matrix is an inherently 2-dimensional representation. To handle 3-way tests it'd need to be in 3D. That's more ambitious than we've wanted to tackle. And to handle 4-way (and up) tests it'd require 4+ dimensions and alien intelligence and vision to perceive additional dimensions.

We could of course show the 2-way coverage achieved with 3-way+ tests using the matrix, but we've chosen not to do that as we think it'd be more misleading than helpful, since if you are generating 3-way tests, presumably it's because you care about 3-way tuple coverage.

FYI, there are coverage graphs for all strengths, just not matrix graphs.

Photo of Justin Hunter, Hexawise Founder

Justin Hunter, Hexawise Founder, Founder and CEO

  • 246 Posts
  • 15 Reply Likes
Thank you for your kind words about the Matrix coverage graph. It has become a very popular feature with test designers who tell us they like how much granular detail it makes clear.

To add a little to Sean's answer, Hexawise has two different types of test coverage reports.

The Coverage Matrix (shown above) is explained in detail here.

As Sean says, the Coverage Matrix is inherently a 2-dimensional representation, so it only displays for 2-way.

The Coverage Graph (shown above) is explained in detail here.

The Coverage Graph offers a larger variety of coverage display options. It will show you testing coverage for any coverage strength you choose (e.g., 2-way, 3-way, 4-way, 5-way, 6-way, Mixed-Strength)