Invalid Pairs & 2-Way Interaction

  • 2
  • Question
  • Updated 8 years ago
  • Answered
When defining inputs, if I set invalid pairs can I only create 2-way interaction test cases?
Photo of Conor Brady

Conor Brady

  • 2 Posts
  • 0 Reply Likes
  • Happy

Posted 9 years ago

  • 2
Photo of Sean Johnson

Sean Johnson, CTO

  • 270 Posts
  • 26 Reply Likes
Conor,

What's happening is that the inclusion of invalid pairs is going to cause your tests to be generated by a different version of the Hexawise algorithm. This version has better precision in respecting invalid pairs, but the performance is not up to snuff yet. Because of this, today we limit it to generating 2-way tests.

The performance of this algorithm is something we've been working on hard over the past couple of months. We have it generating up to 6-way tests in our test environments. The performance and stability are just not there yet though to put these improvements into production yet. We'll get there soon though.

Thanks!
Sean
Photo of Conor Brady

Conor Brady

  • 2 Posts
  • 0 Reply Likes
Fantastic stuff, Sean - thanks for the speedy reply. Still getting my head around Hexawise, but am quite impressed with the tool so far; keep up the good work!
Photo of Michael

Michael

  • 6 Posts
  • 0 Reply Likes
Any idea when this will be implemented? The tests I'm trying to create contain many invalid pairs and value expansions. The tests cases being produced from this are fairly limited at the moment. So the ability to increase the strength would be really beneficial.

Thanks,

Mike
Photo of Justin Hunter, Hexawise Founder

Justin Hunter, Hexawise Founder, Founder and CEO

  • 246 Posts
  • 15 Reply Likes
Michael,

I suspect we'll be able to grant you access to use this new feature as a beta user by August 15th (or, if not, then by September 1st).

To request beta access, please email me at justin {dot] x [dot} hunter {at} gmail [dot] com. Thanks.

- Justin
Photo of Michael

Michael

  • 6 Posts
  • 0 Reply Likes
Hi Justin,

Sounds good. I'll check the feature out if it's implemented on the 15th.
Photo of Michael

Michael

  • 6 Posts
  • 0 Reply Likes
Will this be implemented soon? I've just checked and the functionality is still the same.
Photo of Justin Hunter, Hexawise Founder

Justin Hunter, Hexawise Founder, Founder and CEO

  • 246 Posts
  • 15 Reply Likes
Michael,

Thank you for checking back. We have the feature implemented but not yet fully tested / ready to be pushed into production. Since my last post, we have needed to temporarily adjust our short term development priorities. In particular, we needed to step away from our plan of putting that feature into production in order to wrap up development of a standalone test generation appliance (AKA "private cloud" or "cloud-in-a-box" solution) that we have been asked to deliver to one of the world's largest global banks.

I don't know how many more days of testing we'll need to do on the hardware appliance or the n-wise plus constraint handling feature you're asking about. In the mean time, if you'd would like, I can give you special, limited access to a different, non-public instance of Hexawise for you to run your tests. Using our non-public instance, you would be able to not only generate pairwise software testing solutions but also more comprehensive n-wise solutions (3-way, 4-way, 5-way, and 6-way combinatorial testing solutions). You'll be able to do this for tests even when invalid pairs exist (e.g., constraint handling will be handled with n-wise testing solutions).
Photo of Michael

Michael

  • 6 Posts
  • 0 Reply Likes
I'd be interested in checking this out in the non-public instance you've mentioned.

Cheers,

Mike
Photo of Michael

Michael

  • 6 Posts
  • 0 Reply Likes
Still not heard back on this. Is the offer still there?

Cheers,

Mike
Photo of Sean Johnson

Sean Johnson

  • 1 Post
  • 0 Reply Likes
Mike,

It sure is. After you login, click on "My Account" in the menubar up top and then check the box that says "Higher strength test generation (beta)".

Let me know here if you have any issues or feedback. We're eager to put this beta feature into production for everyone.

Thanks,
Sean
Photo of Justin Hunter, Hexawise Founder

Justin Hunter, Hexawise Founder, Founder and CEO

  • 246 Posts
  • 15 Reply Likes
Just following up on this question with an overdue status update. I'm happy to confirm that this feature has been successfully implemented for all Hexawise users for three months now.

Justin
Photo of michaeldavies23

michaeldavies23

  • 5 Posts
  • 0 Reply Likes
Thanks for the updates guys.

Mixed-strength interactions still isn't working for me at the minute but the others seem fine.

In mixed-strength, I change the strength for a parameter and click 'Reapply' - The page looks like it's loading but then returns to the initial values and test cases after loading for a few seconds.

This isn't a priority issue for me but I just thought I'd mention it : )

Cheers ,

Mike.
Photo of Sean Johnson

Sean Johnson, CTO

  • 270 Posts
  • 26 Reply Likes
Mike,

That's pretty odd. The feature is working generally. I'd like to follow up with you on this to see what the problem might be for you. Drop me a note at sean period johnson < at > hexawise period com so we can dig into the details.

Thanks,
Sean
Photo of Justin Hunter, Hexawise Founder

Justin Hunter, Hexawise Founder, Founder and CEO

  • 246 Posts
  • 15 Reply Likes
Official Response
I realized this question was hanging out there without a clear statement from us that this issue was resolved long ago. It has been implemented for months now and working well.