Networking-Forums.com

General Category => Forum Lobby => Topic started by: Dieselboy on March 12, 2015, 12:36:50 AM

Title: How do you test new software if you only have the one device and no spare cash ?
Post by: Dieselboy on March 12, 2015, 12:36:50 AM
Scenario: I have a Cisco WLC and their new 8.x code has a feature we want (I want to make use of). We only have the one WLC. I recall a previous where we found issues down the line such as: WLC crash for no reason, random wifi disconnects where the client appears to be connected but there is no wifi access at all.

This question could be for any device though, for example, a single ISR that you need to upgrade but do not have anything to test with.

I just wondered what others do if you were in a similar situation. The only way I can see to proceed is:

Then, when you implement the new feature I guess you should test that individual feature (obviously) and then re-test each of your items from the test plan above. Sometimes it's not as straight forward as that though if issues like a device crash / hang or random wifi disconnects that you cannot reproduce, they just happen randomly.
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: Netwörkheäd on March 12, 2015, 06:27:04 AM
Can you get a demo wlc from the vendor?
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: SimonV on March 12, 2015, 06:49:39 AM
What WLC chassis are you running, and how many APs? Might be a good business investment to get a HA unit. That wouldn't require you to buy AP licenses for the second time.
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: Otanx on March 12, 2015, 09:23:57 AM
Your plan looks good if you can't get any test gear. The only things I would add is to read the release notes very closely to make sure nothing in there is a concern, and do a Google search to see if there are people talking about any issues/concerns about the product. Don't put too much trust in random internet postings, but they can identify areas to test more closely if you see several people having problems.

-Otanx
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: routerdork on March 12, 2015, 11:55:02 AM
Is it possible to utilize some of the virtual software they've come out with and just test through the demo licensing period? There's a virtual everything now it seems.
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: routerdork on March 12, 2015, 12:03:29 PM
Quote from: Netwörkheäd on March 12, 2015, 06:27:04 AM
Can you get a demo wlc from the vendor?
LOL somehow I missed your post.
Title: Re: How do you test new software if you only have the one device and no spare cash ?
Post by: killabee on March 12, 2015, 11:17:35 PM
We don't have test boxes or spares, but we do have low traffic/low usage locations where we'll deploy the feature and watch.  However, this isn't foolproof either.  In different cases I upgraded some F5s at these locations and saw no immediate issues.  But later when I upgraded the F5s at the main site I had issues upgrading and saw memory leaks a month later.  The traffic and usage patters just weren't the same, so of course I wouldn't have seen any problems at the other locations. 

Other than you doing the exhaustive testing, be patient and wait for 8.1, 8.2, etc to come out, watch the Cisco/vendor forums for any comments about the current release, and do a bug scrub.