Weekend works

Started by Dieselboy, March 19, 2017, 01:24:00 AM

Previous topic - Next topic
Print
Go Down Pages1
User actions

Dieselboy

March 19, 2017, 01:24:00 AM
Spent Saturday morning re-provisioning resources in our virtual env. Quite recently we had 100 VMs running on 3 Hosts. CPU utilisation is under 20% always but RAM consumption was literally maxed out across all hosts. When I began looking into the VM utlisation we had VMs with 4GB ram and consuming 10% of that. Most of these VMs come from requests such as "must have 4GB RAM and 500GB HDD" then find out it's only using 10% and 9GB on the HDD but now your overallocations are all screwed up in the 1000's of % overallocated.
It's mainly one guy requesting this and he kicks up a fuss. Going to have to lump it now, as the rediculousness began impacting prod systems. From 4GB ram down to 768mb with guaranteed 512mb :)  :XD: >:D Worst case scenario I can hot-swap more RAM during business hours.
I've been monitoring this since before Christmas, in a server audit doc so I done some basic profiling before making the changes.

Upgraded the OS on the SAN - love this NimbleStorage SAN. It's as easy to manage as making a cup of coffee. But I still have a problem where the controller failover triggers the VM env. to pause the VMs. I have a document to read, I have to make some minor config changes to the iscsid and multipathd settings next week.

And then I can deploy another OpenStack instance :)

deanwebb

#1
March 20, 2017, 12:07:56 PM
Careful, though... some systems freak out if they don't have that 4GB of RAM that they were promised, especially virtual ports of hardware.
Take a baseball bat and trash all the routers, shout out "IT'S A NETWORK PROBLEM NOW, SUCKERS!" and then peel out of the parking lot in your Ferrari.
"The world could perish if people only worked on things that were easy to handle." -- Vladimir Savchenko
Вопросы есть? Вопросов нет! | BCEB: Belkin Certified Expert Baffler | "Plan B is Plan A with an element of panic." -- John Clarke
Accounting is architecture, remember that!
Air gaps are high-latency Internet connections.

SimonV

#2
March 22, 2017, 12:46:40 PM Last Edit: March 22, 2017, 12:48:47 PM by SimonV
Just arrived in Budapest. One of our offices is moving so perfect chance to standardize (ie get under control) the network here. Here until Saturday, hope I don't get into major issues so I can see some of the city on Friday :pub:

deanwebb

#3
March 22, 2017, 01:41:50 PM
Man, they cut our travel budget. Now I have to see Europe on my own nickel.
Take a baseball bat and trash all the routers, shout out "IT'S A NETWORK PROBLEM NOW, SUCKERS!" and then peel out of the parking lot in your Ferrari.
"The world could perish if people only worked on things that were easy to handle." -- Vladimir Savchenko
Вопросы есть? Вопросов нет! | BCEB: Belkin Certified Expert Baffler | "Plan B is Plan A with an element of panic." -- John Clarke
Accounting is architecture, remember that!
Air gaps are high-latency Internet connections.

SimonV

#4
March 30, 2017, 04:27:42 PM
So I didn't see anything of Budapest itself last week, too much lost on the physical move. Actual network was fine though, I love building from scratch in an empty rack :) They did give me a book with pretty pictures as a souvenir, maybe I should go back for a weekend trip soon.

This weekend I'm in Portugal for another office move. Working tomorrow and Saturday, and they want me here on Monday to support so on Sunday I can cruise along the coast  8)

And after that, I'm staying put for a couple of weeks...

SimonV

#5
June 10, 2017, 03:06:33 AM
Office move in Nigeria today (remotely :whistle:), two sites are being merged into one. Remote firewall is a Check Point, I hate Check Points.

deanwebb

#6
June 10, 2017, 09:35:20 AM
Quote from: SimonV on June 10, 2017, 03:06:33 AM
Office move in Nigeria today (remotely :whistle:), two sites are being merged into one. Remote firewall is a Check Point, I hate Check Points.

Fun fact: I've never logged into any of the CheckPoints at where I work. I leave that to others. In exchange, they don't have to touch NAC.

We all dread the day we implement a CheckPoint integration module with our NAC solution...
Take a baseball bat and trash all the routers, shout out "IT'S A NETWORK PROBLEM NOW, SUCKERS!" and then peel out of the parking lot in your Ferrari.
"The world could perish if people only worked on things that were easy to handle." -- Vladimir Savchenko
Вопросы есть? Вопросов нет! | BCEB: Belkin Certified Expert Baffler | "Plan B is Plan A with an element of panic." -- John Clarke
Accounting is architecture, remember that!
Air gaps are high-latency Internet connections.

SimonV

#7
September 11, 2017, 03:35:37 PM
Just spent 5 days moving and replacing a network in Sweden, tired af. Sweden is a great place, but you can lose a fortune on alcohol :)

SimonV

#8
September 11, 2017, 03:44:34 PM
Quote from: deanwebb on June 10, 2017, 09:35:20 AMFun fact: I've never logged into any of the CheckPoints at where I work. I leave that to others. In exchange, they don't have to touch NAC.

It's Check Point, they want you to use the GUI

:flipdesk:

deanwebb

#9
September 11, 2017, 03:49:57 PM
Now that I'm at $VENDOR, I don't have to mess with CheckPoint. At all. :smug:
Take a baseball bat and trash all the routers, shout out "IT'S A NETWORK PROBLEM NOW, SUCKERS!" and then peel out of the parking lot in your Ferrari.
"The world could perish if people only worked on things that were easy to handle." -- Vladimir Savchenko
Вопросы есть? Вопросов нет! | BCEB: Belkin Certified Expert Baffler | "Plan B is Plan A with an element of panic." -- John Clarke
Accounting is architecture, remember that!
Air gaps are high-latency Internet connections.

Dieselboy

#10
September 23, 2017, 03:52:01 AM
Quote from: SimonV on September 11, 2017, 03:35:37 PM
Just spent 5 days moving and replacing a network in Sweden, tired af. Sweden is a great place, but you can lose a fortune on alcohol :)

Went to Switzerland to set up a office there years ago. Loved it but buying a simple burger and a beer was extremely funny trying to guess how high the bill was going to be :)

SimonV

#11
September 23, 2017, 03:57:56 PM
Quote from: Dieselboy on September 23, 2017, 03:52:01 AM
Quote from: SimonV on September 11, 2017, 03:35:37 PM
Just spent 5 days moving and replacing a network in Sweden, tired af. Sweden is a great place, but you can lose a fortune on alcohol :)

Went to Switzerland to set up a office there years ago. Loved it but buying a simple burger and a beer was extremely funny trying to guess how high the bill was going to be :)

Yeah, that was probably the only country where I  couldn't eat a real main course because of budget constraints, it's crazy. But the Swiss do earn about twice as much as other Europeans.

Last project finished today in Germany, now I have five more days to finish documenting everything I did in the last three years and it's on to the next assignment, probably no more travel - mixed feelings!
Print
Go Up Pages1
User actions