On 10/11/19 12:20 PM, Kevin Fenzi wrote:
So to update this thread some:
* Load is fine/responsiveness is fine as long as we aren't doing a
database dump.
* When we do, things slow down and load goes way up.
We did find one very odd/bad thing on the virthost the server is on (one
drive in the raid is showing active in multipath and possibly getting
copies of all i/o sent to it? unclear exactly, but it's wrong and needs
fixing).
So, we stopped the backup and we are going to wait until 21UTC
(after 5pm EDT). At that point we will try and clean up that multipath
issue and see if that helps things. If not we will try and tune the
vm/database more until we have it responsive all the time.
We hope we can do these changes with minimal to no downtime, but there
may be some.
I've filed
https://pagure.io/fedora-infrastructure/issue/8292 on this
issue, folks are welcome to follow along there.
Sorry about all this, I was just hoping to make things faster and sadly,
did not.
Thanks for working on this, your help is greatly appreciated.
--
Orion Poplawski
Manager of NWRA Technical Systems 720-772-5637
NWRA, Boulder/CoRA Office FAX: 303-415-9702
3380 Mitchell Lane orion(a)nwra.com
Boulder, CO 80301
https://www.nwra.com/