infrastructure August 2024

infrastructure@lists.fedoraproject.org

10 participants
12 discussions

VDO
by Miroslav Suchý 04 Jul '26

04 Jul '26

After I seen the talk about VDO: https://www.youtube.com/watch?v=7CGr5LEAfRY I went ahead and tried it. I tried it on small (12GB) sample of Copr data and I saved 20-30% data. I then deployed it on production server retrace.fedoraproject.org and saved there 15% out of 2TB. Several notes: The RPM packages are only available for RHEL. Recently the public github has been updated with version of VDO, which should work on Fedora. No RPM available for Fedora yet though. Here are my notes: # vdo create --name=vdo1 --device=/dev/vdb --vdoLogicalSize=1T # mkfs.ext4 /dev/mapper/vdo1 Some slides suggest to use -E discard. This is not needed for new volumes. See vdo-devel mailing list for reasoning. # mount -o discard /dev/mapper/vdo1 /mnt/a Probably best scenario is to create vdo on whole disk and then make PV from whole VDO disk and put LVM on top of that. When you already have data, you cannot convert your disk to VDO. You need create new VDO disk, format it, mount it and copy the data. In my case, due limited space for migration I created a small LVM volume "vdosrv": # lvcreate -L 80G -n vdosrv vol0 I converted it to VDO which claims to have 2TB of vitual total size # vdo create --name=srv18 --device=/dev/vol0/vdosrv --vdoLogicalSize=2T # mkfs.ext4 /dev/mapper/srv18 See how many space is *actually* free. # vdostats # mkdir /mnt/srv18 # mount -o discard /dev/mapper/srv18 /mnt/srv18 Now I moved some data from old volume to /mnt/srv18. I shrank the FS of old volume, I shrank the old LV. And then I enlarged the new LV. # lvresize -L +400G /dev/vol0/vdosrv and let know vdo that it can use the new space: # vdo growPhysical -n srv18 I repeated this several times. I have to say that my experience is so far good. I hope that my notes help someone. Miroslav

10 14

Deleting old AMIs in AWS
by Miroslav Suchý 09 Jan '25

09 Jan '25

FYI I plan to continue in AWS cleanup on Friday. I waited till Freeze is over - just to be safe. And now I want to delete the old AMIs. Likely in several waves. Going from oldest to ~2021. In this step I plan to keep the associated snapshots. So if I break something we can still restore the AMI. BTW - quick summary where we are with the cleanup stuff: * all VM, volumes have tag FedoraGroup * all gp2 volumes are migrated to gp3 * All AMIs with name 'Fedora-AtomicHost-*' are deleted. Including associated snapshots * all Fedora GA AMIs and snapshots are tagged with FedoraGroup. * all old (2021-) snapshots with no associated AMIs are deleted. -- Miroslav Suchy, RHCA Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys

5 33

Fedora 41 beta freeze now in effect!
by Kevin Fenzi 18 Sep '24

18 Sep '24

Greetings. We are now in the infrastructure freeze leading up to the Fedora 41 Beta release. This is a pre release freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 41 Beta when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://pagure.io/fedora-infra/ansible.git ansible/scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2024-09-17 (or later if release slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list or a pull request for review. Thanks, Kevin

1 1

Freeze Break Request: update pungi on compose-branched01
by Kevin Fenzi 03 Sep '24

03 Sep '24

Greetings I'd like to update pungi on compose-branched01 from pungi-4.7.0-1.fc40 to pungi-4.7.0-3.fc40. The changelog is: * Thu Aug 29 2024 Lubomír Sedlář <lsedlar(a)redhat.com> - 4.7.0-3 - Backport patch for setting kiwibuild image type in metadata * Wed Aug 28 2024 Lubomír Sedlář <lsedlar(a)redhat.com> - 4.7.0-2 - Backport patch with kiwibuild options version and repo_releasever This will allow us to build/deliver a number of kiwi artifacts in f41 builds, including some approved changes (Miracle spin, KDE mobile, etc). This has been tested with rawhide and is now working there. After this update, we will need to merge: https://pagure.io/pungi-fedora/pull-request/1338 +1s? kevin

5 4

Planned Outage - network hardware updates - 2024-08-27 15:00 UTC
by Kevin Fenzi 28 Aug '24

28 Aug '24

Planned Outage - network hardware updates - 2024-08-29 15:00 UTC There will be an outage starting at 2024-08-29 15:00 UTC, which will last approximately 1 hour. To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run: date -d '2024-08-29 15:00UTC' Reason for outage: Some networking hardware at our IAD datacenter will be updated. There may be small network outages as devices reboot into new firmware and routes and switch ports reconverge. Affected Services: services at IAD2, but only for small windows. Ticket Link: https://pagure.io/fedora-infrastructure/issue/12153 Please join #fedora-admin or #fedora-noc on irc.libera.chat or #admin:fedoraproject.org / #noc:fedoraproject.org on matrix. Please add comments to the ticket for this outage above. Updated status for this outage may be available at https://www.fedorastatus.org/

1 0

DNF-automatic to run only during workday?
by Miroslav Suchý 26 Aug '24

26 Aug '24

I am working on https://github.com/fedora-copr/copr/issues/3327 summary is that dnf-automatic installed security fix on Saturday, but the new version changed something else too. And part of Copr was down most of the weekend. This happened already twice. In Copr we do not want to repeat this (fool me once...) and I want to change dnf-automatic to run only on Mon-Thu. I will do that for Copr. And I am willing to do that for all Fedora's machines. Should I? Opinions? -- Miroslav Suchy, RHCA Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys

6 7

Intention to hand over python-moksha-hub
by Sandro 16 Aug '24

16 Aug '24

Hi, A while ago I adopted `python-moksha-hub` as a dependency of `fedmsg`, which was still used by Badges back then. Badges no longer requires `fedmsg`. With setuptools 72 removing setup.py the package will break. I have no desire of looking into it. One other package, `module-build-service`, depends on `moksha-hub`. Since both dependent packages are somewhat in the infra realm, I would like to hand over `moksha-hub` to someone being more actively involved in infra. If nobody steps forward, I will orphan the package and let things progress from there. Cheers, -- Sandro FAS: gui1ty Matrix: Penguinpee Elsewhere: [Pp]enguinpee

2 2

Cleaning pagure fedora-infra group
by Michal Konecny 15 Aug '24

15 Aug '24

Hi everyone, I'm continuing with the archiving initiative we started on Flock with Github. This time I'm looking at infra group in pagure. I started the discussion on https://discussion.fedoraproject.org/t/pagure-fedora-infra-group-cleanup/12… with the list of repositories that could be potential candidates for archiving/deletion. Feel free to reply on the discussion, especially if you think that something shouldn't be on the archiving/deletion list. Regards, Michal

1 0

Meeting Agenda Item: Introduction Edward Fitz Abucay
by Edward Fitz Abucay 14 Aug '24

14 Aug '24

Good Day, My name is Edward, and I am reaching out to introduce myself and share a brief overview of my skills and experiences. I have certain experience in various programming languages, including Golang, Rust, and TypeScript/Node. While I have primarily used Python for scripting and prototyping, I am eager to expand my proficiency in this language (currently using this in testing LLMs). In addition to my programming skills, I have prior background in DevOps and BE development. I have successfully set up infrastructure using Terraform and managed production Kubernetes clusters. My expertise also includes implementing CI/CD pipelines, scaling, optimizing the cost of Kubernetes clusters, and working on different cloud providers such as AWS, Azure, GCP, and OVH. What I would like to learn and work on is probably the pipelines, openshift, also ansible as I've only used it on my local – to setup my workstation. For issues, I'd like to help on #11512, not sure if there's an active blocker for that. I am enthusiastic about the opportunity to contribute to the infra team and further develop my skills. Please feel free to reach out to me on Matrix at @eabucay:fedora.im. Cheers, Edward Fitz Abucay

3 2

Introductions
by Ben Maconi 10 Aug '24

10 Aug '24

Hello world! I'm Ben Maconi, I'm a student in high school and I'm learning a lot about anything fedora. I know python, html/css, and how to google! I'm excited to learn and be a part of the community. My dad and nb are making me do this, but I'm having fun so why not keep going?

3 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure August 2024