infrastructure February 2021

infrastructure@lists.fedoraproject.org

14 participants
20 discussions

VDO
by Miroslav Suchý 04 Jul '26

04 Jul '26

After I seen the talk about VDO: https://www.youtube.com/watch?v=7CGr5LEAfRY I went ahead and tried it. I tried it on small (12GB) sample of Copr data and I saved 20-30% data. I then deployed it on production server retrace.fedoraproject.org and saved there 15% out of 2TB. Several notes: The RPM packages are only available for RHEL. Recently the public github has been updated with version of VDO, which should work on Fedora. No RPM available for Fedora yet though. Here are my notes: # vdo create --name=vdo1 --device=/dev/vdb --vdoLogicalSize=1T # mkfs.ext4 /dev/mapper/vdo1 Some slides suggest to use -E discard. This is not needed for new volumes. See vdo-devel mailing list for reasoning. # mount -o discard /dev/mapper/vdo1 /mnt/a Probably best scenario is to create vdo on whole disk and then make PV from whole VDO disk and put LVM on top of that. When you already have data, you cannot convert your disk to VDO. You need create new VDO disk, format it, mount it and copy the data. In my case, due limited space for migration I created a small LVM volume "vdosrv": # lvcreate -L 80G -n vdosrv vol0 I converted it to VDO which claims to have 2TB of vitual total size # vdo create --name=srv18 --device=/dev/vol0/vdosrv --vdoLogicalSize=2T # mkfs.ext4 /dev/mapper/srv18 See how many space is *actually* free. # vdostats # mkdir /mnt/srv18 # mount -o discard /dev/mapper/srv18 /mnt/srv18 Now I moved some data from old volume to /mnt/srv18. I shrank the FS of old volume, I shrank the old LV. And then I enlarged the new LV. # lvresize -L +400G /dev/vol0/vdosrv and let know vdo that it can use the new space: # vdo growPhysical -n srv18 I repeated this several times. I have to say that my experience is so far good. I hope that my notes help someone. Miroslav

10 14

About JS framework
by Pierre-Yves Chibon 17 Oct '22

17 Oct '22

Good Morning Everyone, Our infrastructure is mostly a python store, meaning almost all our apps are written in python and most using wsgi. However in python we are using a number of framework: * flask for most * pyramid for some of the biggest (bodhi, FAS3) * Django (askbot, Hyperkitty) * TurboGears2 (fedora-packages) * aiohttp (python3, async app: mdapi) While this makes sometime things difficult, these are fairly standard framework and most of our developers are able to help on all. However, as I see us starting to look at JS for some of our apps (fedora-hubs, wartaa...), I wonder if we could start the discussion early about the different framework and eventually see if we can unify around one. This would also allow those of us not familiar with any JS framework to look at the recommended one instead of picking one up semi-randomly. So has anyone experience with one or more JS framework? Do you have one that would you recommend? Why? Thanks for your inputs, Pierre

10 12

Fedora 34 Beta Freeze now in effect
by Kevin Fenzi 28 Mar '21

28 Mar '21

Greetings. We are now in the infrastructure freeze leading up to the Fedora 34 Beta release. This is a pre release freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 34 Beta when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://infrastructure.fedoraproject.org/infra/ansible.git ansible/scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2021-03-16 (or later if release slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list. Thanks, Kevin

3 2

Introducing the ARC sub-team in CPE - and first research topic
by Pierre-Yves Chibon 26 Feb '21

26 Feb '21

Good Morning Everyone, While planning work, the CPE team has realized that a number of our initiatives actually start with a research phase to find the most appropriate technical solution. This leads to some issues with planning as without knowing the technical solution we want to take, it's hard to evaluate the amount of work needed and thus the time it'll take to do it. In order to help with this, we're creating a small sub-team in CPE, called the ARC team for Advance Reconaissance Crew*. The goal of this team will be to investigate what we believe to be the possible technical solutions for initiatives and advise the team on what they believe would be the appropriate solution. To this end, we will reach out when we start looking for ideas as you may have ideas that we did not think about. The first investigation, led by Will Woods, Mark O'Brien and I, will be around datanommer and datagrepper. datanommer is an application listening to fedmsg and filling a (postgresql) database with all the messages passing on the bus. datagrepper is a web application exposing these messages and offering a way to filter or search them. available at: https://apps.fedoraproject.org/datagrepper/ Currently our ideas are: - for datanommer: - port it to fedora-messaging - adjust it to whichever solution we chose to replace datagrepper - for datagrepper: - keep it as is - Replace by - postgres https://postgrest.org/ - prest https://github.com/prest/prest - kinto https://docs.kinto-storage.org/en/stable/ - Swagger/OpenAPI https://swagger.io/ - Add support for Graphql - for the postgresql server - Split messages per year in different table - Unite them using a postgresql view - Kick out the old messages per year - Keep the current year + n-1 in the current DB - Kick the other to another DB? - Kick the other to a tarball somewhere? - Output the database daily dump to file / year - TimescaleDB a postgresql plugin for time-series data - https://alibaba-cloud.medium.com/postgresql-time-series-database-plug-in-ti… - https://dev.t-matix.com/blog/postgresql-as-a-time-series-database/ - https://docs.timescale.com/latest/introduction - Make the msg field in the message table be a JSON field Would you have any other ideas of things we could look at? Looking forward for your input, Thanks, Pierre, Will and Mark * Our notes and documentation are hosted at: https://fedora-arc.readthedocs.io/en/latest/index.html

3 6

CPE Weekly Report: 2021-02-26
by Aoife Moloney 25 Feb '21

25 Feb '21

Hi Everyone, If you would like to see this report and toggle to the section you are most interested in, I would suggest visiting this link https://hackmd.io/8iV7PilARSG68Tqv8CzKOQ?view and use the header bar on your left to skip to where you want to go! ## Initiative FYI Links Initiatives repo here: https://pagure.io/cpe/initiatives-proposal 2021 Quarterly Planning timetable here: https://docs.fedoraproject.org/en-US/cpe/time_tables/ so you know when I need it in by to review it. Details on initiative requesting/how to work with us on new projects here: https://docs.fedoraproject.org/en-US/cpe/initiatives/ ### Misc I hope you all enjoyed DevConf.cz last week! There were some great talks and I am looking forward to catching up on the ones I unfortunately missed when they are posted in a few weeks! Also if you missed the CentOS Dojo at FOSDEM, you can watch all talks on the CentOS YouTube channel here https://www.youtube.com/playlist?list=PLuRtbOXpVDjC7RkMYSy-gk47s5vZyKPbt ## Project Updates *The below updates are pulled directly from our CPE team call we have every week.* ### Fedora * We are now in F34 freeze! All changes to frozen hosts take 2 +1s * Bodhi updates-testing activated for F34 * Fedscm-admin work started on default branches * Openh264 repos are hosted on Cisco CDN ### Noggin/AAA * User migration script has been successfully re-run * Lots of docs updates - check out the docs section for more information https://noggin-aaa.readthedocs.io/en/latest/ * PR opened for changes to docs to add pkinit to docs to allow applicable certs be shipped for packages but it seems fedora-packager Fedora package has to be built with the change applied https://pagure.io/fedora-packager/pull-request/166 * If you are experiencing any issues with your application authenticating with Noggin, please reach out to the team on IRC channel #fedora-aaa * The work tracker for this project can be found here https://github.com/orgs/fedora-infra/projects/6 * And please report any issues you find in the repo https://github.com/fedora-infra/noggin ## CentOS Updates ### CentOS * CentOS CI updated OCP to 4.6.17 * Rolled out security fixes to ci.centos.org Jenkins and cert update ### CentOS Stream * Documentation updated on the shortened CentOS Linux -> CentOS Stream conversion, see the demo here https://asciinema.org/a/393875 * CentOS Extras is now separately delivered for Stream and Linux * CentOS Stream 8 container images are published now to quay.io ## Team Info ### Background: The Community Platform Engineering group, or CPE for short, is the Red Hat team combining IT and release engineering from Fedora and CentOS. Our goal is to keep core servers and services running and maintained, build releases, and other strategic tasks that need more dedicated time than volunteers can give. See our wiki page here for more information:https://docs.fedoraproject.org/en-US/cpe/ As always, feedback is welcome, and we will continue to look at ways to improve the delivery and readability of this weekly report. Have a great weekend! Aoife Source: https://hackmd.io/8iV7PilARSG68Tqv8CzKOQ?view -- Aoife Moloney Product Owner Community Platform Engineering Team Red Hat EMEA Communications House Cork Road Waterford

1 0

Meeting Agenda Item: Introduction Marcelo Piedra
by Marcelo Piedra 24 Feb '21

24 Feb '21

Hello, Here I complete the required information. - IRC handle: I believe by this you meant the username, else please correct me. *stonefeller* or *lodbrok* are my usernames. - Marcelo Piedra - Time Zone: EET +2 / Finland - I know Python and have tried frameworks like Flask and fastAPI, also have basic experience using postgres. Have worked for +3 years as a product manager in different startups and also in databases as a service company. Additionally, I have learned some docker. Moreover, I have used vue.js and of course HTML and CSS. At the moment I am attending a course about cybersecurity, started a month ago so at the moment learning about networking. - I am looking to get started in development, as I have learned to code by myself and have used different frameworks, deployed to the cloud and used github, I need to get the real experience and feel of it. so looking to start with easy tasks to get started and learn to get into more advanced stuff at a later stage. If the tasks are related to security then would be good, but if that requires more experience then at a later stage is fine. - I can contribute a minimum of 10 hours per week, but it's possible to add more hours depending on the week. All the best, Marcelo

1 1

[Fedocal] Reminder meeting : Fedora Infrastructure
by smooge＠gmail.com 24 Feb '21

24 Feb '21

Dear all, You are kindly invited to the meeting: Fedora Infrastructure on 2021-02-25 from 08:00:00 to 09:00:00 America/Los_Angeles At fedora-meeting-1(a)irc.freenode.net The meeting will be about: Weekly Fedora Infrastructure meeting. See infrastructure list for agenda a day before. Source: https://apps.fedoraproject.org/calendar/meeting/9675/

1 0

[Fedocal] Reminder meeting : Fedora Infrastructure
by Damian Tometzki 23 Feb '21

23 Feb '21

1 0

FBR: To add i3 spin pungi config to F34
by Mohan Boddu 23 Feb '21

23 Feb '21

Hi, i3 spin is a new deliverable for F34 and this PR [1] adds the needed config for generating the i3 live iso as part of nightly compose. Please give your +1's. [1] https://pagure.io/pungi-fedora/pull-request/1012 Thanks, Mohan Boddu.

2 1

[Fedocal] Reminder meeting : Fedora Infrastructure
by smooge＠gmail.com 17 Feb '21

17 Feb '21

Dear all, You are kindly invited to the meeting: Fedora Infrastructure on 2021-02-18 from 08:00:00 to 09:00:00 America/Los_Angeles At fedora-meeting-1(a)irc.freenode.net The meeting will be about: Weekly Fedora Infrastructure meeting. See infrastructure list for agenda a day before. Source: https://apps.fedoraproject.org/calendar/meeting/9675/

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure February 2021