infrastructure October 2019

infrastructure@lists.fedoraproject.org

42 participants
59 discussions

About JS framework
by Pierre-Yves Chibon 17 Oct '22

17 Oct '22

Good Morning Everyone, Our infrastructure is mostly a python store, meaning almost all our apps are written in python and most using wsgi. However in python we are using a number of framework: * flask for most * pyramid for some of the biggest (bodhi, FAS3) * Django (askbot, Hyperkitty) * TurboGears2 (fedora-packages) * aiohttp (python3, async app: mdapi) While this makes sometime things difficult, these are fairly standard framework and most of our developers are able to help on all. However, as I see us starting to look at JS for some of our apps (fedora-hubs, wartaa...), I wonder if we could start the discussion early about the different framework and eventually see if we can unify around one. This would also allow those of us not familiar with any JS framework to look at the recommended one instead of picking one up semi-randomly. So has anyone experience with one or more JS framework? Do you have one that would you recommend? Why? Thanks for your inputs, Pierre

10 12

The packages app has a short runway
by Randy Barlow 24 Apr '20

24 Apr '20

Greetings! The packages app is running on Fedora 30, and its dependencies are not available in Fedora 31+ as I understand it. This means it has about 7 months before we need to do something about it, or shut it off. Do we know if it can run on RHEL 7?

9 31

[Fedocal, Nuancier] looking for new maintainers
by Francis Gesora 17 Mar '20

17 Mar '20

Hi, I would like to help out with the work for Nuancier. May not be available to take ownership, but willing to assist with the work. Pls advise. -- Regards, Gesora.

2 3

Infrastructure docs & apps.fp.o
by Timothée Floure 05 Feb '20

05 Feb '20

Hi, I wrote [1] to devel some time ago regarding the deprecation of the apps.fp.o index and plan to move its content to the main docs. Kevin mentionned that it could end up in the infrastructure docs and that the whole should be moved to docs.fp.o at some point. I will take a look at both since I have wanted to play with the new documentation pipeline for a while. I am not the best guy to meddle with the infrastructure doc but I might as well do something useful while playing with antora. Tell me if it's not or if I missed something. I might have something to show you at Flock if I have troubles sleeping in the train. [1] https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org… See you in Budapest, -- Timothée

5 12

Re: Deprecating Autocloud
by Sinny Kumari 06 Dec '19

06 Dec '19

On Mon, Apr 29, 2019 at 4:47 PM Kamil Paral <kparal(a)redhat.com> wrote: > On Mon, Apr 29, 2019 at 11:39 AM Sinny Kumari <ksinny(a)gmail.com> wrote: > >> >> >> On Wed, Apr 24, 2019 at 12:19 AM Kevin Fenzi <kevin(a)scrye.com> wrote: >> >>> Or could we move f29+ all to whatever is replacing it? (taskotron?) >>> >> >> It will be nice but I am not aware of any other system in place which >> would >> replace checks performed by autocloud. >> >> (CC'ed tflink and kparal) >> Does taskotron provides capability to perform tests on Fedora cloud >> Images like booting images and other basic checks? >> > > Theoretically it is possible using nested virt. However, Taskotron is > going away as well. The replacement is Fedora CI: > https://docs.fedoraproject.org/en-US/ci/ > Thanks kamil! yeah, it doesn't make sense to move to Taskotron if it is going to be deprecated as well. > I recommend to ask in the CI list: > https://lists.fedoraproject.org/archives/list/ci%40lists.fedoraproject.org/ > > It should be possible for them to provide the infrastructure you need. > Hmm, I am not very sure if we should spend time investigating and setting up alternative to autocloud unless we have usecases for long run. Fedora Atomic Host Two Week releases ends with F29 EOL. -- http://sinny.io/

5 11

New mirrorlist server implementation
by Adrian Reber 19 Nov '19

19 Nov '19

Fedora's complete MirrorManager setup is still running on Python2. The code has been ported to Python3 probably over two years ago but we have not switched yet. One of the reasons is that the backend is running on RHEL7 which means we are not in a hurry to deploy the Python3 version. The mirrorlist server which is answering the actual dnf/yum queries for a mirrorlist/metalink is, however, running in a Fedora 29 container. This container also still uses Python2 and it actually cannot use the Python3 version. One of MirrorManager's design points is that the mirrorlist servers, which are answering around 27 000 000 requests per day, are not directly accessing the database. The backend creates a snapshot of the relevant data (113MB) and the mirrorlist servers are using this snapshot to answer client requests. This data exchange is based on Python's pickle format and that does not seem to work with Python3 if it is generated using Python2. Having used protobuf before, I added code to also export the data for the mirrorlist servers based on protobuf. The good news with protobuf is, that the resulting file is only 66MB instead of 113MB. The bad news is, that loading it from Python requires 3.5 times the amount of memory during runtime (3.5GB instead of 1GB). In addition to the data exchange problems between backend and mirrorlist servers the architecture of the mirrorlist server does not really make sense today. 12 years ago it made a lot of sense as it could be easily integrated into httpd and it could be easily reloaded without stopping the service. Today the mirrorlist server and httpd is all part of a container which is then behind haproxy. So there is a lot of infrastructure in the container which is not really useful. To get rid of the pickle format and to have a simpler architecture I reimplemented the mirrorlist-server in Rust. This was brought up some time ago on a ticket and with the protobuf problems I was seeing in Python it made sense to try it out. My code currently can be found at https://github.com/adrianreber/mirrorlist-server and so far the results from the new mirrorlist server are the same as from the Python based mirrorlist server. It requires less than 700MB instead of the 1GB in Python with production based data and seems really fast. I have set up a test instance with the mirror data from Sunday at: https://lisas.de/metalink?repo=updates-testing-f31&arch=x86_64 https://lisas.de/mirrorlist?repo=updates-testing-f31&arch=x86_64 The instance is based on the container I pushed to quay.io: $ podman run quay.io/adrianreber/mirrorlist-server:latest -h With this change the mirrorlist server would also finally switch to geoip2. The currently running mirrorlist server still uses the legacy geoip database. After the Fedora 31 freeze I would like to introduce this new mirrorlist server implementation on the proxies. I already verified that I can run this mirrorlist container rootless. This new container can be a drop-in replacement for the current container and no infrastructure around it needs to be changed. The main changes to get it into production is to change mirrorlist1.service and mirrorlist2.service to include a line "User=mirrormanager" and replace the current container name with new container. Adrian

4 13

Wikiedit FAS group and Fedora Join new workflow
by alciregi＠gmail.com 19 Nov '19

19 Nov '19

Hello! As you can read here[0], the Fedora Join SIG is experimenting a new way to help people become part of the community. This workflow includes also a temporary FAS group if required or asked by the newcomer. Since this overlaps with the current "wikiedit" system, we were wondering if it'd make sense to retire it and send newcomers to the Fedora Join channels instead where they can speak to community members and take their time learning/exploring the community and it's projects. It'll be one less responsibility for the infra team, and it'll help us channel folks to the new workflow. Please let us know if this sounds OK and we'll edit the wiki page here accordingly [1]. We'll send out more posts announcing the new workflow to the community this week. If you have the cycles, please hang out in the Fedora Join channels[2]. [0] : https://communityblog.fedoraproject.org/fedora-join-is-trying-a-new-people-… [1] https://fedoraproject.org/wiki/Help:Editing#Gaining_Edit_Access [2] https://fedoraproject.org/wiki/SIGs/Join?rd=Fedora_Join_SIG Thanks, A.

5 23

What is the purpose of my "...@fedoraproject.org" email address?
by Chris Rainey 02 Nov '19

02 Nov '19

I just noticed that my FAS account has an automatic(?) @fedoraproject.org email address. Is there an "Inbox" for this or is it just an alias to my "Primary" account address for privacy, etc.? Thanks!

6 15

FBR bodhi-pungi: only run multi-arch SB on f31+
by Dusty Mabe 01 Nov '19

01 Nov '19

[PATCH] bodhi-pungi: only run multi-arch SB on f31+

4 11

[Fedora 31 / FAS] Error connecting to my FAS from GNOME "Online Accounts"
by Chris Rainey 01 Nov '19

01 Nov '19

Please see attached screenshot for exact error: "Error connecting to Fedora: Preauthentication failed" Thanks!

2 3

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure October 2019