cloud May 2023

cloud@lists.fedoraproject.org

9 participants
8 discussions

Packaging the AWS SSM Agent
by Major Hayden 30 Jun '23

30 Jun '23

Hey there, I've been working on packaging the AWS SSM Agent[0] in Fedora on and off for a few months now and I finally got a free moment to work on it again. However, there are a few problems that have me scratching my head a little. Just to level set, AWS Systems Manager[1] is an offering that allows AWS customers to manage their instances outside the instance itself. We all know (and love) cloud-init, but it really only handles the first boot provisioning of the instance. The SSM agent has similarities to Azure's WALinuxAgent as it allows for management *after* the first boot. (For reference, WALinuxAgent is already packaged in Fedora and automatically enabled when Fedora lands in an Azure instance.) The main issue is around dependencies: ---------- # No commits since Mar 2021 💀 'golang(github.com/Workiva/go-datastructures)' # Should be covered by the existing aws-sdk-go package 🤔 'golang(github.com/aws/aws-sdk-go/service/backupstorage)' 'golang(github.com/aws/aws-sdk-go/service/privatenetworks)' 'golang(github.com/aws/aws-sdk-go/service/ssm/ssmiface/mocks)' 'golang(github.com/aws/aws-sdk-go/service/ssmmds)' 'golang(github.com/aws/aws-sdk-go/service/ssmmds/ssmmdsiface)' 'golang(github.com/aws/aws-sdk-go/service/ssmmds/ssmmdsiface/mocks)' # No commits since Jan 2017 💀 'golang(github.com/carlescere/scheduler)' # No commits since Jan 2017 💀 'golang(github.com/cihub/seelog)' # No commits since Sep 2018 💀 'golang(github.com/digitalocean/go-smbios/smbios)' # No commits since Sep 2016 💀 'golang(github.com/pborman/ansi)' # Last commit Feb 2023 👍 'golang(github.com/xtaci/smux)' ---------- Some of these have not been updated in quite some time and many of them have several unresolved bugs that are years old. Although I'd like to get the SSM Agent packaged in Fedora, I don't like the idea of packaging quite a few packages which aren't being actively maintained. One potential option is to work with upstream (AWS) to change these dependencies out for actively maintained ones instead, but that likely requires significant development work. 🥵 Another option might be to vendor these dependencies in the main SSM package, but that still means we're building against unmaintained code and it likely violates some Fedora policies. 😱 How should I proceed? Thanks for reading this far? [0] https://github.com/aws/amazon-ssm-agent [1] https://docs.aws.amazon.com/systems-manager/latest/userguide/what-is-system… -- Major Hayden

3 5

What makes Fedora desirable in clouds?
by Major Hayden 26 May '23

26 May '23

Hey everyone, While mowing the yard last weekend, something came to mind about Fedora on clouds. We spend a lot of time thinking about getting Fedora onto more clouds and making it more interoperable with cloud APIs. Increasing Fedora's usage by making it available in more clouds seems like a worthwhile goal. However, I wonder why people choose to use Fedora versus an alternative when they deploy in public clouds. These questions came to mind: * Is there something lacking in the Fedora experience? * Is Fedora more difficult to use or does it have limitations that frustrate users? * Are we missing docs and blog posts that help users deploy their favorite applications on Fedora? I'll admit that I bounce between regular Fedora and Fedora CoreOS in my own deployments. A lot of that depends on what I plan to run there. If I'm running containerized applications, CoreOS gets me up and running quickly. If I need to do some development or run something a bit more complex, I usually reach for Fedora Cloud. I would love to hear thoughts from others on this topic about how we can improve the end-user experience for Fedora in public clouds of all sizes. -- Major Hayden

5 4

[Fedocal] Reminder meeting : Fedora Cloud Workgroup
by dusty＠dustymabe.com 23 May '23

23 May '23

Dear all, You are kindly invited to the meeting: Fedora Cloud Workgroup on 2023-05-25 from 15:00:00 to 16:00:00 UTC At fedora-meeting-1(a)irc.libera.chat The meeting will be about: Standing meeting for the Fedora Cloud Workgroup Source: https://calendar.fedoraproject.org//meeting/1999/

1 0

Adding tracer to cloud images to detect reboots
by Major Hayden 15 May '23

15 May '23

Hey there, I was reading through BZ 2192127[0] and it's a request for enhancement to recognize when a system needs a reboot after package updates. Here's the scenario: 1) User launches an instance and requests package updates on boot 2) Instance boots and dnf updates packages 3) Some of the packages (openssl perhaps) need a reboot to take effect 4) cloud-init recognizes that the system needs a reboot after the package update 5) cloud-init reboots the system On Debian/Ubuntu systems, apt will write a file to /var/run/reboot-required that provides a hint that a reboot is needed. After cloud-init finishes its run, it checks to see if that file is present and then reboots the system immediately[1]. We can use `tracer` in Fedora to determine if a reboot is needed. When you run it, it prints out what needs to be done after the most recent dnf update. It has some exit codes that tell you what needs to be done. The biggest two are: 103: You need to restart your user session 104: The whole machine needs a reboot Adding tracer includes a few Python dependencies that aren't terribly large. However, there may be an easier way to do this that I'm not considering. Does anyone else have any lightweight ways that cloud-init could determine if a reboot is needed? [0] https://bugzilla.redhat.com/show_bug.cgi?id=2192127 [1] https://github.com/canonical/cloud-init/blob/main/cloudinit/config/cc_packa… -- Major Hayden

3 3

Fedora Cloud Meeting Minutes 2023-05-11
by Duncan, David 11 May '23

11 May '23

Minutes: https://meetbot.fedoraproject.org/fedora-meeting-1/2023-05-11/fedora_cloud_… Minutes (text): https://meetbot.fedoraproject.org/fedora-meeting-1/2023-05-11/fedora_cloud_… Log: https://meetbot.fedoraproject.org/fedora-meeting-1/2023-05-11/fedora_cloud_… ======================================= #fedora-meeting-1: fedora_cloud_meeting ======================================= Meeting started by davdunc[m at 15:01:06 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-meeting-1/2023-05-11/fedora_cloud_… . Meeting summary --------------- * roll call (davdunc[m, 15:01:17) * Action items from last meeting (davdunc[m, 15:06:13) * davdunc will review the raw notes from 2023-04-13-15 and determine (davdunc[m, 15:06:42) * LINK: https://fedoramagazine.org/new-aws-storage-type-for-fedora-linux/ (mhayden, 15:09:12) * LINK: https://fedoramagazine.org/new-aws-storage-type-for-fedora-linux/ (davdunc[m, 15:09:19) * nzwulfin to build out a needit / gotit table for the cloud team. (davdunc[m, 15:09:59) * LINK: https://github.com/nzwulfin/cloud-sig-doc-test/blob/main/targets.md (nzwulfin, 15:10:22) * LINK: https://github.com/GoogleCloudPlatform/compute-virtual-ethernet-linux (davdunc[m, 15:18:29) * ACTION: davdunc to finish the change proposal for the gvnic this week. (davdunc[m, 15:18:56) * Azure Marketplace progress (davdunc[m, 15:22:16) * LINK: https://pagure.io/cloud-sig/issue/399 (davdunc[m, 15:22:27) * the FESCo change proposal for producing/uploading Azure images was approved today (davdunc[m, 15:24:23) * davdunc is working on the fedimg conversion to do more than ec2 (davdunc[m, 15:27:37) * ACTION: mhayden to get azure images building somehow without making releng upset (mhayden, 15:35:52) * ACTION: davdunc[m to prototype the Ansible upload for Azure and the delete for images. (davdunc[m, 15:36:27) * publish Cloud images for OCI (davdunc[m, 15:40:13) * LINK: https://pagure.io/cloud-sig/issue/400 (davdunc[m, 15:40:26) * mhayden has packages for the OCI commands in review (davdunc[m, 15:40:53) * Pharaoh_Atem is going to review them. (davdunc[m, 15:41:07) * LINK: https://docs.ansible.com/ansible/latest/scenario_guides/guide_oracle.html (davdunc[m, 15:43:32) * LINK: https://github.com/oracle/oci-ansible-collection (mhayden, 15:43:44) * ACTION: mhayden to set up a cloud sig packaging group. (davdunc[m, 15:47:08) * ACTION: davdunc to work on the ansible for the OCI image upload and image delete (davdunc[m, 15:48:36) * open floor (davdunc[m, 15:51:48) * davdunc will be a RH Summit if you wanna chat about Cloud (davdunc[m, 15:52:30) * ACTION: davdunc[m to collaborate with the cloud sig on building images with kiwi. (davdunc[m, 15:56:01) Meeting ended at 15:57:44 UTC. Action Items ------------ * davdunc to finish the change proposal for the gvnic this week. * mhayden to get azure images building somehow without making releng upset * davdunc[m to prototype the Ansible upload for Azure and the delete for images. * mhayden to set up a cloud sig packaging group. * davdunc to work on the ansible for the OCI image upload and image delete * davdunc[m to collaborate with the cloud sig on building images with kiwi. Action Items, by person ----------------------- * davdunc[m * davdunc[m to prototype the Ansible upload for Azure and the delete for images. * davdunc[m to collaborate with the cloud sig on building images with kiwi. * mhayden * mhayden to get azure images building somehow without making releng upset * mhayden to set up a cloud sig packaging group. * **UNASSIGNED** * davdunc to finish the change proposal for the gvnic this week. * davdunc to work on the ansible for the OCI image upload and image delete People Present (lines said) --------------------------- * davdunc[m (135) * Pharaoh_Atem (67) * mhayden (60) * zodbot (24) * nzwulfin (20) * dustymabe (6) * davidduffey[m] (4) * themayor (2) * ngompa (0) * Conan (0) * Kudo (0) * davidduffey (0) * dduffey (0) * Eighth_Doctor (0) Generated by `MeetBot`_ 0.4 .. _`MeetBot`: https://fedoraproject.org/wiki/Zodbot#Meeting_Functions -- Duncan, David | he/him Cloud Working Group | _davdunc_at_fedoraproject.org_

1 0

[Fedocal] Reminder meeting : Fedora Cloud Workgroup
by dusty＠dustymabe.com 09 May '23

09 May '23

Dear all, You are kindly invited to the meeting: Fedora Cloud Workgroup on 2023-05-11 from 15:00:00 to 16:00:00 UTC At fedora-meeting-1(a)irc.libera.chat The meeting will be about: Standing meeting for the Fedora Cloud Workgroup Source: https://calendar.fedoraproject.org//meeting/1999/

2 1

Sample table for images we build
by matt m 09 May '23

09 May '23

Hey all, Ahead of this weeks meeting I push a sample of the tracking table to a personal github repo for comment and review. It's pretty basic and not at all accurate, all of the statuses in the table are for formatting and showcasing only :) I made the legend up too, but I think it's a better way of indicating what's actually happening with any image. https://github.com/nzwulfin/cloud-sig-doc-test/blob/main/targets.md I'll be in this week's meeting if folks want to discuss further then! - Matt

1 0

Fedora Cloud Meeting Minutes 2023-04-27
by Duncan, David 03 May '23

03 May '23

======================================= #fedora-meeting-1: fedora_cloud_meeting ======================================= Meeting started by davdunc[m at 15:11:29 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-meeting-1/2023-04-27/fedora_cloud_… . Meeting summary --------------- * roll call (davdunc[m, 15:12:03) * Action items from last meeting (davdunc[m, 15:19:08) * LINK: https://fedoraproject.org/wiki/Changes/Fedora_Images_On_Azure (mhayden, 15:21:02) * LINK: https://pagure.io/pungi-fedora/pull-request/1169 (davdunc[m, 15:24:14) * ACTION: davdunc will review the raw notes from 2023-04-13-15 and determine what he was going to do to the ansible for infra before mhayden beat him to it. (davdunc[m, 15:34:16) * Story for F39 Release Eng cycle. (davdunc[m, 15:34:58) * LINK: https://discussion.fedoraproject.org/t/objective-review-each-edition-has-a-… (davdunc[m, 15:38:47) * LINK: https://pagure.io/fedora-kickstarts (davdunc[m, 15:41:54) * LINK: https://fedoraproject.org/wiki/Cloud/Cloud_PRD (davdunc[m, 15:52:09) * ACTION: nzwulfin to build out a needit / gotit table for the cloud team. (davdunc[m, 15:57:35) * ACTION: cloud team to discuss story in next meeting and over email (davdunc[m, 15:58:15) * open floor (davdunc[m, 15:58:21) * ACTION: davdunc to complete change proposal for GVNIC feature on GCP (davdunc[m, 15:59:57) * for those of us who have the opportunity to go to summit, let's meet up. (davdunc[m, 16:00:28) Meeting ended at 16:00:52 UTC. Action Items ------------ * davdunc will review the raw notes from 2023-04-13-15 and determine what he was going to do to the ansible for infra before mhayden beat him to it. * nzwulfin to build out a needit / gotit table for the cloud team. * cloud team to discuss story in next meeting and over email * davdunc to complete change proposal for GVNIC feature on GCP Action Items, by person ----------------------- * mhayden * davdunc will review the raw notes from 2023-04-13-15 and determine what he was going to do to the ansible for infra before mhayden beat him to it. * nzwulfin * nzwulfin to build out a needit / gotit table for the cloud team. * **UNASSIGNED** * cloud team to discuss story in next meeting and over email * davdunc to complete change proposal for GVNIC feature on GCP People Present (lines said) --------------------------- * davdunc[m (86) * Eighth_Doctor (37) * mhayden (23) * nzwulfin (21) * zodbot (20) * mhayden[m] (5) * obudai[m] (4) * davidduffey[m] (1) * Conan (0) * Kudo (0) * davidduffey (0) * obudai (0) Generated by `MeetBot`_ 0.4 .. _`MeetBot`: https://fedoraproject.org/wiki/Zodbot#Meeting_Functions -- David Duncan | Sr. PSA Mgr. Linux

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

cloud May 2023