#fedora-meeting: Infrastructure (2013-11-21)
Meeting started by nirik at 19:00:07 UTC. The full logs are available at
* welcome y'all (nirik, 19:00:07)
* New folks introductions and Apprentice tasks (nirik, 19:01:32)
* Applications status / discussion (nirik, 19:03:30)
* LINK: https://github.com/gildub/arrod
* Sysadmin status / discussion (nirik, 19:20:23)
* updates applied yesterday, rhel 6.5 out today, will look at
upgrading as much as we can before freeze (nirik, 19:22:06)
* Upcoming Tasks/Items (nirik, 19:27:46)
* LINK: https://apps.fedoraproject.org/calendar/list/infrastructure/
* LINK: https://fedorahosted.org/fedora-infrastructure/ticket/3796
behaviour? (docent_, 19:31:01)
* Open Floor (nirik, 19:39:00)
Meeting ended at 19:52:14 UTC.
Action Items, by person
People Present (lines said)
* nirik (94)
* abadger1999 (34)
* pingou (28)
* threebean (17)
* relrod (12)
* mirek (10)
* docent (9)
* abompard (8)
* jimikirk (7)
* zodbot (5)
* lmacken (4)
* docent_ (3)
* smooge (3)
* kde_tony (2)
* tflink (2)
* samkottler (1)
* puiterwijk (0)
* mdomsch (0)
* dgilmore (0)
19:00:07 <nirik> #startmeeting Infrastructure (2013-11-21)
19:00:07 <zodbot> Meeting started Thu Nov 21 19:00:07 2013 UTC. The chair is nirik.
Information about MeetBot at http://wiki.debian.org/MeetBot
19:00:07 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
19:00:07 <nirik> #meetingname infrastructure
19:00:07 <nirik> #topic welcome y'all
19:00:07 <nirik> #chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch
threebean pingou puiterwijk
19:00:07 <zodbot> The meeting name has been set to 'infrastructure'
19:00:07 <zodbot> Current chairs: abadger1999 dgilmore lmacken mdomsch nirik pingou
puiterwijk relrod smooge threebean
19:00:16 * relrod here
19:00:19 * lmacken
19:00:20 * threebean is here
19:00:29 * mirek also here
19:00:30 * tflink is around
19:00:37 * samkottler is kinda here
19:01:04 * abadger1999 here -- finishing up $otherMeeting meeting notes
19:01:16 <nirik> welcome everyone.
19:01:32 <nirik> #topic New folks introductions and Apprentice tasks
19:01:46 <nirik> any new folks like to introduce themselves ? or apprentices with
questions or comments?
19:02:26 <nirik> ok...
19:02:31 * pingou late
19:02:36 <jimikirk> nirik: I'm still looking for sponsor
19:02:55 <jimikirk> nirik: #fedora-devel didn't work
19:02:57 <nirik> jimikirk: sure, although thats not really infrastructure related.
19:03:15 <jimikirk> nirik: ok, talk about it later
19:03:30 <nirik> #topic Applications status / discussion
19:03:36 <kde_tony> .fas kdetony
19:03:36 <zodbot> kde_tony: kdetony 'Anthony Mogrovejo'
19:03:43 <nirik> any exciting applications news this week or upcoming?
19:03:49 <nirik> hey kde_tony
19:04:04 <kde_tony> hi nirik :)
19:04:12 <pingou> some pkgdb2 work
19:04:26 <pingou> and a lot of work on fmn, but I let threebean talk about that :)
19:04:34 <mirek> I would like to get more active around cloud - just been on second
openstack workshop, can we get keystone credentials to Fedora Cloud get on some place
where is not required root and where members of sysadmin-cloud can access it?
19:04:38 * docent_ is late as usual
19:04:55 <threebean> yeah, not much to talk about with fmn unless people have any
questions. lots of rapid dev this week and last.
19:05:11 <threebean> We have a cloud instance up here http://18.104.22.168
19:05:25 <threebean> And the source is here https://github.com/fedora-infra/fmn
19:05:45 <threebean> we're working out of the TODO.md file there and are aiming
to get this stood up in at least our staging environment by dec. 15th.
19:05:48 <nirik> mirek: possibly. But what things would you do? More help might be
someone driving install of our havana or whatever cloud with ansible playbooks.
19:05:56 <pingou> oh threebean check the grey bar at the top and the <title>
19:06:12 <threebean> pingou: will fix :) thanks
19:06:31 * abompard says hello
19:06:44 <lmacken> bodhi: minor bugfix update hit the mashers yesterday.
19:07:03 <abadger1999> threebean, pingou: I thought of one pkgdb+fmn interaction I
19:07:21 <abadger1999> What happens if someone wants to deploy pkgdb2 in their own
19:07:29 <abadger1999> Will they also have to deploy fedmsgand fmn?
19:07:40 <abadger1999> or can we have a fallback notification method of some sort?
19:07:41 <threebean> they won't have to.. but they would if they wanted email
19:07:56 <mirek> nirik: start new instances, create/change flavours (will probably
need that for copr), but yeah, can even install OS havana (or we want to upgrade current
one OS to havana?)
19:08:00 * abadger1999 hadn't thought of this until pidora expressed interest in
running it too.
19:08:11 <threebean> right, right.
19:08:40 <pingou> abadger1999: I thought about this yesterday indeed, I might have
to write the email system finally :/
19:08:53 <threebean> heh :)
19:09:04 <threebean> what if they don't want emails? (no one wants emails...)
19:09:11 <threebean> pingou, abadger1999: let's ask them first.
19:09:16 <pingou> then they just turn it off :)
19:09:34 <nirik> mirek: well, new instances are either via ansible or self service,
so there's not usually much to do there. :) flavors I could see, but we haven't
really bothered yet... if you are interested in installing new I can bring you up to speed
on that and get you access. There's 0 upgrade path, so no, we don't want to
upgrade I don't think.
19:09:38 <pingou> it will have to be swith on/off as I don't want email
notifications + fmn
19:10:05 <nirik> mirek: my plan was to install latest one via ansible playbooks, get
it all working right, then migrate instances over from the old one (ie, terminate and
19:10:06 <abadger1999> <nod>
19:10:12 <abadger1999> okay, sounds like a plan then.
19:10:43 <pingou> threebean: abadger1999 it's just gonna be a hock onto the
log() function where all the fedmsg notifications are also set-up
19:10:54 <abadger1999> <nod>
19:11:00 <abadger1999> that makes sense to me.
19:11:00 <threebean> pingou: nice :)
19:11:41 * pingou added some task pro:pkgdb2 for tomorrow \ó/
19:11:49 <nirik> mirek: anyhow, if you want to work on that, happy to set you up. I
keep not getting to it. ;(
19:11:50 <mirek> nirik: if we have HW to run old cloud and new one in paralel, then
it would be best
19:12:05 <nirik> mirek: yep. we have 2 machines not in the current cloud.
19:12:47 <nirik> just to note, we go back into freeze next tuesday. :) Anything
folks want to try and land before then?
19:13:08 <smooge> sorry I need to move my clock
19:13:15 <threebean> hm.. perhaps we should create nodes for fmn ahead of time?
19:13:24 <pingou> +1
19:13:27 <mirek> hmm since Copr is still not officially part of infra then it is not
affected by frezee?
19:13:40 <nirik> mirek: right, it would not be frozen.
19:13:51 <nirik> threebean: could do that yeah... in case. :)
19:14:01 <threebean> :)
19:14:06 <nirik> aat least the stg ones
19:14:16 <threebean> cool
19:14:19 <mirek> nirik: can you point me to openstack playbooks in ansible? I could
not find it
19:14:32 <nirik> mirek: it's a seperate repo, let me get it...
19:15:05 <nirik> https://github.com/gildub/arrod
19:15:23 * mirek si looking
19:15:36 * abadger1999 will try to land his python-fedora change today.
19:15:41 <nirik> I've run into various issues with it, the maintainer is pretty
responsive, but I keep getting distracted. :)
19:15:46 <pingou> abadger1999: cool!
19:15:57 <nirik> abadger1999: whats in that?
19:15:59 <abadger1999> pingou: heh -- hotfix. Not the release changes.
19:16:16 <nirik> did we need something in there for mod_auth_openid?
19:16:18 * nirik forgets.
19:16:20 <abadger1999> nirik: fix the translation of TG1 apps (notably: fas)
19:16:55 <pingou> abadger1999: still good :)
19:16:56 <nirik> thats a biggie yeah
19:17:38 <nirik> ok, any other apps news?
19:17:58 <mirek> nirik: and is somewher doc how and to which machines we deploy it?
could not see anything relevant in doc.git
19:18:38 <nirik> mirek: no doc, I can fill you in after the meeting... basically you
fill in some group vars. ;)
19:19:00 <nirik> ideally we get this working and merge it into our ansible repo so
we can just deploy/update/change the cloud from the same place we do everything else.
19:19:47 <mirek> nirik: some group vars, yes... :)
19:20:01 <nirik> heh. nice. :)
19:20:02 <mirek> nirik: I will cont. on that with you after meeting
19:20:13 <nirik> thats also known as "this step left as an exersize for the
19:20:21 <nirik> anyhow...
19:20:23 <nirik> #topic Sysadmin status / discussion
19:20:34 <nirik> so, we had an outage yesterday and got everything updated.
19:20:41 <nirik> and today... rhel 6.5 came out. ;)
19:20:45 <relrod> yep :P
19:21:00 <nirik> which is our normal luck. ;)
19:21:15 <nirik> anyhow, so I am going to look at updating all the stuff we can
thats non outage causing...
19:21:30 <nirik> and then decide if we want to have another short outage monday
before freeze to update outage causing things.
19:22:06 <nirik> #info updates applied yesterday, rhel 6.5 out today, will look at
upgrading as much as we can before freeze
19:22:12 * lmacken checks if any of our wsgi stack got updated in 6.5
19:22:17 <nirik> Also I grew db01's disk a bunch.
19:22:53 <nirik> We also have 9 builders on one of our new blades using iscsi.
19:23:14 <nirik> They seemed to do ok at first, but then were very slow later for
some things. More data and investigation needed.
19:23:47 <abompard> Quick update of the HyperKitty front: I merged mizmo's work
and deployed my redesign of the front page. Now I'm fixing the stuff that broke on
real data :-)
19:23:58 <nirik> they did finish all there image builds from rawhide/branched today
19:24:06 <nirik> abompard: cool. ;)
19:24:06 <lmacken> new python beaker and weberror in rhel 6.5. I think that'll
only affect fedora-packages
19:24:17 <smooge> oh boy
19:24:28 <pingou> threebean: https://badges.fedoraproject.org/explore/badges/rss
should add it to the planet now :)
19:24:36 <threebean> pingou: oh, right!
19:24:43 <pingou> nirik: the specific planet feeds are managed by puppet right?
19:24:48 <pingou> s/by/in/
19:25:09 <nirik> abompard: do we want to perhaps roll out a mailman01 production
before freeze? or just wait and do prod after f20 is out/with freeze breaks?
19:25:16 <nirik> pingou: you can add them in puppet yeah.
19:25:33 <pingou> threebean: do you or shall I?
19:25:43 <threebean> pingou: go for it :)
19:25:45 <pingou> threebean: on my way
19:26:15 <abompard> nirik: I guess we can wait for f20, working around the schedule
may end up being more work
19:26:46 <nirik> abompard: ok. I'm eager to have a prod one, but sure... :)
19:26:59 <abompard> nirik: I can understand that :-)
19:27:46 <nirik> #topic Upcoming Tasks/Items
19:27:46 <nirik> https://apps.fedoraproject.org/calendar/list/infrastructure/
19:27:56 <nirik> anything upcoming people would like to schedule or note?
19:28:03 <nirik> next week is a holiday in the US...
19:28:13 <nirik> so no meeting, unless someone else wants to run one. ;)
19:28:26 <abadger1999> heh, what days are we supposed to be taking off?
19:28:42 <nirik> thursday and friday
19:28:52 <nirik> are holidays for RH folks in the US.
19:29:00 * nirik will of course likely still be around.
19:29:27 * abadger1999 will try to stay away on Friday. Thursday it will be easier as
he'll be in the kitchen.
19:29:40 <nirik> :)
19:29:58 <nirik> you could go do some "black friday" shopping. Won't
that be fun? :)
19:30:08 <smooge> I will be around on Thursday and Friday. I plan to cook and run a
D&D game but other than that will be around
19:30:18 <abadger1999> nirik: Mmm... black friday is what will keep me at home ;-)
19:30:43 <nirik> abadger1999: yeah, no kidding.
19:30:47 <tflink> nirik: I made the mistake of doing that one year ... no plans to
repeat the mistake :)
19:31:01 <docent_> https://fedorahosted.org/fedora-infrastructure/ticket/3796
19:31:43 <nirik> hey docent_
19:31:47 <docent_> :)
19:31:48 <nirik> good question.
19:32:42 <docent> ok second question - is that totally dead one:
19:33:05 <nirik> docent: there were still a few pending I think there...
19:33:10 <nirik> but the main driver of it moved on.
19:33:24 <nirik> we need to look at whats not yet done...
19:33:39 <abadger1999> docent: The linked owasp.org
points out that https-only sites
are not affected by the known easy vulnerability... that's us.
19:33:58 <docent> abadger1999: great :)
19:34:19 <abadger1999> docent: also, the csrf protection in the URL is for TG1 and
TG2. we're getting rid of tg1 and only have one tg2 app at the moment.
19:34:26 * nirik ponders. perhaps a 'git grep db01' and looking for any that still
point direct to db01 would show them?
19:34:42 <docent> ok so i'll stick to this csrf-issue with webapps..? or it can
be left as it is?
19:35:04 <docent> ok, great thx
19:35:12 <nirik> looks to me like 'datagrepper' and 'askbot' are the
19:35:20 <abadger1999> as it will keep it out of bookmarks, cut and paste, etc.
19:35:50 <docent> :)
19:35:54 <nirik> abadger1999: would this be a hotfix thing? or ? this is bodhi and
19:36:03 <abadger1999> jsut pointing out that we're not exposed to the automated
19:36:10 <abadger1999> nirik: fas, bodhi, packagedb, elections1.
19:36:29 <nirik> ok.
19:36:33 <abadger1999> We could hotfix.
19:36:48 <nirik> although in practice people only usually copy/paste from
19:36:56 <abadger1999> But we probably don't 100% need to.
19:37:10 <abadger1999> yeah -- because fas requires that you login to view
19:37:43 <abadger1999> I think I'd hotfix if we're not in freeze.
19:37:46 <nirik> well, with bodhi we could just try and get lmacken to add it to
next release, but pkgdb isn't likely to have too many more releases right?
19:38:02 <abadger1999> If we are in freeze, defer deploying until later.
19:38:10 <abadger1999> nirik: correct.
19:38:11 <nirik> yeah, it's a convience.
19:38:31 <docent> ok i'll bother you with that in a few days after meeting.
don't know even how to start own dev envs for those apps for now so first i'll
have to work this out
19:38:52 <nirik> docent: cool. You can always ask in #fedora-apps on how to get
19:38:58 <docent> sure :)
19:39:00 <nirik> #topic Open Floor
19:39:17 <nirik> any items for open floor? suggestions, comments, ideas, turkey
19:40:11 <relrod> Still looking for people willing to (co)maintain the dpsearch
package...We've been following the upstream snapshots (which they've been doing
more of lately) and I don't have enough time/energy right now to maintain it as well
as it should be.
19:40:18 <pingou> oh has the meeting time changed for you?
19:40:24 <relrod> So if we're still interested in possibly deploying it one day,
it'd be nice to have some comaintainers
19:40:54 <pingou> with the time change, it's an hour earlier for us ( abompard
19:41:14 <nirik> pingou: yeah, it's earlier for us too... did you want to move
19:41:19 <docent> relrod: is that something suitable for apprentices?
19:41:30 <nirik> relrod: how often? I might be able to help out...
19:41:47 <pingou> nirik: I must say, 9pm is better for me (not in the middle of
dinner as it is now), but I'm not the only one :)
19:41:49 <relrod> docent: suitable for anyone in the packager group ;)
19:41:53 <jimikirk> relrod: I'm interested in co-maintaining
19:42:08 <docent> relrod: ha, so no can do for now ;)
19:42:28 <relrod> nirik: one sec
19:42:38 <nirik> pingou: yeah, if we move an hour eariler we need to coordinate with
the irc support sig, as they are an hour before this meeting.
19:42:48 <nirik> if we move an hour later we could do that yeah
19:42:52 <pingou> nirik: or one hour later if it was
19:42:53 <relrod> nirik: looks like every 2 weeks or so, lately.
19:43:05 * relrod has no idea when they're going to make 4.54 stable.
19:43:16 <nirik> relrod: if you want to mentor jimikirk, you could add him as
comaintainer and show him the ropes. ;)
19:43:30 <pingou> abompard: what's better for you for the meeting (time wise) ?
19:43:51 <abompard> pingou: something earlier would be better
19:43:55 <nirik> relrod: and/or I also could comaintain and help mentor.
19:44:13 <relrod> nirik: sure, happy to add you both.
19:44:13 <jimikirk> nirik, relrod: I'm very interested
19:44:31 <pingou> abompard: and is 9 better than 8 for you? (if we can't move
19:44:34 <abompard> pingou: but if you prefer 9pm, I can make it work
19:44:37 <abompard> pingou: yeah
19:44:52 <nirik> relrod: cool. I'll need to sponsor jimikirk... but I can do
that and we can sort it after the meeting?
19:45:02 <relrod> nirik: wfm :)
19:45:27 <jimikirk> relrod: perhaps meeting in fedora-devel or fedora-admin after
19:45:34 <nirik> abompard / pingou we could also just do a whenisgood and see if
moving days would be better?
19:45:38 <abompard> pingou: actually I don't mind, 8pm or 9pm is pretty much the
19:45:42 <relrod> jimikirk: -admin works
19:45:51 <jimikirk> relrod: ok
19:46:11 <pingou> nirik: day is fine for me, it's more the time
19:46:20 <pingou> but if I'm the only one, I'll deal with it :)
19:46:21 <nirik> we have been on thursdays for a long time, but I don't care
much as long as the most people could make it.
19:46:34 <pingou> abadger1999: you have a meeting earlier don't you?
19:46:37 <abadger1999> FPC is two hours earlier and lately has gone two hours. That
won't go on forever, though (and many times, I don't have to speak in this meeting
-- especially when FPC has big things that take 2hours to resolve :-(
19:47:04 <abadger1999> pingou: so I wouldn't object to an hour earlier.
19:47:24 <nirik> also however, there's sometimes a fedora engineering phone
meeting now an hour before this meeting...
19:47:32 <nirik> so if we moved earlier that would conflict too.
19:47:38 <abadger1999> nirik: Maybe we could change that one though?
19:47:44 <nirik> possibly yeah.
19:48:01 <abadger1999> I don't think we've met twice at the same time for
19:48:26 <nirik> so, an hour later wouldn't help any? or it would?
19:48:45 <abadger1999> (Although, I think the next meeting has someone externally
scheduled.. so maybe we can't change that one.)
19:48:55 <pingou> earlier is better, then it's later, then it's as it is
19:49:24 <nirik> perhaps we should do a whenisgood. ;)
19:50:14 <nirik> I'll look at doing that (or someone else can) and send to the
19:50:32 <nirik> lets assume current time until/unless we change
19:51:04 <pingou> +1
19:51:20 <nirik> cool. Anything else for open floor?
19:51:36 <relrod> not from me
19:52:11 <nirik> cool. Thanks for coming everyone!
19:52:14 <nirik> #endmeeting