fedrtc.org -> infrastructure?
by Daniel Pocock
Hi all,
At some point, it would be good to see fedrtc.org migrate to Fedora
infrastructure and use the fedoraproject.org domain
I'd be happy to submit the full request for resources[1] but I just want
to see if there is any initial comment on it. Here is a list of what is
involved:
- it uses a PostgreSQL database schema[2]
- it requires some DNS entries (SRV and NAPTR), examples[3]
- it needs a TLS cert for fedoraproject.org on the host(s) where it runs
- it has static HTTP content and PHP that is currently hosted with all
but one problem[4] on a RHEL7 httpd. Content is in Github[5], it could
be presented as an RPM if necessary.
- all packages are in EPEL7, except:
cajun-json in EPEL6, in testing for EPEL7
resiprocate in Fedora, builds from SRPM on RHEL7
- the SIP proxy is a single daemon, managed by systemctl. All settings
in a single file, /etc/repro/repro.config
- the TURN server process is also a single daemon, managed by systemctl.
All settings in a single file, /etc/reTurn/reTurnServer.config
Just to clarify the scope of this: it is not a full telephony service
like Asterisk, just a SIP proxy and TURN server. There is no persistent
state information (as there would be for voicemail, email service, etc)
and no customized routing.
Ongoing maintenance requirements:
- TLS certificate renewals
- monitoring the ports
- package updates from time to time
It currently runs on a lab machine, I'd be happy to arrange SSH access
to the Fedora Infrastructure team to see exactly what is involved and
verify that it is manageable.
Regards,
Daniel
1. https://fedoraproject.org/wiki/Request_For_Resources
2.
https://github.com/resiprocate/resiprocate/blob/master/repro/create_postg...
3. http://rtcquickstart.org/guide/multi/dns.html
4. https://bugzilla.redhat.com/show_bug.cgi?id=1222649
5. https://github.com/opentelecoms-org/fedrtc-org
8 years
Council Engineering update
by Josh Boyer
Hi Infrastructure,
As part of the on-going Council updates, I'm organizing a Fedora
Engineering update. This includes the various WGs, rel-eng,
infrastructure, and a few others. The idea behind this is to give a
brief update of the work your group is doing towards the F23 and F24
releases. Think of this as a 5-10 minute "lightning talk" of the
highlights you want to see in those releases.
The meeting is July 7th. It would be excellent if you could have a
volunteer present the update for your group and stay around to answer
any questions. Worst case, please gather the information and send it
to me and I can do the overview, but representation from the group is
clearly preferred.
If you have questions, please let me know. The idea and format are
somewhat new, so we'll work through this as best we can.
josh
8 years, 5 months
[PATCH] distgit: Upload files to both the new and old path
by Mathieu Bridon
From: Mathieu Bridon <bochecha(a)daitauha.fr>
Currently, the CGI script is set to upload files:
- to the old path if the upload uses md5
- to the new path if the upload uses sha512
The old path is as follows:
/%(srpmname)s/%(filename)s/%(hash)s/%(filename)s
The new path is:
/%(srpmname)s/%(filename)s/%(hashtype)s/%(hash)s/%(filename)s
This was meant to ensure compatibility with current fedpkg which
always downloads from the old path, but will eventually download from
the new path when we move to sha512.
However, working more on this, I now think it would make for a smoother
transition if we instead always stored the files at the new path, but
just hardlinked to the old path if the upload is using md5.
This is what this patch achieves.
With this deployed in production, fedpkg could be patched to try
downloading from the new path, and fallback to the old one if necessary,
which decouples the migration to the new path from the migration to the
new hash.
---
roles/distgit/files/dist-git-upload.cgi | 10 +++++-----
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/roles/distgit/files/dist-git-upload.cgi b/roles/distgit/files/dist-git-upload.cgi
index b4fda74..38c40db 100644
--- a/roles/distgit/files/dist-git-upload.cgi
+++ b/roles/distgit/files/dist-git-upload.cgi
@@ -112,11 +112,6 @@ def main():
hash_dir = os.path.join(module_dir, filename, hash_type, checksum)
msgpath = os.path.join(name, module_dir, filename, hash_type, checksum, filename)
- if hash_type == "md5":
- # Preserve compatibility with the current folder hierarchy for md5
- hash_dir = os.path.join(module_dir, filename, checksum)
- msgpath = os.path.join(name, module_dir, filename, checksum, filename)
-
unwanted_prefix = '/srv/cache/lookaside/pkgs/'
if msgpath.startswith(unwanted_prefix):
msgpath = msgpath[len(unwanted_prefix):]
@@ -180,6 +175,11 @@ def main():
print >> sys.stderr, '[username=%s] Stored %s (%d bytes)' % (username, dest_file, filesize)
print 'File %s size %d %s %s stored OK' % (filename, filesize, hash_type.upper(), checksum)
+ # Add the file to the old path, where fedpkg is currently looking for it
+ if hash_type == "md5":
+ old_path = os.path.join(module_dir, filename, checksum, filename)
+ os.link(dest_file, old_path)
+
# Emit a fedmsg message. Load the config to talk to the fedmsg-relay.
try:
config = fedmsg.config.load_config([], None)
--
2.1.0
8 years, 5 months
[adrian@fedoraproject.org: [ansible] Re-enable /mirrormanager without slash at the end]
by Adrian Reber
This change still needs a playbook to be run. If this change is correct
it would be great if someone could run the playbook. Thanks.
Adrian
----- Forwarded message from Adrian Reber <adrian(a)fedoraproject.org> -----
Date: Sun, 31 May 2015 09:30:09 +0000 (UTC)
From: Adrian Reber <adrian(a)fedoraproject.org>
To: sysadmin-members(a)fedoraproject.org
Subject: [ansible] Re-enable /mirrormanager without slash at the end
This is the public repository, do not commit sensitive
or confidential information here.
X-Git-Refname: refs/heads/master
X-Git-Oldrev: af9462caabbbbff1cb4736d6ffaec93338c2f7b8
X-Git-Newrev: 9a90bb869ff7982dc6c05c804d83f7444249fc52
commit 9a90bb869ff7982dc6c05c804d83f7444249fc52
Author: Adrian Reber <adrian(a)lisas.de>
Date: Sun May 31 09:27:54 2015 +0000
Re-enable /mirrormanager without slash at the end
The mirrormanager application and the publiclist re-write used to work
without a slash at the end. Re-enable /mirrormanager without a slash at
the end of the URL.
roles/varnish/files/proxy.vcl | 2 +-
1 files changed, 1 insertions(+), 1 deletions(-)
---
diff --git a/roles/varnish/files/proxy.vcl b/roles/varnish/files/proxy.vcl
index ed8333b..788b717 100644
--- a/roles/varnish/files/proxy.vcl
+++ b/roles/varnish/files/proxy.vcl
@@ -181,7 +181,7 @@ sub vcl_recv {
set req.url = regsub(req.url, "\?.*", "");
}
}
- if (req.url ~ "^/mirrormanager/") {
+ if (req.url ~ "^/mirrormanager") {
set req.backend_hint = mirrormanager;
if (req.url ~ "^/mirrormanager/static/") {
unset req.http.cookie;
----- End forwarded message -----
8 years, 6 months
Ticket #4765 (RFR) - Domain name request for the Fedora Bootstrap project web server
by Jaromir Capik
Hello.
We created a homepage for the Fedora Bootstrap project we're hosting on the OS1 cloud VM and we'd like to request a well looking domain name for the web URL. We believe the 'bootstrap.fedoraproject.org' is the most suitable and easy to remember name. The current FQDN is vm-107-179-132-209.osop.rhcloud.com (pointing at 209.132.179.107) and we've requested a change to fedora-bootstrap.osop.rhcloud.com in the OS1 tracker (should be configured tonight) so that you could create a CNAME record if needed. We expect the server could be under a heavy network load soon as it offers rootfs snapshots and therefore it isn't wise to do proxying. Please, let me know if you need any additional data.
Thanks in advance.
Regards, Jaromir.
--
Jaromir Capik
Red Hat Czech, s.r.o.
Software Engineer / Secondary Arch
Email: jcapik(a)redhat.com
Web: www.cz.redhat.com
Red Hat Czech s.r.o., Purkynova 99/71, 612 45, Brno, Czech Republic
IC: 27690016
8 years, 6 months
haproxy and mirrorlists
by Kevin Fenzi
So, currently we have 5 mirrorlists servers, spread out around the
world in 5 datacenters.
Haproxy on our proxies sends requests to all 5 of those as they come
in. This means for example that a request could hit proxy01 and it
could send it to mirrorlist-host1plus in germany and then the reply
comes back out proxy01 to the user. Not only does that mean there's
more traffic on our vpn, but the answer is slower for the user.
5 of our datacenters have a local mirrorlist in the same datacenter,
but currently it's just one of 5, so gets only 20% of traffic or so.
I'd like to change the haproxy config from being a file to a template.
In that mirrorlist section:
listen mirror-lists 0.0.0.0:10002
balance hdr(appserver)
timeout connect 30s
{% if datacenter == 'dedicatedsolutions' %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3 backup
{% elif datacenter == 'host1plus' %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3 backup
{% elif datacenter == 'ibiblio' %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3 backup
{% elif datacenter == 'osuosl' %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3 backup
{% elif datacenter == 'phx2' %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3 backup
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3
{% else %}
server mirrorlist-dedicatedsolutions mirrorlist-dedicatedsolutions:80 check inter 5s rise 2 fall 3
server mirrorlist-host1plus mirrorlist-host1plus:80 check inter 5s rise 2 fall 3
server mirrorlist-ibiblio mirrorlist-ibiblio:80 check inter 5s rise 2 fall 3
server mirrorlist-osuosl mirrorlist-osuosl:80 check inter 5s rise 2 fall 3
server mirrorlist-phx2 mirrorlist-phx2:80 check inter 5s rise 2 fall 3
{% endif %}
option httpchk GET /mirrorlist
option allbackups
This means that for the 5 proxies with a local mirrorlist server in their same datacenter,
they use that one unless it's down, then they use any of the other ones.
This should reduce traffic on our vpn and give people faster mirror answers.
Did I miss anything here? Does the change look good?
kevin
8 years, 6 months
[release] pagure: 0.1.9
by Pierre-Yves Chibon
Good morning everyone,
Yesterday and today, with the help of Patrick we cut and pushed a new release of
pagure: 0.1.9.
Here is its changelog:
* Fri May 29 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 0.1.9-1
- Update to 0.1.9
- Initial API work
- Document the initial API
- Fix the CSS to present the links correctly
- Add new API endpoint to list the git tags of a project
- Ensure the DB is updated regarding the start and stop commits before merging
Let me know if you run into any trouble :)
Thanks,
Pierre
8 years, 6 months
Meeting Agenda Item: Introduction Mike Ruckman
by Mike Ruckman
Hey Infra team!
Many of you know me on IRC as roshi, working with the Cloud WG and the
QA team. I'm interested in learning more about the inner workings of our
infrastructure and thought it'd be good to join the team.
What skills you have to offer and which you would like to learn: I'm
fairly well versed in python, have system admin experience and want to
learn more. I'm interested in filling gaps and learning all I can,
specifically working with cloud and release engineering.
What you would like to work on: I'm open to helping anywhere infra can
use an extra set of eyes, but I'm really interested in helping with our
cloud infrastructure and anything on the release engineering side of
things.
I'll be attending the meeting at 1800UTC - see you there!
--
// Mike
--
Fedora QA
freenode: roshi
http://roshi.fedorapeople.org
8 years, 6 months
Fwd: Joining FAS / Infrastructure group
by SmootherFrOgZ
Hi Nasko,
Forwarding your email to the infrastructure list as this the right
place to introduce yourself.
You might want to look at this as well:
http://fedoraproject.org/wiki/Infrastructure/GettingStarted
---------- Forwarded message ---------
From: Atanas Beloborodov <arrtedone(a)gmail.com>
Date: Thu, May 28, 2015 at 2:48 AM
Subject: Joining FAS / Infrastructure group
Hi, my name is Atanas Beloborodov (Nasko), currently located in Plovdiv,
Bulgaria.
Using Fedora since Fedora Core 3
I am and web developer / administrator with 10 years experience,
currently employed by [Programista; <http://programista.bg/>].I worked
with some of the biggest web agencies (BBDO, Proximity) on challenging
projects for clients like Pepsi, Lays, Costa Concordia, Ministere,
Comverse, AKQA and so on.
Member and one of founders of non-profit organization Hackafe (
http://hackafe.org/) - place, where local IT community exchange and share
ideas, get new skills, make new contacts. Hackafe also organize courses,
meetings, lectures and conferences on local level.
I want to be allowed to join Fedora FAS / Infrastructure group and try to
bring my experience, professionalism and passion for excellence to the
Fedora Project.
Thanks in advance, Nasko.
8 years, 6 months
[release] elections: 2.5.4
by Pierre-Yves Chibon
Good morning everyone,
I just cut and pushed a new elections release: 2.5.4
It's just a bug-fix release that push the hotfix I had made during the freeze
and last elections to have the simplified range voting work properly.
Here is the changelog:
* Thu May 28 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 2.5.4-1
- Update to 2.5.4
- Fix displaying information about the simplified range voting method
- Fix setting the max_vote value in the stats dict for the results page
This way, if we need to re-install we'll have the fixes :)
Cheers,
Pierre
8 years, 6 months