badges-backend(and stg)
by Zach Villers
I've been working on getting the award-lifecycle-badges cron job to run from badges-backend. I beleive I have the script fixed, but I have a couple of problems;
1. This error message from badges-backend01.stg
requests.exceptions.SSLError: hostname 'admin.fedoraproject.org' doesn't match either of '*.stg.fedoraproject.org', 'stg.fedoraproject.org'
2. The original reason (as far as I can tell) that the script fails is that the request to pull down all of the usernames from FAS times out. In a couple of limited (and babysat) tests on the production machine. My script works, but would take (in my estimation) 10-15 hours to run.
I don't know if the reason behind this is that there are alot of lifecycle badges to be awarded, or the resources available to badges-backend + tahrir + fas isn't sufficient for the number of users/backlog we have, or if my fix is crap.
I'd like to get some advice/suggestions on this and have placed an item on the meeting agenda today.
Basically, to get around the timeout issue, I created a list of search terms (a*, b*, etc) so that I only pull in one letter of the alphabet at a time. The main function pulls down each list of usernames, checks to see if each user needs one of five lifecycle badges and awards the badge if the user qualifies. Here is a bit of the main loop;
fas_credentials = fm_config['fas_credentials']
searchterms = gen_fas_searchterms()
for search_elem in searchterms:
results = get_fas_userlist(fas_credentials, search_elem)
8 years, 1 month
Freeze break request: Enable Basset to 0.3 and enable mediawiki extension
by Patrick Uiterwijk
Hi,
Could I get +1s for:
- the following patches
- updating basset on basset01
- running the mediawiki and basset playbooks
This will enable the mediawiki automated cleanup and account blocking.
commit e86a0bb505017454f8e921374d1f593136fdc5ec
Author: Patrick Uiterwijk <puiterwijk(a)redhat.com>
Date: Tue Mar 22 20:51:07 2016 +0000
Add ACL for basset frontend
Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com>
diff --git a/roles/basset/frontend/tasks/main.yml
b/roles/basset/frontend/tasks/main.yml
index 54637ab..d2ccf6b 100644
--- a/roles/basset/frontend/tasks/main.yml
+++ b/roles/basset/frontend/tasks/main.yml
@@ -6,6 +6,15 @@
- basset
- basset/frontend
+- name: install basset config
+ template: src=frontend.cfg.j2 dest=/etc/basset/frontend.cfg
+ user=basset-frontend group=basset-frontend mode=0600
+ notify:
+ - restart httpd
+ tags:
+ - basset
+ - basset/frontend
+
- name: install staging htpasswd
copy: src={{private}}/files/httpd/basset.stg.htpasswd
dest=/etc/httpd/conf.d/basset.htpasswd
owner=root group=root mode=0644
diff --git a/roles/basset/frontend/templates/frontend.cfg.j2
b/roles/basset/frontend/templates/frontend.cfg.j2
new file mode 100644
index 0000000..476efa2
--- /dev/null
+++ b/roles/basset/frontend/templates/frontend.cfg.j2
@@ -0,0 +1,6 @@
+[submission_access]
+10.5.126.63 = mediawiki.new,mediawiki.edit
+10.5.126.73 = mediawiki.new,mediawiki.edit
+10.5.126.25 = fedora.fas.registration,fedora.fas.cla_sign
+10.5.126.26 = fedora.fas.registration,fedora.fas.cla_sign
+10.5.126.30 = fedora.fas.registration,fedora.fas.cla_sign
commit b10be2e241a3b270236aa0f35f89609281e75595
Author: Patrick Uiterwijk <puiterwijk(a)redhat.com>
Date: Tue Mar 22 20:46:39 2016 +0000
Open iptables on basset for wiki
Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com>
diff --git a/inventory/group_vars/basset b/inventory/group_vars/basset
index 5bab0fa..85fc069 100644
--- a/inventory/group_vars/basset
+++ b/inventory/group_vars/basset
@@ -9,6 +9,9 @@ custom_rules: [
'-A INPUT -p tcp -m tcp -s 10.5.126.25 --dport 80 -j ACCEPT',
'-A INPUT -p tcp -m tcp -s 10.5.126.26 --dport 80 -j ACCEPT',
'-A INPUT -p tcp -m tcp -s 10.5.126.30 --dport 80 -j ACCEPT'
+ # wiki01, wiki02
+ '-A INPUT -p tcp -m tcp -s 10.5.126.63 --dport 80 -j ACCEPT'
+ '-A INPUT -p tcp -m tcp -s 10.5.126.73 --dport 80 -j ACCEPT'
]
fas_client_groups: sysadmin-main
diff --git a/inventory/group_vars/basset-stg
b/inventory/group_vars/basset-stg
index ad45a6f..02049e5 100644
--- a/inventory/group_vars/basset-stg
+++ b/inventory/group_vars/basset-stg
@@ -7,6 +7,8 @@ num_cpus: 2
custom_rules: [
# fas01.stg
'-A INPUT -p tcp -m tcp -s 10.5.126.86 --dport 80 -j ACCEPT',
+ # wiki01.stg
+ '-A INPUT -p tcp -m tcp -s 10.5.126.60 --dport 80 -j ACCEPT',
]
fas_client_groups: sysadmin-main
commit bc7f0faabfcef27470398703fdd2cf43a6daf270
Author: Patrick Uiterwijk <puiterwijk(a)redhat.com>
Date: Tue Mar 22 20:44:02 2016 +0000
Enable mediawiki basset plugin
Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com>
diff --git a/roles/mediawiki/tasks/main.yml b/roles/mediawiki/tasks/main.yml
index dc64683..ddf1e8e 100644
--- a/roles/mediawiki/tasks/main.yml
+++ b/roles/mediawiki/tasks/main.yml
@@ -36,6 +36,7 @@
- mediawiki119-RSS
- mediawiki-FedoraBadges
+ - mediawiki119-basset
- php-zmq
- php-pecl-uuid
tags:
diff --git a/roles/mediawiki/templates/LocalSettings.php.fp.j2
b/roles/mediawiki/templates/LocalSettings.php.fp.j2
index a6c10b4..3362115 100644
--- a/roles/mediawiki/templates/LocalSettings.php.fp.j2
+++ b/roles/mediawiki/templates/LocalSettings.php.fp.j2
@@ -324,6 +324,18 @@ require_once "$IP/extensions/fedmsg-emit.php";
require_once "$IP/extensions/HTTP302Found/HTTP302Found.php";
require_once "$IP/extensions/intersection/DynamicPageList.php";
require_once "$IP/extensions/RSS/RSS.php";
+require_once "$IP/extensions/BassetSubmitter.php";
+
+{% if env == "staging" %}
+$basset_url = 'http://basset01.stg.phx2.fedoraproject.org/basset';
+$basset_username = '{{ basset_stg_frontend_user }}';
+$basset_password = '{{ basset_stg_frontend_pass }}';
+{% else %}
+$basset_url = 'http://basset01.phx2.fedoraproject.org/basset';
+$basset_username = '{{ basset_prod_frontend_user }}';
+$basset_password = '{{ basset_prod_frontend_pass }}';
+{% endif %}
+
$wgShowExceptionDetails = true;
8 years, 1 month
Freeze break: cachefilesd
by Kevin Fenzi
Greetings.
I'd like to take download05 out of dns and test out using cachefilesd
on it. We tried this a number of years ago with rhel6 and ran into
problems, but perhaps rhel7 might be more stable.
Basically this would be setting up a 500GB cache on the server and then
caching 500GB of stuff from nfs. In theory this would reduce load on
the backend NFS server. There is a pending netapp upgrade and storage
folks would need to throttle our access while the upgrade was
happening, so the more load we can take off the filer, the better it
will be when we have to do the upgrade.
I'd take download05 out of dns (so no one should hit it), setup
cachefilesd and test. If all goes well on testing we could re-add it
and see if handles normal load. If not or if it cannot handle regular
load we can just repave it and put it back the way it is now.
4 download machines should be fine for the normal load we have, and
this testing should long be done before the end of the week when we
might need to stage Alpha.
Thoughts? +1s?
kevin
8 years, 1 month
Freeze break: pkgs git config
by Kevin Fenzi
Greetings.
It seems there is a fedpkg/pyrpgk update that depends on using the
namespaced (/rpms/) git checkouts.
I'd like to apply the following to pkgs02:
diff --git a/inventory/group_vars/pkgs b/inventory/group_vars/pkgs
index 2ebef26..fa29449 100644
--- a/inventory/group_vars/pkgs
+++ b/inventory/group_vars/pkgs
@@ -18,7 +18,7 @@ git_group: packager
git_port: 9418
git_server: /usr/libexec/git-core/git-daemon
git_server_args: --export-all --syslog --inetd --verbose
-git_basepath: /srv/git/repositories/rpms
+git_basepath: /srv/git/repositories
git_daemon_user: nobody
clamscan_mailto: admin(a)fedoraproject.org
and then make sure we are using the systemd git socket instead of
xinetd (which we seem to be for some reason currently).
This should allow namespaced git checkouts and fix:
https://fedorahosted.org/fedora-infrastructure/ticket/5178
and
https://fedorahosted.org/fedora-infrastructure/ticket/5059
I also have already made this change in stg a while back and it works
fine there.
+1s?
kevin
8 years, 1 month
Re: The results of your email commands
by Sérgio Basto
Also , can't unsubscribe java-devel mailing list
On Seg, 2016-03-21 at 18:33 +0000, java-devel-
bounces(a)lists.fedoraproject.org wrote:
> The results of your email command are provided below. Attached is
> your
> original message.
>
> - Results:
> sergio(a)serjux.com is not a member of the java-devel mailing list
>
> - Done.
>
--
Sérgio M. B.
8 years, 1 month
ocaml-devel@lists.fedoraproject.org is not delivering emails Re:
Undelivered Mail Returned to Sender
by Sérgio Basto
On Seg, 2016-03-21 at 18:15 +0000, Mail Delivery System wrote:
> This is the mail system at host lists.fedoraproject.org.
>
> I'm sorry to have to inform you that your message could not
> be delivered to one or more recipients. It's attached below.
>
> For further assistance, please send mail to postmaster.
>
> If you do so, please include this problem report. You can
> delete your own text from the attached returned message.
>
> The mail system
>
> <ocaml-devel(a)lists.fedoraproject.org>: host
> mailman01.vpn.fedoraproject.org[192.168.1.118] said: 550 5.1.1
> <ocaml-devel(a)lists.fedoraproject.org>: Recipient address
> rejected: User
> unknown in local recipient table (in reply to RCPT TO command)
--
Sérgio M. B.
8 years, 1 month
Freeze break request: update Mailman3+Postorius+HyperKitty
by Aurelien Bompard
Hi!
There's been a lot of recent changes in the Mailman stack, including a new
feature that will let us migrate more lists. I'd like to update the
software stack on prod and keep it under observation for a few days (there
are apparently performance issues for some people).
This freeze break does not include migrating the remaining lists, except
trans-ru. I've received a request to migrate this one, it has been cleared
of the filters that blocked it before, so it shouldn't be any different
from the others.
What say you? :-)
Aurélien
8 years, 1 month
[PATCH] releng sudoe cleanup
by Dennis Gilmore
From: Dennis Gilmore <ausil(a)fedoraproject.org>
move releng-sudoers to 00releng-sudoers everywhere
drop the no longer needed ftpsync-sudo file
ansible-priave has some changes to match
Signed-off-by: Dennis Gilmore <ausil(a)fedoraproject.org>
---
inventory/group_vars/bodhi-backend | 2 +-
inventory/group_vars/bodhi-backend-stg | 2 +-
inventory/group_vars/buildarm | 2 +-
inventory/group_vars/buildhw | 2 +-
inventory/group_vars/buildppc | 2 +-
inventory/group_vars/buildppcle | 2 +-
inventory/group_vars/buildvm | 2 +-
inventory/group_vars/buildvm-ppc64 | 2 +-
inventory/group_vars/buildvm-ppc64le | 2 +-
inventory/group_vars/buildvm-stg | 2 +-
inventory/group_vars/koji | 2 +-
inventory/group_vars/koji-stg | 2 +-
inventory/group_vars/osbs-stg | 2 +-
inventory/group_vars/sign-bridge | 2 +-
inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org | 2 +-
inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org | 2 +-
roles/releng/tasks/main.yml | 5 -----
17 files changed, 16 insertions(+), 21 deletions(-)
diff --git a/inventory/group_vars/bodhi-backend b/inventory/group_vars/bodhi-backend
index 796c058..dfc9440 100644
--- a/inventory/group_vars/bodhi-backend
+++ b/inventory/group_vars/bodhi-backend
@@ -42,6 +42,6 @@ fedmsg_error_recipients:
nfs_mount_opts: "rw,hard,bg,intr,noatime,nodev,nosuid,nfsvers=3"
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
## XXX - note that the csi_ stuff is kept at the host_vars/ level.
diff --git a/inventory/group_vars/bodhi-backend-stg b/inventory/group_vars/bodhi-backend-stg
index a4f7723..4f9204e 100644
--- a/inventory/group_vars/bodhi-backend-stg
+++ b/inventory/group_vars/bodhi-backend-stg
@@ -73,7 +73,7 @@ fedmsg_certs:
- bodhi.updates.fedora.sync
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
# For the MOTD
diff --git a/inventory/group_vars/buildarm b/inventory/group_vars/buildarm
index c57d037..8d36e73 100644
--- a/inventory/group_vars/buildarm
+++ b/inventory/group_vars/buildarm
@@ -1,6 +1,6 @@
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
ansible_ifcfg_blacklist: true
koji_server_url: "http://koji.fedoraproject.org/kojihub"
diff --git a/inventory/group_vars/buildhw b/inventory/group_vars/buildhw
index ab559ca..6c2cc5e 100644
--- a/inventory/group_vars/buildhw
+++ b/inventory/group_vars/buildhw
@@ -1,7 +1,7 @@
---
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
freezes: true
koji_server_url: "http://koji.fedoraproject.org/kojihub"
diff --git a/inventory/group_vars/buildppc b/inventory/group_vars/buildppc
index d0891f9..76c7e4c 100644
--- a/inventory/group_vars/buildppc
+++ b/inventory/group_vars/buildppc
@@ -21,7 +21,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}"
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
koji_server_url: "http://koji.fedoraproject.org/kojihub"
koji_weburl: "http://koji.fedoraproject.org/koji"
diff --git a/inventory/group_vars/buildppcle b/inventory/group_vars/buildppcle
index 8c001a2..9bafafe 100644
--- a/inventory/group_vars/buildppcle
+++ b/inventory/group_vars/buildppcle
@@ -20,7 +20,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}"
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
koji_server_url: "http://koji.fedoraproject.org/kojihub"
koji_weburl: "http://koji.fedoraproject.org/koji"
diff --git a/inventory/group_vars/buildvm b/inventory/group_vars/buildvm
index 4b3a6d2..a16019f 100644
--- a/inventory/group_vars/buildvm
+++ b/inventory/group_vars/buildvm
@@ -16,7 +16,7 @@ virt_install_command: "{{ virt_install_command_two_nic }}"
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
koji_server_url: "http://koji.fedoraproject.org/kojihub"
koji_weburl: "http://koji.fedoraproject.org/koji"
diff --git a/inventory/group_vars/buildvm-ppc64 b/inventory/group_vars/buildvm-ppc64
index dbfbab7..9012128 100644
--- a/inventory/group_vars/buildvm-ppc64
+++ b/inventory/group_vars/buildvm-ppc64
@@ -14,7 +14,7 @@ dns: 10.5.126.21
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng,sysadmin-secondary
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
virt_install_command: "{{ virt_install_command_one_nic }} --graphics none"
diff --git a/inventory/group_vars/buildvm-ppc64le b/inventory/group_vars/buildvm-ppc64le
index 8c1ebd6..376d4e2 100644
--- a/inventory/group_vars/buildvm-ppc64le
+++ b/inventory/group_vars/buildvm-ppc64le
@@ -14,7 +14,7 @@ dns: 10.5.126.21
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng,sysadmin-secondary
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
virt_install_command: "{{ virt_install_command_one_nic }} --graphics none"
diff --git a/inventory/group_vars/buildvm-stg b/inventory/group_vars/buildvm-stg
index 293d05b..08562ba 100644
--- a/inventory/group_vars/buildvm-stg
+++ b/inventory/group_vars/buildvm-stg
@@ -14,7 +14,7 @@ dns: 10.5.126.21
# the host_vars/$hostname file
host_group: kojibuilder
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
datacenter: staging
nfs_mount_opts: "rw,hard,bg,intr,noatime,nodev,nosuid"
diff --git a/inventory/group_vars/koji b/inventory/group_vars/koji
index df2bfa2..6096adb 100644
--- a/inventory/group_vars/koji
+++ b/inventory/group_vars/koji
@@ -19,7 +19,7 @@ custom_rules: [
]
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
# These are consumed by a task in roles/fedmsg/base/main.yml
fedmsg_certs:
diff --git a/inventory/group_vars/koji-stg b/inventory/group_vars/koji-stg
index b34c56d..4876829 100644
--- a/inventory/group_vars/koji-stg
+++ b/inventory/group_vars/koji-stg
@@ -36,7 +36,7 @@ fedmsg_certs:
# NOTE -- staging mounts read-only
nfs_mount_opts: "ro,hard,bg,intr,noatime,nodev,nosuid,nfsvers=3"
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
koji_server_url: "http://koji.stg.fedoraproject.org/kojihub"
koji_weburl: "http://koji.stg.fedoraproject.org/koji"
diff --git a/inventory/group_vars/osbs-stg b/inventory/group_vars/osbs-stg
index 768067e..1b6424d 100644
--- a/inventory/group_vars/osbs-stg
+++ b/inventory/group_vars/osbs-stg
@@ -7,4 +7,4 @@ num_cpus: 2
tcp_ports: [ 80, 443 ]
fas_client_groups: sysadmin-releng,fi-apprentice
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
diff --git a/inventory/group_vars/sign-bridge b/inventory/group_vars/sign-bridge
index 55170e5..c01cbcd 100644
--- a/inventory/group_vars/sign-bridge
+++ b/inventory/group_vars/sign-bridge
@@ -10,4 +10,4 @@ num_cpus: 4
tcp_ports: [ 44333, 44334 ]
fas_client_groups: sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
diff --git a/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org b/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org
index 18e3815..f18bb81 100644
--- a/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org
+++ b/inventory/host_vars/compose-ppc64-01.ppc.fedoraproject.org
@@ -10,7 +10,7 @@ gw: 10.5.129.254
main_bridge: br1
fas_client_groups: sysadmin-noc,sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
host_group: releng
diff --git a/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org b/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org
index 07d4904..c6e3970 100644
--- a/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org
+++ b/inventory/host_vars/compose-ppc64le-01.ppc.fedoraproject.org
@@ -10,7 +10,7 @@ gw: 10.5.129.254
main_bridge: br1
fas_client_groups: sysadmin-noc,sysadmin-releng
-sudoers: "{{ private }}/files/sudo/releng-sudoers"
+sudoers: "{{ private }}/files/sudo/00releng-sudoers"
host_group: releng
diff --git a/roles/releng/tasks/main.yml b/roles/releng/tasks/main.yml
index cb99faf..08d0b18 100644
--- a/roles/releng/tasks/main.yml
+++ b/roles/releng/tasks/main.yml
@@ -185,11 +185,6 @@
copy: src="twoweek-updates" dest=/etc/cron.d/twoweek-updates
when: inventory_hostname.startswith('compose-x86-01')
-- name: sudoers for ftpsync
- copy: src="{{ private }}/files/sudo/ftpsync-sudo" dest=/etc/sudoers.d/ftpsync mode=0440
- tags:
- - configs
-
- name: install compose /etc/httpd/conf.d/compose.conf file
copy: >
src="compose.conf"
--
1.8.3.1
8 years, 1 month