Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
FYI, there's an extension work done on the webhook implementation to provide more options from Zanata which is yet deployed to fedora.zanata.org.
Right now, the webhook available in fedora.zanata.org is when a document is 100% translated.
On Thu, Aug 24, 2017 at 4:45 AM, Matthew Miller mattdm@fedoraproject.org wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
-- Matthew Miller mattdm@fedoraproject.org Fedora Project Leader _______________________________________________ trans mailing list -- trans@lists.fedoraproject.org To unsubscribe send an email to trans-leave@lists.fedoraproject.org
On Wed, Aug 23, 2017 at 02:45:15PM -0400, Matthew Miller wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages; I'm looking something which can help show user activitiy.
On Wed, Aug 23, 2017 at 05:46:02PM -0400, Matthew Miller wrote:
On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages; I'm looking something which can help show user activitiy.
Ah, I think you're right. (At least staring at the payload and scratching my head makes me think so.)
So we'd need an additional webhook on commits in Zanata, or something like that?
Paul/Matthew,
Zanata 4.0 have few more options of webhooks but it is still waiting to be deployed. However, we do have staging machine which can be used for testing.
http://docs.zanata.org/en/release/user-guide/projects/project-settings/#webh...
We should catchup during Flock to have more information about the use cases.
On Fri, Aug 25, 2017 at 7:11 AM, Paul W. Frields stickster@gmail.com wrote:
On Wed, Aug 23, 2017 at 05:46:02PM -0400, Matthew Miller wrote:
On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi
feedback
are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages; I'm looking something which can help show user activitiy.
Ah, I think you're right. (At least staring at the payload and scratching my head makes me think so.)
So we'd need an additional webhook on commits in Zanata, or something like that?
-- Paul W. Frields http://paul.frields.org/ gpg fingerprint: 3DA6 A0AC 6D58 FEC4 0233 5906 ACDB C937 BD11 3717 http://redhat.com/ - - - - http://pfrields.fedorapeople.org/ The open source story continues to grow: http://opensource.com _______________________________________________ trans mailing list -- trans@lists.fedoraproject.org To unsubscribe send an email to trans-leave@lists.fedoraproject.org
On Fri, Aug 25, 2017 at 05:55:55PM +1000, Alex Eng wrote:
Paul/Matthew,
Zanata 4.0 have few more options of webhooks but it is still waiting to be deployed. However, we do have staging machine which can be used for testing.
http://docs.zanata.org/en/release/user-guide/projects/project-settings/#webh...
We should catchup during Flock to have more information about the use cases.
Yes, definitely. My case is pretty simple: I want to track the health of the project by measuring number of contributors per week and whether those contributors are new this year, active for 1-2 years, or "old school". I'd also like to see what percentage of work is done by which set of people — for example, in packaging changes in dist-git, it appears about ⅔ of the actions are taken by about the top 10% of contributors. Is that the same in translations? I dunno — let's find out!
2017-08-25 15:05 GMT+02:00 Matthew Miller mattdm@fedoraproject.org:
On Fri, Aug 25, 2017 at 05:55:55PM +1000, Alex Eng wrote:
Paul/Matthew,
Zanata 4.0 have few more options of webhooks but it is still waiting to be deployed. However, we do have staging machine which can be used for testing.
http://docs.zanata.org/en/release/user-guide/projects/project-settings/#webh...
We should catchup during Flock to have more information about the use cases.
Yes, definitely. My case is pretty simple: I want to track the health of the project by measuring number of contributors per week and whether those contributors are new this year, active for 1-2 years, or "old school". I'd also like to see what percentage of work is done by which set of people — for example, in packaging changes in dist-git, it appears about ⅔ of the actions are taken by about the top 10% of contributors. Is that the same in translations? I dunno — let's find out!
If you need something before Zanata 4, I can provide a userscript to get a list of what can be seen in the user activity pages (date, user, project-version, locale, action, number of words). But: - It's a userscript, so someone would have to open a browser, log into Zanata and copy-paste the output whenever they want to update the numbers. - It's basically a screen-scraper, so it's brittle (if a new language or member is added and that makes the pages the script uses paginate, it will stop working or give wrong results). - It queries users in the languages members lists. If contributions from people not represented there are possible, they are not counted. - It seems there's "only" data for a year, so no conclusions as to whether contributors have been active for 2 years, etc. - Executing it would launch (as of now) 66 requests for language members and then about 450 for members activity. I don't know if the server would like that.
Le 29 août 2017 06:55:23 UTC-04:00, "Máximo Castañeda" mcrcctm@gmail.com a écrit :
If you need something before Zanata 4, I can provide a userscript to get a list of what can be seen in the user activity pages (date, user, project-version, locale, action, number of words).
Hi, this looks very interesting bravo, can you please share this script? I tried to write something too, but used the API (which timeouts quite often..).
https://github.com/Jibec/fedora-translation-statistics
Even if I'm unsatisfied of the data I can collect, it still gives a picture of the current status of hosted projects.
2017-08-29 14:18 GMT+02:00 Jean-Baptiste Holcroft jean-baptiste@holcroft.fr:
Le 29 août 2017 06:55:23 UTC-04:00, "Máximo Castañeda" mcrcctm@gmail.com a écrit :
If you need something before Zanata 4, I can provide a userscript to get a list of what can be seen in the user activity pages (date, user, project-version, locale, action, number of words).
Hi, this looks very interesting bravo, can you please share this script? I tried to write something too, but used the API (which timeouts quite often..).
https://github.com/Jibec/fedora-translation-statistics
Even if I'm unsatisfied of the data I can collect, it still gives a picture of the current status of hosted projects.
https://pagure.io/us4z/blob/master/f/all_activity.user.js
When testing I limited it to 3 locales, I haven't run it even once to get all the data. So I don't know, it may explode too, and when it gets an error it doesn't retry or at least keep whatever it got to have less work next time.
After installed and activated, go to the languages list in zanata and you'll see an "Activity" button dumped there. Click it, wait, pray, wait a little bit more, and if you are lucky a table will appear at the end of the page.
You may also want to have a look at the other one in the repo (please use safety goggles), which is what I really had before this thread. Even though it's not finished and the code is still littered with TODO, test code and probably even dead code, it is a bit more integrated in zanata's look and feel. That one is aimed at reviewers and coordinators, and it has dates selection, different ways to group the data and links to projects. It appears as a new "tab" in the language members page. Most of the warnings I gave for the other one apply here, too.
And then someday I may get to an it-seems-it-runs state the one with which it all started: aimed at translators, it shows a tab in your dashboard with the same project stats and bars you see everywhere in zanata, but with all the projects/versions/groups/languages you are interested in and only those, all together in a place. Don't hold your breath.
And I should write at least a few words with a description and installation instructions.
Off-list
On 24 August 2017 at 03:16, Matthew Miller mattdm@fedoraproject.org wrote:
On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages; I'm looking something which can help show user activitiy.
Right, this is what we were looking for. In long term, it will also help for badges.
Thanks, Pravin
On Fri, Aug 25, 2017, at 10:26 AM, pravin.d.s@gmail.com wrote:
Off-list
On 24 August 2017 at 03:16, Matthew Miller mattdm@fedoraproject.org wrote:>> On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages;>> I'm looking something which can help show user activitiy.
Right, this is what we were looking for. In long term, it will also help for badges.
Is this on a project plan? Do we have a rough timeline? Can we get some historical data so we can run these numbers for the past? regards,
bex
On 25 August 2017 at 23:28, Brian Exelbierd bex@pobox.com wrote:
On Fri, Aug 25, 2017, at 10:26 AM, pravin.d.s@gmail.com wrote:
Off-list
On 24 August 2017 at 03:16, Matthew Miller mattdm@fedoraproject.org wrote:
On Wed, Aug 23, 2017 at 05:19:55PM -0400, Paul W. Frields wrote:
Hi everyone. I see that Zanata issues messages on the bus when documents reach milestones. I'm trying to get a better picture of Fedora's usage, and some things like package changes and bodhi feedback are very easy to measure because each action emits a fedmsg with an associated username. What would it take to get similar data for translation work?
This ticket looks relevant: https://pagure.io/fedora-infrastructure/issue/5120
I *think* this is the thing that does the document milestone messages; I'm looking something which can help show user activitiy.
Right, this is what we were looking for. In long term, it will also help for badges.
Is this on a project plan?
Yes, this is in plan from last flock.
Do we have a rough timeline? Can we get some historical data so we can run these numbers for the past?
I think Alex can help us here. Lets take this up for discussion in flock.
- Pravin