very simple end-to-end test
by Max Spevack
I'm having difficulty with even the simplest end to end tests --
information doesn't seem to be written into the sqlite db at all.
I noticed this when the graph was spitting out empty results, despite
the fact that tons of list data had been downloaded. Poked around
inside the .db, and nothing was there. The size of the .db was also
very small -- nothing had happened after ekg-generate-tables in terms of
touching the .db
I propose a simple end-to-end debugging test, Yaakov.
Login to our devel machine -- rawhide1.fedoraproject.org -- which has
python-ekg-0.3.2-1.fc11.noarch
Put only this in your config file:
[lists]
freeipa-devel = rhmailman
freeipa-users = rhmailman
And see if you can get a successful download & graph.
That will (a) prove we've got EKG working, and (b) give Karsten some
data that he is in great need of.
My $.02 -- maybe you'll have success where I have had FAIL.
--Max
14 years, 11 months
date parsing bug
by Max Spevack
I added some debug-code and narrowed it down a bit. Seems like
something odd is happening in February, but I can't figure out why it's
saying day is out of range for month, when it appears to only be using
month and year -- and since it's using a Python date library, I'd think
that there wouldn't be any weirdness.
This wasn't happening a few days ago. We've had successful runs past
this point before. There's a variety of different-formatted date
strings in the .txt.gz for that month, but I assume that exists for many
months.
Yaakov, or anyone else?
[mspevack@rawhide1 ~]$ rpm -q python-ekg
python-ekg-0.3.2-1.fc11.noarch
[mspevack@rawhide1 ~]$ ekg-scan
[Errno 17] File exists: 'fhmailman/cobbler'
May
2009
April
2009
March
2009
February
2009
Traceback (most recent call last):
File "/usr/bin/ekg-scan", line 8, in <module>
load_entry_point('ekg==0.3.2', 'console_scripts', 'ekg-scan')()
File "/usr/lib/python2.6/site-packages/ekg/commands.py", line 47, in
scan
stream = StreamClass.create_or_update(name=list)
File "/usr/lib/python2.6/site-packages/ekg/model.py", line 96, in
create_or_update
sql_obj.update(remote)
File "/usr/lib/python2.6/site-packages/ekg/model.py", line 160, in
update
self.source_class.create_or_update(**remote)
File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__
self.gen.throw(type, value, traceback)
File "/usr/lib/python2.6/site-packages/ekg/util.py", line 30, in pwd
yield
File "/usr/lib/python2.6/site-packages/ekg/model.py", line 159, in
update
for remote in iter_in_transaction(session, remotes):
File "/usr/lib/python2.6/site-packages/ekg/util.py", line 35, in
iter_in_transaction
for item in iter:
File "/usr/lib/python2.6/site-packages/ekg/model.py", line 252, in
remote_iter
match_dict['month'] = dup.parse('%s %s' % (match_dict['month'],
match_dict['year']))
File "/usr/lib/python2.6/site-packages/dateutil/parser.py", line 697,
in parse
return DEFAULTPARSER.parse(timestr, **kwargs)
File "/usr/lib/python2.6/site-packages/dateutil/parser.py", line 310,
in parse
ret = default.replace(**repl)
ValueError: day is out of range for month
14 years, 11 months
final code drop?
by Max Spevack
Hey Yaakov,
What's the status on a "final" ekg code drop prior to your internship
officially ending?
Also, how's the package review going?
What else do we need to know, in terms of having a bow all wrapped up
around EKG, both from a "I want to use it" and "I want to work on it"
point of view?
Do we have a roadmap/todo list that would give someone a place to get
started if they wanted to work on it?
Is there any low-hanging-fruit that you won't have a chance to get to?
(Hoping the answer is no :)
Thanks,
Max
14 years, 11 months
Fwd: EKG included in the Softpedia Linux software database
by Yaakov Nemoy
Got this a few days ago.
---------- Forwarded message ----------
From: Softpedia Editorial Team <linuxeditor(a)softpedia.com>
Date: 2009/5/20
Subject: EKG included in the Softpedia Linux software database
To: ekg(a)hexago.nl
Congratulations,
EKG, one of your products, has been added to Softpedia's database of
software programs for Linux. It is featured with a description text,
screenshots, download links and technical details on this page:
http://linux.softpedia.com/get/Programming/Libraries/EKG-47686.shtml
The description text was created by our editors, using sources such as
text from your product's homepage, information from its help system, the
PAD file (if available) and the editor's own opinions on the program
itself.
If you feel that having your product listed on Softpedia is not a benefit
for you or simply need something changed or updated, please contact us via
email at webmaster(a)softpedia.com and we will work with you to fix any
problem you may have found with the product's listing.
--
Sincerely,
The Softpedia Team
-----------------------------------------------------------------------
Softpedia is a library of over 400,000 free and free-to-try software
programs for Windows, Mac OS and Linux, games and gaming tools, Windows
device drivers, mobile devices and IT-related articles.
-----------------------------------------------------------------------
Softpedia - the encyclopedia of free software downloads
http://www.softpedia.com/
14 years, 11 months
Status 2009.05.17 Late Afternoon
by Yaakov Nemoy
Hey All,
EKG got a few under the hood changes today, i've put in migrate support, so we can change the DB schema. This will be important for making extensions to the program later on. I've built a pre release for 0.4.0 that should hilight the changes. I'm gonna aim for a full release once i have it doocumented.
Build URL coming soon.
-Yaakov
14 years, 11 months
Notes about changes to config
by Yaakov Nemoy
Hey All,
Just a heads up, moving forward i'm setting up EKG to use sqlalchemy-migrate to manage setting up and upgrading the database model. There will be new directions on the wiki shortly, but of note, make sure to include your DB URI in the config file. Your settings.ini files should have a line such as:
dburi=sqlite:///sqllite.db
In the case of sqlite, the database file will be made for you automatically. In the case of other databases, you probably need to set up and configure the DB and set the right permissions.
-Yaakov
14 years, 11 months
Pinging the python-ekg review request
by Yaakov Nemoy
Hey All,
I've noticed that the Review Request for python-ekg in Bugzilla is not happening. Can someone please take care of the review?
-Yaakov
14 years, 11 months
Re: [redhat.com #1088571] Access for publicly available mailing list archives via imap and/or pop3
by Max Spevack
On Thu, 14 May 2009, Marco Grigull via RT wrote:
> let me forward this to the Admin team for consideration. They will
> want to know which lists you are referring to.
As Yaakov says, eventually we might want to look at all of our public
lists -- this is part of the Community Architecture team's FY10 goals --
we've been asked to develop a tool that can analyze public email
archives and mine that data for various trends on community health.
However, as a starting point, we are looking at:
genome-list
ovirt-devel
freeipa-devel
freeipa-users
spacewalk-list
spacewalk-devel
fedora-devel-list
thincrust-devel
func-list
epel-devel-list
Thanks,
Max
14 years, 11 months
Re: [redhat.com #1088571] Access for publicly available mailing list archives via imap and/or pop3
by Yaakov Nemoy
To sum it up, all of them. There is an initial core set Max is
looking, but theoretically, any public mailing list is relevant to
anyone in the future.
-Yaakov
2009/5/14 Marco Grigull via RT <helpdesk(a)redhat.com>:
> Hi,
>
> let me forward this to the Admin team for consideration. They will want
> to know which lists you are referring to.
>
> Regards,
> Marco
>
> On Thu May 14 20:26:36 2009, loupgaroublond(a)gmail.com wrote:
>> Hi,
>>
>> I am currently working on EKG for max spevack and we are having some
>> reliability and performance issues reading the RH mailman instance. I
>> would like to request open access to the public archives in other
>> formats that are designed to perform better for our purposes.
>>
>> I would like to ask RH IT to provide the archives available as a set
>> of pop3 and/or imap mailboxes. There are a number of tools we can use
>> that handle the rest of the job.
>>
>> Thanks in advance.
>>
>> -Yaakov Nemoy
>
>
> --
> Marco Grigull
> Global Help Desk
>
>
14 years, 11 months
Access for publicly available mailing list archives via imap and/or pop3
by Yaakov Nemoy
Hi,
I am currently working on EKG for max spevack and we are having some
reliability and performance issues reading the RH mailman instance. I
would like to request open access to the public archives in other
formats that are designed to perform better for our purposes.
I would like to ask RH IT to provide the archives available as a set
of pop3 and/or imap mailboxes. There are a number of tools we can use
that handle the rest of the job.
Thanks in advance.
-Yaakov Nemoy
14 years, 11 months