Jul 13 15:55:56 --> You are now talking on #fedora-admin Jul 13 15:55:56 --- Topic for #fedora-admin is This is the meeting place of the Fedora Infrastructure & Sysadmin team | http://fedoraproject.org/wiki/Infrastructure | Regular meetings: http://fedoraproject.org/wiki/Infrastructure/Meetings | https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list/ Jul 13 15:55:56 --- Topic for #fedora-admin set by nman64 at Sun Jun 25 00:30:30 2006 Jul 13 15:56:22 Sopwith: thought you'd be gone? Jul 13 15:56:40 I thought so too Jul 13 15:56:52 But apparently TV stations don't like it when you show up half an hour late for a tour... Jul 13 15:57:12 doh Jul 13 15:57:12 ahh well Jul 13 15:58:56 hehe Jul 13 16:03:46 erk, I hate java Jul 13 16:04:21 is there a meeting tonight? Jul 13 16:04:25 yea Jul 13 16:04:32 xdamox: How was your time away? Jul 13 16:05:18 Good :) I watched a world cup football game live :) also when to alot of places Jul 13 16:05:34 150 euros the ticket cost me Jul 13 16:05:45 wow Jul 13 16:06:19 OK, who's here? Jul 13 16:06:38 * mmcgrath yo Jul 13 16:06:46 me Jul 13 16:06:50 * iWolf here, sort of Jul 13 16:07:17 * skvidal is here Jul 13 16:07:24 cool. Jul 13 16:07:26 * abadger1999 is here Jul 13 16:07:40 Oh, and I'm here, unexpectedly! :) Jul 13 16:07:51 hehe Jul 13 16:08:04 OK, let's get started Jul 13 16:08:05 * jcmoore raises hand Jul 13 16:08:06 * rordway is here Jul 13 16:08:27 okay Jul 13 16:08:30 extras64 is bouncing Jul 13 16:08:32 it's not in use Jul 13 16:09:04 dgilmore e-mailed me earlier today with comments about backup stuff... and he also owns the first item on the list (minimal buildroots). Jul 13 16:09:09 Dennis? Jul 13 16:11:28 I'm here, but not really here. Jul 13 16:11:37 extras64 is back up Jul 13 16:13:33 Hmm Jul 13 16:13:42 no dennis, how about pasqual? Jul 13 16:14:14 pasqual: A couple of weeks ago you said you were interested in the whole web interface type of stuff. What has happened in that area? Jul 13 16:14:55 Sopwith: I have been takina look to all the sites Jul 13 16:15:12 Sopwith: listed in thehomega Jul 13 16:15:34 Sopwith: I will try to make a draft this weekend Jul 13 16:15:48 pasqual: OK, cool. Jul 13 16:16:04 Sopwith: and ask in the mailing list for aditional url's Jul 13 16:16:32 Sopwith:but it would be nice if somebody could indicate me a refrence page Jul 13 16:16:41 Sopwith: for the aspect Jul 13 16:17:20 Sopwith: I will write something in the mailing list Jul 13 16:17:25 --> ja8sun (n=ja8sun@64.241.37.140) has joined #fedora-admin Jul 13 16:17:38 pasqual: OK, once we see your e-mail it'll be easier to figure out the next steps... Jul 13 16:17:38 whad up ja8sun. Jul 13 16:17:43 hey Jul 13 16:17:52 ok Jul 13 16:18:13 sorry I'm late Jul 13 16:18:15 iwolf: System upgrades - it is just db1 and bastion at this point, correct? Jul 13 16:18:38 Sopwith: correct. Jul 13 16:19:03 Sopwith: db1 we are going to wrap into a cluster/replication type deal with the new server. Jul 13 16:19:07 OK Jul 13 16:19:17 Sopwith: worked with mmcgrath for specs on the box. Jul 13 16:19:24 coool Jul 13 16:19:26 Sopwith: and jcmoore Jul 13 16:20:43 OK nifty Jul 13 16:21:13 Is there a plan for getting bastion updated? Jul 13 16:21:38 Sopwith: Not really, I am not sure how best to do that one due to its unique position. Jul 13 16:21:55 oh true, it needs someone inside to do that. Jul 13 16:22:03 OK, my problem I guess. Jul 13 16:23:05 * dgilmore is here now Jul 13 16:23:18 Oh, is someone logging into RHN regularly to push updates to all the machines? Jul 13 16:23:50 lmacken: On your end, where do the TurboGears packages stand? Jul 13 16:23:52 Sopwith: I have not been... :( Jul 13 16:24:16 Sopwith: But I can start! :) Jul 13 16:24:21 iwolf: OK, I suppose we should start reviewing the "Ongoing tasks" each week as well. Jul 13 16:24:30 hehe OK cool. Jul 13 16:24:37 we should add some type of script that runs up2date -l once a day/week Jul 13 16:24:49 mmcgrath, I get emails on upgrades Jul 13 16:24:52 mmcgrath: rhnsd does that type of thing, no? Jul 13 16:25:02 Sopwith, yea Jul 13 16:25:04 I have no idea, where do the emails go? Jul 13 16:25:10 I run the upgrades from there Jul 13 16:25:12 * mmcgrath is used to working with yum. Jul 13 16:25:15 :-D Jul 13 16:25:19 :) Jul 13 16:25:36 I updated all the security there today Jul 13 16:25:42 No clue, although I know xdamox and I are both owners of the Fedora Organization in RHN, and can get that permission to anyone else who needs it. Jul 13 16:26:06 Sopwith: Was my account setup as owner? Jul 13 16:26:22 iwolf: administrator I think, dunno Jul 13 16:26:22 Sopwith: shouldn't that stuff go to admin@fedoraproject.org? Jul 13 16:26:30 mmcgrath: Yup Jul 13 16:26:40 Sopwith: not all the boxes are on RH are they? only the ones at RH Jul 13 16:26:48 dgilmore: Correct. Jul 13 16:26:52 We can hook the rest in, no problem. Jul 13 16:27:14 does CentOS have something like RHN? Jul 13 16:27:22 it's called yum Jul 13 16:27:29 iwolf: OK, you are now an "organization administrator" blah blah blah. Jul 13 16:27:34 Sopwith: perhaps that should be done add them all into rhn and task a couple of people to make syre they stay updated , we dont want a debian incident Jul 13 16:27:36 Sopwith: :) Jul 13 16:27:42 yeah, I'm referring to the web interface :-) Jul 13 16:27:59 rordway: nope Jul 13 16:28:16 rordway: it would require a central server + authentication of users Jul 13 16:28:27 If lmacken wakes up, we can bug him about the firewall and TG stuff. I think he is really expecting the rest of us to take his pyroman work and deploy it. Jul 13 16:28:53 I'm using the RHN XMLRPC interface to hook into some of my internal management interfaces, but I'm considering switching to CentOS Jul 13 16:29:21 Sopwith, the firewall on lockbox needs port 514/udp open for all logs to be directed there Jul 13 16:29:39 ahh Jul 13 16:29:56 Once that is open its simple to direct all logs Jul 13 16:30:46 ok Jul 13 16:30:53 * Sopwith fiddles with rc.firewall to get that going. Jul 13 16:31:18 skvidal: http://vodka.library.oregonstate.edu/syspoll/ notably, snapshot2_cut.png Jul 13 16:31:40 Ok Sopwith when thats done Ill set up the logs to go there Jul 13 16:31:43 Documentation - anything we know we need today? Jul 13 16:31:45 the code in there is old, old though Jul 13 16:31:47 xdamox: OK Jul 13 16:32:13 rordway: nice - doing that all yourself? Jul 13 16:32:44 * lmacken strolls in late Jul 13 16:33:21 rordway: so when do we see packages? Jul 13 16:33:23 skvidal: yeah, it's been in progress for awhile now. the back-end has come alot father than the front-end Jul 13 16:33:27 :-) Jul 13 16:33:53 that'd require me to write some sort of documentation.... Jul 13 16:34:04 as for the TurboGears stuff is concerned: I packaged up the rest of the deps for 0.9a6 (simplejson, Paste{,Script,Deploy}, ConfObj, and updated cherrypy today to 2.2.1. Jul 13 16:34:07 it's sort of spaghetti-like at the moment Jul 13 16:34:10 xdamox: Firewall mod on lockbox *should* be done. Jul 13 16:34:25 ok Jul 13 16:35:00 Ill get that done soon defentaly done for tommorow Jul 13 16:35:11 lmacken: any of those needing reviews to get into extras? Jul 13 16:35:24 lmacken: Way cool. Sounds like it's a "week or two more" type of thing until all the main packaging work is done... Jul 13 16:35:33 sqlobject and formencode will still need to be bumped, and we need to find a way to pull Turbo{Json,Cheetah,Kid} out of the TurboGears tarball Jul 13 16:35:38 dgilmore: most of them are Jul 13 16:36:14 dammit got to go, Ill catch up with you all later, also I need to email you all about the hardware tracker some input will be required Jul 13 16:36:26 Sopwith: yeah, most of that stack needed lots of work Jul 13 16:36:28 xdamox: OK, see ya Jul 13 16:36:35 lmacken: are TurboJson/Cheetah/Kid distributed as separate tarballs as well? Jul 13 16:36:42 lmacken: when there ready let me know and ill look Jul 13 16:37:28 who has access to make the changes needed so that we are using the minimal buildroots in plague Jul 13 16:37:40 abadger1999: they are in the TurboGears tarball as plugins i belive Jul 13 16:37:53 dgilmore: I was under the impression that that was working? Did I miss a thread? Jul 13 16:37:59 dgilmore: dcbw and skvidal should have it... Jul 13 16:38:03 what do we have? Jul 13 16:38:15 ah Jul 13 16:38:16 right Jul 13 16:38:20 mmcgrath: in the fesco meeting nbo one knew if minimal buildroots were in place or not Jul 13 16:38:26 dgilmore: we need to check the mock versions on the builders Jul 13 16:38:35 and the rest cascades out from there, ultimately Jul 13 16:38:36 got'cha. Thats right, we updated mock recently Jul 13 16:38:41 skvidal: can you do that i dont have access Jul 13 16:38:48 maybe Jul 13 16:39:18 is there a reason why you don't have access? Jul 13 16:39:26 umm Jul 13 16:39:27 so Jul 13 16:39:29 wtf Jul 13 16:39:35 why is nagios reporting fedoraproject.org is down? Jul 13 16:39:39 skvidal: I dont have access to anything inside fedora that i know of Jul 13 16:39:50 dgilmore: so why don't we change that? Jul 13 16:40:11 skvidal: that can work also Jul 13 16:40:17 dgilmore: https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=189338#c2 Jul 13 16:40:42 * Sopwith moves the xferlog item off the list. Jul 13 16:41:14 I need to change the timeout. 10 seconds is sometimes not long enough Jul 13 16:41:22 mmcgrath: for the mirror stuff? Jul 13 16:42:07 dgilmore: So for the buildroots thing, can you work with Seth to sort that out for next week? Jul 13 16:42:16 Sopwith: sure Jul 13 16:42:20 sopwith: How is xferlog script working? Jul 13 16:42:24 dgilmore: we'll get it straight - can you remind me about it tomorrow? Jul 13 16:42:28 ja8sun: Working great! Jul 13 16:42:33 ja8sun: Thanks again for doing that. Jul 13 16:42:40 sopwith: good to hear :) Jul 13 16:43:08 Oh BTW, nman64 deserves props for fixing up various account system bugs. Just need to push the changes from CVS onto all the machines. Jul 13 16:43:23 Sopwith: Sopwith: With pyroman, i wasn't expecting everyone to deploy it, I'm just tryin Jul 13 16:43:25 skvidal: sorry no for nagios Jul 13 16:43:38 * lmacken kicks irssi Jul 13 16:43:40 skvidal: ill ping you about it in the morning Jul 13 16:43:52 dgilmore: k Jul 13 16:44:05 I'll allow 514/upd for lockbox. Jul 13 16:44:37 Sopwith: I'm just trying to get it tested and tweaked. Jul 13 16:44:49 I'm still poking around with it as well Jul 13 16:44:56 lmacken: Do you have the access needed to actually try it out on the boxes? Jul 13 16:44:57 <-- tibbs has quit (Remote closed the connection) Jul 13 16:45:03 I'm trying to get upstream involved with our efforts as well Jul 13 16:45:22 lmacken: We have 4 proxy servers - it's fine to have one of them drop off the network for a while. Jul 13 16:45:54 lmacken: Do you need anyone else to help with anything there, or is it mainly a matter of setting a goal for yourself? Jul 13 16:47:13 Sopwith: yeah, I have access. The only configuration left is to allow the services on the machines. Jul 13 16:47:18 ok Jul 13 16:47:22 I'm not too familiar with most of them Jul 13 16:47:41 There is a list on the wiki. Have you seen it? Jul 13 16:48:12 yeah Jul 13 16:48:58 I'll see what I can do as far as setting up the configurations. If stuff breaks, just yell ;) Jul 13 16:48:58 OK, moving along Jul 13 16:49:03 lmacken: Sounds good Jul 13 16:49:25 Sopwith: backups? Jul 13 16:49:26 ja8sun/skvidal/et al: Want to say anything about the mirror management system? Jul 13 16:49:30 I do Jul 13 16:49:33 :) Jul 13 16:49:39 I've checked in lots of fun code this week Jul 13 16:49:45 and you can see what it does here: Jul 13 16:49:50 Sopwith: oh you mean mirrors.fedoraproject.org? I think he's got a few things to say :-D Jul 13 16:50:00 http://mirrors.fedoraproject.org/cgi-bin/return-mirrorlist.py?repo=core-5&arch=i386 Jul 13 16:50:05 for example Jul 13 16:50:13 http://mirrors.fedoraproject.org/ Jul 13 16:50:14 ahhhhhhhhhhhh that's so cool! Jul 13 16:50:20 there's a script that generates the text files Jul 13 16:50:31 It actually works too! Jul 13 16:50:33 it uses some routines from yum to check to see if the repomd.xml is current on all the mirrors Jul 13 16:50:41 compared to canonical mirror master Jul 13 16:50:50 (not the company, the definitive) Jul 13 16:50:57 (canonical) Jul 13 16:51:06 Its amazing how many bad mirrors there are out there. I mean look at the extras-5-US-i386.txt mirror: http://mirrors.fedoraproject.org/extras-5-US-i386.txt Jul 13 16:51:08 take a look at check-mirrors in /cvs/fedora Jul 13 16:51:25 it uses python-geoip and some other routines to split it out Jul 13 16:51:34 if your country doesn't have any mirrors Jul 13 16:51:38 then it gives you the global one Jul 13 16:51:46 Awesome. Jul 13 16:51:58 very nice Jul 13 16:52:04 I've got a couple of more things to do to it before I say 'yay' lets use it Jul 13 16:52:16 I'd like for it to use a db on the backend - but right now it's just simple files Jul 13 16:52:20 but it works pretty well Jul 13 16:52:35 I just checked in a new config file which should cover all the mirrors for 5 and rawhide Jul 13 16:52:44 sweeet Jul 13 16:53:05 if anyone wants to fulfill the todos at the top of the file Jul 13 16:53:07 just go for it Jul 13 16:53:26 if I can get about an hour tonight I'll put the new config file in place for it Jul 13 16:53:32 Cool Jul 13 16:53:37 the todos are listed in check-mirror? Jul 13 16:53:42 ja8sun: in the file, yes. Jul 13 16:53:46 thanks Jul 13 16:53:46 look for todo or FIXME Jul 13 16:53:50 it's in python Jul 13 16:53:52 it's not complex code Jul 13 16:54:01 so if you see something stupid just assume I'm a moron Jul 13 16:54:04 not that it was intended Jul 13 16:54:04 :) Jul 13 16:54:14 :) Jul 13 16:54:36 Sopwith: do you know how to get to www.redhat.com from inside the phx colo? Jul 13 16:54:39 Definitely something to dig into later... Jul 13 16:54:51 but the code appears to work Jul 13 16:54:52 mmcgrath: Not offhand. Stacy could tell ya. Jul 13 16:55:03 and I've had the cgi checked out by a couple of real web programmers Jul 13 16:55:07 it should not be dangerous to us Jul 13 16:55:26 the inputs are checked in a couple of ways and they aren't ever expanded out in any useful way to a malicious attacker Jul 13 16:55:46 oh and the mirror files are generated per-arch Jul 13 16:55:52 b/c some mirrors don't carry all archs Jul 13 16:55:57 (which is irritating, imo, but ...) Jul 13 16:56:04 and a lot of the mirrors are DEEPLY fucked up, btw Jul 13 16:56:35 okay, I think I'm done. Jul 13 16:56:49 hehe Jul 13 16:57:01 oh! Jul 13 16:57:09 skvidal: oh! Jul 13 16:57:12 if anyone is l33ter than me with apache scriptaliasmatch Jul 13 16:57:15 or redirectmatch Jul 13 16:57:16 We do need to talk about backups, I think that's the only other thing that really needs time today. Jul 13 16:57:24 I'd like to figure out how to make Jul 13 16:57:47 mirrors.fedoraproject.org/mirrors/reponame/arch/country rewrite out to use the cgi Jul 13 16:57:54 but it's not important just a personal interest Jul 13 16:58:42 skvidal: that shouldn't be terribly hard. Jul 13 16:58:47 mod_rewrite! Jul 13 16:58:54 mmcgrath: and yet I am apparently unable to do it :) Jul 13 16:59:00 I'll take a look ;-) Jul 13 16:59:05 look in mirrors Jul 13 16:59:11 you'll see my bad regex attempts, apparently Jul 13 16:59:13 Sopwith: whats the word on us and backups? Jul 13 16:59:20 My main concern is protecting the backups. Jul 13 16:59:32 mmcgrath: i think ive narowed it down to bacula or backuppc Jul 13 17:00:00 I'm fine with either of those. Jul 13 17:00:09 What would make us choose one or the other? Jul 13 17:00:28 I think bacula is more enterprise and backuppc is simpler. Jul 13 17:00:46 I was between rdiff-backup and backuppc Jul 13 17:00:49 mmcgrath: i agree Jul 13 17:01:16 So count my vote towards backuppc Jul 13 17:01:20 skvidal: you could rewrite everything to the path of the .py and interpret the /reponame/arch/country path to determine what they're trying to find Jul 13 17:01:22 skvidal: what do you guys use over there? Jul 13 17:01:30 i think that backuppc is simpler to restore from but we would need to ssl the interface i think Jul 13 17:01:44 mmcgrath: amanda and rdiff-backup (different types of backups for each) Jul 13 17:01:52 mmcgrath: and then in the big oit-backup-of-doom they use tsm Jul 13 17:01:55 (shudder) Jul 13 17:02:06 I like amanda and rdiff-backup Jul 13 17:02:08 we use NetWorker, but I've also used amanda in the past Jul 13 17:02:10 amanda is good for tape-y things Jul 13 17:02:19 and rdiff-backup is nice for the quick restores Jul 13 17:02:30 I wrote some wrapper scripts to rdiff-backup to give it config-file like things Jul 13 17:02:41 so you edit shit in /etc and it's simple Jul 13 17:03:15 gotta run...have a good day Jul 13 17:03:25 ja8sun: later Jul 13 17:03:30 later Jul 13 17:03:39 l8r ja8sun Jul 13 17:03:39 :) Jul 13 17:03:39 Sopwith: lets say we do the backuppc over an SSH tunnel to disk thing. Jul 13 17:03:47 Where are we going to keep the backups and who has access? Jul 13 17:03:49 skvidal: my main concern with rdiff-backup was resoring single files. logging didint seem as good as it could be Jul 13 17:03:58 <-- ja8sun has quit ("Leaving") Jul 13 17:04:09 I should prefis this with the fact that I have worked at a place that a leaving employee deleted everything *and* the backups. Jul 13 17:04:10 dgilmore: Jul 13 17:04:14 dgilmore: I don't disagree Jul 13 17:04:23 bacula and backuppc have the ability to view logs via the web Jul 13 17:04:25 mmcgrath: Nod... The backups could be stored on both lockbox and on an internal server here... Jul 13 17:04:33 that would be my preference. Jul 13 17:04:35 mmcgrath: Eek, I get where you're coming from. Jul 13 17:04:57 mmcgrath: mmm offsite tapes :) Jul 13 17:05:01 mmcgrath: hard to remove the backups :) Jul 13 17:05:10 I've designed systems where backups existed in two place as well as a tape that was off site at all times just because of that. Jul 13 17:05:10 double backups ? Jul 13 17:05:17 the tape guy was different from the backup guy. Jul 13 17:05:46 So how about lockbox also be the system that all the backups funnel into, and then an internal server (to be maintained by someone here) to mirror from there Jul 13 17:06:08 (Not that this has any bearing on the backup software decision, but it's a good question) Jul 13 17:06:08 Sopwith: would work for me if lockbox has enough space Jul 13 17:06:11 Sopwith: That sounds good to me. Jul 13 17:06:14 agreed. Jul 13 17:06:20 dgilmore: lockbox used to be the cvs server - 249G free Jul 13 17:06:29 we *might* have to move the backups off of the machine that nagios is on but we can deal with that later. Jul 13 17:06:36 Sopwith: that should be enough :) Jul 13 17:06:39 plugins time out when the machine is under heavy load. Jul 13 17:06:54 renice or somesuch... Jul 13 17:07:04 yeah, there's options. Jul 13 17:07:53 how about a vote? Jul 13 17:07:56 It's all fixable. What we need to do right now is agree on a piece of software, and start setting it up Jul 13 17:08:07 * mmcgrath notes we so rarely vote on stuff :-D Jul 13 17:08:37 I am fine with whatever dgilmore has researched, and it sounds like backuppc is on most people's short lists, so in the interest of making a decision, I suggest going with it. Jul 13 17:08:50 And in the worst case, we find out we were *gasp* wrong and need to switch :) Jul 13 17:09:33 hah true that. Jul 13 17:09:39 backuppc sounds fine with me. Jul 13 17:09:52 I am fine with backuppc Jul 13 17:09:53 Sopwith: id say between bacula and backuppc Jul 13 17:09:55 mmcgrath: wow, that's lame! Jul 13 17:10:37 eiter option needs to be packaged for extras Jul 13 17:10:46 Sounds like a good "next step" :) Jul 13 17:11:07 * rordway is fine with anything that doesn't involve me having to swap tapes Jul 13 17:11:19 :-) Jul 13 17:11:24 hehe Jul 13 17:11:32 lets make rordway switch tapes! Jul 13 17:11:37 nooooo! Jul 13 17:11:46 I can package that up for extras if we want. Jul 13 17:11:52 I got no job right now so I can do that ;-) Jul 13 17:12:02 mmcgrath: you're unemployed? Jul 13 17:12:04 really? Jul 13 17:12:15 oh, mmcgrath, do I have access to the nagios box? Jul 13 17:12:24 yeah, had a "moment" with my boss on tuesday so today he asked me to resign. Jul 13 17:12:33 * iWolf thnks he was the guy the deleted all data and backups.... Jul 13 17:12:40 iWolf: maybe so Jul 13 17:12:48 mmcgrath: ill leave it to you to package Jul 13 17:12:53 k, will do. Jul 13 17:13:13 Let's start a company to manufacture and sell a "Ryan Ordway 2000" tape robot, featuring DNA technology. mmcgrath will be CEO... Jul 13 17:13:37 * mmcgrath goes off to register a domain right now Jul 13 17:13:40 * dgilmore will be flunky Jul 13 17:13:44 heheh OK Jul 13 17:14:32 haha Jul 13 17:14:38 For next week, it sounds like mmcgrath wants to get a backuppc package going, and we can go from there. Jul 13 17:14:43 need inpuuuut Jul 13 17:15:32 mmcgrath: add me as a cc and ill review it Jul 13 17:15:36 dennis@ausil.us Jul 13 17:15:49 will do Jul 13 17:16:14 I think we're pretty much done this meeting thing. Anything else to go over before we get back to hacking? Jul 13 17:16:23 Nothing here. Jul 13 17:16:29 nothing Jul 13 17:16:38 nothing here Jul 13 17:16:42 nothing here covered what i wanted to Jul 13 17:17:08 Cool. Meeting over - happy hacking! Jul 13 17:17:29 Later all.... Jul 13 17:17:41 aieet Jul 13 17:17:45 bye Jul 13 17:17:51 <-- pasqual (n=pasqual@81-202-75-184.user.ono.com) has left #fedora-admin ("Leaving") Jul 13 17:19:06 mmcgrath: how do I get to the nagios box? was going to poke around Jul 13 17:21:16 rordway: I think you need to be in the sysadmin main group Jul 13 17:21:39 k Jul 13 17:21:49 <-- skvidal (n=skvidal@fedora/skvidal) has left #fedora-admin ("Ex-Chat") Jul 13 17:22:56 I think I put in a request for that Jul 13 17:23:03 lemme check Jul 13 17:35:05 Hey Rordway: I have to get going but I'll double check as to why you don't have an account yet. Jul 13 17:36:29 mmcgrath: cool thanks