00:19:32  * chorrelljoined
00:22:04  * paulfryzeljoined
00:24:09  * therealkoopajoined
00:26:29  * paulfryzelquit (Ping timeout: 240 seconds)
00:28:38  * therealkoopaquit (Ping timeout: 240 seconds)
00:29:43  * notmattjoined
00:34:43  * notmattquit (Ping timeout: 265 seconds)
00:40:38  * marsellquit (Quit: marsell)
00:46:40  * therealkoopajoined
00:50:30  * mariuspjoined
00:51:00  * therealkoopaquit (Ping timeout: 252 seconds)
00:54:59  * mariuspquit (Ping timeout: 240 seconds)
01:11:14  * bixu_joined
01:13:58  * bixuquit (Ping timeout: 240 seconds)
01:19:47  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
01:20:00  * ed209quit (Remote host closed the connection)
01:20:07  * ed209joined
01:22:40  * paulfryzeljoined
01:26:49  * paulfryzelquit (Ping timeout: 240 seconds)
01:37:31  * abraxasjoined
01:55:57  * abraxasquit (Remote host closed the connection)
01:56:35  * abraxasjoined
02:00:25  * ins0mniaquit (Ping timeout: 240 seconds)
02:00:49  * abraxasquit (Ping timeout: 240 seconds)
02:04:12  * abraxasjoined
02:17:57  * notmattjoined
02:19:19  * abraxasquit (Remote host closed the connection)
02:19:57  * abraxasjoined
02:20:48  * abraxasquit (Read error: Connection reset by peer)
02:21:11  * abraxasjoined
02:22:29  * notmattquit (Ping timeout: 240 seconds)
02:46:50  * therealkoopajoined
02:51:30  * therealkoopaquit (Ping timeout: 265 seconds)
02:51:36  * mariuspjoined
02:55:58  * mariuspquit (Ping timeout: 240 seconds)
03:08:31  * marselljoined
03:23:11  * notmattjoined
03:24:31  * paulfryzeljoined
03:27:29  * notmattquit (Ping timeout: 240 seconds)
03:27:39  * abraxasquit (Remote host closed the connection)
03:28:17  * abraxasjoined
03:28:29  * paulfryzelquit (Ping timeout: 240 seconds)
03:32:29  * abraxasquit (Ping timeout: 240 seconds)
03:46:35  * therealkoopajoined
03:50:34  * abraxasjoined
03:51:46  * therealkoopaquit (Ping timeout: 264 seconds)
04:17:36  * notmattjoined
04:20:18  * abraxasquit (Remote host closed the connection)
04:36:20  * irajoined
04:46:01  * notmattquit (Remote host closed the connection)
04:52:33  * mariuspjoined
04:56:49  * mariuspquit (Ping timeout: 240 seconds)
05:17:31  * notmattjoined
05:35:20  * notmattquit (Read error: Connection reset by peer)
05:35:31  * notmattjoined
05:38:17  * therealkoopajoined
05:43:05  * therealkoopaquit (Ping timeout: 265 seconds)
05:46:44  * therealkoopajoined
05:50:58  * therealkoopaquit (Ping timeout: 240 seconds)
06:08:29  * venuraquit (Ping timeout: 240 seconds)
06:22:19  * notmattquit (Remote host closed the connection)
06:22:51  * notmattjoined
06:23:04  * abraxasjoined
06:27:10  * notmattquit (Ping timeout: 252 seconds)
06:27:33  * marsellquit (Ping timeout: 265 seconds)
06:30:20  * notmattjoined
06:46:46  * therealkoopajoined
06:51:18  * ghostbar_quit (Ping timeout: 240 seconds)
06:51:46  * therealkoopaquit (Ping timeout: 264 seconds)
06:55:14  * ghostbarjoined
07:14:33  * notmattquit (Remote host closed the connection)
07:15:06  * notmattjoined
07:19:26  * notmattquit (Ping timeout: 252 seconds)
07:27:17  * paulfryzeljoined
07:30:57  * mariuspjoined
07:31:29  * paulfryzelquit (Ping timeout: 240 seconds)
07:38:01  * mariusp_joined
07:40:22  * mariuspquit (Ping timeout: 264 seconds)
07:46:48  * daviddiasjoined
08:22:48  * notmattjoined
08:27:26  * notmattquit (Ping timeout: 265 seconds)
08:28:19  * paulfryzeljoined
08:32:29  * paulfryzelquit (Ping timeout: 240 seconds)
08:36:27  * bixujoined
08:38:38  * daviddiasquit (Remote host closed the connection)
08:39:37  * bixu_quit (Ping timeout: 240 seconds)
08:40:50  * bixu_joined
08:41:28  * daviddiasjoined
08:41:33  * bixuquit (Read error: Connection reset by peer)
08:41:48  * bixujoined
08:43:35  * daviddiasquit (Remote host closed the connection)
08:44:58  * bixu_quit (Ping timeout: 240 seconds)
08:47:47  * ffahimijoined
08:48:51  * mamashjoined
09:00:46  * mariusp_quit (Ping timeout: 264 seconds)
09:03:23  * ffahimiquit (Remote host closed the connection)
09:03:58  * bixuquit (Ping timeout: 240 seconds)
09:08:08  * mamashpart
09:12:31  * ffahimijoined
09:13:15  * mamashjoined
09:14:49  * ghostbarquit (Remote host closed the connection)
09:18:13  * ffahimiquit (Remote host closed the connection)
09:19:49  * ffahimijoined
09:28:56  * paulfryzeljoined
09:33:59  * paulfryzelquit (Ping timeout: 269 seconds)
09:34:52  * ffahimiquit (Remote host closed the connection)
09:37:59  * ffahimijoined
10:11:00  * notmattjoined
10:11:47  * bixujoined
10:15:29  * notmattquit (Ping timeout: 252 seconds)
10:34:53  <bixu>In the out.txt for a given job, would we expect that data (the out.txt object) to last forever?
10:35:40  <jperkin>if you store it back into manta then yes, if it's on a transient part of the local file system then no, it will be wiped out as soon as your job completes
10:36:31  <bixu>Okay - I meant for the job records in ~~/jobs
10:36:40  <bixu>So it sounds like it will persist.
10:37:13  <jperkin>yes (at least as far as I'm aware)
10:38:14  <bixu>Thanks.
10:39:22  * daviddiasjoined
10:41:30  * ErolCanjoined
10:43:59  * daviddiasquit (Ping timeout: 240 seconds)
10:44:43  <ErolCan>I'm trying to make things work on Windows 8. I installed Manta and added all the environment variables as specified. When I type mls on my command line, I get the following: "Error: *my ssh key fingerprint* not found in C:\Users\ErolCan\.ssh. I have both my public and private keys in this folder. What could be a possible fix for this problem?
10:56:57  * abraxasquit (Remote host closed the connection)
10:57:32  * abraxasjoined
11:01:58  * abraxasquit (Ping timeout: 264 seconds)
11:05:41  * abraxasjoined
11:09:37  * ErolCan_joined
11:12:59  * ErolCanquit (Ping timeout: 240 seconds)
11:13:42  * ffahimiquit (Remote host closed the connection)
11:14:48  * bixuquit (Remote host closed the connection)
11:15:09  * notmattjoined
11:16:15  * abraxasquit (Remote host closed the connection)
11:16:51  * abraxasjoined
11:19:37  * notmattquit (Ping timeout: 240 seconds)
11:19:37  * ErolCan_quit (Ping timeout: 240 seconds)
11:20:58  * abraxasquit (Ping timeout: 240 seconds)
11:31:56  * marselljoined
11:40:26  * daviddiasjoined
11:44:06  * ffahimijoined
11:44:29  * daviddiasquit (Ping timeout: 240 seconds)
11:49:31  * ins0mniajoined
11:50:26  * ffahimiquit (Ping timeout: 265 seconds)
12:01:56  * ins0mniaquit (Read error: Operation timed out)
12:05:41  * ins0mniajoined
12:31:49  * ffahimijoined
12:32:32  * ErolCanjoined
12:41:29  * daviddiasjoined
12:42:30  * abraxasjoined
12:45:59  * daviddiasquit (Ping timeout: 240 seconds)
12:49:31  * bixujoined
12:52:19  * abraxasquit (Remote host closed the connection)
12:52:57  * abraxasjoined
12:54:17  * abraxasquit (Read error: Connection reset by peer)
12:54:41  * abraxasjoined
12:56:18  * abraxasquit (Remote host closed the connection)
13:01:53  * daviddiasjoined
13:03:27  * iraquit (Quit: Connection terminated.)
13:06:29  * daviddiasquit (Ping timeout: 240 seconds)
13:12:06  * ErolCanquit (Quit: Leaving)
13:13:14  * therealkoopajoined
13:15:23  * ghostbarjoined
13:18:53  * daviddiasjoined
13:19:37  * ghostbarquit (Ping timeout: 240 seconds)
13:27:38  * paulfryzeljoined
13:28:12  <bixu>I'm working on sorting data from about 3000 log files that are in Manta, and I'm seeing only 1 job ID - is that normal?
13:28:38  <jperkin>yes
13:28:48  * paulfryzelquit (Remote host closed the connection)
13:30:03  <bixu>So I would assign more jobs to process these logs by specifying parallelization?
13:30:36  <jperkin>no, it's already parallelised
13:31:08  <bixu>Okay, so maybe I'm misunderstanding how the work is done. Is there one zone being spawned per object?
13:32:21  <jperkin>I don't think it's quite that many, mark et al can provide more details later, but the mappers will be spread out across multiple zones
13:32:33  <bixu>Okay - I see.
13:40:15  * daviddiasquit (Remote host closed the connection)
13:40:23  * ghostbarjoined
13:40:52  * daviddiasjoined
13:44:02  * paulfryzeljoined
13:44:29  * ghostbarquit (Ping timeout: 240 seconds)
13:45:28  * daviddiasquit (Ping timeout: 265 seconds)
13:45:57  * daviddiasjoined
13:52:16  * chorrelljoined
13:56:23  <bixu>So the log files I'm working with are split up into 10 files per day. I want to process data one day at a time - is there a way to concatenate the different log chunks before processing? Can I use -m args?
14:03:57  * seldoquit (Remote host closed the connection)
14:06:54  * daviddiasquit (Remote host closed the connection)
14:07:35  <jperkin>are they compressed?
14:11:46  * chorrellchanged nick to chorrell-away
14:35:05  * paulfryzelquit (Remote host closed the connection)
14:36:00  <bixu>They are.
14:36:18  * bsdgurujoined
14:36:59  <bixu>But I could convert them to uncompressed if needed.
14:37:08  <bixu>(Or would that be way more expensive to store?
14:44:17  * chorrell-awayquit (Quit: My Mac has gone to sleep. ZZZzzz…)
14:49:33  * utlemmingquit (Remote host closed the connection)
14:49:34  * doug_quit (Ping timeout: 265 seconds)
14:49:34  * utlemmingjoined
14:50:01  * chorrelljoined
14:51:24  * paulfryzeljoined
14:51:33  * AvianFluquit (Remote host closed the connection)
14:52:00  * doug_joined
14:52:19  * ins0mniaquit (Excess Flood)
14:53:21  * daviddiasjoined
14:54:31  * ins0mniajoined
14:57:24  * abraxasjoined
15:02:19  * abraxasquit (Ping timeout: 265 seconds)
15:11:26  * bixu_joined
15:15:10  * bixuquit (Ping timeout: 264 seconds)
15:19:47  * ffahimiquit (Remote host closed the connection)
15:25:17  * ffahimijoined
15:32:07  * mcavagejoined
15:37:52  * daviddiasquit (Remote host closed the connection)
15:38:30  * daviddiasjoined
15:38:45  * seldojoined
15:40:23  * ryancnelsonjoined
15:40:35  * AvianFlujoined
15:41:09  * AvianFlu_joined
15:41:52  * seldoquit (Remote host closed the connection)
15:42:59  * daviddiasquit (Ping timeout: 240 seconds)
15:44:38  * AvianFluquit (Ping timeout: 240 seconds)
15:57:46  * fredkjoined
16:03:09  * dap_joined
16:03:23  * ryancnelsonquit (Quit: Leaving.)
16:11:04  * AvianFlu_changed nick to AvianFlu
16:15:23  * nfitchjoined
16:17:13  * notmattjoined
16:21:53  <bixu_>Trying to work out how to pass an asset to Python in my mjob:
16:21:55  <bixu_>mfind ~~/stor/logs/foo.log.gz | mjob create -o -s "/assets/$MANTA_USER/stor/bin/some_python.py" -m "gunzip | grep blabla | grep 'some_string'| awk '{print \$18}' | cut -f1 -d ','" -m "python /assets/$MANTA_USER/stor/bin/some_python.py"
16:22:05  <bixu_>What am I doing wrong?
16:22:48  <dap_>The argument for "-s" is the actual Manta path, so you don't want /assets in there. You use /assets only in the "-m" argument (which you're doing)
16:24:27  <dap_>The other problem is that "-s" only applies to the next phase
16:24:53  <dap_>It looks like you're only using it in the second phase, so I think you want to move the "-s …" argument in between the two "-m" arguments.
16:27:45  <bixu_>That did it - thanks!
16:30:25  * arash__joined
16:44:43  <bixu_>Another question - does mjob cost actually work?
16:45:05  * chorrellchanged nick to chorrell-away
16:45:16  * chorrell-awaychanged nick to chorrell
16:45:34  <dap_>bixu_: I haven't used it in a while, but it should. If not, that would be a bug. But it only works after an hour.
16:45:49  <bixu_>That makes sense.
16:45:58  <dap_>I see that's not documented, though :(
16:46:36  <dap_>It does say:
16:46:37  <dap_>Warning: job was running in the past two hours. Compute usage reports may be missing for all or part of this job.
16:46:39  <dap_>when you try to use it
16:46:44  <mcavage>bixu: yes - it warns if it's run in under 2 hrs
16:46:48  <mcavage>Marks-MacBook-Pro:lab mcavage$ mjob cost 76d24e3f-0356-ee51-cdec-8a38062a2299
16:46:48  <mcavage>5522813c-5341-485a-daf1-ac454fa7de93
16:46:48  <mcavage>added 1 input to 5522813c-5341-485a-daf1-ac454fa7de93
16:46:49  <mcavage>0.14624
16:46:51  <mcavage>Marks-MacBook-Pro:lab mcavage$
16:46:53  <mcavage>(that was from just now)
16:46:58  <mcavage>so yes it still works :)
16:47:01  <bixu_>Makes total sense.
16:49:01  * ffahimiquit (Remote host closed the connection)
16:49:07  <bixu_>Thanks - we are really excited about what we got done today.
16:49:13  <bixu_>Heading home now.
16:49:18  * arash__quit
16:49:52  * yunongjoined
16:49:52  * yunongquit (Client Quit)
16:50:42  * daviddiasjoined
16:51:14  * yunongjoined
16:52:11  * seldojoined
16:52:28  * elijah-mbpquit (Quit: Leaving)
16:55:10  * bsdguruquit (Quit: bsdguru)
16:55:30  * bixu_quit (Remote host closed the connection)
16:56:25  * bixujoined
16:58:30  * abraxasjoined
17:02:30  * daviddiasquit (Remote host closed the connection)
17:02:38  * abraxasquit (Ping timeout: 240 seconds)
17:04:30  * yunongquit (Quit: Leaving.)
17:06:18  * daviddiasjoined
17:10:11  * dap_quit (Quit: Leaving.)
17:26:49  * ghostbarjoined
17:28:17  * daviddiasquit (Remote host closed the connection)
17:28:20  * ghostbar_joined
17:31:37  * ghostbarquit (Ping timeout: 240 seconds)
17:32:17  * daviddiasjoined
17:36:10  * marsellquit (Ping timeout: 264 seconds)
17:48:32  * daviddiasquit (Remote host closed the connection)
17:48:56  * daviddiasjoined
17:52:51  * marselljoined
17:59:51  * paulfryzelquit (Remote host closed the connection)
18:04:03  * bixuquit (Ping timeout: 244 seconds)
18:05:55  * ghostbar_quit (Remote host closed the connection)
18:05:58  * mamashpart
18:15:32  * paulfryzeljoined
18:19:59  * paulfryzelquit (Ping timeout: 240 seconds)
18:20:55  * elijah-mbpjoined
18:22:57  * paulfryzeljoined
18:30:15  <paulfryzel>is manta currently down? i'm receiving a "ServiceUnavailableError: manta is unable to serve this request" for all requests.
18:31:29  * daviddiasquit (Remote host closed the connection)
18:32:00  * daviddiasjoined
18:32:28  * ghostbarjoined
18:34:39  * daviddia_joined
18:34:41  * daviddiasquit (Read error: Connection reset by peer)
18:34:53  * dap_joined
18:39:01  <mcavage>paul: yes, there was a brief outage (human error during an upgrade)
18:40:09  <paulfryzel>ok, it appears it be back now. in general, where would be the best place to monitor to find immediate status changes? https://help.joyent.com/forums/20715782-current-system-status -- doesn't appear to be updated
18:41:22  <mcavage>paulyfryzel: that is the correct place -- this was 5-10m; we fixed it faster than we would have posted there.
18:41:46  * chorrellchanged nick to chorrell-away
18:42:41  * jamesdubyoujoined
18:42:49  <paulfryzel>mcavage: ok, thank you
18:47:53  * chorrell-awaychanged nick to chorrell
19:01:34  * bixujoined
19:25:27  * daviddia_quit (Remote host closed the connection)
19:25:56  * daviddiasjoined
19:30:18  * daviddiasquit (Ping timeout: 240 seconds)
19:39:09  * chorrellchanged nick to chorrell-away
20:02:28  * mamashjoined
20:10:51  * chorrell-awaychanged nick to chorrell
20:14:44  * daviddiasjoined
20:40:22  * bsdgurujoined
20:41:38  * bsdguru_joined
20:42:35  * jamesdubyouquit (Quit: Textual IRC Client: www.textualapp.com)
20:44:59  * bsdguruquit (Ping timeout: 240 seconds)
20:44:59  * bsdguru_changed nick to bsdguru
20:53:40  * bixuquit (Ping timeout: 252 seconds)
20:54:07  * seldoquit (Remote host closed the connection)
20:59:10  * seldojoined
21:00:20  * abraxasjoined
21:04:25  * abraxasquit (Ping timeout: 240 seconds)
21:06:18  * daviddiasquit (Remote host closed the connection)
21:06:49  * daviddiasjoined
21:07:04  * rmustaccquit (Quit: Lost terminal)
21:08:15  * chorrellchanged nick to chorrell-away
21:08:20  * rmustaccjoined
21:08:34  * daviddia_joined
21:08:35  * daviddiasquit (Read error: Connection reset by peer)
21:10:42  * paulfryzelquit (Remote host closed the connection)
21:32:31  * daviddia_quit (Remote host closed the connection)
21:32:37  <bsdguru>the issue with manta 3 hours ago
21:33:00  <bsdguru>was that connectivity in ashburn again or issues with the load balancer?
21:33:18  * daviddiasjoined
21:34:22  * paulfryzeljoined
21:41:37  * ins0mniaquit (Ping timeout: 240 seconds)
21:43:31  * daviddiasquit (Remote host closed the connection)
21:44:06  * daviddiasjoined
21:45:08  * mamashpart
21:48:29  * daviddiasquit (Ping timeout: 240 seconds)
21:51:02  * chorrell-awaychanged nick to chorrell
22:03:58  * AvianFlu_joined
22:04:58  * AvianFluquit (Ping timeout: 264 seconds)
22:08:54  * chorrellchanged nick to chorrell-away
22:09:15  * bsdguruquit (Ping timeout: 240 seconds)
22:10:15  * AvianFlu_changed nick to AvianFlu
22:11:33  * chorrell-awaychanged nick to chorrell
22:20:19  * therealkoopaquit (Remote host closed the connection)
22:22:26  * paulfryzelquit (Remote host closed the connection)
22:26:55  * paulfryzeljoined
22:27:09  * therealkoopajoined
22:32:18  * therealkoopaquit (Ping timeout: 240 seconds)
22:38:22  * chorrellchanged nick to chorrell-away
22:53:41  * bixujoined
23:00:27  * paulfryzelquit (Remote host closed the connection)
23:03:58  * AvianFluquit (Ping timeout: 240 seconds)
23:09:12  <bahamas10>mcavage: https://github.com/dominictarr/ssh-key-to-pem/pull/3, i'm not sure if you or dominictarr own this (I see both on npm) but just an fyi, pem => ssh-rsa conversion implemented
23:09:37  <bahamas10>althogh i had to learn asn.1 encoding for this implementation... it may not be correct, though the tests pass
23:10:10  <mcavage>bahamas10: cool -- I think dominic took the stuff from http-signature. you know how node people love micro libraries ;)
23:10:43  <mcavage>asn.1 is a little esoteric, but kind of sane: it's just binary TLV (tag length value)
23:13:39  <bahamas10>mcavage: yeah, having never parsed or used asn.1 myself directly, it was a little intimidating
23:14:04  <mcavage>yeah. but then it's not scary anymore.
23:14:19  <bahamas10>i also made the mistake of trying to readInt() on a 2048 bit key.. that didn't quite work out :)
23:14:33  <bahamas10>but yeah, it makes sense.. and seems like a sensible way to encode data in a very small number of bytes
23:14:36  * paulfryzeljoined
23:15:31  <bahamas10>oh wow, i didn't even notice that this was copied from util.js on http-signature... hm
23:16:08  <mcavage>yeah i'm pretty sure it's the same code. And Fedor was going to do something with node-asn1 so it did DER as well.
23:16:34  <mcavage>i only did BER (that was all I needed, and as far as the encodings I needed used by x.509, ber and der are the same)
23:23:09  * paulfryzelquit (Remote host closed the connection)
23:30:36  * daviddiasjoined
23:33:58  * daviddiasquit (Remote host closed the connection)
23:34:21  * daviddiasjoined
23:41:36  * chorrell-awaychanged nick to chorrell
23:42:38  * therealkoopajoined
23:47:43  * therealkoopaquit (Ping timeout: 265 seconds)