00:02:19  * lloyddejoined
00:06:39  * lloyddequit (Ping timeout: 252 seconds)
00:09:46  * therealkoopajoined
00:14:38  * daviddiasquit (Ping timeout: 264 seconds)
00:15:11  * lloyddejoined
00:19:29  * lloyddequit (Ping timeout: 240 seconds)
00:28:59  * AvianFluquit (Ping timeout: 240 seconds)
00:37:13  * daviddiasjoined
01:07:04  * fredkquit (Quit: Leaving.)
01:10:04  * AvianFlujoined
01:11:18  * papajuansjoined
01:14:56  * mcavagequit
01:15:54  * lloyddejoined
01:17:18  * papajuansquit (Remote host closed the connection)
01:18:46  * ghostbarjoined
01:20:01  * ed209quit (Remote host closed the connection)
01:20:05  * lloyddequit (Ping timeout: 248 seconds)
01:20:08  * ed209joined
01:23:39  * ghostbarquit (Ping timeout: 260 seconds)
01:25:55  * daviddia_joined
01:28:47  * daviddiasquit (Ping timeout: 252 seconds)
01:30:51  * ghostbarjoined
01:36:05  * paulfryzeljoined
01:41:23  * paulfryzelquit (Ping timeout: 245 seconds)
01:45:07  * abraxasjoined
01:47:31  * notmattquit (Remote host closed the connection)
01:48:05  * notmattjoined
01:50:52  * lloyddejoined
01:53:02  * notmattquit (Ping timeout: 264 seconds)
01:55:17  * lloyddequit (Ping timeout: 248 seconds)
01:56:34  * notmattjoined
01:57:50  * ghostbarquit (Remote host closed the connection)
02:10:50  * abraxasquit (Remote host closed the connection)
02:14:54  * dap_quit (Quit: Leaving.)
02:23:30  * notmattquit (Remote host closed the connection)
02:42:29  * therealkoopaquit (Remote host closed the connection)
02:51:02  * iraquit (Quit: Connection terminated.)
02:51:39  * lloyddejoined
02:56:03  * lloyddequit (Ping timeout: 252 seconds)
03:03:08  * ghostbarjoined
03:10:01  * ghostbarquit (Ping timeout: 272 seconds)
03:19:20  * abraxasjoined
03:19:20  * therealkoopajoined
03:23:07  * therealkoopaquit (Read error: Operation timed out)
03:52:28  * lloyddejoined
03:56:53  * lloyddequit (Ping timeout: 248 seconds)
04:04:29  * papajuansjoined
04:19:56  * papajuansquit (Remote host closed the connection)
04:35:12  * abraxasquit (Remote host closed the connection)
04:53:14  * lloyddejoined
04:56:10  * __rockbot__joined
04:57:29  * lloyddequit (Ping timeout: 240 seconds)
05:01:11  * seldojoined
05:25:39  * mamashjoined
05:34:36  * mamashpart
05:48:40  * abraxasjoined
05:53:46  * lloyddejoined
05:58:26  * lloyddequit (Ping timeout: 264 seconds)
06:20:42  * therealkoopajoined
06:25:41  * therealkoopaquit (Ping timeout: 248 seconds)
06:27:55  * marsellquit (Ping timeout: 245 seconds)
06:30:27  * daviddia_quit (Read error: Connection reset by peer)
06:36:06  * __rockbot__quit (Quit: __rockbot__)
06:49:01  * AvianFluquit (Remote host closed the connection)
06:54:44  * lloyddejoined
06:58:26  * AvianFlujoined
06:59:17  * lloyddequit (Ping timeout: 272 seconds)
07:01:21  * notmattjoined
07:09:51  * notmattquit (Quit: Leaving...)
07:15:41  * bsdgurujoined
07:45:32  * bsdguruquit (Quit: bsdguru)
07:55:33  * lloyddejoined
07:57:24  * AvianFluquit (Remote host closed the connection)
07:59:43  * lloyddequit (Ping timeout: 245 seconds)
08:06:57  * bsdgurujoined
08:27:58  * AvianFlujoined
08:35:59  * AvianFluquit (Ping timeout: 240 seconds)
08:55:43  * daviddiasjoined
08:56:08  * lloyddejoined
09:00:53  * lloyddequit (Ping timeout: 272 seconds)
09:02:40  * daviddiasquit (Read error: Connection reset by peer)
09:04:47  * daviddiasjoined
09:29:29  * ins0mniajoined
09:48:31  * abraxasquit (Remote host closed the connection)
09:56:30  * abraxasjoined
09:57:04  * lloyddejoined
09:57:37  * daviddiasquit (Read error: Connection reset by peer)
10:01:09  * lloyddequit (Ping timeout: 248 seconds)
10:13:41  * mamashjoined
11:02:41  * daviddiasjoined
11:03:09  * daviddia_joined
11:03:23  * daviddia_quit (Remote host closed the connection)
11:03:24  * daviddiasquit (Read error: No route to host)
11:03:58  * daviddiasjoined
11:32:09  * abraxasquit (Remote host closed the connection)
11:33:09  * abraxasjoined
11:50:00  * abraxasquit (Remote host closed the connection)
11:57:05  * daviddia_joined
11:58:03  * daviddiasquit (Ping timeout: 245 seconds)
11:58:20  * lloyddejoined
12:02:45  * lloyddequit (Ping timeout: 252 seconds)
12:04:10  * irajoined
12:19:15  * daviddiasjoined
12:21:23  * daviddia_quit (Ping timeout: 245 seconds)
12:30:59  * bsdguruquit (Ping timeout: 240 seconds)
12:35:59  * therealkoopajoined
12:40:38  * bsdgurujoined
12:59:18  * lloyddejoined
13:03:28  * lloyddequit (Ping timeout: 245 seconds)
13:15:34  * mamashpart
13:26:23  * mamashjoined
13:34:21  * iraquit (Read error: Connection reset by peer)
13:34:34  * irajoined
13:48:32  * therealkoopaquit (Remote host closed the connection)
13:50:47  * abraxasjoined
13:52:38  * daviddiasquit (Ping timeout: 245 seconds)
13:54:06  * daviddiasjoined
13:55:07  * therealkoopajoined
13:55:55  * abraxasquit (Ping timeout: 260 seconds)
13:56:28  * paulfryzeljoined
14:00:04  * lloyddejoined
14:00:50  * paulfryzelquit (Ping timeout: 245 seconds)
14:04:26  * lloyddequit (Ping timeout: 264 seconds)
14:06:17  * mamashpart
14:13:24  * AvianFlujoined
14:36:21  * daviddiasquit (Remote host closed the connection)
14:42:26  * daviddiasjoined
14:49:11  * Bamberrousejoined
14:49:16  * Bamberrousepart
14:51:37  * daviddiasquit (Remote host closed the connection)
14:52:06  * daviddiasjoined
14:56:23  * daviddiasquit (Ping timeout: 245 seconds)
14:57:12  * paulfryzeljoined
14:58:32  * bsdguruquit (Quit: bsdguru)
15:00:43  * iraquit (Quit: Connection terminated.)
15:01:43  * paulfryzelquit (Ping timeout: 260 seconds)
15:14:04  * AvianFluquit (Remote host closed the connection)
15:17:01  * daviddiasjoined
15:26:36  * bsdgurujoined
15:52:07  * abraxasjoined
15:56:38  * abraxasquit (Ping timeout: 264 seconds)
15:57:59  * paulfryzeljoined
15:59:13  * paulfryzelquit (Read error: No route to host)
15:59:26  * AvianFlujoined
15:59:41  * paulfryzeljoined
16:01:41  * lloyddejoined
16:04:35  * paulfryzelquit (Ping timeout: 272 seconds)
16:06:20  * lloyddequit (Ping timeout: 265 seconds)
16:15:05  * utlemmingquit (Ping timeout: 272 seconds)
16:18:00  * paulfryzeljoined
16:18:29  * utlemmingjoined
16:20:21  * paulfryzelquit (Remote host closed the connection)
16:20:57  * paulfryzeljoined
16:38:18  * paulfryz_joined
16:38:25  * paulfryz_quit (Remote host closed the connection)
16:41:30  * paulfryzelquit (Ping timeout: 252 seconds)
16:44:00  * irajoined
16:56:00  * robertkowalskijoined
16:56:05  <robertkowalski>hey
16:56:45  <robertkowalski>i started to use manta yesterday night and have a quite noobish question
16:56:56  <rmustacc>Ask away
16:58:48  * daviddiasquit (Remote host closed the connection)
16:59:18  * daviddiasjoined
16:59:45  <robertkowalski>i want to compute on the licenses used in npm
17:00:01  <robertkowalski>mfind -n '.*.json' /isaacs/public/npm/npm | mjob create -o -m "xargs cat | json license [...]
17:01:13  * bsdguruquit (Ping timeout: 272 seconds)
17:01:25  * nfitchjoined
17:01:26  <rmustacc>And I imagine that snippet there isn't working quite right?
17:02:09  <robertkowalski>so i am getting this one json file lying in npm on isaacs public space
17:02:14  * lloyddejoined
17:02:34  * daviddia_joined
17:02:34  <robertkowalski>and cat errors, because it cant access the file.
17:02:37  <rmustacc>So, there's a few things.
17:02:58  * daviddiasquit (Read error: No route to host)
17:03:11  <rmustacc>If you run that mfind, you'll see that there isn't much there.
17:03:59  <rmustacc>It looks like that stuff is all under /npm/public/registry.
17:04:19  <rmustacc>However, you also don't want to be using xargs there.
17:04:40  * bsdgurujoined
17:04:46  <rmustacc>So When you fire off a map phase your job is run once for every input object.
17:05:42  <rmustacc>So every object is placed on your stdin in the first phase.
17:05:57  <rmustacc>So waht you probably want to use there is something that's actually just -m 'json license'
17:06:15  <rmustacc>And then maybe add a -r 'sort | uniq -c'
17:06:45  * lloyddequit (Ping timeout: 265 seconds)
17:08:31  * fredkjoined
17:12:46  <rmustacc>robertkowalski: That make sense?
17:13:51  <robertkowalski>rmustacc: i started with piping directly into json but i started thinking that i need something like an echoing when i got:
17:14:07  <robertkowalski>json: error: input is not JSON: Unexpected '/' at line 1, column 1:
17:14:08  * therealkoopaquit (Remote host closed the connection)
17:14:26  <rmustacc>robertkowalski: What file was that in?
17:15:16  <robertkowalski>rmustacc: look https://gist.github.com/robertkowalski/8713706
17:15:35  <rmustacc>Oh, no, that's not what I meant.
17:15:44  <rmustacc>So you still want to create a job.
17:15:57  <robertkowalski>ah ok!
17:16:00  * mamashjoined
17:16:04  <robertkowalski>so this is unrelated
17:16:32  <rmustacc>What happened here is you just did an mfind, which outputs paths and tried to ask json to process it.
17:16:45  <rmustacc>Let me pull up the example you want to adapt for your case.
17:17:52  <rmustacc>So you had the right idea with your original one.
17:17:54  <robertkowalski>yes. i was somehow assuming that i could use the interactive shell as a kind of sandbox for jobs
17:18:02  <rmustacc>You can.
17:18:18  <rmustacc>There you'll want to run mlogin <object path>
17:18:44  <rmustacc>But here you want to still do the mjob create like you did before.
17:18:58  <rmustacc>But you want the -m argument to simply be 'json license'
17:19:03  <rmustacc>Then you want to probably combine all that data in the end.
17:19:18  <rmustacc>So you'll want a -r 'sort | uniq -c' or something similar.
17:19:35  * mcavagejoined
17:19:51  <robertkowalski>yep!
17:19:55  <rmustacc>So what you want all in all is something like: ... | mjob create -o -m 'json license' -r 'sort | uniq -c'
17:20:24  <robertkowalski>yes, but that strangely returns no output
17:21:01  <rmustacc>Has the job completed?
17:21:25  <rmustacc>What does mjob get <id> show?
17:21:31  * dap_joined
17:24:16  * notmattjoined
17:25:30  <robertkowalski>state: done, outputs: 1 - https://gist.github.com/robertkowalski/8713898
17:25:56  <rmustacc>So you only had two inputs.
17:26:11  <rmustacc>What was the full line you ran?
17:26:21  <rmustacc>Err, 1 input.
17:26:57  <robertkowalski>COUNT=30; mfind -n '.*.json' /isaacs/public/npm/npm | mjob create -o -m "json license" -r 'sort | uniq -c'
17:27:11  <robertkowalski>you are right, this has just one input
17:27:37  <rmustacc>If you run an mfind of /isaaacs/public/npm, you'll find not much there.
17:27:43  <rmustacc>It's all moved under /npm
17:28:16  <rmustacc>Try doing the mfind, without the | mjob create of /npm/public/registry
17:49:46  * daviddia_quit (Remote host closed the connection)
17:50:15  * daviddiasjoined
17:52:49  * abraxasjoined
17:53:06  * daviddia_joined
17:54:23  <robertkowalski>rmustacc: ah meh!
17:54:43  * daviddiasquit (Ping timeout: 245 seconds)
17:55:03  <robertkowalski>now trying again.
17:57:14  * abraxasquit (Read error: Operation timed out)
18:02:41  * lloyddejoined
18:08:14  * lloyddequit (Read error: Connection reset by peer)
18:08:50  * lloyddejoined
18:11:00  * therealkoopajoined
18:28:52  <robertkowalski>rmustacc: thanks so much for your help to get started!
18:29:25  <robertkowalski>rmustacc: seems mfind -t o -l 2000 -n '.*\.json$' /npm/public/registry does the trick!
18:43:25  * ins0mniaquit (Ping timeout: 265 seconds)
18:46:35  * ins0mniajoined
18:46:59  * therealkoopaquit (Remote host closed the connection)
18:48:33  * mcavagequit (Remote host closed the connection)
18:48:59  * mcavagejoined
18:49:25  * therealkoopajoined
18:53:20  * mcavagequit (Ping timeout: 245 seconds)
19:03:07  * mcavagejoined
19:24:44  * mamashpart
19:53:51  * abraxasjoined
19:57:37  * lloyddequit (Remote host closed the connection)
19:58:55  * abraxasquit (Ping timeout: 272 seconds)
20:04:45  * mcavagequit (Remote host closed the connection)
20:05:18  * mcavagejoined
20:09:08  * notmattquit (Remote host closed the connection)
20:09:42  * notmattjoined
20:14:45  * notmattquit (Ping timeout: 272 seconds)
20:19:03  * chorrelljoined
20:21:04  * therealkoopaquit (Remote host closed the connection)
20:31:11  <robertkowalski>rmustacc: somehow the jsontool is not producing output. while '-m wc' works like a charm, '-m "jsontool license"' does not give any output.
20:32:36  <robertkowalski>but it works when i am on the shell via mlogin and do echo '{"license": 23}' | jsontool license
20:32:37  <rmustacc>Did you mean 'json' not 'jsontool'
20:32:48  <robertkowalski>err. yes. sorry
20:32:52  <robertkowalski>getting late here ;)
20:34:10  <robertkowalski>just a mistype in the chat.
20:37:54  * therealkoopajoined
20:39:10  <dap_>robertkowalski: that example works for me in a job:
20:39:10  <dap_>https://gist.github.com/davepacheco/ac943b69ab3e39a10432
20:53:38  * notmattjoined
21:03:03  * lloyddejoined
21:06:19  * ins0mniaquit (Read error: Connection reset by peer)
21:07:15  * lloyddequit (Ping timeout: 252 seconds)
21:10:36  * lloyddejoined
21:18:02  * AvianFluquit (Remote host closed the connection)
21:37:08  <robertkowalski>dap_ hm that is very interesting
21:38:44  <robertkowalski>dap_ mfind -l 1 -n '.*.test.json' /dap/public/ | mjob create -o -m 'json license' <- adapted, works for me, too
21:38:52  * daviddia_quit (Read error: Connection reset by peer)
21:39:08  * daviddiasjoined
21:39:40  <robertkowalski>dap_ mfind -n 'doc.json' /npm/public/registry/npm | mjob create -o -m 'json license' <- works not!
21:40:36  <dap_>That object does not appear to have a "license" property
21:41:22  <dap_>At least at the top level
21:48:28  <robertkowalski>dap_ wow thank you! i somehow missed that!
21:48:34  * AvianFlujoined
21:49:49  <dap_>:)
21:56:45  * AvianFluquit (Ping timeout: 252 seconds)
22:42:03  * AvianFlujoined
22:44:42  * lloyddequit (Remote host closed the connection)
22:58:49  * daviddiasquit (Remote host closed the connection)
22:58:55  * jperkinjoined
22:59:20  * daviddiasjoined
23:02:29  * therealkoopaquit (Remote host closed the connection)
23:03:45  * daviddiasquit (Ping timeout: 252 seconds)
23:20:47  * therealkoopajoined
23:21:45  * therealkoopaquit (Remote host closed the connection)
23:25:39  * therealkoopajoined
23:34:48  * daviddiasjoined
23:49:26  * therealkoopaquit (Remote host closed the connection)
23:52:25  * chorrellquit (Quit: My MacBook Pro has gone to sleep. ZZZzzz…)
23:55:33  * abraxasjoined
23:55:39  * daviddiasquit (Read error: Connection reset by peer)
23:57:58  * chorrelljoined