00:14:40  * fredkquit (Quit: Leaving.)
00:16:23  * nfitchquit (Quit: Leaving.)
00:21:42  * yunongquit (Quit: Leaving.)
00:50:08  * lloyddejoined
00:57:04  * lloyddequit (Remote host closed the connection)
00:57:31  * lloyddejoined
01:00:20  * lloydde_joined
01:00:24  * lloydde_quit (Remote host closed the connection)
01:00:39  * lloyddequit (Read error: Connection reset by peer)
01:00:50  * lloyddejoined
01:05:08  * lloyddequit (Ping timeout: 245 seconds)
01:37:16  * abraxasjoined
02:11:26  * lloyddejoined
02:16:37  * lloyddequit (Ping timeout: 256 seconds)
02:55:11  * lloyddejoined
03:01:23  * lloyddequit (Remote host closed the connection)
03:01:49  * lloyddejoined
03:06:42  * lloyddequit (Ping timeout: 264 seconds)
04:03:29  * notmattjoined
04:07:21  * lloyddejoined
04:23:10  * konobijoined
04:23:50  <konobi>hey guys... asking on behalf of someone else, but is there a way to run manta jobs as the object is being uploaded?
04:24:18  <rmustacc>konobi: You mean run a job on the object while it is still being uploaded?
04:24:36  <konobi>yup
04:24:58  <rmustacc>No.
04:25:18  <rmustacc>Also if you have an object that already exists with that name that'd be even more confusingl
04:25:19  <konobi>mkay... makes sense from the docs
04:25:22  <rmustacc>*confusing
04:25:52  <rmustacc>I'm not sure what it would even mean to run a job on an object where not all the input is available.
04:26:03  <konobi>rmustacc: think transcoding
04:27:18  <konobi>you want to start your trancoding as soon as possible, so that your different versions are available asap
04:28:12  <konobi>ffmprg and the like have the ability to deal with encoding "live" streams in a sane way
04:28:29  <rmustacc>But semantically how do you indicate the presence of something that isn't present.
04:28:44  <rmustacc>Especially as you can upload multiple files with exactly the same name.
04:28:52  <konobi>cat file | mput | mjob.....
04:28:56  <rmustacc>And basically whichever one finishes last will finish.
04:29:40  <marsell>I suspect that'd probably cause serious problems for the Manta model.
04:29:50  <marsell>Imagine many simultaneous and slow uploads.
04:29:58  <marsell>They'd tie up many zones.
04:30:02  <konobi>*shrug* i was just seeing if it was possible... it's not... so may just need to do chunking
04:30:39  <konobi>marsell: vs 2-3 million dollar peices of equipment, it might be just fine
04:32:10  <marsell>It's an interesting idea, but it's also a simple way to tie up many resources using very few resources. Unfortunately, the Manta guys need to keep in mind there's always some jackass out there with DoS on his mind. :/
04:32:31  <marsell>But maybe one day they'll figure something out.
04:32:32  <konobi>it's similar to the thumbnailing an image, but in multiple sizes at the same time
04:33:09  <rmustacc>The challenge is really only in the just in time nature of wanting that in manta really. Otherwise it's a simple map job.
04:33:28  <rmustacc>I mean, at the end of the day as long as they're paying us for tying up zones, *shrug*.
04:33:33  <konobi>yup
04:33:44  <rmustacc>But you're losing a big chunk of the value prop.
04:33:51  <konobi>just been talking to some broadcast folks
04:34:29  <konobi>they're all about reducing latency... but there's always chunking then map reduce on those
04:35:23  <konobi>so yeah, well doable that way... just more to keep track of =0)
04:35:44  <marsell>Out of curiosity, is the emphasis on resizing or long-term storage for those guys?
04:36:10  <rmustacc>If you're worried about reducing latency even uploading to manta seems painful.
04:36:13  <konobi>generally 90 day turn around
04:36:40  <konobi>once it's available to upload, they want it asap... then the different versions just sit there
04:36:55  <konobi>may just stay, may get deleted
04:37:12  <konobi>not quite sure what they're looking at in those terms
04:37:38  <marsell>It might be faster for them to transcode locally and store on Manta. I imagine that's a lot of data to shuffle around.
04:38:21  <konobi>mmm... maybe, maybe not
04:49:56  * lloyddequit (Remote host closed the connection)
04:50:22  * lloyddejoined
04:52:33  * lloydde_joined
04:52:39  * lloyddequit (Read error: Connection reset by peer)
05:23:59  * lloydde_quit (Remote host closed the connection)
05:24:26  * lloyddejoined
05:28:56  * lloyddequit (Ping timeout: 245 seconds)
06:09:39  * mamashjoined
06:17:08  * notmattquit (Remote host closed the connection)
06:25:33  * lloyddejoined
06:29:43  * lloyddequit (Ping timeout: 245 seconds)
07:03:19  * yruss972joined
07:25:55  * lloyddejoined
07:30:22  * lloyddequit (Ping timeout: 260 seconds)
07:42:25  * yruss972quit (Remote host closed the connection)
07:43:01  * yruss972joined
07:47:16  * yruss972quit (Ping timeout: 256 seconds)
08:11:18  * yruss972joined
08:15:55  * yruss972quit (Ping timeout: 248 seconds)
08:26:15  * lloyddejoined
08:30:14  * lloyddequit (Ping timeout: 240 seconds)
09:13:49  * yruss972joined
09:17:34  * yruss972quit (Remote host closed the connection)
09:18:09  * yruss972joined
09:22:39  * yruss972quit (Ping timeout: 252 seconds)
09:26:36  * lloyddejoined
09:31:33  * lloyddequit (Ping timeout: 268 seconds)
10:28:41  * yruss972joined
10:33:02  * yruss972quit (Ping timeout: 240 seconds)
10:52:44  * abraxasquit (Remote host closed the connection)
11:07:17  * mamashpart
11:07:27  * mamashjoined
11:27:18  * lloyddejoined
11:31:39  * lloyddequit (Ping timeout: 248 seconds)
12:27:39  * lloyddejoined
12:32:02  * lloyddequit (Ping timeout: 256 seconds)
12:49:48  * AvianFlujoined
13:23:39  * AvianFluquit (Remote host closed the connection)
13:28:00  * lloyddejoined
13:32:30  * lloyddequit (Ping timeout: 264 seconds)
13:51:59  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
14:28:20  * lloyddejoined
14:32:38  * lloyddequit (Ping timeout: 245 seconds)
14:59:35  * lloyddejoined
15:04:59  * lloyddequit (Ping timeout: 248 seconds)
15:07:31  * mamashpart
15:28:31  * mcavagejoined
15:37:39  * aolsonjoined
15:57:02  * fredkjoined
16:02:59  * nfitchjoined
16:03:52  * fredkquit (Quit: Leaving.)
16:04:10  * fredkjoined
16:05:09  * chorrelljoined
16:15:15  * lloyddejoined
16:15:18  * dap1joined
16:27:46  * yunongjoined
16:45:11  * mamashjoined
16:59:16  * dap1quit (Quit: Leaving.)
17:48:30  * mamashpart
18:00:25  <bixu>iirc, there are ways to split up most multimedia files, transcode, then splice back together.
18:09:02  * lloyddequit (Remote host closed the connection)
18:09:35  * lloyddejoined
18:13:45  * lloyddequit (Ping timeout: 245 seconds)
18:14:34  * lloyddejoined
18:20:01  <nahamu>with some penalty presumably to be payed for having to do a full frame at the beginning of each chunk even though it might have been similar to the end of the preceding chunk.
18:49:35  * lloyddequit (Remote host closed the connection)
18:50:11  * lloyddejoined
18:54:36  * lloyddequit (Ping timeout: 245 seconds)
19:21:36  * lloyddejoined
19:28:45  * lloyddequit (Ping timeout: 252 seconds)
20:04:07  * lloyddejoined
20:18:19  * mamashjoined
20:29:21  * aolsonquit (Quit: Textual IRC Client: www.textualapp.com)
20:34:23  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
20:46:34  * mamashpart
20:52:01  * nfitchquit (Quit: Leaving.)
21:36:53  <bixu>Is there an easy way to stream a curl or wget of a remote file directly to mput?
21:38:24  * nfitchjoined
21:39:53  <tjfontaine>curl http://localhost/myfile.txt | mput ~~/stor/myfile.txt
21:40:01  <tjfontaine>bixu: ^^ ? :)
21:46:23  <bixu>Yes, although curl -s was necessary to silence the output to STDOUT. Thanks!
21:46:58  <tjfontaine>no problemo
21:54:31  <mcavage>bixu: one important point -- that won't set content-type for you, so if you want that to work in a browser ->
21:54:46  <mcavage>curl foo | mput -H content-type:text/plain ~~/stor/foo.txt
21:54:51  <bixu>right! thanks.
21:54:54  <mcavage>or whatever you want.
22:28:19  * yunongquit (Quit: Leaving.)
22:30:43  * yunongjoined
22:32:54  * echelog-1quit (Read error: Connection reset by peer)
22:35:07  * echelog-1joined
23:16:44  * lloyddequit (Remote host closed the connection)
23:17:19  * lloyddejoined
23:17:40  * konobipart
23:22:04  * lloyddequit (Ping timeout: 264 seconds)
23:29:04  * AvianFlujoined
23:30:17  * lloyddejoined
23:52:09  * nfitchquit (Quit: Leaving.)
23:55:23  * nfitchjoined