00:25:54  * kenansulaymanjoined
00:26:07  * kenansulaymanchanged nick to Guest36838
00:31:12  * thlorenzjoined
00:44:18  * thlorenzquit (Ping timeout: 240 seconds)
00:58:33  * Guest36838quit (Quit: Cheers)
01:07:29  * kenansul_joined
01:10:40  * madthanujoined
01:24:08  * kenansulaymanjoined
01:24:16  * kenansulaymanchanged nick to Guest63181
01:41:08  * thlorenzjoined
01:54:50  * thlorenzquit (Ping timeout: 264 seconds)
02:03:59  * madthanuquit (Ping timeout: 246 seconds)
02:14:19  * timoxleyquit (Remote host closed the connection)
02:25:41  * timoxleyjoined
02:27:26  * kenansul_quit (Ping timeout: 246 seconds)
02:29:17  * kenansulaymanjoined
02:31:30  * sneakynessjoined
02:31:48  * sneakynessquit (Client Quit)
02:34:32  * sneakynessjoined
02:34:36  * kenansulaymanquit (Quit: ≈♡≈)
02:35:18  * kenansulaymanjoined
02:39:22  * kenansulaymanquit (Client Quit)
02:51:01  * thlorenzjoined
02:59:04  * nrwjoined
03:04:22  * thlorenzquit (Ping timeout: 246 seconds)
03:18:02  <nrw>Is this a good place to ask a scuttlebutt question?
03:18:23  <nrw>I'm trying to figure out how big I can let a CRDT get before it will start causing problems. Is a 20 megabyte document with about 18,000 rows reasonable use? I'm streaming them to and from each client browser and persisting with level-scuttlebutt on the server.
03:35:20  * wolfeidauquit
03:40:49  * esundahljoined
03:50:44  * timoxleyquit (Remote host closed the connection)
04:00:54  * thlorenzjoined
04:01:22  * esundahlquit (Remote host closed the connection)
04:01:59  * esundahljoined
04:06:28  * quimquit
04:06:35  * esundahlquit (Ping timeout: 260 seconds)
04:07:05  * esundahljoined
04:08:30  * timoxleyjoined
04:34:35  * thlorenzquit (Ping timeout: 260 seconds)
04:39:55  * Pwnnaquit (Read error: Operation timed out)
04:40:03  * Pwnnajoined
04:47:59  * ramitosquit (Quit: Textual IRC Client: www.textualapp.com)
05:30:59  * thlorenz_joined
05:44:10  * thlorenz_quit (Ping timeout: 245 seconds)
06:03:24  * dominictarr_joined
06:05:51  * esundahlquit
06:07:32  * dominictarr_quit (Client Quit)
06:07:39  * dominictarr_joined
06:12:12  * brianloveswordsquit (Excess Flood)
06:13:24  * brianloveswordsjoined
06:16:43  <nrw>dominictarr_: you're the right guy to ask a scuttlebutt question to, right?
06:24:34  <nrw>I'm trying to figure out how big I can let a CRDT get before it will start causing problems. Is a 20 megabyte document with about 18,000 rows reasonable use?
06:25:43  <dominictarr_>nrw, I don't know, how is is behaveing for you?
06:26:14  <nrw>dominictarr_: just fine. :)
06:26:59  <nrw>i'm just wondering what the factor that limits size will be or is likely to be.
06:27:22  <nrw>so far it seems a little too good to be true. so, i'm cautious.
06:27:29  <dominictarr_>what are you using it for?
06:28:19  <dominictarr_>you could do an experiment where you add random things, and see when node crashes?
06:28:28  <nrw>streaming judging data live during competitions to spectators.
06:28:35  <dominictarr_>note you will also get GC pauses when it get really large
06:29:00  <nrw>the max i've tried is about 20 people changing data, 200ish receiving it.
06:29:10  <dominictarr_>oh, that might be fine, considering that the competition is not long lived
06:29:30  <dominictarr_>so crdt just has to survive one competition :)
06:29:58  <nrw>yes. 3 days max, and i can flatten it.
06:30:15  <dominictarr_>what sort of data is the commentary?
06:30:33  <dominictarr_>like, lots of text comments?
06:31:05  <nrw>very simple: just a competitor id and the judges integer mark.
06:31:18  <nrw>the big data is how complex the schedule of the competition is.
06:31:38  <dominictarr_>oh right
06:31:56  <nrw>that hardly changes, but when it does, i need the schedule to propagate to all the judges, which is why i picked crdt.
06:31:56  <dominictarr_>what sport is this for (just curious)?
06:32:01  <nrw>ballroom dancing
06:32:07  <dominictarr_>ha! nice.
06:32:09  <nrw>… is what i've used it for so far. :)
06:33:02  <nrw>to be clear, if the object is too big, memory in browser and on the server will likely be the resource that is getting taxed. right?
06:33:11  <dominictarr_>what is the largest most out of control sized ballroom dancing competition you can imagine?
06:33:42  <dominictarr_>yeah, browser memory - someone may be watching it on a phone or something
06:34:07  <nrw>if i ran the biggest comp in the world and doubled the biggest participation it's ever had, the crdt would be about 40 megabytes.
06:34:35  <nrw>… that's while the last round is being judged.
06:35:15  <dominictarr_>right, so test that on an old android, and see if it's okay
06:35:25  <nrw>ahh. i see what you did there. :P
06:35:48  <nrw>thanks for helping me hash that out. :)
06:36:02  <dominictarr_>if not, there is probably something that could be done to restrict the set for the watchers
06:36:18  <dominictarr_>haha, no problem! it's great to know it's being used for stuff like this
06:36:35  <nrw>absolutely. i can find ways to break the data up into more documents. i just wouldn't if that would be a wasteful optimization. :P
06:36:49  <nrw>i suppose i'll keep you posted on what works out. :)
06:37:04  <dominictarr_>cheers, cool!
06:41:27  * thlorenzjoined
06:54:48  * thlorenzquit (Ping timeout: 252 seconds)
06:56:01  * dominictarr_quit (Ping timeout: 272 seconds)
07:51:07  * thlorenzjoined
08:04:44  * thlorenzquit (Ping timeout: 265 seconds)
08:11:07  * madthanujoined
08:37:56  * dominictarr_joined
08:44:09  * fergiemcdowalljoined
08:45:57  <fergiemcdowall>When scaling a leveldb index up from one box to several
08:46:24  <fergiemcdowall>would it be practical to roll something cool with multilevel?
08:47:25  <fergiemcdowall>or is it more sensible just to go with a ready made key-value server such as Riak...
08:47:32  <fergiemcdowall>To reformulate:
08:48:24  <fergiemcdowall>Is there a distributed cluster version of levelDB?
08:49:08  <gildean>fergiemcdowall: idk if it would be practical, but it would be cool
08:49:18  <rvagg>yes, riak, hyperdex, but you're interested specifically for Node fergiemcdowall?
08:51:25  <fergiemcdowall>I am trying to make Forage.js scale up
08:51:49  <rvagg>fergiemcdowall: have you actually hit limitations or are you just looking ahead?
08:52:30  <fergiemcdowall>...but not sure if a remote level cluster _must_ be a node.js app
08:52:41  <fergiemcdowall>@rvagg a bit of both...
08:52:58  <rvagg>have a look through the replication options for level*
08:53:21  <rvagg>one of dominic's does a nice master -> many slaves replication
08:54:03  <fergiemcdowall>OK! looking...
08:54:34  <rvagg>we're not really at a stage where we have a very solid replication story, particularly for this kind of thing, but it really needs people with the use-case to push those boundaries and put different implementations to the test
08:59:15  <fergiemcdowall>@rvagg I really like the idea of having a big LoFi index, that is remote, but always available on a socket, and can 'easily' grow and contract by adding/removing machines
09:00:59  * thlorenzjoined
09:04:03  * frankblizzardjoined
09:14:49  * thlorenzquit (Ping timeout: 265 seconds)
09:25:52  * Pwnna-joined
09:26:29  * book`_joined
09:26:56  * dominictarr_quit (*.net *.split)
09:26:56  * Pwnnaquit (*.net *.split)
09:26:58  * book`quit (*.net *.split)
09:26:58  * Pwnna-changed nick to Pwnna
09:33:53  * dominictarr_joined
09:52:05  * dominictarr_quit (Ping timeout: 272 seconds)
10:10:53  * thlorenzjoined
10:24:45  * thlorenzquit (Ping timeout: 272 seconds)
10:25:17  * kenansulaymanjoined
10:37:50  * stagasjoined
10:58:21  * fergiemcdowallquit (Ping timeout: 250 seconds)
11:20:51  * thlorenzjoined
11:34:19  * thlorenzquit (Ping timeout: 246 seconds)
11:45:47  * insertcoffeejoined
11:57:16  * kenansulaymanquit (Ping timeout: 245 seconds)
11:58:23  * kenansulaymanjoined
11:58:29  * timoxleyquit (Remote host closed the connection)
12:30:45  * thlorenzjoined
12:44:35  * thlorenzquit (Ping timeout: 260 seconds)
12:46:56  * kenansulaymanquit (Ping timeout: 246 seconds)
12:50:11  * kenansulaymanjoined
13:23:56  * kenansulaymanquit (Ping timeout: 245 seconds)
13:25:38  * kenansulaymanjoined
13:40:41  * thlorenzjoined
13:54:27  * thlorenzquit (Ping timeout: 252 seconds)
14:01:19  * nialloZ_quit (Ping timeout: 246 seconds)
14:16:15  * pbwjoined
14:34:34  * groglogicjoined
14:50:36  * thlorenzjoined
15:04:41  * thlorenzquit (Ping timeout: 272 seconds)
15:09:20  <kenansulayman>juliangruber
15:10:07  <kenansulayman>Can I use +new Date timestamps as key?
15:15:11  * quimjoined
15:20:15  * dguttmanjoined
15:22:34  <juliangruber>kenansulayman: typeof +new Date == 'number', you should cast to strings
15:22:44  <kenansulayman>Yes of course
15:22:49  <kenansulayman>I mean are they in the right order?
15:23:34  <kenansulayman>1385738577155, 1385738577674, 1385738577946, 1385738578162, 1385738578394, 1385738578562
15:23:42  <kenansulayman>say we put them in that order into the db
15:23:51  <kenansulayman>will a readstream yield them in that order?
15:28:55  <kenansulayman>juliangruber
15:29:11  <juliangruber>yep it's the right order
15:29:20  <juliangruber>as long as two keys don't have the same timestamp
15:29:23  <juliangruber>you should be fine
15:29:32  <kenansulayman>nice!
15:29:42  <kenansulayman>thanks & schönen abend :)
15:31:46  <juliangruber>kenansulayman: you too! :)
15:43:35  * stagasquit (Ping timeout: 272 seconds)
15:44:29  * frankblizzardquit
16:00:34  * thlorenzjoined
16:11:20  * madthanuquit (Ping timeout: 260 seconds)
16:14:08  * thlorenzquit (Ping timeout: 260 seconds)
16:22:49  * dguttmanquit (Quit: dguttman)
16:38:09  * Punnajoined
16:46:26  * Punnaquit (Ping timeout: 245 seconds)
16:47:55  * insertcoffeequit (Ping timeout: 246 seconds)
16:49:39  * tarrudajoined
16:54:18  * jmartinsjoined
16:59:50  * Punnajoined
17:10:25  * thlorenzjoined
17:12:39  * groglogicquit (Remote host closed the connection)
17:24:07  * thlorenzquit (Ping timeout: 260 seconds)
17:28:56  * Punnaquit (Ping timeout: 245 seconds)
17:31:07  * sneakynessquit (Quit: ¡)
17:32:14  * Punnajoined
17:32:36  * madthanujoined
17:40:29  * Punnaquit (Ping timeout: 272 seconds)
17:41:46  * Punnajoined
17:55:41  * Punnaquit (Ping timeout: 272 seconds)
18:05:46  * nrwpart
18:06:51  * Punnajoined
18:20:20  * thlorenzjoined
18:23:54  * rudjoined
18:28:11  * kenansulaymanquit (Ping timeout: 246 seconds)
18:30:26  * kenansulaymanjoined
18:31:23  * rudquit (Ping timeout: 260 seconds)
18:34:07  * thlorenzquit (Ping timeout: 260 seconds)
18:39:11  * rudjoined
18:39:11  * rudquit (Changing host)
18:39:11  * rudjoined
18:49:51  * kenansulaymanquit (Remote host closed the connection)
19:02:55  * tarrudaquit (Remote host closed the connection)
19:04:03  * jxsonjoined
19:04:06  * kenansulaymanjoined
19:05:53  * insertcoffeejoined
19:07:08  * kenansulaymanquit (Client Quit)
19:14:55  * jcrugzzjoined
19:22:51  * rudquit (Ping timeout: 265 seconds)
19:26:07  * Punnaquit (Ping timeout: 246 seconds)
19:27:40  * mikealquit (Quit: Leaving.)
19:28:08  * rudjoined
19:28:09  * rudquit (Changing host)
19:28:09  * rudjoined
19:28:32  * kenansulaymanjoined
19:30:13  * thlorenzjoined
19:32:41  * madthanuquit (Ping timeout: 245 seconds)
19:43:59  * thlorenzquit (Ping timeout: 272 seconds)
19:45:32  * kenansulaymanquit (Ping timeout: 246 seconds)
19:48:21  * kenansulaymanjoined
19:49:04  * jxsonquit (Remote host closed the connection)
19:49:32  * jxsonjoined
19:52:46  * jmartinsquit (Quit: KVIrc 4.2.0 Equilibrium http://www.kvirc.net/)
19:53:55  * thlorenzjoined
19:58:35  * thlorenzquit (Ping timeout: 260 seconds)
20:03:39  * stagasjoined
20:08:06  * kenansulaymanquit (Quit: ≈ and thus my mac took a subtle yet profound nap ≈)
20:09:50  * kenansulaymanjoined
20:13:16  * paulfryzeljoined
20:13:29  * dguttmanjoined
20:35:26  * dguttmanquit (Quit: dguttman)
20:36:04  * ramitosjoined
20:36:14  * jcrugzzquit (Ping timeout: 264 seconds)
20:40:48  * thlorenzjoined
20:53:39  * thlorenzquit (Ping timeout: 260 seconds)
21:00:41  * mikealjoined
21:10:33  * jcrugzzjoined
21:22:58  <rvagg>kenansulayman: http://ghub.io/monotonic-timestamp
21:50:07  * thlorenzjoined
21:50:19  * rudquit (Ping timeout: 246 seconds)
21:53:22  * paulfryzelquit (Remote host closed the connection)
21:54:03  * paulfryzeljoined
21:59:21  * kevinswiberjoined
22:03:35  * thlorenzquit (Ping timeout: 272 seconds)
22:06:52  <kenansulayman>rvagg yes know that; ty :)
22:06:58  * kenansulaymanquit (Quit: ≈♡≈)
22:14:46  * kevinswiberquit (Remote host closed the connection)
22:16:08  * ryan_ramagejoined
22:16:30  * paulfryzelquit (Remote host closed the connection)
22:20:07  * kevinswiberjoined
22:30:52  * kevinswiberquit (Remote host closed the connection)
22:52:51  * jxsonquit (Remote host closed the connection)
22:53:19  * jxsonjoined
22:57:51  * jxsonquit (Ping timeout: 252 seconds)
23:00:06  * thlorenzjoined
23:13:43  * thlorenzquit (Ping timeout: 260 seconds)
23:31:14  * mikealquit (Quit: Leaving.)
23:46:16  * mikealjoined
23:50:51  * jxsonjoined