00:03:23  * paxos2kchanged nick to paxos^off
00:07:55  * mikealquit (Quit: Leaving.)
00:14:50  * ashihjoined
00:20:24  * jjmalinajoined
00:37:19  * book`quit (Ping timeout: 264 seconds)
00:38:12  * kenansulaymanchanged nick to kenan|afk
00:39:34  * DTrejojoined
00:42:20  * daviddiasquit (Remote host closed the connection)
00:42:47  * daviddiasjoined
00:43:13  * book`joined
00:46:05  * paxos^offchanged nick to paxos2k
00:46:49  * daviddiasquit (Ping timeout: 240 seconds)
00:49:00  * daviddiasjoined
00:50:31  * thlorenzjoined
00:53:37  * justicefriesquit (Ping timeout: 240 seconds)
00:53:55  * ehdquit (Ping timeout: 264 seconds)
00:54:01  * hughsk__quit (Ping timeout: 240 seconds)
00:54:25  * calvinmetcalfquit (Ping timeout: 240 seconds)
00:54:29  * jcrugzz_quit (Ping timeout: 246 seconds)
00:54:35  * ELLIOTTCABLE__quit (Ping timeout: 246 seconds)
00:54:56  * l1xquit (Ping timeout: 246 seconds)
00:55:08  * hughsk__joined
00:55:50  * justicefries_joined
00:55:52  * ehdjoined
00:55:53  * jcrugzz_joined
00:56:01  * paxos2kchanged nick to paxos^off
00:56:05  * calvinmetcalfjoined
00:56:08  * l1xjoined
00:56:23  * ELLIOTTCABLE__joined
00:57:01  * mikealjoined
01:11:01  * thlorenzquit (Remote host closed the connection)
01:11:38  * parshapquit (Ping timeout: 246 seconds)
01:11:55  * ELLIOTTCABLE__quit (Ping timeout: 264 seconds)
01:12:00  * ehdquit (Ping timeout: 255 seconds)
01:12:25  * l1xquit (Ping timeout: 240 seconds)
01:12:25  * calvinmetcalfquit (Ping timeout: 240 seconds)
01:12:41  * jcrugzz_quit (Ping timeout: 246 seconds)
01:12:43  * stagasquit (Ping timeout: 264 seconds)
01:12:47  * justicefries_quit (Ping timeout: 246 seconds)
01:13:21  * daleharveyquit (Ping timeout: 255 seconds)
01:13:44  * ehdjoined
01:14:35  * calvinmetcalfjoined
01:14:43  * jcrugzz_joined
01:14:57  * l1xjoined
01:15:06  * parshapjoined
01:15:10  * paulfryzeljoined
01:15:31  * ELLIOTTCABLE__joined
01:16:20  * daleharveyjoined
01:16:33  * justicefries_joined
01:19:25  * paulfryzelquit (Ping timeout: 246 seconds)
01:21:43  * mikealquit (Quit: Leaving.)
01:38:59  * ELLIOTTCABLE__changed nick to ELLIOTTCABLE
01:40:45  * thlorenzjoined
01:43:50  * ashihquit (Remote host closed the connection)
01:44:24  * ashihjoined
01:44:24  * ashihquit (Client Quit)
01:44:44  * ashihjoined
01:47:59  * jjmalinaquit (Ping timeout: 255 seconds)
01:54:01  * thlorenzquit (Remote host closed the connection)
01:54:53  * daviddiasquit (Remote host closed the connection)
01:55:20  * daviddiasjoined
01:58:29  * ashihquit (Remote host closed the connection)
01:58:45  * DTrejoquit (Remote host closed the connection)
01:59:03  * ashihjoined
01:59:55  * daviddiasquit (Ping timeout: 264 seconds)
02:15:25  * daviddiasjoined
02:21:20  * ashihquit (Remote host closed the connection)
02:21:54  * ashihjoined
02:22:06  * mikealjoined
02:26:55  * mikealquit (Ping timeout: 264 seconds)
02:31:14  * DTrejojoined
02:34:22  * paxos^offchanged nick to paxos2k
02:44:14  * paxos2kchanged nick to paxos^off
02:46:45  * thlorenzjoined
02:51:07  * thlorenzquit (Ping timeout: 246 seconds)
02:52:07  * eugenewarequit (Remote host closed the connection)
02:52:32  * Raynosquit (Ping timeout: 252 seconds)
02:53:28  * Raynos_joined
02:55:28  * ashihquit (Remote host closed the connection)
02:55:54  * ashihjoined
02:56:06  * ashihquit (Remote host closed the connection)
02:56:33  * ashihjoined
03:04:08  * Sorellaquit (Quit: It is tiem!)
03:22:38  * mikealjoined
03:25:10  * DTrejoquit (Remote host closed the connection)
03:26:49  * mikealquit (Ping timeout: 246 seconds)
03:30:31  * DTrejojoined
03:30:34  * DTrejoquit (Remote host closed the connection)
03:39:29  * eugenewarejoined
03:44:19  * eugenewarequit (Ping timeout: 264 seconds)
03:59:21  * ashihquit (Quit: Textual IRC Client: www.textualapp.com)
04:01:01  * ashihjoined
04:17:33  * paulfryzeljoined
04:17:52  * ashih_joined
04:18:50  * ashihquit (Read error: Connection reset by peer)
04:21:46  * paulfryzelquit (Ping timeout: 246 seconds)
04:22:37  * paxos^offchanged nick to paxos2k
04:28:08  * daviddiasquit (Remote host closed the connection)
04:28:42  * daviddiasjoined
04:30:04  * eugenewarejoined
04:31:30  * ashihjoined
04:31:37  * ashih_quit (Ping timeout: 240 seconds)
04:32:32  * paxos2kchanged nick to paxos^off
04:33:09  * kytwbjoined
04:33:17  * daviddiasquit (Ping timeout: 252 seconds)
04:34:26  * daviddiasjoined
04:36:07  * eugenewarequit (Ping timeout: 246 seconds)
04:41:07  * dguttmanquit (Quit: dguttman)
04:41:15  * eugenewarejoined
04:45:44  * eugenewarequit (Ping timeout: 255 seconds)
04:53:07  * eugenewarejoined
04:58:25  * ashih_joined
05:00:58  * ashihquit (Ping timeout: 246 seconds)
05:07:09  * daviddiasquit (Remote host closed the connection)
05:07:45  * daviddiasjoined
05:11:49  * daviddiasquit (Ping timeout: 246 seconds)
05:24:07  * dguttmanjoined
05:58:00  * mikealjoined
06:02:08  * eugenewarequit (Remote host closed the connection)
06:02:45  * dguttmanquit (Quit: dguttman)
06:11:00  * paxos^offchanged nick to paxos2k
06:19:03  * paulfryzeljoined
06:20:48  * paxos2kchanged nick to paxos^off
06:23:13  * paulfryzelquit (Ping timeout: 246 seconds)
06:23:21  * ednapiranhaquit (Quit: Leaving...)
06:33:12  * eugenewarejoined
06:39:02  * daviddiasjoined
06:39:35  * eugenewarequit (Ping timeout: 255 seconds)
06:43:10  * daviddiasquit (Ping timeout: 246 seconds)
06:45:49  * ashih_quit (Quit: My MacBook has gone to sleep. ZZZzzz…)
07:03:15  * daviddiasjoined
07:07:40  * daviddiasquit (Ping timeout: 246 seconds)
07:19:44  * paulfryzeljoined
07:24:07  * paulfryzelquit (Ping timeout: 246 seconds)
07:40:28  * eugenewarejoined
07:45:31  * eugenewarequit (Ping timeout: 264 seconds)
07:59:08  * paxos^offchanged nick to paxos2k
08:09:05  * paxos2kchanged nick to paxos^off
08:20:29  * paulfryzeljoined
08:25:01  * paulfryzelquit (Ping timeout: 246 seconds)
08:40:40  * eugenewarejoined
08:46:01  * eugenewarequit (Ping timeout: 246 seconds)
09:05:05  * daviddiasjoined
09:09:28  * daviddiasquit (Ping timeout: 246 seconds)
09:21:15  * paulfryzeljoined
09:25:34  * paulfryzelquit (Ping timeout: 246 seconds)
09:32:39  * kytwb_joined
09:35:31  * kytwbquit (Ping timeout: 264 seconds)
09:40:23  * eugenewarejoined
09:45:43  * eugenewarequit (Ping timeout: 264 seconds)
09:47:45  * paxos^offchanged nick to paxos2k
09:57:01  * rsolejoined
09:57:07  * rsolequit (Client Quit)
09:57:20  * paxos2kchanged nick to paxos^off
09:58:33  * rsolejoined
10:22:03  * paulfryzeljoined
10:26:28  * paulfryzelquit (Ping timeout: 246 seconds)
10:30:16  * kenan|afkchanged nick to kenansulayman
10:46:24  * kytwbjoined
10:46:47  * kytwb_quit (Ping timeout: 246 seconds)
10:59:14  * daviddiasjoined
11:03:34  * daviddiasquit (Ping timeout: 246 seconds)
11:06:32  * kytwbquit (Ping timeout: 252 seconds)
11:21:19  * paxos^offchanged nick to paxos2k
11:22:51  * paulfryzeljoined
11:27:01  * paulfryzelquit (Ping timeout: 246 seconds)
11:56:01  * Sorellajoined
12:07:43  * rsolequit (Ping timeout: 264 seconds)
12:09:36  * rsolejoined
12:11:23  * blessYahujoined
12:12:28  * blessYahu_joined
12:15:44  * blessYahuquit (Ping timeout: 255 seconds)
12:23:35  * paulfryzeljoined
12:25:37  * rsolequit (Ping timeout: 240 seconds)
12:27:56  * paulfryzelquit (Ping timeout: 246 seconds)
12:43:00  * blessYahu_quit (Read error: Connection reset by peer)
13:00:39  * daviddiasjoined
13:05:02  * daviddiasquit (Ping timeout: 246 seconds)
13:10:09  * thlorenzjoined
13:11:29  * thlorenzquit (Remote host closed the connection)
13:24:21  * paulfryzeljoined
13:24:58  * mhernandez1joined
13:28:49  * paulfryzelquit (Ping timeout: 246 seconds)
13:30:43  * thlorenzjoined
13:42:40  * thlorenz_joined
13:43:36  * thlorenzquit (Read error: Connection reset by peer)
14:22:48  * daviddiasjoined
14:24:27  * ashihjoined
14:25:12  * paulfryzeljoined
14:29:22  * paulfryzelquit (Ping timeout: 246 seconds)
14:30:28  * jjmalinajoined
14:32:36  * kenansulaymanchanged nick to kenan|afk
14:33:31  * kenan|afkchanged nick to kenansulayman
14:38:39  * paulfryzeljoined
14:55:51  * daviddiasquit (Remote host closed the connection)
14:56:31  * daviddiasjoined
15:00:53  * daviddiasquit (Ping timeout: 246 seconds)
15:05:17  * daviddiasjoined
15:06:19  * daviddiasquit (Remote host closed the connection)
15:06:43  * daviddiasjoined
15:08:56  * daviddiasquit (Remote host closed the connection)
15:09:36  * daviddiasjoined
15:12:30  * paulfryzelquit (Read error: Connection reset by peer)
15:12:58  * paulfryzeljoined
15:13:49  * daviddiasquit (Ping timeout: 246 seconds)
15:18:31  * thlorenz_changed nick to thlorenz
15:21:43  * mikealquit (Quit: Leaving.)
15:30:12  * mikealjoined
15:36:11  * dguttmanjoined
15:39:09  * ednapiranhajoined
15:40:55  * mikealquit (Quit: Leaving.)
15:55:54  * ramitosjoined
15:55:56  * daviddiasjoined
16:01:34  * pfrazejoined
16:14:01  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
16:22:11  * daviddiasquit (Remote host closed the connection)
16:22:38  * daviddiasjoined
16:26:49  * daviddiasquit (Ping timeout: 240 seconds)
16:30:09  * ashihjoined
16:30:21  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
16:37:01  <ogd>http://lebron.technology/
16:37:55  <kenansulayman>wtf
16:38:02  <kenansulayman>.technology?
16:38:02  <ogd>:D
16:38:03  <pfraze>hahaha
16:38:06  <ogd>welcome to 2014
16:38:16  * daviddiasjoined
16:38:54  <kenansulayman>I'd call it
16:38:56  <kenansulayman>le bro
16:39:14  <kenansulayman>These new TLDs are ridiculous
16:39:43  <pfraze>my only problem is that it's not .tech
16:39:54  <kenansulayman>indeed
16:39:56  <pfraze>theyre kinda weirdly long
16:40:01  <kenansulayman>technology is longer than lebron :E
16:40:27  <pfraze>namecheap has a big list, maybe .tech will come too...
16:40:58  <pfraze>ah yeah, it will
16:41:02  <kenansulayman>
16:41:18  * mikealjoined
16:44:49  * joaoluisquit (Ping timeout: 240 seconds)
16:45:13  * joaoluisjoined
16:45:37  * mikealquit (Ping timeout: 240 seconds)
16:49:57  <kenansulayman>ogd is that your site?
16:50:24  <kenansulayman>Admin Email: [email protected]
16:50:25  <kenansulayman>Tech ID: nec06m0g76eq7dsy
16:50:26  <kenansulayman>Tech Name: max ogden
16:50:27  <kenansulayman>ah yes
16:50:34  <kenansulayman>like it :D
17:05:19  * jjmalinajoined
17:12:31  <brycebaril>the new tld's are a terrible idea that is currently a source for fun
17:13:32  * eugenewarejoined
17:36:01  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
17:38:04  * ashihjoined
17:39:46  * ashihquit (Client Quit)
17:40:43  * ramitosquit (Ping timeout: 264 seconds)
17:45:11  * mikealjoined
18:02:11  * jaynequit (Remote host closed the connection)
18:09:22  * ashihjoined
18:17:08  * sygijoined
18:23:20  * daviddiasquit (Remote host closed the connection)
18:23:46  * daviddiasjoined
18:28:20  * daviddiasquit (Ping timeout: 255 seconds)
18:34:22  * daviddiasjoined
18:41:04  * eugenewarequit (Remote host closed the connection)
18:44:52  * kenansulaymanchanged nick to kenan|afk
18:54:32  * thlorenzquit (Remote host closed the connection)
19:05:17  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
19:07:15  * thlorenzjoined
19:08:39  * jjmalinajoined
19:25:38  * chapelquit (Quit: ZNC - http://znc.sourceforge.net)
19:27:10  * chapeljoined
19:58:37  <ogd>lets say i 2 indexes, each with 10 billion keys
19:58:56  <ogd>index 1 is key = [email protected], value = some json
19:59:04  <ogd>index 2 is key = id, value = currentVersion
19:59:28  <ogd>so if i do createReadStream for all of index 2, and as i get current versions do a db.get on index1
19:59:41  <ogd>is it possible that the readStream will happen faster than the gets? e.g. will i run out of memory
19:59:47  <ogd>im not sure internally how things are scheduled
20:00:41  <rescrv>ogd: get rid of index2. store index1 as [email protected]<X> , where X is big endian of UINT64 - version. You can then just find the first instance of ID and assume it's the latest verison
20:01:11  <rescrv>it'll save you from having to look things up twice, and sidestep that issue
20:01:52  <ogd>rescrv: i benchmarked it and it was roughly twice as fast to use a secondary index in this case, as opposed to creating lots of iterators
20:02:29  <ogd>rescrv: (non scientific) https://github.com/maxogden/level-row-versioning-benchmarks
20:04:04  * mikealquit (Quit: Leaving.)
20:08:52  <brycebaril>ogd: why the get on index1 in that case?
20:09:13  <ogd>brycebaril: yea i guess i could store a full copy of the data in index2
20:09:16  <brycebaril>index2 could just be a full value copy of the same thing at index1's most current vers
20:09:19  <brycebaril>yeah
20:09:37  * justicefries_changed nick to justicefries
20:10:03  <ogd>brycebaril: but my original question stands, will the readStream go too fast for the .gets
20:10:48  * daviddiasquit (Remote host closed the connection)
20:11:09  <brycebaril>I'd have to try it and see, but yeah you'd probably end up scheduling too many gets and go to an unhappy place
20:11:23  * daviddiasjoined
20:11:32  <brycebaril>I think you'd also need to do the full value copy to avoid a race condition
20:12:21  <brycebaril>well, I guess it isn't much of a race condition actually, the index2 pointer would just be out of date, which is no better than the readstream's snapshot
20:12:31  <ogd>yea
20:15:42  * daviddiasquit (Ping timeout: 264 seconds)
20:22:17  <ogd>feels good to rip out code when you have tests
20:22:24  <ogd>im basically rewriting the dat storage layer
20:22:27  <ogd>but keeping the api
20:22:31  <ogd>w00t
20:40:43  * pfrazequit (Ping timeout: 246 seconds)
20:47:06  * pfrazejoined
20:53:46  * mikealjoined
21:08:35  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
21:22:27  * jaynejoined
21:37:49  * jjmalinajoined
21:38:26  * mhernandez1quit (Remote host closed the connection)
21:41:14  * daviddiasjoined
21:51:11  * ryan_ramagejoined
22:22:58  * mikealquit (Quit: Leaving.)
22:23:34  * mikealjoined
22:30:27  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
22:32:17  * kenan|afkchanged nick to kenansulayman
22:34:07  * kenansulaymanchanged nick to kenan|afk
22:34:18  * kenan|afkchanged nick to kenansulayman
22:39:16  * daviddiasquit (Remote host closed the connection)
22:39:44  * daviddiasjoined
22:45:40  * paulfryzelquit (Remote host closed the connection)
22:46:06  * calvinmetcalfquit (Quit: Connection closed for inactivity)
22:48:43  * ramitosjoined
23:00:58  * ryan_ramagequit (Quit: ryan_ramage)
23:04:25  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
23:12:31  * sygiquit (Quit: Connection closed for inactivity)
23:13:39  * joaoluisquit (Ping timeout: 255 seconds)
23:14:53  * fritzyjoined
23:15:24  <fritzy>readStreams don't appear to implement backpressure. Is there a reason for this?
23:16:07  <fritzy>I mean, hi.
23:18:08  <ogd>fritzy: might be a leveldb limitation, im not really sure. rvagg would probably know
23:19:27  <fritzy>ogd: thanks
23:24:59  * ednapiranhaquit (Quit: Leaving...)
23:25:45  <rescrv>ogd fritzy: no reason in the underlying leveldb that they cannot
23:26:25  <ogd>oh right since you have to explicitly advance the iterator, duh
23:26:45  <ogd>im guessing its not implemented yet cause nobody has needed it
23:27:28  * joaoluisjoined
23:30:45  <fritzy>*nod*
23:31:26  <fritzy>it's easy enough to make a writable stream, but it's buffer gets rather large if you don't keep up
23:32:30  <brycebaril>we actually did some work on this last year at nodeconf
23:32:48  <brycebaril>oh wait that was writestreams maybe
23:33:54  * thlorenzquit (Remote host closed the connection)
23:35:25  <fritzy>brycebaril: I'm using the read(0) method in https://github.com/substack/stream-handbook#consuming-a-readable-stream to indicate that I'm ready for the next write to read(), but delaying that call with an async callback or a manual setTimeout doesn't slow it down. Shall I open an issue reproduction code?
23:36:18  * daviddiasquit (Remote host closed the connection)
23:36:37  <brycebaril>fritzy: definitely
23:36:42  <fritzy>k
23:37:23  <brycebaril>I typically don't use read() like that but I'm happy to look at your example to see how it compares to what I do
23:41:14  <brycebaril>fritzy: looking over the code I don't see why it wouldn't support backpressure, it is a pretty straightforward Readable
23:41:57  <fritzy>brycebaril: k, I'll make the issue and show the reproduction code in a bit.
23:52:59  * ashihjoined
23:59:31  * joaoluisquit (Ping timeout: 246 seconds)