00:00:10  * daviddiasquit (Remote host closed the connection)
00:00:46  * daviddiasjoined
00:01:07  * kofnojoined
00:02:18  * mageemooneyquit (Ping timeout: 240 seconds)
00:03:27  * daviddiasquit (Read error: No route to host)
00:04:17  * daviddiasjoined
00:13:15  * daviddiasquit (Ping timeout: 240 seconds)
00:15:15  * kenan|afkchanged nick to kenansulayman
00:28:23  * mageemooneyjoined
00:32:42  * mageemooneyquit (Ping timeout: 240 seconds)
00:34:16  * paulfryzeljoined
00:36:58  * thlorenzjoined
00:38:37  * paulfryzelquit (Ping timeout: 252 seconds)
00:41:53  * thlorenzquit (Remote host closed the connection)
00:42:13  * thlorenzjoined
00:45:51  * ednapiranhajoined
00:50:13  <rescrv>ogd: if you don't need hyperleveldb right away, wait until 0.11.13 is out. We'll have a new version of hldb out by then that will have many fixes/perf improvements
00:50:37  <ogd>rescrv: oh, good to hear!
00:51:03  * daviddiasjoined
00:53:08  * daviddiasquit (Remote host closed the connection)
00:53:50  * daviddiasjoined
00:58:03  * daviddiasquit (Ping timeout: 250 seconds)
00:58:37  * mageemooneyjoined
00:59:26  * mikealjoined
01:03:55  * mikealquit (Ping timeout: 252 seconds)
01:04:25  * ednapiranhaquit (Remote host closed the connection)
01:08:42  * mageemooneyquit (Ping timeout: 276 seconds)
01:10:24  * daviddiasjoined
01:11:22  <rvagg>rescrv: timeframe for 0.11.13 was about 3 weeks ago but the guy responsible for it is even more time-poor than me and is being trotted around the country (US) by his employer for a "listening tour"
01:17:01  <rescrv>what's a "listening tour"?
01:29:44  <rvagg>~= bleh
01:29:59  <rvagg>this thing: http://www.joyent.com/noderoad
01:30:22  <rvagg>NYC this week, you should go ...!
01:33:23  * kenansulaymanchanged nick to kenan|afk
01:35:10  * paulfryzeljoined
01:39:54  * paulfryzelquit (Ping timeout: 276 seconds)
01:40:37  * wolfeidauquit
01:52:28  * daviddiasquit (Remote host closed the connection)
01:59:49  * mageemooneyjoined
02:00:17  <rescrv>rvagg: this week's kinda busy. I'll see if I can squeeze it in, but it's unlikely. Are there going to be some in May elsewhere?
02:12:07  * mageemooneyquit (Ping timeout: 252 seconds)
02:15:28  * wolfeidaujoined
02:35:45  * paulfryzeljoined
02:39:37  * mageemooneyjoined
02:39:59  * paulfryzelquit (Ping timeout: 252 seconds)
02:41:35  <rvagg>probably not over that side of the country
02:45:03  <Aria>Boston on Tuesday, but still this week.
02:46:42  * mageemooneyquit (Ping timeout: 240 seconds)
02:49:06  * thlorenzquit (Remote host closed the connection)
03:00:24  * mageemoo_joined
03:13:50  * thlorenzjoined
03:20:43  * thlorenzquit (Remote host closed the connection)
03:31:47  * Sorellaquit (Quit: It is tiem!)
03:36:31  * paulfryzeljoined
03:40:51  * paulfryzelquit (Ping timeout: 252 seconds)
03:55:17  * ednapiranhajoined
04:11:43  <rvagg>w00t, we have the *leveldb* package name in npm to play with now: https://github.com/rvagg/node-levelup/issues/244
04:11:47  <rvagg>just got to decide what to put there
04:21:06  * dguttmanjoined
04:24:07  * dguttmanquit (Client Quit)
04:34:32  * dguttmanjoined
04:37:26  * paulfryzeljoined
04:41:43  * paulfryzelquit (Ping timeout: 252 seconds)
05:00:21  * dguttmanquit (Quit: dguttman)
05:03:50  * dominic_joined
05:04:30  * ednapiranhaquit (Quit: Leaving...)
05:40:32  <ogd>Oooh nice
05:47:19  <levelbot>[npm] [email protected] <http://npm.im/level-search>: universal search for leveldb (@dominictarr)
05:50:21  <dominic_>ogd: yo
05:51:17  <ogd>dominic_: hiya
05:51:40  <dominic_>ogd: I've been working on a pure js levellike
05:51:43  <dominic_>GOATDB
05:51:51  <dominic_>(because it's so goatscale)
05:51:54  <ogd>dominic_: lol
05:52:32  <dominic_>and then I realized... if you have a append only memtable, and you do a bulk load from another db
05:52:37  <dominic_>then all the writes should be in order
05:52:52  <dominic_>so, they should be written to the memtable's log in order too
05:53:32  <ogd>Oh yea isn't there an optimization where you can insert in reverse to avoid compaction
05:53:47  <dominic_>no, that is a different optimization
05:53:52  <ogd>If you can ensure data is already sorted
05:53:54  <ogd>Ah
05:53:59  <dominic_>that is just to avoid searching the skip list
05:54:26  <dominic_>if they are added in reverse order it's always a single op to add to the head of the list
05:54:33  <ogd>Memtable is the same as the log right
05:54:34  <dominic_>I'm talking about how it's stored on disk
05:54:41  <dominic_>ogd: correct
05:55:12  <dominic_>there is the log on disk, which is probably out of order, and so level loads it all into memory and keeps it sorted there
05:55:49  <dominic_>so, but if the log _happened_ to be sorted, maybe you could just treat it as an SST
05:56:20  <dominic_>and then you could have a very fast load that is about as fast as just appending a bunch of stuff to a large file?
05:56:37  <ogd>Ah interesting, I have been wondering if this is possible lately
05:57:08  <ogd>But are read-on-write semantics possible here? Eg conflict resolution
05:58:35  <ogd>It'd be really nice to have a way to both quickly export and import a bunch of keys, that is faster than read streams
05:58:49  <dominic_>well, the reads are another thing
05:59:20  <dominic_>but if the writes are in order, then you could do it like this, you'd just have to totally rewrite leveldb probably
05:59:49  <dominic_>(because the formats that the log and the sst are stored in would need to be the same)
06:00:07  <ogd>Ahh
06:00:12  <dominic_>they are in goatdb (ldjson), which is what made me think of it.
06:01:26  <ogd>Well I definitely want to be goatscale
06:02:06  <dominic_>yeah exactly. it will be the fastest db to npm install and then write a record to it
06:02:20  <dominic_>because it won't need compiling
06:02:37  <dominic_>also, that will make it work easy on windows!
06:03:20  <ogd>We now have a complicated prebuilt binary solution for leveldown + dat
06:04:13  <ogd>But I am really interested in faster replication
06:05:01  <ogd>I can squeeze a little more perf out of read streams and that's probably good enough for v1
06:06:08  <ogd>But I keep feeling like there must be some optimizations for replication involving lower level stuff with the leveldb files
06:06:55  <dominic_>ogd: you can get obsessive about perf when you start measuring it...
06:07:10  <dominic_>but no one is actually using dat and complaining about how it ruins their day
06:07:32  <dominic_>and neither do you have a direct compeditor that is faster than dat.
06:07:53  <dominic_>SOLUTION: CHILLAXE
06:08:27  <ogd>Yea good point
06:08:41  <dominic_>a magical axe that makes things turn to ice when you smash them to peices
06:09:02  <ogd>Lol
06:09:27  <dominic_>you must journey into the cave of the ice king and steal the CHILLAXE!
06:13:06  <dominic_>oh, hmm - if you wanted read-on-write for a bulk inorder load
06:13:20  <dominic_>that would just be a kind of stream merge
06:13:30  <dominic_>(leveldb is all about stream merges)
06:13:57  <dominic_>(you have multiple ordered files, you read from them, and merge into one stream)
06:15:53  <dominic_>brb, eats
06:28:26  * dominic_quit (Ping timeout: 240 seconds)
06:33:00  * brianloveswordsjoined
06:38:51  * paulfryzeljoined
06:44:06  * paulfryzelquit (Ping timeout: 276 seconds)
07:16:50  * mageemoo_quit (Remote host closed the connection)
07:17:28  * mageemooneyjoined
07:17:46  * mageemooneyquit (Read error: Connection reset by peer)
07:18:12  * mageemooneyjoined
07:39:39  * paulfryzeljoined
07:41:33  * brianloveswordsquit (Quit: Computer has gone to sleep.)
07:43:57  * paulfryzelquit (Ping timeout: 252 seconds)
08:38:46  * ralphtheninjajoined
08:40:23  * paulfryzeljoined
08:43:32  * daviddiasjoined
08:44:49  * paulfryzelquit (Ping timeout: 252 seconds)
09:41:06  * paulfryzeljoined
09:45:14  * paulfryzelquit (Ping timeout: 240 seconds)
10:05:30  * dominic_joined
10:41:49  * paulfryzeljoined
10:43:54  * binocarlosjoined
10:46:11  * paulfryzelquit (Ping timeout: 252 seconds)
10:56:19  * ramitosjoined
11:04:34  * kenan|afkchanged nick to kenansulayman
11:07:01  * kenansulaymanchanged nick to kenan|afk
11:14:03  * kenan|afkchanged nick to kenansulayman
11:20:58  * calvinmetcalfjoined
11:35:28  * daviddiasquit (Remote host closed the connection)
11:36:07  * daviddiasjoined
11:37:27  * daviddiasquit (Read error: Operation timed out)
11:42:37  * paulfryzeljoined
11:46:12  * Sorellajoined
11:47:11  * paulfryzelquit (Ping timeout: 265 seconds)
12:14:45  * kenansulaymanchanged nick to kenan|afk
12:41:58  * mhernandez1joined
12:43:34  * paulfryzeljoined
12:48:05  * paulfryzelquit (Ping timeout: 265 seconds)
12:50:06  * daviddiasjoined
12:53:32  * mhernandez1quit (Remote host closed the connection)
12:56:57  * mhernandez1joined
12:58:40  * thlorenzjoined
13:09:41  * mageemooneyquit
13:15:35  * ralphtheninjaquit (Ping timeout: 250 seconds)
13:21:15  * dominic_quit (Ping timeout: 276 seconds)
13:22:06  * thlorenzquit (Remote host closed the connection)
13:31:44  * ednapiranhajoined
13:34:16  * thlorenzjoined
13:42:38  * thlorenzquit (Ping timeout: 240 seconds)
13:44:12  * paulfryzeljoined
13:45:12  * lithiumjakejoined
13:48:59  * paulfryzelquit (Ping timeout: 265 seconds)
13:56:31  * ashihjoined
14:01:28  * thlorenzjoined
14:02:31  * ednapiranhaquit (Remote host closed the connection)
14:08:06  * jjmalinajoined
14:08:19  <hij1nx>goatscale
14:17:45  * brianloveswordsjoined
14:25:07  * daviddiasquit (Remote host closed the connection)
14:25:39  * daviddiasjoined
14:27:09  * daviddia_joined
14:27:47  * daviddia_quit (Remote host closed the connection)
14:28:22  * daviddia_joined
14:30:02  * daviddiasquit (Ping timeout: 240 seconds)
14:32:58  * daviddia_quit (Ping timeout: 265 seconds)
14:40:05  * jerrysvjoined
14:45:04  * paulfryzeljoined
14:46:38  * daviddiasjoined
14:47:22  * daviddiasquit (Remote host closed the connection)
14:47:56  * daviddiasjoined
14:49:56  * paulfryzelquit (Ping timeout: 265 seconds)
14:51:42  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
14:52:18  * daviddiasquit (Ping timeout: 265 seconds)
15:01:17  * daviddiasjoined
15:10:51  * ashihjoined
15:20:04  * paulfryzeljoined
15:23:42  * daviddiasquit (Remote host closed the connection)
15:24:15  * daviddiasjoined
15:28:26  * daviddiasquit (Ping timeout: 240 seconds)
15:40:17  * daviddiasjoined
15:43:10  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
15:53:59  * ralphtheninjajoined
15:59:13  * daviddiasquit (Remote host closed the connection)
15:59:52  * daviddiasjoined
16:01:02  * lithiumjakequit (Ping timeout: 255 seconds)
16:04:19  * daviddiasquit (Ping timeout: 265 seconds)
16:09:34  * thlorenzquit (Remote host closed the connection)
16:13:13  * ednapiranhajoined
16:25:12  * lithiumjakejoined
16:26:03  * ashihjoined
16:31:06  * ednapiranhaquit (Remote host closed the connection)
16:31:15  * jjmalinaquit (Read error: Connection reset by peer)
16:31:47  * jjmalinajoined
16:41:29  * ednapiranhajoined
16:53:14  * ednapiranhaquit (Quit: Leaving...)
16:55:03  * ednapiranhajoined
16:56:35  * thlorenzjoined
16:56:52  * dguttmanjoined
17:00:28  * thlorenz_joined
17:00:50  * thlorenzquit (Ping timeout: 240 seconds)
17:07:42  * paulfryzelquit (Read error: Connection reset by peer)
17:08:19  * paulfryzeljoined
17:13:07  * daviddiasjoined
17:13:39  * ednapiranhaquit (Remote host closed the connection)
17:23:04  * dominic_joined
17:39:45  * paulfryzelquit (Read error: Connection reset by peer)
17:40:18  * paulfryzeljoined
17:40:38  * lithiumjakequit (Ping timeout: 252 seconds)
17:43:19  * ednapira_joined
17:43:43  * ednapira_changed nick to ednapiranha_
17:44:40  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
17:52:52  * ashihjoined
17:55:04  * wolfeidauquit (Remote host closed the connection)
17:55:33  * wolfeidaujoined
18:02:33  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
18:11:20  * mhernandez1quit (Remote host closed the connection)
18:20:57  * mhernandez1joined
18:22:17  * mhernandez1quit (Remote host closed the connection)
18:22:30  * mhernandez1joined
18:26:38  * ashihjoined
18:37:55  * ednapiranha_changed nick to ednapiranha
18:51:05  * mikealjoined
18:51:51  <dominic_>GOATDB https://github.com/dominictarr/goatdb
18:56:14  * ashihquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
18:57:08  * daviddia_joined
18:57:08  * daviddiasquit (Read error: Connection reset by peer)
19:06:24  * dominic_quit (Ping timeout: 276 seconds)
19:12:30  * lithiumjakejoined
19:27:55  * ramitosquit (Remote host closed the connection)
19:28:13  * ramitosjoined
19:47:39  * sygijoined
20:08:12  * ednapiranhaquit (Remote host closed the connection)
20:16:52  * ashihjoined
20:17:50  * mhernandez1quit (Remote host closed the connection)
20:20:38  * ashihquit (Client Quit)
20:31:48  * daviddia_quit (Remote host closed the connection)
20:32:26  * daviddiasjoined
20:34:18  * daviddiasquit (Read error: Connection reset by peer)
20:34:19  * adamyeatsjoined
20:34:23  * daviddia_joined
20:39:57  * mcavagejoined
20:52:35  * daviddia_quit (Remote host closed the connection)
20:55:55  * ednapiranhajoined
21:13:21  * adamyeatsquit (Quit: Textual IRC Client: www.textualapp.com)
21:17:10  * No9quit (Quit: Gone to join the choir invisibule)
21:17:39  * ednapiranhaquit (Remote host closed the connection)
21:20:59  * lithiumjakequit (Ping timeout: 255 seconds)
21:31:28  * daviddiasjoined
21:35:10  * paulfryzelquit (Read error: Connection reset by peer)
21:35:36  * paulfryzeljoined
21:37:52  * daviddiasquit (Remote host closed the connection)
21:38:08  * daviddiasjoined
21:38:41  * daviddiasquit (Client Quit)
21:41:05  * daviddiasjoined
21:57:55  * lithiumjakejoined
21:59:46  * daviddiasquit (Remote host closed the connection)
22:02:07  * thlorenz_quit (Remote host closed the connection)
22:02:22  * sygiquit (Quit: Connection closed for inactivity)
22:02:43  * thlorenzjoined
22:06:27  * daviddiasjoined
22:07:20  * thlorenzquit (Ping timeout: 255 seconds)
22:12:30  * ednapiranhajoined
22:14:03  * brianloveswordsquit (Quit: Computer has gone to sleep.)
22:20:50  * lithiumjakequit (Ping timeout: 240 seconds)
22:27:50  * brianloveswordsjoined
22:39:50  * daviddiasquit
22:41:56  * lithiumjakejoined
22:46:44  * ralphtheninjaquit (Ping timeout: 276 seconds)
22:53:19  <levelbot>[npm] [email protected] <http://npm.im/dat>: real-time replication and versioning for large tabular data sets (@maxogden)
22:58:04  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
23:06:53  * lithiumjakequit (Ping timeout: 264 seconds)
23:09:36  * paulfryzelquit (Read error: Connection reset by peer)
23:09:50  * paulfryzeljoined
23:18:02  * ednapiranhaquit (Remote host closed the connection)
23:25:45  * paulfryz_joined
23:25:48  * lithiumjakejoined
23:25:56  * paulfryzelquit (Read error: Connection reset by peer)
23:26:07  * paulfryz_changed nick to paulfryzel
23:34:27  * saibotvisadjoined
23:36:11  * mcavagequit (Remote host closed the connection)
23:51:17  * jerrysvquit (Remote host closed the connection)