00:04:12  * jjmalinajoined
00:07:59  * ednapiranhaquit (Quit: Leaving...)
00:10:47  * fritzyquit (Remote host closed the connection)
00:12:27  * thlorenzjoined
00:12:59  * fritzyjoined
00:13:12  * fritzyquit (Remote host closed the connection)
00:17:03  * jjmalinaquit (Ping timeout: 245 seconds)
00:31:23  * thlorenzquit (Remote host closed the connection)
00:31:57  * thlorenzjoined
00:36:18  * thlorenzquit (Ping timeout: 240 seconds)
00:42:52  * brianloveswordsquit (Quit: Computer has gone to sleep.)
00:55:18  * brianloveswordsjoined
00:55:38  * mhernandez1joined
01:00:18  * ednapiranhajoined
01:00:28  * ednapiranhaquit (Remote host closed the connection)
01:09:57  * fritzyjoined
01:12:57  * mhernandez1quit (Remote host closed the connection)
01:41:12  * thlorenzjoined
02:04:01  * fritzyquit
02:36:18  * jcrugzzquit (Read error: Connection reset by peer)
02:38:38  * jcrugzzjoined
02:52:28  * daleharveyquit (Ping timeout: 245 seconds)
02:54:46  * daleharveyjoined
02:55:06  * binocarlosquit (Read error: Connection reset by peer)
03:02:04  * fritzyjoined
03:09:41  * thlorenzquit (Remote host closed the connection)
03:13:51  * thlorenzjoined
03:14:23  * Sorellaquit (Quit: It is tiem!)
03:14:38  * thlorenzquit (Remote host closed the connection)
03:33:57  * jerrysvjoined
03:37:22  * jerrysvquit (Client Quit)
03:45:57  * saibotvisadjoined
03:57:59  * dguttmanquit (Quit: dguttman)
04:23:57  * ryan_ramagejoined
04:37:00  * brianloveswordsquit (Quit: Computer has gone to sleep.)
04:59:21  * ryan_ramagequit (Quit: ryan_ramage)
05:21:27  * saibotvisadquit (Quit: Leaving.)
05:32:48  * DTrejojoined
06:06:56  * DTrejoquit
06:08:14  * calvinmetcalfquit (Quit: Connection closed for inactivity)
06:41:34  * domanicjoined
07:02:13  * sveisveijoined
07:04:51  * sygijoined
07:28:06  * fritzyquit (Remote host closed the connection)
08:29:49  * kenan|afkchanged nick to kenansulayman
09:09:07  * contrahaxjoined
09:15:48  * domanicquit (Remote host closed the connection)
09:28:15  * contrahaxquit (Ping timeout: 265 seconds)
10:19:37  * daviddiasjoined
10:22:31  * daviddiasquit (Client Quit)
10:22:44  * daviddiasjoined
11:20:06  * daviddiasquit (Remote host closed the connection)
11:27:30  * domanicjoined
11:33:19  <domanic>idea for database profiler:
11:34:03  <domanic>scan a database, count the number of keys occuring in that database, track the total records, and the occurances of each key.
11:34:29  <domanic>so you can detect implicit schemas - say in npm "name" and "version" are ALWAYS present.
11:34:54  <domanic>just track the probability that a given field exists in a given table (sublevel)
11:35:12  <domanic>... to do this, build up an in memory object.
11:36:02  <domanic>hmm, it would probably be okay to just keep a count of keys... assuming keys are from a natural language, there isn't gonna be more than tens of thousands of them.
11:36:26  <domanic>if there are more, you could remove old ones from the object, and move them into a bloom filter
11:37:20  <domanic>then you could query: do any rows in this table have this key? and know immediately (syncly)
11:37:58  <domanic>hmm, with bloom filters, you could do this do this for values too
11:38:41  <domanic>so you could look at a document, look at it's values, then immediately check what other rows it "links" to
11:38:54  <domanic>or at least, where to look for them...
11:44:09  * binocarlosjoined
11:52:27  * sygiquit (Quit: Connection closed for inactivity)
11:54:03  * calvinmetcalfjoined
11:55:16  <rvagg>domanic: are you going to jsconf this year perchance?
11:56:52  <domanic>rvagg, in the US? no. LXjs, nodeconf, nodeconf.eu
11:56:59  <domanic>that is what is lined up
11:57:01  <rvagg>k
11:57:13  <domanic>Oh, and the guy who does jsconf asia wants me to come.
11:57:26  <domanic>but that isn't formal yet
11:58:02  <rvagg>ah, cool, trying to get timoxley into that too since it's basically next door
11:58:20  <rvagg>(he organises too many events and doesn't get to speak at enough)
12:30:44  * lithiumjakejoined
12:48:50  * mhernandez1joined
12:53:26  * Sorellajoined
13:05:39  * mhernandez1quit (Remote host closed the connection)
13:07:34  * ramitosjoined
13:11:29  * mhernandez1joined
13:26:10  <domanic>ogd, hey, what is your content addressable store called?
13:29:21  * contrahaxjoined
13:33:19  * contraha_joined
13:36:41  * contrahaxquit (Ping timeout: 240 seconds)
13:40:21  * thlorenzjoined
13:44:21  * lithiumjakequit (Ping timeout: 276 seconds)
13:47:30  * dguttmanjoined
13:51:53  <ogd>domanic: cabs. Not mine, I just helped. I ended up using yours in dat
13:57:23  * plumajoined
13:57:23  * plumaquit (Changing host)
13:57:23  * plumajoined
13:59:40  * ryan_ramagejoined
13:59:41  * ryan_ramagequit (Client Quit)
14:00:48  <domanic>ah haha, okay cool
14:07:30  * daviddiasjoined
14:07:31  * daviddiasquit (Remote host closed the connection)
14:07:46  * daviddiasjoined
14:07:52  * sygijoined
14:12:22  * jerrysvjoined
14:14:14  * brianloveswordsjoined
14:18:09  * dguttmanquit (Quit: dguttman)
14:21:44  * lithiumjakejoined
14:21:57  * blessYahujoined
14:23:01  * dguttmanjoined
14:28:05  * jjmalinajoined
14:29:08  <rescrv>hij1nx: you around?
14:30:19  <rescrv>hij1nx: Everyone else is going to recommend that you use merkel trees. That's a bad way to go. Look at Andrew Tridgell's thesis (http://www.samba.org/~tridge/phd_thesis.pdf) that defined the algorithm used in rsync
14:30:38  <rescrv>instead of bytes in a file, you have key-value pairs in a DB. Everywhere they hash a byte, you hash the KV pair
14:35:30  <ogd>rescrv: missed context on that, are you referring to some question about generalized sync?
14:35:51  <rescrv>ogd: yeah. we're skipping around because twitter has a 140 char limit
14:37:21  * mikealjoined
14:38:07  <rescrv>ogd: I'll let hij1nx fill you in on the context if that's OK
14:45:02  <substack>rescrv: cool I'm working on that problem for http://npmjs.org/package/sinker
14:45:23  <substack>I haven't implemented the rolling hash algorithms yet but those are coming next
14:48:26  * brianloveswordsquit (Quit: Computer has gone to sleep.)
14:49:20  * brianloveswordsjoined
14:51:17  * mikealquit (Quit: Leaving.)
15:00:27  * ednapiranhajoined
15:07:21  * daviddiasquit (Remote host closed the connection)
15:12:38  * plumaquit (Ping timeout: 258 seconds)
15:14:38  * daviddiasjoined
15:30:14  * domanicquit (Ping timeout: 255 seconds)
15:33:49  * lithiumjakequit (Ping timeout: 252 seconds)
15:43:58  * domanicjoined
15:47:11  * mikealjoined
15:49:43  * blessYahuquit (Read error: Connection reset by peer)
15:51:00  * blessYahujoined
16:00:37  * lithiumjakejoined
16:10:35  * dguttmanquit (Quit: dguttman)
16:11:37  * dguttmanjoined
16:15:55  * ryan_ramagejoined
16:35:43  * mhernandez1quit (Remote host closed the connection)
16:42:12  * 17SAAEGVSjoined
16:49:05  * brianloveswordsquit (Quit: Computer has gone to sleep.)
16:55:24  * brianloveswordsjoined
17:02:51  * mikealquit (Quit: Leaving.)
17:06:52  <domanic>ogd, https://github.com/dominictarr/level-datablobs/blob/master/test/index.js#L45-L47
17:07:03  * mikealjoined
17:09:09  * mikealquit (Client Quit)
17:10:18  * kenansulaymanchanged nick to kenan|afk
17:28:25  * brianloveswordsquit (Quit: Computer has gone to sleep.)
17:29:23  * sveisveiquit (Quit: Connection closed for inactivity)
17:47:35  * thlorenzquit (Remote host closed the connection)
17:47:54  * fritzyjoined
17:48:07  * thlorenzjoined
17:52:41  * thlorenzquit (Ping timeout: 252 seconds)
18:00:00  * mikealjoined
18:15:56  * thlorenzjoined
18:39:58  * 17SAAEGVSquit (Remote host closed the connection)
18:41:06  * mhernandez1joined
18:44:04  * brianloveswordsjoined
19:19:33  * brianloveswordsquit (Ping timeout: 245 seconds)
19:19:59  * contrahaxjoined
19:20:05  * contraha_quit (Read error: Connection reset by peer)
19:30:42  * brianloveswordsjoined
19:31:47  * brianloveswordsquit (Client Quit)
19:39:02  * contrahaxquit (Read error: Connection reset by peer)
19:39:04  * contraha_joined
19:41:37  * daviddiasquit (Remote host closed the connection)
19:42:10  * daviddiasjoined
19:46:13  * daviddiasquit (Ping timeout: 245 seconds)
19:47:40  * ramitosquit (Remote host closed the connection)
19:48:10  * ramitosjoined
19:55:16  * ednapiranhaquit (Quit: Leaving...)
20:00:44  * brianloveswordsjoined
20:12:17  * tmcwjoined
20:12:41  * daviddiasjoined
20:18:43  * daviddiasquit (Ping timeout: 245 seconds)
20:35:12  * brianloveswordsquit (Quit: Computer has gone to sleep.)
20:36:57  * mhernandez1quit (Remote host closed the connection)
20:40:57  * sxjoined
20:54:47  * mhernandez1joined
21:01:02  * ednapiranhajoined
21:09:21  * mhernandez1quit (Remote host closed the connection)
21:09:45  * mhernandez1joined
21:10:24  * mhernandez1quit (Remote host closed the connection)
21:11:53  * Raynosquit (Ping timeout: 252 seconds)
21:11:55  * ogdquit (Ping timeout: 240 seconds)
21:11:56  * contraha_quit (Quit: Sleeping)
21:12:03  * sygiquit (Ping timeout: 245 seconds)
21:12:35  * ednapiranhaquit (Quit: Leaving...)
21:12:37  * hughskquit (Ping timeout: 252 seconds)
21:12:53  * parshap_quit (Ping timeout: 245 seconds)
21:12:57  * JasonSmithquit (Ping timeout: 265 seconds)
21:12:59  * daleharveyquit (Ping timeout: 252 seconds)
21:13:07  * jcrugzzquit (Ping timeout: 240 seconds)
21:13:07  * ehdquit (Ping timeout: 240 seconds)
21:13:26  * mafintoshquit (Ping timeout: 265 seconds)
21:13:31  * calvinmetcalfquit (Ping timeout: 240 seconds)
21:13:43  * l1xquit (Ping timeout: 252 seconds)
21:13:55  * nolanlawsonquit (Ping timeout: 265 seconds)
21:15:26  * tmcwquit (Remote host closed the connection)
21:16:01  * tmcwjoined
21:16:04  * sygijoined
21:17:53  * ryanjquit (Ping timeout: 245 seconds)
21:20:15  * tmcwquit (Ping timeout: 258 seconds)
21:21:56  * tmcwjoined
21:22:00  * fritzyquit
21:22:15  * fritzyjoined
21:22:41  * ogdjoined
21:23:08  * hughskjoined
21:24:06  * daleharveyjoined
21:26:39  * brianloveswordsjoined
21:27:47  * JasonSmithjoined
21:28:19  * Domenic_joined
21:28:47  * ehdjoined
21:29:02  * jcrugzzjoined
21:29:07  * l1xjoined
21:29:43  * parshap_joined
21:30:18  * mafintoshjoined
21:30:44  * calvinmetcalfjoined
21:32:08  * nolanlawsonjoined
21:35:18  * Domenic_changed nick to Raynos
21:42:54  * brianloveswordsquit (Quit: Computer has gone to sleep.)
21:47:54  * ednapiranhajoined
22:00:19  * mikealquit (Quit: Leaving.)
22:01:05  * daviddiasjoined
22:02:59  * brianloveswordsjoined
22:05:47  * daviddiasquit (Ping timeout: 255 seconds)
22:10:31  * thlorenzquit (Remote host closed the connection)
22:22:30  * brianloveswordsquit (Quit: Computer has gone to sleep.)
22:38:15  * calvinmetcalfquit (Quit: Connection closed for inactivity)
22:50:00  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)
22:55:36  * tmcwquit (Remote host closed the connection)
22:56:11  * tmcwjoined
22:59:02  * ryan_ramagequit (Quit: ryan_ramage)
23:00:28  * daviddiasjoined
23:00:44  * tmcwquit (Ping timeout: 265 seconds)
23:06:38  * daviddiasquit (Ping timeout: 245 seconds)
23:06:59  * ryanjjoined
23:10:52  * ednapiranhaquit (Quit: Leaving...)
23:14:02  * meschjoined
23:19:35  * jerrysvquit (Remote host closed the connection)
23:41:57  * fritzyquit
23:45:29  * domanicquit (Ping timeout: 240 seconds)
23:59:50  * thlorenzjoined