| 00:04:12
| * jjmalina | joined |
| 00:07:59
| * ednapiranha | quit (Quit: Leaving...) |
| 00:10:47
| * fritzy | quit (Remote host closed the connection) |
| 00:12:27
| * thlorenz | joined |
| 00:12:59
| * fritzy | joined |
| 00:13:12
| * fritzy | quit (Remote host closed the connection) |
| 00:17:03
| * jjmalina | quit (Ping timeout: 245 seconds) |
| 00:31:23
| * thlorenz | quit (Remote host closed the connection) |
| 00:31:57
| * thlorenz | joined |
| 00:36:18
| * thlorenz | quit (Ping timeout: 240 seconds) |
| 00:42:52
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 00:55:18
| * brianloveswords | joined |
| 00:55:38
| * mhernandez1 | joined |
| 01:00:18
| * ednapiranha | joined |
| 01:00:28
| * ednapiranha | quit (Remote host closed the connection) |
| 01:09:57
| * fritzy | joined |
| 01:12:57
| * mhernandez1 | quit (Remote host closed the connection) |
| 01:41:12
| * thlorenz | joined |
| 02:04:01
| * fritzy | quit |
| 02:36:18
| * jcrugzz | quit (Read error: Connection reset by peer) |
| 02:38:38
| * jcrugzz | joined |
| 02:52:28
| * daleharvey | quit (Ping timeout: 245 seconds) |
| 02:54:46
| * daleharvey | joined |
| 02:55:06
| * binocarlos | quit (Read error: Connection reset by peer) |
| 03:02:04
| * fritzy | joined |
| 03:09:41
| * thlorenz | quit (Remote host closed the connection) |
| 03:13:51
| * thlorenz | joined |
| 03:14:23
| * Sorella | quit (Quit: It is tiem!) |
| 03:14:38
| * thlorenz | quit (Remote host closed the connection) |
| 03:33:57
| * jerrysv | joined |
| 03:37:22
| * jerrysv | quit (Client Quit) |
| 03:45:57
| * saibotvisad | joined |
| 03:57:59
| * dguttman | quit (Quit: dguttman) |
| 04:23:57
| * ryan_ramage | joined |
| 04:37:00
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 04:59:21
| * ryan_ramage | quit (Quit: ryan_ramage) |
| 05:21:27
| * saibotvisad | quit (Quit: Leaving.) |
| 05:32:48
| * DTrejo | joined |
| 06:06:56
| * DTrejo | quit |
| 06:08:14
| * calvinmetcalf | quit (Quit: Connection closed for inactivity) |
| 06:41:34
| * domanic | joined |
| 07:02:13
| * sveisvei | joined |
| 07:04:51
| * sygi | joined |
| 07:28:06
| * fritzy | quit (Remote host closed the connection) |
| 08:29:49
| * kenan|afk | changed nick to kenansulayman |
| 09:09:07
| * contrahax | joined |
| 09:15:48
| * domanic | quit (Remote host closed the connection) |
| 09:28:15
| * contrahax | quit (Ping timeout: 265 seconds) |
| 10:19:37
| * daviddias | joined |
| 10:22:31
| * daviddias | quit (Client Quit) |
| 10:22:44
| * daviddias | joined |
| 11:20:06
| * daviddias | quit (Remote host closed the connection) |
| 11:27:30
| * domanic | joined |
| 11:33:19
| <domanic> | idea for database profiler: |
| 11:34:03
| <domanic> | scan a database, count the number of keys occuring in that database, track the total records, and the occurances of each key. |
| 11:34:29
| <domanic> | so you can detect implicit schemas - say in npm "name" and "version" are ALWAYS present. |
| 11:34:54
| <domanic> | just track the probability that a given field exists in a given table (sublevel) |
| 11:35:12
| <domanic> | ... to do this, build up an in memory object. |
| 11:36:02
| <domanic> | hmm, it would probably be okay to just keep a count of keys... assuming keys are from a natural language, there isn't gonna be more than tens of thousands of them. |
| 11:36:26
| <domanic> | if there are more, you could remove old ones from the object, and move them into a bloom filter |
| 11:37:20
| <domanic> | then you could query: do any rows in this table have this key? and know immediately (syncly) |
| 11:37:58
| <domanic> | hmm, with bloom filters, you could do this do this for values too |
| 11:38:41
| <domanic> | so you could look at a document, look at it's values, then immediately check what other rows it "links" to |
| 11:38:54
| <domanic> | or at least, where to look for them... |
| 11:44:09
| * binocarlos | joined |
| 11:52:27
| * sygi | quit (Quit: Connection closed for inactivity) |
| 11:54:03
| * calvinmetcalf | joined |
| 11:55:16
| <rvagg> | domanic: are you going to jsconf this year perchance? |
| 11:56:52
| <domanic> | rvagg, in the US? no. LXjs, nodeconf, nodeconf.eu |
| 11:56:59
| <domanic> | that is what is lined up |
| 11:57:01
| <rvagg> | k |
| 11:57:13
| <domanic> | Oh, and the guy who does jsconf asia wants me to come. |
| 11:57:26
| <domanic> | but that isn't formal yet |
| 11:58:02
| <rvagg> | ah, cool, trying to get timoxley into that too since it's basically next door |
| 11:58:20
| <rvagg> | (he organises too many events and doesn't get to speak at enough) |
| 12:30:44
| * lithiumjake | joined |
| 12:48:50
| * mhernandez1 | joined |
| 12:53:26
| * Sorella | joined |
| 13:05:39
| * mhernandez1 | quit (Remote host closed the connection) |
| 13:07:34
| * ramitos | joined |
| 13:11:29
| * mhernandez1 | joined |
| 13:26:10
| <domanic> | ogd, hey, what is your content addressable store called? |
| 13:29:21
| * contrahax | joined |
| 13:33:19
| * contraha_ | joined |
| 13:36:41
| * contrahax | quit (Ping timeout: 240 seconds) |
| 13:40:21
| * thlorenz | joined |
| 13:44:21
| * lithiumjake | quit (Ping timeout: 276 seconds) |
| 13:47:30
| * dguttman | joined |
| 13:51:53
| <ogd> | domanic: cabs. Not mine, I just helped. I ended up using yours in dat |
| 13:57:23
| * pluma | joined |
| 13:57:23
| * pluma | quit (Changing host) |
| 13:57:23
| * pluma | joined |
| 13:59:40
| * ryan_ramage | joined |
| 13:59:41
| * ryan_ramage | quit (Client Quit) |
| 14:00:48
| <domanic> | ah haha, okay cool |
| 14:07:30
| * daviddias | joined |
| 14:07:31
| * daviddias | quit (Remote host closed the connection) |
| 14:07:46
| * daviddias | joined |
| 14:07:52
| * sygi | joined |
| 14:12:22
| * jerrysv | joined |
| 14:14:14
| * brianloveswords | joined |
| 14:18:09
| * dguttman | quit (Quit: dguttman) |
| 14:21:44
| * lithiumjake | joined |
| 14:21:57
| * blessYahu | joined |
| 14:23:01
| * dguttman | joined |
| 14:28:05
| * jjmalina | joined |
| 14:29:08
| <rescrv> | hij1nx: you around? |
| 14:30:19
| <rescrv> | hij1nx: Everyone else is going to recommend that you use merkel trees. That's a bad way to go. Look at Andrew Tridgell's thesis (http://www.samba.org/~tridge/phd_thesis.pdf) that defined the algorithm used in rsync |
| 14:30:38
| <rescrv> | instead of bytes in a file, you have key-value pairs in a DB. Everywhere they hash a byte, you hash the KV pair |
| 14:35:30
| <ogd> | rescrv: missed context on that, are you referring to some question about generalized sync? |
| 14:35:51
| <rescrv> | ogd: yeah. we're skipping around because twitter has a 140 char limit |
| 14:37:21
| * mikeal | joined |
| 14:38:07
| <rescrv> | ogd: I'll let hij1nx fill you in on the context if that's OK |
| 14:45:02
| <substack> | rescrv: cool I'm working on that problem for http://npmjs.org/package/sinker |
| 14:45:23
| <substack> | I haven't implemented the rolling hash algorithms yet but those are coming next |
| 14:48:26
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 14:49:20
| * brianloveswords | joined |
| 14:51:17
| * mikeal | quit (Quit: Leaving.) |
| 15:00:27
| * ednapiranha | joined |
| 15:07:21
| * daviddias | quit (Remote host closed the connection) |
| 15:12:38
| * pluma | quit (Ping timeout: 258 seconds) |
| 15:14:38
| * daviddias | joined |
| 15:30:14
| * domanic | quit (Ping timeout: 255 seconds) |
| 15:33:49
| * lithiumjake | quit (Ping timeout: 252 seconds) |
| 15:43:58
| * domanic | joined |
| 15:47:11
| * mikeal | joined |
| 15:49:43
| * blessYahu | quit (Read error: Connection reset by peer) |
| 15:51:00
| * blessYahu | joined |
| 16:00:37
| * lithiumjake | joined |
| 16:10:35
| * dguttman | quit (Quit: dguttman) |
| 16:11:37
| * dguttman | joined |
| 16:15:55
| * ryan_ramage | joined |
| 16:35:43
| * mhernandez1 | quit (Remote host closed the connection) |
| 16:42:12
| * 17SAAEGVS | joined |
| 16:49:05
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 16:55:24
| * brianloveswords | joined |
| 17:02:51
| * mikeal | quit (Quit: Leaving.) |
| 17:06:52
| <domanic> | ogd, https://github.com/dominictarr/level-datablobs/blob/master/test/index.js#L45-L47 |
| 17:07:03
| * mikeal | joined |
| 17:09:09
| * mikeal | quit (Client Quit) |
| 17:10:18
| * kenansulayman | changed nick to kenan|afk |
| 17:28:25
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 17:29:23
| * sveisvei | quit (Quit: Connection closed for inactivity) |
| 17:47:35
| * thlorenz | quit (Remote host closed the connection) |
| 17:47:54
| * fritzy | joined |
| 17:48:07
| * thlorenz | joined |
| 17:52:41
| * thlorenz | quit (Ping timeout: 252 seconds) |
| 18:00:00
| * mikeal | joined |
| 18:15:56
| * thlorenz | joined |
| 18:39:58
| * 17SAAEGVS | quit (Remote host closed the connection) |
| 18:41:06
| * mhernandez1 | joined |
| 18:44:04
| * brianloveswords | joined |
| 19:19:33
| * brianloveswords | quit (Ping timeout: 245 seconds) |
| 19:19:59
| * contrahax | joined |
| 19:20:05
| * contraha_ | quit (Read error: Connection reset by peer) |
| 19:30:42
| * brianloveswords | joined |
| 19:31:47
| * brianloveswords | quit (Client Quit) |
| 19:39:02
| * contrahax | quit (Read error: Connection reset by peer) |
| 19:39:04
| * contraha_ | joined |
| 19:41:37
| * daviddias | quit (Remote host closed the connection) |
| 19:42:10
| * daviddias | joined |
| 19:46:13
| * daviddias | quit (Ping timeout: 245 seconds) |
| 19:47:40
| * ramitos | quit (Remote host closed the connection) |
| 19:48:10
| * ramitos | joined |
| 19:55:16
| * ednapiranha | quit (Quit: Leaving...) |
| 20:00:44
| * brianloveswords | joined |
| 20:12:17
| * tmcw | joined |
| 20:12:41
| * daviddias | joined |
| 20:18:43
| * daviddias | quit (Ping timeout: 245 seconds) |
| 20:35:12
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 20:36:57
| * mhernandez1 | quit (Remote host closed the connection) |
| 20:40:57
| * sx | joined |
| 20:54:47
| * mhernandez1 | joined |
| 21:01:02
| * ednapiranha | joined |
| 21:09:21
| * mhernandez1 | quit (Remote host closed the connection) |
| 21:09:45
| * mhernandez1 | joined |
| 21:10:24
| * mhernandez1 | quit (Remote host closed the connection) |
| 21:11:53
| * Raynos | quit (Ping timeout: 252 seconds) |
| 21:11:55
| * ogd | quit (Ping timeout: 240 seconds) |
| 21:11:56
| * contraha_ | quit (Quit: Sleeping) |
| 21:12:03
| * sygi | quit (Ping timeout: 245 seconds) |
| 21:12:35
| * ednapiranha | quit (Quit: Leaving...) |
| 21:12:37
| * hughsk | quit (Ping timeout: 252 seconds) |
| 21:12:53
| * parshap_ | quit (Ping timeout: 245 seconds) |
| 21:12:57
| * JasonSmith | quit (Ping timeout: 265 seconds) |
| 21:12:59
| * daleharvey | quit (Ping timeout: 252 seconds) |
| 21:13:07
| * jcrugzz | quit (Ping timeout: 240 seconds) |
| 21:13:07
| * ehd | quit (Ping timeout: 240 seconds) |
| 21:13:26
| * mafintosh | quit (Ping timeout: 265 seconds) |
| 21:13:31
| * calvinmetcalf | quit (Ping timeout: 240 seconds) |
| 21:13:43
| * l1x | quit (Ping timeout: 252 seconds) |
| 21:13:55
| * nolanlawson | quit (Ping timeout: 265 seconds) |
| 21:15:26
| * tmcw | quit (Remote host closed the connection) |
| 21:16:01
| * tmcw | joined |
| 21:16:04
| * sygi | joined |
| 21:17:53
| * ryanj | quit (Ping timeout: 245 seconds) |
| 21:20:15
| * tmcw | quit (Ping timeout: 258 seconds) |
| 21:21:56
| * tmcw | joined |
| 21:22:00
| * fritzy | quit |
| 21:22:15
| * fritzy | joined |
| 21:22:41
| * ogd | joined |
| 21:23:08
| * hughsk | joined |
| 21:24:06
| * daleharvey | joined |
| 21:26:39
| * brianloveswords | joined |
| 21:27:47
| * JasonSmith | joined |
| 21:28:19
| * Domenic_ | joined |
| 21:28:47
| * ehd | joined |
| 21:29:02
| * jcrugzz | joined |
| 21:29:07
| * l1x | joined |
| 21:29:43
| * parshap_ | joined |
| 21:30:18
| * mafintosh | joined |
| 21:30:44
| * calvinmetcalf | joined |
| 21:32:08
| * nolanlawson | joined |
| 21:35:18
| * Domenic_ | changed nick to Raynos |
| 21:42:54
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 21:47:54
| * ednapiranha | joined |
| 22:00:19
| * mikeal | quit (Quit: Leaving.) |
| 22:01:05
| * daviddias | joined |
| 22:02:59
| * brianloveswords | joined |
| 22:05:47
| * daviddias | quit (Ping timeout: 255 seconds) |
| 22:10:31
| * thlorenz | quit (Remote host closed the connection) |
| 22:22:30
| * brianloveswords | quit (Quit: Computer has gone to sleep.) |
| 22:38:15
| * calvinmetcalf | quit (Quit: Connection closed for inactivity) |
| 22:50:00
| * jjmalina | quit (Quit: Textual IRC Client: www.textualapp.com) |
| 22:55:36
| * tmcw | quit (Remote host closed the connection) |
| 22:56:11
| * tmcw | joined |
| 22:59:02
| * ryan_ramage | quit (Quit: ryan_ramage) |
| 23:00:28
| * daviddias | joined |
| 23:00:44
| * tmcw | quit (Ping timeout: 265 seconds) |
| 23:06:38
| * daviddias | quit (Ping timeout: 245 seconds) |
| 23:06:59
| * ryanj | joined |
| 23:10:52
| * ednapiranha | quit (Quit: Leaving...) |
| 23:14:02
| * mesch | joined |
| 23:19:35
| * jerrysv | quit (Remote host closed the connection) |
| 23:41:57
| * fritzy | quit |
| 23:45:29
| * domanic | quit (Ping timeout: 240 seconds) |
| 23:59:50
| * thlorenz | joined |