00:11:31  * pfrazequit (Remote host closed the connection)
00:11:54  * pfrazejoined
00:48:05  * warbrett_quit (Quit: Connection closed for inactivity)
01:17:24  * phatedquit (Remote host closed the connection)
02:09:36  * dguttmanquit (Quit: dguttman)
03:38:23  * phatedjoined
03:44:49  * phatedquit (Remote host closed the connection)
04:22:16  * dguttmanjoined
04:24:07  * dguttmanquit (Client Quit)
05:56:56  * pfrazequit (Remote host closed the connection)
06:18:31  * contrahaxquit (Quit: Sleeping)
06:29:30  * contrahaxjoined
07:00:29  * contrahaxquit (Quit: Sleeping)
07:34:37  * fotoveritequit (Quit: fotoverite)
07:40:47  * fotoveritejoined
07:51:13  * fotoveritequit (Quit: fotoverite)
09:08:12  * drptbljoined
09:13:26  * drptblquit (Ping timeout: 240 seconds)
09:17:12  * drptbljoined
10:03:15  * peutetrejoined
10:10:18  * peutetrequit (Quit: ...)
10:19:00  * peutetrejoined
10:20:08  * peutetrequit (Client Quit)
10:25:46  * peutetrejoined
10:34:51  * peutetrequit (Quit: ...)
10:43:30  * peutetrejoined
10:44:33  * peutetrequit (Client Quit)
11:00:46  * peutetrejoined
11:01:45  * peutetrequit (Client Quit)
11:44:06  * drptblquit (Ping timeout: 240 seconds)
11:47:46  * drptbljoined
12:35:39  * peutetrejoined
13:13:00  * pfrazejoined
13:17:50  <mafintosh>mikolalysenko: noob question. when resizing an on-disk hash table are there any clever techniques or do you just rewrite everything from the old table to the new one?
13:35:45  * pfrazequit (Remote host closed the connection)
13:36:09  * pfrazejoined
13:37:50  * pfrazequit (Remote host closed the connection)
13:43:26  * peutetrequit (Quit: ...)
13:52:37  * peutetrejoined
14:01:57  * Jan____changed nick to jan____
14:12:42  * peutetrequit (Quit: ...)
14:38:38  * pfrazejoined
14:42:55  * pfrazequit (Ping timeout: 240 seconds)
14:48:07  * contrahaxjoined
15:07:55  * JSON_voorheesquit (Changing host)
15:07:55  * JSON_voorheesjoined
15:18:33  * peutetrejoined
15:22:00  * brycebaril_joined
15:22:46  * brycebarilquit (Ping timeout: 272 seconds)
15:22:47  * brycebaril_changed nick to brycebaril
15:34:05  <mikolalysenko>mafintosh: off the top of my head I've never heard of one
15:34:15  <mikolalysenko>I guess you could replace the hash table with a trie
15:34:40  <mikolalysenko>there is probably something out there that solves this
15:34:49  <mafintosh>mikolalysenko: i was thinking about that as well
15:35:14  <mafintosh>mikolalysenko: yep - haven't written anything yet so if you come across anything let me know
15:35:20  * peutetrequit (Quit: ...)
15:38:49  <mikolalysenko>another thing you could consider is perfect hashing https://en.wikipedia.org/wiki/Dynamic_perfect_hashing
15:39:10  <mikolalysenko>it is still amortized, but it might be a bit better for on-disk stuff
15:40:18  <mikolalysenko>imo though a trie is simpler
15:40:38  <mikolalysenko>but one draw back to a trie is that it would take O(hash size) number of disk seeks
15:40:44  <mikolalysenko>which isn't great
15:41:02  <mikolalysenko>well maybe less if the top few levels of the trie are cached
15:41:11  <mikolalysenko>but still poor
15:50:09  * peutetrejoined
15:59:33  * peutetrequit (Quit: ...)
16:07:44  * mafintoshquit (Ping timeout: 272 seconds)
16:11:18  * mafintoshjoined
16:26:26  * therealkoopajoined
17:13:31  * pfrazejoined
17:14:33  * drptblquit (Quit: My MAC has gone to sleep. zZz..)
17:29:04  * ralphtheninjajoined
17:42:08  <emilbayes>mafintosh: When you told me that you'd support abstract-chunk-store in hyperdrive, so eg. S3 backend would be possible, you meant as a store for the metadata and chunks, right? Not the "materialized" files? Or did I misunderstand something?
17:42:49  <mafintosh>emilbayes: for files as well
17:43:17  <mafintosh>emilbayes: everything stored is technically blocks/chunks
17:44:55  <emilbayes>mafintosh: Arr ok, I think I need to read the spec carefully then. I understood as the files not really "existing" but simply being feeds referring to chunks somewhere else
17:46:03  <mafintosh>emilbayes: yes everything is chunks in feeds. if you think its unclear open sn issue so we can fix it :)
17:48:26  <emilbayes>mafintosh: It's probably just me jumping to conclusions without reading carefully enough. Really want to try doing something with it, so I was thinking about trying to get a S3 backend working with leveldown. Is that too naive currently?
17:54:01  <mafintosh>emilbayes: i thinks too low level since isnt really good for leveldb usecases. Maybe a blob store instead? Although i think that already exists
18:04:19  * therealkoopaquit
18:05:58  * therealkoopajoined
18:10:26  <ogd>emilbayes: s3 doesnt have sorted key iteration IIRC so a leveldown would be hard as one of the requirements is arbitrary forward/backward key range iterators on a lexicographically sorted idnex
18:11:15  <emilbayes>ogd: Arr damn. I just thought I saw a S3 backed leweldown at some point
18:11:45  <ogd>emilbayes: its probably possible but would be really slow hehe
18:11:52  <ogd>emilbayes: there is an s3-blob-store though
18:17:04  <emilbayes>ogd: I probably confused the s3-blob-store with the dynamodown... 😅
18:26:33  <emilbayes>ogd: I know I was thinking along the wrong lines, but the s3 list operations does return keys in lexicographical order. But it can only return 1000 keys per request, so I don't know if it's worth it. And it might get expensive quickly :p
18:26:50  <emilbayes>*list operation
18:27:02  <ogd>emilbayes: oh i didnt know that, nice
18:29:48  * ralphtheninjaquit (Ping timeout: 256 seconds)
18:31:22  * sethvincentjoined
18:31:38  * ralphtheninjajoined
18:48:30  * phatedjoined
19:04:26  * sethvincentquit (Ping timeout: 272 seconds)
19:04:44  * therealkoopaquit (Remote host closed the connection)
19:06:35  * dguttmanjoined
19:08:48  * sethvincentjoined
19:16:28  * therealkoopajoined
19:26:00  * contrahaxquit (Quit: Sleeping)
19:28:20  * dguttmanquit (Quit: dguttman)
19:46:07  * contrahaxjoined
19:49:45  <emilbayes>mafintosh: Have you had issues when the seeding peer is running in the browser and the other peer is running in node? I get a "ECONNREFUSED" but not sure why
19:58:52  * freeman-labquit
20:00:57  * freeman-labjoined
20:21:41  * phatedquit (Remote host closed the connection)
20:32:12  * sethvincentquit (Ping timeout: 256 seconds)
20:37:15  * phatedjoined
21:18:59  * fotoveritejoined
21:52:55  * dguttmanjoined