00:21:37  * mhernandez1quit (Remote host closed the connection)
00:22:33  * dguttmanquit (Quit: dguttman)
00:22:57  * mhernandez1joined
00:48:36  * mhernandez1quit (Remote host closed the connection)
01:22:26  * mhernandez1joined
01:36:28  * mhernandez1quit (Remote host closed the connection)
01:42:16  * mhernandez1joined
01:49:36  * neonstalwartjoined
01:50:41  * dguttmanjoined
02:26:19  * mhernandez1quit (Remote host closed the connection)
02:32:13  * mhernandez1joined
02:32:25  * lordofcherrypiesjoined
02:35:35  * mhernandez1quit (Remote host closed the connection)
02:35:50  <lordofcherrypies>argh maties! I am exploring the use of levelDB as a low-ram disk-basked K/V store to sit buddy-buddy next to redis which will provide it ad-hoc indexing. At this point I am considering levelUP for doing this in NodeJS. In my readings it was noted that levelDB does not work across processes. Is this a "per open db file" limitation, or a limitation of the binding that would impact if I were to use multiple files?
02:37:52  <chilts_>lordofcherrypies: yes, you can only open each DB in one process. You can open multiple DBs in one process, but better to partition just one with multiple tables (ie. table-prefixed records)
02:37:54  <lordofcherrypies>also, is there any way to set the usable memory cache in its levelDB bindings (or any alternative that exposes this capabilty). Its availability seems implied from benchmarks
02:38:14  <chilts_>also see https://www.npmjs.com/package/multilevel for exposing LevelDB on the network, so you can have multiple processes talk to it
02:38:50  <chilts_>lordofcherrypies: 'cacheSize' option in leveldown
02:38:57  * chilts_changed nick to chilts
02:39:06  <lordofcherrypies>chilts: fantastic!
02:41:02  <lordofcherrypies>is there a specific reason that you recommend using key prefixing instead of multiple files? my use case here is specific, and would be provisioning for future sharding capability.
02:41:24  <lordofcherrypies>my consideration was having several logical shards I could later easily seperate.
02:41:58  <chilts>only because then you're sharing the cache across all of your records, and then leveldb can figure out your best usage, instead of you setting it at a non-optimal level for separate DBs
02:42:00  <lordofcherrypies>and my fear being that a one-file system would both increase key space overhead, as well as require a bunch of explicit tooling
02:42:09  <lordofcherrypies>ah, gotya
02:42:17  <chilts>but yes, if you are sharding in the future, or doing some other kind of splitting, you probably know more than leveldb does :)
02:42:35  <chilts>so, you know your use-case more than the automatic feature of leveldb :D
02:43:40  <chilts>as for explicit tooling for prefixed records, see https://github.com/dominictarr/level-sublevel
02:43:56  <chilts>is that what you meant re: explicit tooling?
02:44:16  * mhernandez1joined
02:44:23  <lordofcherrypies>awesome. yea I looked (roughly) at sublevel, but the "unstable" bit turned me off for that
02:44:34  <lordofcherrypies>explicit tooling meaning having to manually go up and split the files apart later
02:44:49  <lordofcherrypies>probably using key walking, testing sizes, etc etc
02:45:10  <lordofcherrypies>not that it would be strikingly hard, just more crapola to support in an otherwise simple system
02:46:04  <lordofcherrypies>all I am really doing here is pairing this next to redis on various nodes in the cloud, giving me a really low level DB with super-strong control over indexes.
02:46:04  <chilts>yeah, annoying but at least fairly easy - choose one :D
02:48:32  <lordofcherrypies>awesome :) thanks for all of your quick help
02:48:45  <lordofcherrypies>this looks like it will fit my use case perfectly
02:48:56  <chilts>good luck
02:49:23  <lordofcherrypies>ty mate
02:54:36  * mhernandez1quit (Remote host closed the connection)
03:00:56  * neonstalwartquit (Quit: Leaving.)
04:04:16  * Bijan-Ejoined
05:00:50  * dguttmanquit (Quit: dguttman)
05:11:34  * dguttmanjoined
05:53:41  * ncthom91joined
05:54:33  * dguttmanquit (Quit: dguttman)
06:09:33  * ncthom91quit (Quit: My MacBook has gone to sleep. ZZZzzz…)
06:09:51  * ncthom91joined
06:13:03  * ncthom91quit (Client Quit)
07:49:52  * ChrisPartridgequit (Ping timeout: 245 seconds)
08:05:33  * jerrysvjoined
08:10:27  * jerrysvquit (Ping timeout: 265 seconds)
08:18:19  * bonswouarjoined
08:22:14  * yoyohamjoined
08:22:49  * yoyohamquit (Client Quit)
08:38:56  * joakinojoined
08:46:04  * smccullyquit (Read error: Connection reset by peer)
08:46:47  * smccullyjoined
09:39:14  * binocarlosjoined
10:40:01  * stagasjoined
10:56:13  * binocarlosquit (Ping timeout: 255 seconds)
11:28:56  * phpnodejoined
11:34:25  * stagasquit (Ping timeout: 265 seconds)
11:42:23  * binocarlosjoined
12:55:57  * mhernandez1joined
13:16:38  * Bijan-Equit (Quit: Don't Follow Me)
13:42:56  * neonstalwartjoined
14:25:36  * stagasjoined
14:38:37  * stagasquit (Ping timeout: 245 seconds)
14:38:44  * stagas_joined
14:38:55  * stagas_changed nick to stagas
14:42:50  * stagas_joined
14:43:12  * stagas_quit (Client Quit)
14:44:17  * stagasquit (Ping timeout: 244 seconds)
14:59:45  * dguttmanjoined
15:46:15  * jjmalinajoined
16:12:49  * davidbjorklundquit (Ping timeout: 265 seconds)
16:13:18  * jcrugzzquit (Ping timeout: 265 seconds)
16:13:18  * ehdquit (Ping timeout: 265 seconds)
16:14:45  * Raynosquit (Ping timeout: 265 seconds)
16:14:45  * ggreerquit (Ping timeout: 265 seconds)
16:15:03  * ggreerjoined
16:15:45  * ggreerquit (Changing host)
16:15:46  * ggreerjoined
16:17:56  * davidbjorklundjoined
16:18:47  * bonswouarquit (Remote host closed the connection)
16:19:27  * ehdjoined
16:19:33  * jcrugzzjoined
16:20:26  * ncthom91joined
16:21:05  * Raynosjoined
17:48:06  * ncthom91quit (Quit: My MacBook has gone to sleep. ZZZzzz…)
18:22:05  * binocarlosquit (Quit: Leaving)
18:29:03  * ncthom91joined
19:32:29  * phpnodequit (Remote host closed the connection)
19:39:24  * joakinoquit
20:17:51  * ncthom91quit (Quit: My MacBook has gone to sleep. ZZZzzz…)
20:20:01  * sbahraquit (Disconnected by services)
21:20:01  * ncthom91joined
21:30:33  * ChrisPartridgejoined
21:30:33  * ChrisPartridgequit (Changing host)
21:30:33  * ChrisPartridgejoined
22:15:17  * neonstalwartquit (Quit: Leaving.)
22:51:01  * ncthom91quit (Quit: My MacBook has gone to sleep. ZZZzzz…)
23:12:18  * mhernandez1quit (Remote host closed the connection)
23:44:09  * jjmalinaquit (Quit: Textual IRC Client: www.textualapp.com)