00:05:18  * eugenewarejoined
00:07:00  * daviddiasquit (Remote host closed the connection)
00:08:27  * kenan|afkchanged nick to kenansulayman
00:09:50  * eugenewarequit (Ping timeout: 264 seconds)
00:15:56  * mikealjoined
00:16:01  * mikealquit (Client Quit)
00:23:02  * mikealjoined
00:33:22  * mikealquit (Quit: Leaving.)
00:54:53  * thlorenzquit (Remote host closed the connection)
01:07:34  * timoxleyjoined
01:09:02  * eugenewarejoined
01:11:00  * timoxleyquit (Client Quit)
01:26:24  * kenansulaymanchanged nick to kenan|afk
01:54:59  * jcrugzzquit (Ping timeout: 272 seconds)
01:59:28  * thlorenzjoined
02:03:27  * thlorenzquit (Remote host closed the connection)
02:14:29  * eugenewarequit (Remote host closed the connection)
02:14:56  * eugenewarejoined
02:16:50  * eugenewarequit (Remote host closed the connection)
02:16:57  * eugenewarejoined
02:20:34  * jcrugzzjoined
02:29:27  * jcrugzzquit (Ping timeout: 272 seconds)
02:30:09  * jcrugzzjoined
02:33:05  * Aredrideljoined
02:33:59  * levelbotquit (*.net *.split)
02:41:28  * levelbotjoined
02:54:28  * thlorenzjoined
03:04:45  * thlorenzquit (Remote host closed the connection)
03:10:12  * thlorenzjoined
03:29:27  * jcrugzzquit (Ping timeout: 240 seconds)
03:43:35  * Sorellaquit (Read error: Connection reset by peer)
04:25:45  * eugenewarequit (Remote host closed the connection)
05:29:03  * eugenewarejoined
05:33:25  * eugenewarequit (Ping timeout: 248 seconds)
05:46:09  * thlorenzquit (Remote host closed the connection)
05:59:45  * Aredridelquit (Quit: Textual IRC Client: www.textualapp.com)
06:01:23  <levelbot>[npm] [email protected] <http://npm.im/amalgamate>: Forward and reverse iteration of a Strata b-tree. (@bigeasy)
06:02:27  * TehShrikejoined
06:44:53  <levelbot>[npm] [email protected] <http://npm.im/amalgamate>: Forward and reverse iteration of a Strata b-tree. (@bigeasy)
07:25:38  * jcrugzzjoined
07:29:56  * jcrugzzquit (Ping timeout: 240 seconds)
07:45:49  * abstractjquit (Changing host)
07:45:49  * abstractjjoined
07:46:30  * eugenewarejoined
08:18:53  <levelbot>[npm] [email protected] <http://npm.im/pathos>: Decompose a javascript object into a set of path/value slices. (@eugeneware)
09:13:28  * mikealjoined
09:33:40  * eugenewarequit (Remote host closed the connection)
09:35:08  * frankblizzardjoined
10:24:17  * frankblizzardquit (Remote host closed the connection)
10:24:44  * frankblizzardjoined
10:29:53  * frankblizzardquit (Ping timeout: 272 seconds)
10:38:54  * eugenewarejoined
10:46:37  * eugenewarequit (Ping timeout: 272 seconds)
10:48:25  * kenan|afkchanged nick to kenansulayman
11:58:33  * eugenewarejoined
12:06:55  <levelbot>[npm] [email protected] <http://npm.im/pathos>: Decompose a javascript object into a set of path/value slices. (@eugeneware)
12:12:22  * eugenewarequit (Remote host closed the connection)
12:12:50  * eugenewarejoined
12:17:07  * eugenewarequit (Ping timeout: 246 seconds)
12:44:42  * daviddiasjoined
13:48:23  * thlorenzjoined
14:23:46  * jcrugzzjoined
14:29:25  * Sorellajoined
14:29:33  * Sorellaquit (Changing host)
14:29:33  * Sorellajoined
14:48:00  * daviddiasquit (Read error: Connection reset by peer)
14:48:39  * daviddiasjoined
14:58:26  * daviddiasquit (Ping timeout: 264 seconds)
14:59:37  * daviddiasjoined
15:01:51  * daviddia_joined
15:05:38  * daviddiasquit (Ping timeout: 264 seconds)
15:36:04  * frankblizzardjoined
15:38:05  * eugenewarejoined
15:42:34  * eugenewarequit (Ping timeout: 246 seconds)
15:42:53  <levelbot>[npm] [email protected] <http://npm.im/lvl-serve>: serve a level db (@robertkowalski)
16:00:24  <levelbot>[npm] [email protected] <http://npm.im/lvl-serve>: serve a level db (@robertkowalski)
16:14:46  * frankblizzardquit (Read error: Connection reset by peer)
16:15:13  * frankblizzardjoined
16:19:29  * frankblizzardquit (Ping timeout: 246 seconds)
17:24:57  * kenansulaymanchanged nick to kenan|afk
17:25:05  * kenan|afkchanged nick to kenansulayman
17:41:43  * daviddia_quit (Remote host closed the connection)
17:42:15  * daviddiasjoined
17:44:56  * daviddia_joined
17:46:38  * daviddiasquit (Ping timeout: 246 seconds)
18:05:53  <levelbot>[npm] [email protected] <http://npm.im/manger>: cache feeds (@michaelnisi)
18:06:03  * mikealquit (Quit: Leaving.)
18:13:29  * jcrugzzquit (Ping timeout: 272 seconds)
18:21:30  * jcrugzzjoined
18:23:07  * thlorenzquit (Remote host closed the connection)
18:31:08  * paulfryzeljoined
18:35:21  * paulfryzelquit (Remote host closed the connection)
18:35:59  * paulfryzeljoined
18:37:32  * frankblizzardjoined
18:52:07  * frankblizzardquit (Remote host closed the connection)
18:52:16  * frankblizzardjoined
19:15:23  * frankblizzardquit (Remote host closed the connection)
19:15:49  * frankblizzardjoined
19:19:05  <kenansulayman>rvagg stumbled over a strange issue when importing data to hyperlevel from level-lmdb
19:19:18  <kenansulayman>it seems the database gets corrupted when doing this call:
19:19:27  <kenansulayman>require('level-lmdb')("./lib/data2/template.db").createReadStream().pipe(require('hyperlevel')("./lib/data/template.db").createWriteStream())
19:19:28  * thlorenzjoined
19:19:43  <kenansulayman>opening the database yields this error: OpenError: Corruption: 1 missing files; e.g.: ./lib/data/template.db/000005.sst
19:20:23  * frankblizzardquit (Ping timeout: 252 seconds)
19:21:17  <kenansulayman>though the strangest thing is that I can access the database with hij1nx's lev perfectly well
19:22:35  <kenansulayman>rvagg2?
19:24:39  <kenansulayman>oh I see
19:24:54  <kenansulayman>rescrv are you there?
19:25:15  <rescrv>yes
19:25:41  <kenansulayman>How's the ldb & sst naming with hyperleveldb?
19:25:57  <rescrv>I just need to merge and test.
19:26:06  <kenansulayman>Well check this out:
19:26:12  <rescrv>it sounds like that is what you may be hitting
19:26:20  <kenansulayman>hyperleveldb created sst files when I used this for importing: fs.readdirSync("./data/").forEach(function (v) {require('uberlevel')("./data/"+v).createReadStream().pipe(require('hyperlevel')("./data2/"+v).createWriteStream())})
19:26:41  <kenansulayman>but when I only imported one database, it used the ldb naming
19:26:43  <kenansulayman>(require('uberlevel')("./lib/data2/template.db").createReadStream().pipe(require('hyperlevel')("./lib/data/template.db").createWriteStream()))
19:27:30  <kenansulayman>it seems to create a ldb file
19:27:39  <rescrv>there's no code in hyperleveldb to acknowledge or do anything with *.ldb files. In the case where you're seeing it do so, something is switching a newer leveldb into place instead of hyperleveldb
19:27:56  <kenansulayman>that really is crazy
19:28:12  <rescrv>are you changing anything about the environment between the two calls?
19:28:16  <kenansulayman>no!
19:28:30  <kenansulayman>it created a ldb file and expects a sst on opening
19:28:32  <rescrv>is node sensitive to the directory that you're in?
19:28:42  <kenansulayman>What do you menaƟ
19:28:46  <kenansulayman>mean*?
19:29:25  <rescrv>because in the example that works, I see you're in a directory, and moving `pwd`/data to `pwd`/data2. In the example that doesn't work, you're moving `pwd`/lib/data2/template.db to `pwd`/lib/data/template.db
19:29:32  <rescrv>so you're in a different directory
19:29:49  <rescrv>would that impact how you're importing hyperlevel, and thus put the wrong leveldb to use?
19:30:04  <kenansulayman>well no
19:30:10  <kenansulayman>aha I see
19:30:13  <kenansulayman>Yes indeed
19:30:30  <kenansulayman>the first command (the multi-import) was done on a cluster (ubuntu)
19:30:41  <kenansulayman>to import lmdb into hyper
19:30:50  <kenansulayman>then I merged from the server to local
19:31:16  <kenansulayman>and then (mac osx) imported one local lmdb database into hyper
19:31:30  <kenansulayman>that is, it seems the mac version creates ldb files
19:31:38  <kenansulayman>and expects sst files
19:31:46  <rescrv>so is the specific issue that you're seeing the file ./lib/data/template.db/000005.ldb instead of ./lib/data/template.db/000005.sst?
19:31:59  <kenansulayman>Yes
19:32:10  <kenansulayman>Because when it's not implemented, I wonder where that comes from
19:34:39  <rescrv>You mention that it's opened fine in lev. Are you using any code that could open the db with stock leveldb between when it works and when it doesn't?
19:34:49  <rescrv>If you're always using HyperLevelDB this should be an non-issue
19:35:15  <rescrv>so let's find where it's using stock leveldb
19:35:17  <kenansulayman>the database didn't exist before creating the WriteStream
19:35:38  <kenansulayman>and both me and lev are never using anything else than level-hyper
19:35:39  <rescrv>hmmm
19:36:09  <kenansulayman>So my case to reproduce:
19:36:15  <kenansulayman>I have one level-lmdb database
19:36:18  <rescrv>I have no clue how that could happen, unless something is borked with the way OS X does things. I know static linking is used on Linux.
19:36:48  <kenansulayman>That's really strange
19:37:05  <rescrv>rvagg2 might have insight
19:37:51  <rescrv>I don't have an OS X box, so the only thing i can really do is to prioritize the merge that brings *.ldb support
19:37:54  <rescrv>and then it won't care
19:38:54  <kenansulayman>Well it
19:39:05  <kenansulayman>isn't priority to have ldb in place
19:39:21  <kenansulayman>The issue is why it created it with ldb when using level-hyper in the first place
19:40:56  <rescrv>how big is the data base you're copying?
19:41:04  <kenansulayman>mom
19:41:19  <kenansulayman>very smal
19:41:22  <kenansulayman>2.3 mb
19:41:28  <kenansulayman>(lmdb)
19:41:51  * eugenewarejoined
19:43:34  <rescrv>in that case, can you try again (clean slate), and before touching it with any other tools, do "ls ./lib/data/template.db" and post the MANIFEST-* and LOG files in that directory? This can leak information about your keys, so you may want to do it on fake data if possible (or send privately).
19:44:02  <kenansulayman>sure, it's not sensitive
19:45:52  <kenansulayman>uhm
19:45:57  <kenansulayman>wait
19:46:07  <kenansulayman>now it didn't create any sst or ldb file
19:46:20  * eugenewarequit (Ping timeout: 246 seconds)
19:49:07  * stagasjoined
19:49:27  * daviddia_quit (Remote host closed the connection)
19:54:08  * alanhoffpart ("Someone call 911!")
19:56:40  <kenansulayman>rescrv ok I might have a clue on what went wrong
19:57:29  <kenansulayman>when I imported the databases, I inspected template.db with lev which created the ldb file in the plain database that didn't yet had a sst or ldb file
19:58:04  <kenansulayman>then when I tried to load it into our application, hyper didn't accepted the database anymore
19:58:24  <kenansulayman>in that case I'd like ldb support :F
19:58:31  * jcrugzzquit (Ping timeout: 260 seconds)
19:59:51  * jcrugzzjoined
20:01:29  <rescrv>kenansulayman: thanks. I think you're 100% right. I 'll see what I can do for ldb support.
20:03:58  <kenansulayman>Thanks!
20:08:13  * ELLIOTTCABLE__quit (Ping timeout: 246 seconds)
20:09:51  * ELLIOTTCABLE__joined
20:26:06  * daviddiasjoined
20:30:49  * daviddiasquit (Ping timeout: 272 seconds)
20:46:07  * jcrugzzquit (Ping timeout: 260 seconds)
20:50:54  * jcrugzzjoined
21:02:23  <levelbot>[npm] [email protected] <http://npm.im/level-namequery>: An intelligent search engine on top of LevelDB for Name <-> User-ID relations. (@kenansulayman)
21:55:36  * paulfryz_joined
21:58:06  * paulfryz_quit (Client Quit)
21:59:09  * paulfryzelquit (Ping timeout: 252 seconds)
21:59:23  <levelbot>[npm] [email protected] <http://npm.im/level-cursor>: level stream cursor (@ramitos)
22:01:54  <levelbot>[npm] [email protected] <http://npm.im/modella-level-relations>: levelup based modella relations (@ramitos)
22:47:48  * ramitosjoined
23:09:01  * daviddiasjoined
23:11:12  * eugenewarejoined
23:13:32  * daviddiasquit (Ping timeout: 246 seconds)
23:38:48  * eugenewarequit (Remote host closed the connection)
23:39:17  * eugenewarejoined
23:43:24  <levelbot>[npm] [email protected] <http://npm.im/procede>: In-memory forward iterator for use with the Strata b-tree MVCC tool collection. (@bigeasy)
23:43:24  <levelbot>[npm] [email protected] <http://npm.im/revise>: Utilities for adding MVCC version numbers to Strata b-tree keys. (@bigeasy)
23:43:28  * eugenewarequit (Ping timeout: 246 seconds)
23:55:38  * Aredrideljoined