![]() |
#91 |
BLAM!
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 13,492
Karma: 26047188
Join Date: Jun 2010
Location: Paris, France
Device: Kindle 2i, 3g, 4, 5w, PW, PW2, PW5; Kobo H2O, Forma, Elipsa, Sage, C2E
|
Was that time spent building the json db (Updating collections ...) or waiting for ccat (Sending commands ...)? If it's the latter, building the json db from a powerful host won't change much (i.e., ccat is the bottleneck, and since you'll always have to go through it…).
Last edited by NiLuJe; 09-21-2014 at 03:31 PM. |
![]() |
![]() |
![]() |
#92 | |
Enthusiast
![]() Posts: 25
Karma: 10
Join Date: Sep 2014
Device: pw2
|
Quote:
|
|
![]() |
![]() |
Advert | |
|
![]() |
#93 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
Then it should be while building the json, going through the folders. It should switch to something like "Sending commands" when doing the actual updating...
|
![]() |
![]() |
![]() |
#94 |
Enthusiast
![]() Posts: 25
Karma: 10
Join Date: Sep 2014
Device: pw2
|
i've also tried - https://github.com/foxsen/collectionSync it seems doesn't work anymore..
@baranuphe, i'm scraping now whole lot of books, it should create a .json i guess? it seems librarian doesn't like '%' in filenames, can you fix this? also, is there any way to continue import (not start from scratch) with librarian? if i run librarian --scrape -i it starts again from the start ... ? ehm, what's the point of converting books from .mobi to .epub? when you send to kindle they are converted again back to .mobi? i kinda don't get for what this is made for .. would be just nice to get a tool to make same 'generate .json file based on the directory tree' on the desktop PC. EDIT: i'm just looking into librariansync/generate_collections.py file and trying to adopt it to the PC to generate db on it ![]() EDIT2: so i've installed usbnet on my PW2 and gave a try CollectionSync script from the telnet it seems to be working but have some bugs (with dashes in name of the folders/files), most of the time it takes to update the final collections on the homescreen of the kindle with some java app called (PerformPostBatch.class) but it works MUCH faster comparing to librarianSync, so roughly 3920 books with 360 collections (actually about 400 folders, but some didnt work of the problem above) took about ~10 minutes. the other bug I encountered kindle's home crashed as well for some reason, so had to reboot from console ![]() also it seems to not create sub-collections like CM, e.g. folder1\folder2\some_book.mobi so you get folder1 collection inside it folder2 collection hidden on the home page, but I think its doable to modify the script to make it work properly or just integrate this script functionality into the librarian (which would be quite nice). Last edited by mobusr; 09-22-2014 at 04:40 AM. |
![]() |
![]() |
![]() |
#95 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
So:
1. scraping isn't importing, it'll just copy files scattered in a drive into the import folder. 2. I'll see about the "%" character in filenames 3. importing can be resumed, not scraping. 4. at some point I decided to only have epubs in the library. It's easier to work with as a format and, I guess, by its open nature, more future-proof. 5. you could look at list_folder_contents() in kindle_contents.py to have an idea of how to build your offline script to generate the json. 6. I don't really get why you would get such a difference in terms of speed. Maybe it's a memory thing? how are your files organized? lots of folders/subfolders or a few folders with a lot of files? 7. nested folders do not work in later firmwares, so I dropped support for that during a rewrite. |
![]() |
![]() |
Advert | |
|
![]() |
#96 | |
Enthusiast
![]() Posts: 25
Karma: 10
Join Date: Sep 2014
Device: pw2
|
Quote:
I think the main issue is converting mobi to epub. 7. Ahh, didn't know that. What they've changed there? I've looked into /var/local/cc.db and collections structure is pretty much in Collections table, each Collection is in Entries with Collection type. I'm interested in just updating the sqlite3 db and restarting amazon's launcher, is it possible ? (without whole device restart). |
|
![]() |
![]() |
![]() |
#97 | |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Quote:
Details in the "readme" document and change log at the link you posted earlier. From what I could see at a brief look-through, its not the '-' but the preceding and trailing space in ' - '. *nix doesn't like spaces in file and path names - you have to escape them or quote the string that has them. |
|
![]() |
![]() |
![]() |
#98 | |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
Quote:
|
|
![]() |
![]() |
![]() |
#99 |
Old Kaz
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 208
Karma: 1064151
Join Date: May 2010
Device: PocketBook Era
|
Can make automatic replacement of unrecognised symbols in filename on "_"?
PS: I don't have problems from "%"... Last edited by kaznelson; 09-23-2014 at 01:57 AM. |
![]() |
![]() |
![]() |
#100 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
@mobusr
I've added a new script to the git repo: tools/offline_folder_export.py that basically creates the collections.json file necessary to build folder-based collections. You can run this on your PC on your local mirror of files, copy your files over to your kindle and collections.json to the extensions folder, and rebuild/update your collections with LibrarianSync. |
![]() |
![]() |
![]() |
#101 | |
Enthusiast
![]() Posts: 25
Karma: 10
Join Date: Sep 2014
Device: pw2
|
Quote:
|
|
![]() |
![]() |
![]() |
#102 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
@mobusr
What exactly was wrong with having "%" in filenames? |
![]() |
![]() |
![]() |
#103 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 77
Karma: 40008
Join Date: Aug 2014
Location: Paris, France
Device: PW2, Kobo H20, Kobo Aura One
|
Following a discussion with frakman1, latest version allows for regular expressions in collections.json, for quick sorting into collections of files whose filenames follow known patterns.
|
![]() |
![]() |
![]() |
#104 |
Enthusiast
![]() Posts: 25
Karma: 10
Join Date: Sep 2014
Device: pw2
|
@barsanuphe
I think all my problems related to LibrarianSync is because I synced git repo from Windows system so git added nasty ^M at the end of each line .. I ran today few hours ago 'Export Collections function' and it ran for over 10 hours. So I thought it was something wrong and decided to run same command through the ssh.. I had in the terminal something like: Code:
command not found I'm gonna test your script now for creating collections.json file on localhost.. and report back.. sorry for longness! |
![]() |
![]() |
![]() |
#105 |
BLAM!
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 13,492
Karma: 26047188
Join Date: Jun 2010
Location: Paris, France
Device: Kindle 2i, 3g, 4, 5w, PW, PW2, PW5; Kobo H2O, Forma, Elipsa, Sage, C2E
|
@mobusr: Err, that doesn't make sense. When did you install Python, and which version of the package did you use?
EDIT: That is, unless the shebang itself was mangled by carriage returns. But then just dos2unix'ing it should be enough, the python2.7 symlink has been there as long as the python one, so moving from one to the other wouldn't change anything, which is what I was getting at ![]() Last edited by NiLuJe; 09-27-2014 at 04:56 PM. |
![]() |
![]() |
![]() |
Tags |
kindle collections, librariansync |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Vocabulary builder and flash card feature on old kindle 2/3/dx? | dark.knight1 | Kindle Developer's Corner | 12 | 10-10-2015 01:12 PM |
Vocabulary builder | bobafruit | Kindle Developer's Corner | 25 | 09-04-2015 01:46 AM |
Free (nook/Kindle/iTunes/DRM-free) Legacy Builder [Xtian Business Leadership Advice] | ATDrake | Deals and Resources (No Self-Promotion or Affiliate Links) | 0 | 10-13-2014 02:44 AM |
Vocabulary Builder for Kindle Paperwhite 1 | pxpxpx | Amazon Kindle | 2 | 02-16-2014 06:07 PM |
SBPubX Builder | tmaynard | Fictionwise eBookwise | 16 | 11-20-2008 12:35 PM |