02-17-2017, 11:35 AM | #136 |
Grand Sorcerer
Posts: 6,329
Karma: 12117215
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
|
New but not mandatory. And this zip file doesn't have the bug.
Last edited by Terisa de morgan; 02-17-2017 at 11:39 AM. |
02-17-2017, 01:28 PM | #137 | |
Zealot
Posts: 105
Karma: 10
Join Date: Oct 2013
Device: none
|
Quote:
The next file is a 7zip file, 7z as extension is not supported as attachment, so I add a .zip extension. Uncompressed it is 42,005,756 bytes. debuglog.7z.zip |
|
Advert | |
|
02-17-2017, 02:53 PM | #138 |
null operator (he/him)
Posts: 20,912
Karma: 27620686
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
For diagnostic purposes only, I'd like to suggest that AnselmD repeats his test with the Include folder option checked.
BR |
02-17-2017, 05:26 PM | #139 |
Grand Sorcerer
Posts: 6,329
Karma: 12117215
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
|
No need, @BetterRed. I think I know which the problem can be, but I don't know an easy way to correct it (different threads with different instances of the auxiliary table). A need the auxiliary table to get the original folder. The best I can do (because I have a limited control over the way I can send information between methods) is omiting some checks if folder is not desired, which is @AnselmD's option.
|
02-17-2017, 05:40 PM | #140 |
Groupie
Posts: 178
Karma: 134
Join Date: May 2010
Device: IREX DR1000
|
Hi Terisa, if I could be of any help, I am facing the same problems.
Random group of books have not filename and path information at all. Just download 100 random books from all around the internet, add them and the problem will popup (Windows 8.1 32 bit here) |
Advert | |
|
02-17-2017, 05:45 PM | #141 | |
Zealot
Posts: 105
Karma: 10
Join Date: Oct 2013
Device: none
|
Quote:
|
|
02-17-2017, 06:49 PM | #142 | ||
null operator (he/him)
Posts: 20,912
Karma: 27620686
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
Quote:
Thread racing came up in another context that might have been related to add books or inter-library copying. I'll do some searches. Added : Nuh, they were related to calibre startup - I searched for 'race' in KG's posts - ignoring his recent references to Amazon Arms Race. It appears to be another problem for the master magister. BR Last edited by BetterRed; 02-17-2017 at 06:59 PM. |
||
02-17-2017, 07:12 PM | #143 |
null operator (he/him)
Posts: 20,912
Karma: 27620686
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
FWIW: I'm not seeing this problem, I add books in relatively small batches (10-30) from multiple directories (my file manager has a browse flat feature) via a Windows shortcut to calibre.exe in Windows Send To - which effectively means I add via
calibre.exe '"book1path.xxx", '"book2path.xxx", '"book2path.xxx", '"book3path.xxx", . . ., '"bookNNpath.xxx". I also have the Folder Path checked. Not sure if either are relevant. BR |
02-17-2017, 07:30 PM | #144 |
Grand Sorcerer
Posts: 6,670
Karma: 86234809
Join Date: Nov 2011
Location: Charlottesville, VA
Device: Kindles
|
In case the problem isn't fixed yet, one cause of random plugin errors can be producing print output when not in debug mode.
https://www.mobileread.com/forums/sh...d.php?t=281382 |
02-17-2017, 09:52 PM | #145 |
creator of calibre
Posts: 44,317
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Adding books actually happens multiple stages. First ina separate thread, the filesystem is scanned for files. Then in a separate worker process for reading metadata then once that is done the books are added to the database in the GUI thread. @Terisa: what exactly is the problem? Sorry, I'm a little too busy at the moment to read through this thread.
|
02-18-2017, 01:48 AM | #146 | |
Zealot
Posts: 105
Karma: 10
Join Date: Oct 2013
Device: none
|
I would like to recall my first message into memory:
Quote:
|
|
02-18-2017, 02:49 AM | #147 | |
Grand Sorcerer
Posts: 6,329
Karma: 12117215
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
|
Quote:
The problem here is passing info form the run method to the postadd method (the original path folder). For doing that, the run method includes a dictionary entry with name/original folder and the postadd method reads the dictionary, search the entry related to the file and get the directory. If it doesn't find the entry it assumes that it has processed it (in previous calibre versions, the postadd method was called more than once for a file). The dictionary is included in the preferences method. In this log, I see a bunch of run call and, in the middle, some postadd calls. It looks like at some point, the postadd method gets a dictionary without some of the last entries and, when it saves it without the processed file, all the intermediate entries are lost. The solution I think would be initialize the dictionary when calibre starts and not removing anything in the postadd method. As I don't see now more than one call to postadd method, that wouldn't be a problem. The problem would be to clean the dictionary after finishing the adding (or before the beginning). I don't know where to include the cleaning because my initial idea, init, is not valid as it looks like it is called once for file. This only happens with big batches, there is no problem with small batches as this race situation does not happen. If somebody has a better idea for passing information between methods, I would be glad to try it. Last edited by Terisa de morgan; 10-15-2017 at 01:26 PM. |
|
02-18-2017, 04:14 AM | #148 |
creator of calibre
Posts: 44,317
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
The safest way to pass data between the calls is to use the filesystem. Create a temporary file, use the file locking in calibre.utils.lock.ExclusiveFile to write to the file from the run() method and read from it in the postadd() method.
|
02-18-2017, 04:38 AM | #149 |
Grand Sorcerer
Posts: 6,329
Karma: 12117215
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
|
Thank you very much, I was trying it to avoid for time response, but it's really the safest way: semaphores.
Last edited by Terisa de morgan; 10-15-2017 at 01:26 PM. |
02-19-2017, 03:06 AM | #150 | |
Zealot
Posts: 105
Karma: 10
Join Date: Oct 2013
Device: none
|
Quote:
I would like to start some test with an old version, starting somewhere before the "file date" was introduced. Is there a place to get some older versions? |
|
Tags |
calibredb, calibredb metadata import, plugin |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[FileType Plugin] YVES Bible Plugin | ClashTheBunny | Plugins | 27 | 01-16-2023 01:25 AM |
How to sort quickly books by filetype? | construsol | Calibre | 7 | 05-24-2014 06:20 PM |
Calibre associated with every filetype?! | sej7278 | Calibre | 14 | 08-09-2011 10:36 AM |
Zip Filetype Plugin? | rsingley | Plugins | 7 | 02-11-2011 05:11 PM |
How to register a filetype? | plisken | iRex | 2 | 09-28-2009 07:16 AM |