03-26-2013, 05:18 AM | #1 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Calibre2opds v3.2 - OPDS catalogs from your Calibre library
This first post will be updated as required for the latest news and downloads on the 3.2 release to avoid you having to read through the thread to get the most up-to-date status.
News Most of the developers of Calibre2opds seem to have gone largely dormant (I guess life has gotten in the way ), so it has been a while since the last Calibre2opds release. However enough fixes (and new features) have accumulated that I thought it was a good idea to get a 3.2 release out. It will also give us base for starting work on the 3.3 release. Version 3.2 is available at the Calibre2opds download site. Description: The calibre2opds tool can generate OPDS and HTML catalogs from the metadata of the Calibre ebook library manager. The calibre2opds catalogs are intended for scenarios where use of the Calibre Content Server is not appropriate (see here for a comparison). These catalogs can then be used both to browse your ebook library online and also to download books on demand. Release Notes for Calibre2Opds v3.2 Spoiler:
You can discuss calibre2opds here in the Calibre mobileread forum, or use the dedicated calibre2opds forum shown in the links below. Useful links Last edited by itimpi; 10-22-2013 at 06:15 AM. |
03-26-2013, 06:49 PM | #2 |
Banned
Posts: 640
Karma: 4911
Join Date: Jul 2007
Location: Grapevine, TX
Device: iPad4
|
Will not install. Clicking on install.cmd brings up a fleeting command window but nothing happens. Looking at the file in a text editor shows that it looks for install.jar. There is no such file in the download.
I can run the program without installing by running rungui.cmd. Catalog generation causes it to crash. "Unexpected fatal error during catalog generation. See log file for more details." The last part of the log is: Code:
26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Do not generate external links : no 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Do not generate cross-reference links : no 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Display book titles using the Calibre 'title_sort' field : no 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Display author names using the Calibre 'author_sort' field : no 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Include Modified Date in the Book Details : no 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Language : en 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Database folder : D:\Dropbox\Public\Ebooks 26-03-2013 18:02:57,212 [] INFO com.gmail.dpierron.calibre.opds.Catalog - 26-03-2013 18:02:57,331 [] INFO com.gmail.dpierron.calibre.opds.Catalog - started catalog generation 26-03-2013 18:02:57,332 [] INFO com.gmail.dpierron.calibre.opds.Catalog - loading and filtering database 26-03-2013 18:02:58,400 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Database loaded: 3255 books 26-03-2013 18:02:58,402 [] INFO com.gmail.dpierron.calibre.opds.Catalog - done in 1,065 millisec. 26-03-2013 18:02:58,403 [] INFO com.gmail.dpierron.calibre.cache.CachedFileManager - CRC Cache file set to D:\Dropbox\Public\Ebooks\_catalog\calibre2opds.cache 26-03-2013 18:02:58,403 [] INFO com.gmail.dpierron.calibre.opds.Catalog - done in 0 millisec. 26-03-2013 18:02:58,420 [] INFO com.gmail.dpierron.calibre.opds.Catalog - generating all books catalog 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - ************************************************* 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - UNEXPECTED FATAL ERROR DURING CATALOG GENERATION. SEE LOG FILE FOR MORE DETAIL. 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - CAUSE: java.lang.NullPointerException: null 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - MESSAGE: null 26-03-2013 18:02:58,502 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - STACK TRACE: 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.secure.SecureFileManager.getSplitFilename(SecureFileManager.java:254) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.BooksSubCatalog.getListOfBooks(BooksSubCatalog.java:349) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.BooksSubCatalog.getListOfBooks(BooksSubCatalog.java:226) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.BooksSubCatalog.getListOfBooksSplitByLetter(BooksSubCatalog.java:674) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.BooksSubCatalog.getListOfBooks(BooksSubCatalog.java:381) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.BooksSubCatalog.getListOfBooks(BooksSubCatalog.java:226) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.AllBooksSubCatalog.getSubCatalogEntry(AllBooksSubCatalog.java:89) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.AllBooksSubCatalog.getSubCatalogEntry(AllBooksSubCatalog.java:68) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.opds.Catalog.createMainCatalog(Catalog.java:788) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - com.gmail.dpierron.calibre.gui.Mainframe$3.run(Mainframe.java:358) 26-03-2013 18:02:58,503 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - java.lang.Thread.run(Unknown Source) 26-03-2013 18:02:58,504 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - ************************************************* 26-03-2013 18:02:58,504 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - 26-03-2013 18:02:58,504 [] INFO com.gmail.dpierron.calibre.opds.Catalog - Deleting temporary Files 26-03-2013 18:02:58,507 [] INFO com.gmail.dpierron.calibre.opds.Catalog - done in 2 millisec. 26-03-2013 18:02:59,962 [] ERROR com.gmail.dpierron.calibre.opds.Catalog - Unexpected fatal error during catalog generation. See log file for more detail. Last edited by edbro; 03-26-2013 at 07:04 PM. |
Advert | |
|
03-26-2013, 11:37 PM | #3 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Thanks for te report even if it is to report a problem
You were not meant to attempt to use the install.cmd file! The instructions said to simply unzip the package replacing an existing install! I might need to look at whether install.cmd should even be included in the zip package. I think it is just a legacy from an earlier release that was overlooked, but if it is to be kept it probably needs amending to pick up the correct jar file. As to why it is crashing for you I have no idea without further information. The best way to get this investigated would be to raise an issue at http://calibre2opds.myjetbrains.com/youtrack/issues and to attach the following: - The full log file - a copy of the Calibre metadata.db file (zipped if necessary to reduce size). - ideally a copy of the default.xml file from the configuration folder to help with duplicating your settings. With that I can try and reproduce your symptoms on my system. Last edited by itimpi; 03-27-2013 at 05:15 AM. |
03-29-2013, 10:15 AM | #4 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Just to let everyone know that it appears the calibre2opds project's license for the YouTrack Issue tracker has expired This is a complementary (free) license we get from Jetbrains as an Open source product so I suspect we will not be able to get it re-activated until after the Easter break. In the meantime any issue should be handled either here or in the dedicated calibre2opds forum.
|
07-15-2013, 12:21 PM | #5 |
Connoisseur
Posts: 72
Karma: 10
Join Date: Dec 2008
Device: iPhone, Note3
|
Windows 7 x64
Installed this by copying over the file. The GUI runs fine, but when I try to run this as a scheduled job (a batch file that runs run.cmd) I get this error: [INFO] "C:\Program Files (x86)\Java\jre6\bin\JAVA.EXE" -Xms128m -Xmx512m -cp Op dsOutput-3.1-SNAPSHOT.jar Cli Exception in thread "main" java.lang.NoClassDefFoundError: Cli Caused by: java.lang.ClassNotFoundException: Cli at java.net.URLClassLoader$1.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) Could not find the main class: Cli. Program will exit. ' "-----------------------" " Calibre2Opds FINISHED " "-----------------------" |
Advert | |
|
07-15-2013, 12:40 PM | #6 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Looks like there is an error in the run.cmd batch file as it is trying to run the wrong .jar file! I personally rarely run batch mode so it has not been picked up in testing
If you edit it in a text editor and near the end replace the 'OpdsOutput-3.1-SNAPSHOT.jar' with '%_C2O%' it should fix the problem. |
07-15-2013, 12:47 PM | #7 |
Connoisseur
Posts: 72
Karma: 10
Join Date: Dec 2008
Device: iPhone, Note3
|
That fixed it. It's off and running now.
Thanks! |
08-01-2013, 07:58 PM | #8 |
Banned
Posts: 640
Karma: 4911
Join Date: Jul 2007
Location: Grapevine, TX
Device: iPad4
|
Did this ever get fixed? I'm anxious to try again but I really need the encrypted filenames for my Dropbox library.
|
09-25-2013, 08:32 AM | #9 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Just for those interested I have put a new build of Calibre2opds (229) on the Downloads page. This fixes all issues that I know about (or at least I can no longer reproduce issues with my test libraries). I have labelled this is as RC2, but if no significant issues are found I will relabel it as the 3.2 final release so that work can start on the 3.3 release.
This release has had major work done on the internals of calibre2opds that should improve reliability and help act as a basis for future development. One visible manifestation of is that folder/filenames used within the catalog are changed and are more human readable. In addition here are a lot less folders generated) which should make catalogs slightly smaller. As a teaser one of things that is being worked on for the 3.3 release is support for Calibre Custom columns which is something widely requested. Quite how this will end up manifesting itself is going to depend on what issues are found during implementation. |
09-26-2013, 03:59 AM | #10 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Just added a RC3 build (230M) to the downloads page to fix a silly regression in RC2 (229M) where split-by-letter in the Series sub-catalog was not working
|
10-02-2013, 10:53 AM | #11 |
Connoisseur
Posts: 72
Karma: 10
Join Date: Dec 2008
Device: iPhone, Note3
|
Using Win7 x64
GUI works fine, except "Maximum length of book summary" cannot be saved as -1; when the program reopens, it goes back to 500. I was able to set it to 5000 though. Running my nightly command line batch, I get this error: Code:
Calibre2opds startup ==================== ' Free RAM: 2757556 ' [INFO] Trying to locate Java on this system [INFO] ==================================== [INFO] Java location not found via JAVA_HOME environment variable [INFO] Java not found in default JRE6 location [C:\Program Files\Java\jre6] [INFO] Java not found in default JRE7 location [C:\Program Files\Java\jre7] [INFO] Java found at default 32-bit Java on 64-bit Windows JRE6 location [C:\Pro gram Files (x86)\Java\jre6] | was unexpected at this time. Last edited by ki5ck; 10-02-2013 at 10:56 AM. |
10-02-2013, 01:17 PM | #12 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
I will look into not being able to save -1. I am not sure if -1 should even be allowed - it is rare for people to want that large a value here (note this is the summary under a list of books, not the summary under book details which is always shown ay full length). Most people want to reduce it from the default value of 250 rather than increase it. However as you found using a large value is a valid workaround if you want all the summary. I also noted that the description of this setting was not present in the documentation - I have rectified that!
Regarding the batch file issue, open it in a text editor and look for Calibre2|OpdsConfig just before the :start_c2o label, and remove the |. Not sure how that got in there! |
10-02-2013, 01:58 PM | #13 |
Connoisseur
Posts: 72
Karma: 10
Join Date: Dec 2008
Device: iPhone, Note3
|
Removing the | allowed the command line version to run, thanks.
We might not be talking about the same summary setting. My book details summary has always been truncated for longer summaries (since I never tried going above 500, and setting -1 did not work). Setting this to 5000 no longer truncates my summaries, at least as far as I can tell so far. I hadn't realized there was a summary in the list of books, since I always browse using my ereader and a summary is not shown in a list. This is the setting I'm referring to. Notice the popup does say "Set to -1 to never truncate". And by the way, thank you for all the work you put into this. I hope I don't sound like I'm complaining; I really do love the ability this program gives me to access my books on the web. |
10-02-2013, 07:05 PM | #14 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
I must admit I had forgotten about the tooltip text! Looking at the code the value of -1 to avoid truncation has not been honoured for some time. I can look at allowing it again easily enough.
The OPDS standard specifies a short summary and a long summary. The short summary is constrained to be plain text whereas the full summary can have embedded HTML formatting. That setting is for the short summary that is normally displayed as an additional line or two when showing a list of books. eReader software that is OPDS aware should use the full summary when it makes sense - not the short summary. In Calibre2opds generated catalogs the full summary is in effect the Calibre Comments field with some additional information added. The difference between these two different types of summary is most obvious when looking at HTML format catalogs. The short summary is displayed at the same level as a list of books, while the full summary is displayed when you drill down to a particular book. In particular when you ask for the metadata for a specific book the ereader should be using the full summary. It sounds as if yours is not? One (otherwise excellent) ereader app that I know gets this wrong is Marvin on iOS - it always uses the short summary. Other iOS ereader apps such as MegaReader use the short and full summaries as appropriate. I have emailed the Marvin author about this but had no response. I see there is now a Marvin forum on MobileRead so perhaps I should bring it up there. |
10-03-2013, 05:21 AM | #15 |
Wizard
Posts: 4,553
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Looks like there were 2 errors in the code relating to Maximum Book Summary length:
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Calibre2opds v3 - OPDS catalogs from your Calibre library | itimpi | Related Tools | 31 | 02-10-2013 04:16 PM |
Popular public OPDS catalogs | kguil | Apple Devices | 37 | 01-01-2013 05:00 PM |
OPDS catalogs access | knfevg | PocketBook | 7 | 12-04-2012 04:55 AM |
List of Free Online OPDS Catalogs? | Madmick | General Discussions | 1 | 01-14-2012 12:09 AM |
Call for comments: OPDS Catalogs 0.9 draft (open catalog standard ebooks) | zelda_pinwheel | News | 4 | 05-14-2010 01:02 PM |