![]() |
#1 |
Member
![]() Posts: 19
Karma: 10
Join Date: May 2011
Location: Diamond Creek, Australia
Device: Kindle Voyage
|
![]()
Hi ... my first post, although I do pop in and browse around occasionally and have found a lot of incredibly useful information and snippets here.
(Aside: I must follow up how to put metadata on the first page of a book!!!!! What a ripper! ![]() What I am wondering though is if there is an upper limit to the number of books Calibre can handle. I vaguely recollect somewhere in the early days of looking around here that someone mentioned 50,000 (Fifty THOUSAND? Yikes!) but I've been unable to find that information again. I don't have anywhere near that but cycle a lot through my Kindle 3, which I love to bits and take everywhere with me. Thanks for any help ... |
![]() |
![]() |
![]() |
#2 | |
US Navy, Retired
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,865
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
|
|
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Member
![]() Posts: 19
Karma: 10
Join Date: May 2011
Location: Diamond Creek, Australia
Device: Kindle Voyage
|
Thanks for the prompt answer dwanthny. Highly unlikely I'll ever have anything remotely like that number of books ... I have trouble reading all the ones I have!
|
![]() |
![]() |
![]() |
#4 |
US Navy, Retired
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,865
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
|
![]() |
![]() |
![]() |
#5 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 78
Karma: 457752
Join Date: Oct 2011
Location: Deep South
Device: 4 or 5 generations of kindles
|
This is an old thread but I though people would be interested. I have almost 230,000 books in my library and it runs like a rock. With this many books and as many directories (more than 40,000) that are in the root of the calibre library directory performance was big issue starting at about 100,000 books. I moved the library to it's own dedicated ssd on a sata3 interface and now the largest lag is 4 or 5 seconds instead of 30 seconds to a minute on search queries. It also helps that it is a 2.5 ghz i7 with 32 gigs or ram. I just checked and on a linux system with calibre running since a reboot yesterday it is using 5 gig's of memory on its own.
|
![]() |
![]() |
Advert | |
|
![]() |
#6 |
Junior Member
![]() Posts: 1
Karma: 10
Join Date: Feb 2008
Device: Kindle
|
Thank you. I'm glad to know that. I have a ton of books and they are all over the place. I'm now trying to consolidate them to one folder so I can have calibre search and put everything away correctly
|
![]() |
![]() |
![]() |
#7 |
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,189
Karma: 63194629
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
I know this is an old thread, but I was curious about it too, mostly the hard limit of books the Calibre database can hold.
![]() Calibre uses a sqlite database, and according to the SQLite documentation, the theoretical maximum number of rows in a table is 2*64 (no superscript?), which is....a very big number. Though you'll reach the 140 terabyte database size limit long before that number. Last edited by ownedbycats; 06-20-2020 at 04:55 PM. |
![]() |
![]() |
![]() |
#8 | |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 78
Karma: 457752
Join Date: Oct 2011
Location: Deep South
Device: 4 or 5 generations of kindles
|
Quote:
My current system though fast is 10 years old now. It's fast enough that I haven't been able to justify the 1000 dollars or so to upgrade to one of the new AMD's systems with more cores and lots of PCIE lanes. Maybe late this year or next year. Remember to every once in a while kick a donation through paypal to the developers. This is an awesome program that I have used since pre 2012. I try to send some money every year or two to them. Same with other open source programs I use on a regular basis. I would hate to see Calibre disappear like so many other programs I have used in the past. Update 1/2023 see new post ![]() Last edited by audeojude; 02-06-2023 at 11:05 AM. |
|
![]() |
![]() |
![]() |
#9 |
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,189
Karma: 63194629
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
I figure if my Calibre superlibrary ever gets big enough that it starts lagging, I'll just split it into a few smaller libraries. That'll be a while yet as I've got less than 4000 books in there so far.
|
![]() |
![]() |
![]() |
#10 | |
Well trained by Cats
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 30,265
Karma: 57979022
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Extra columns, large comments, all make the metadata.db bulky. Bulky is what can slow down normal activities. OTOH Large books, slow down conversions and file transfers. |
|
![]() |
![]() |
![]() |
#11 |
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,189
Karma: 63194629
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Yeah, the one thing I'm a little worried about is the fanficfare metadata long-text column, but so far it's proven useful enough to keep.
|
![]() |
![]() |
![]() |
#12 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 78
Karma: 457752
Join Date: Oct 2011
Location: Deep South
Device: 4 or 5 generations of kindles
|
I tend to pull descriptions from amazon so most everything has a paragraph or two in the comments field. Books size averages between .5 to 1.5 mb. 200 pages to 600 pages. Metadata.db file is 545 MB in size.
|
![]() |
![]() |
![]() |
#13 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 78
Karma: 457752
Join Date: Oct 2011
Location: Deep South
Device: 4 or 5 generations of kindles
|
with only 4000 books in your library you are a long way from needing to worry at all. I have about 64x that many entries.
|
![]() |
![]() |
![]() |
#14 |
Custom User Title
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,189
Karma: 63194629
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Thankfully the filesize of the book itself doesn't affect the database much, which is a good thing because I have some rather bulky files.
My metadata.db is about 15 MB in size, although I distinctly remember it being around 2-3 MB before I started using FanFicFare's long-text metadata column. Though after doing a lot of metadata edits and vacuuming the database, it tends to shave off a few kilobytes. |
![]() |
![]() |
![]() |
#15 |
Junior Member
![]() Posts: 1
Karma: 10
Join Date: Nov 2022
Device: Calibre 6.3
|
And I thought my E-Book collection was BIG. I have about 7,000 E-books in my laptop. Most of them were downloaded from Gutenberg.org, for free. If I read one book each day, it would take me about 20 years to read them all!
I'm glad to hear that the CALIBRE E-book reader can handle over 250,000-book super-libraries! |
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Limit on Number of books? | kblechman | Library Management | 1 | 04-02-2011 10:05 AM |
NookLibrary : Limit for number of books? | Kolfe | Barnes & Noble NOOK | 6 | 12-02-2010 06:27 PM |
Limit to number of books in Calibre? | ficbot | Calibre | 1 | 02-26-2010 08:46 AM |
Can calibre handle different books' editions? | italianReader | Calibre | 1 | 01-03-2010 11:13 AM |
Limit to the number of MP3 files? | dhbailey | Sony Reader | 19 | 04-15-2007 04:44 PM |