![]() |
#1 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() Posts: 90
Karma: 618
Join Date: Oct 2007
Location: Ottawa
Device: PocketBook Pro 902, EB-1150, PRS505, PRS700, Jetbook, Hanlin V3, Kobo
|
![]()
I posted this question several months ago, and got three or four answers, but they were all things I had already tried. Anyway, here goes again, but I'll try to clarify it a little more:
I've now got a couple of thousand ebooks on my computer, many of which are the same content, but in multiple different formats (lrf, pdf, lit, epub etc.). Also, many of these files either don't have the correct name, or have variations of the name because the sources of the files edited the titles before posting them. I've tried every search combination I can think of, in both basic and advanced search, and I've tried several duplicate finder programs. I've also looked in any FAQ I think might have the answer, but still can't find it. Does anyone know of a way or a piece of software to locate files with the similar content but in different file formats, PLEASE??? Surely I'm not the first person to realize this is a problem, there must be some way to search documents and have the search look for text that matches 80% or 90% or 95% of the original document. I know I can do this handraulically, but that's going to be a real pain! Any help would be greatly appreciated. Thanks, Dan ![]() ![]() ![]() |
![]() |
![]() |
![]() |
#2 |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 2,251
Karma: 3720310
Join Date: Jan 2009
Location: USA
Device: Kindle, iPad (not used much for reading)
|
If the file names were the same, except for the file extension, it would be pretty easy to write a script to do it. If the file names are NOT the same, except for the extension, it is going to pretty much be impossible, because due to the difference in formats, the contents are going to be wildly different, so you can't compare that.
I'm not sure if by "Also, many of these files either don't have the correct name, or have variations of the name because the sources of the files edited the titles before posting them" you are talking about the book title in the metadata, or the file title or what. A program to search for metadata would have to understand all the formats you are interested in. I'm not sure if Calibre understands all those formats, but if it does, you can import the books into Calibre, and it will put all the books it thinks are the same, except for format, into the same subdirectory in its library. Don't know if that would be of use to you, or not. |
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 3,085
Karma: 722357
Join Date: Feb 2010
Device: PRS-505
|
Calibre understands just about every ebook format out there. You could import all your ebooks into calibre, delete the original files (calibre sets up its own private files), convert those files that aren't in your preferred format to that format, and then have calibre export books in that format to wherever you want them, with understandable names. Or just leave them all in calibre and deal with them from there. In calibre, you can remove formats on a book-by-book basis, remove all instances of a specific format, or remove all formats except the one you prefer.
Even more important, in calibre you are dealing with your books as books, not as files. It doesn't matter what names their files have; what matters is the metadata of the books themselves. Think of it like fonts: on a Windows system, the font you see as "Somefont Italic" might actually reside in a file named SFI__.TTF down in the depths of a folder you never visit. But you never see that name -- you just install it, use it, and uninstall it, as Somefont Italic. It's an abstraction -- a font -- not a file. That's what calibre does for books. It doesn't matter if the file is 234956234.prc, you see it as "A Tale of Two Cities" in calibre, and deal with it accordingly. You might have that book in three different formats, but you don't have to look at 234956234.prc, 234956234.lrf, and 234956234.epub; you just have "A Tale of Two Cities" which, when selected, lists its available formats as prc, lrf, and epub. |
![]() |
![]() |
![]() |
#4 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() Posts: 90
Karma: 618
Join Date: Oct 2007
Location: Ottawa
Device: PocketBook Pro 902, EB-1150, PRS505, PRS700, Jetbook, Hanlin V3, Kobo
|
Thanks Susan & Worldwalker, both of these answers are excellent, I hadn't thought to use Calibre to do the comparison, it just never occurred to me, but it makes perfect sense. Even if the file titles are different, the metadata should help to identify "most" of the duplicates, if not all.
Thanks again, Dan |
![]() |
![]() |
![]() |
#5 |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,479
Karma: 3846231
Join Date: Apr 2009
Location: Edinburgh, Scotland
Device: Kindle 3, Samsung Galaxy
|
Dpayment,
I can't add anything to the good advice you've aready received. But I'd like to ask you a question. You say you've got a couple of thousand ebooks. Do you actually plan to read all of these? If not, why did you acquire them? I'm only asking out of curiosity, you understand. |
![]() |
![]() |
Advert | |
|
![]() |
#6 |
Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 3,085
Karma: 722357
Join Date: Feb 2010
Device: PRS-505
|
I have thousands of pbooks. I've read all of them. Ebooks are less likely to cause structural damage to my floors.
|
![]() |
![]() |
![]() |
#7 | |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() Posts: 90
Karma: 618
Join Date: Oct 2007
Location: Ottawa
Device: PocketBook Pro 902, EB-1150, PRS505, PRS700, Jetbook, Hanlin V3, Kobo
|
Quote:
![]() ![]() |
|
![]() |
![]() |
![]() |
#8 |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,479
Karma: 3846231
Join Date: Apr 2009
Location: Edinburgh, Scotland
Device: Kindle 3, Samsung Galaxy
|
Dpayment, I can only say I'm impressed. I reckon it would take me 75 years to read 2,000 books at my current rate. I admit I'm a slow reader, but even so ....
|
![]() |
![]() |
![]() |
#9 |
Limited Warranty
![]() ![]() ![]() ![]() ![]() ![]() Posts: 89
Karma: 576
Join Date: Jul 2007
Location: North Georgia, USA
Device: A sweet PRS-500, DXG
|
I wouldn't worry about the duplicate files, just compress your hard drive image and write it out to a blue ray disk and you're good for at least a decade. Just keep about 5 years worth of reading material on your local hard drive(s) for your current reading requirements. Who knows what kind of memory density will be available in ten years, you may have several hundred terabytes local by 2010.
Last edited by oggelbe2007; 06-29-2010 at 07:12 PM. |
![]() |
![]() |
![]() |
#10 | |
Junior Member
![]() Posts: 2
Karma: 10
Join Date: Jul 2010
Device: none
|
Quote:
|
|
![]() |
![]() |
![]() |
#11 |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 2,552
Karma: 3799999
Join Date: Jun 2009
Location: Foristell, Missouri, USA
Device: Nokia N800, PRS-505, Nook STR Glowlight, Kindle 3, Kobo Libra 2
|
Those work by file size and other info. If the books are in different formats, they'll not be picked up as duplicates.
|
![]() |
![]() |
![]() |
#12 |
Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 3,085
Karma: 722357
Join Date: Feb 2010
Device: PRS-505
|
I'm suspicious of two people, with a single post each, no devices, no signs of other participation, suddenly showing up here to promote software.
|
![]() |
![]() |
![]() |
#13 |
Fully Converged
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 18,170
Karma: 14021202
Join Date: Oct 2002
Location: Switzerland
Device: Too many to count here.
|
|
![]() |
![]() |
![]() |
#14 | |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 2,552
Karma: 3799999
Join Date: Jun 2009
Location: Foristell, Missouri, USA
Device: Nokia N800, PRS-505, Nook STR Glowlight, Kindle 3, Kobo Libra 2
|
Quote:
|
|
![]() |
![]() |
![]() |
#15 |
Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 3,085
Karma: 722357
Join Date: Feb 2010
Device: PRS-505
|
|
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Duplicate files on SD card | drdman | Astak EZReader | 6 | 08-08-2010 07:03 PM |
Some basics - duplicate files, filenames | clintbradford | Kobo Reader | 3 | 07-11-2010 04:18 AM |
Duplicate books - multiple formats | mranlett | Calibre | 5 | 09-26-2009 07:02 AM |
Deleting duplicate collections | Gazman | Introduce Yourself | 3 | 01-25-2009 10:19 AM |
Duplicate database files | Zach | Reading and Management | 2 | 05-31-2005 05:47 AM |