backup

Moogwi · 08-03-2024, 04:38 PM

Hi,

My Calibre library size like 100 Go (75k of .epub)

but it takes too long to backup:

my config:

OS: Debian GNU/Linux 12 (bookworm) x86_64
Host: Mini IT13
Kernel: 6.9.12-1-liquorix-amd64
CPU: 13th Gen Intel i9-13900H (20) @ 3.001GHz
GPU: Intel Raptor Lake-P [Iris Xe Graphics]
Memory: 3346MiB / 31858MiB

I'm trying to backup on SSD NTFS

Sirtel · 08-03-2024, 04:57 PM

Export/Import is meant for data transfer between two computers, not for backup. For backup just copy both the library folder and the configuration folder, and paste them to your backup drive. Going forward, you can make incremental backups (updating only the files that have been changed) via FreeFileSync, using its mirror (one-way) option.

theducks · 08-03-2024, 05:02 PM

Calibre Export creates a custom Spanned Zip
100G is a huge amount of data to process and compress.

The old way was to manually backup the ENTIRE CONFIGURATION FOLDER and Library folder(s)
Export just keeps all the pieces together. Including multiple Libraries if Calibre is configured that way

Another common way is to use something like FreeFileSync IN MIRROR MODE ONLY
After the initial run, it does an incremental (just the changed pieces)

Sirtel · 08-03-2024, 05:04 PM

Given how many posts we've had here complaining about not being able to restore their libraries from the export/import files, I would not use that method for backup.

Moogwi · 08-03-2024, 05:27 PM

Quote:

Originally Posted by Sirtel

Export/Import is meant for data transfer between two computers, not for backup. For backup just copy both the library folder and the configuration folder, and paste them to your backup drive. Going forward, you can make incremental backups (updating only the files that have been changed) via FreeFileSync, using its mirror (one-way) option.

Thx !

Moogwi · 08-03-2024, 05:28 PM

Quote:

Originally Posted by Sirtel

Export/Import is meant for data transfer between two computers, not for backup. For backup just copy both the library folder and the configuration folder, and paste them to your backup drive. Going forward, you can make incremental backups (updating only the files that have been changed) via FreeFileSync, using its mirror (one-way) option.

Thank you for the tip

JSWolf · 08-03-2024, 05:43 PM

Quote:

Originally Posted by Moogwi

Hi,

My Calibre library size like 100 Go (75k of .epub)

but it takes too long to backup:

my config:

OS: Debian GNU/Linux 12 (bookworm) x86_64
Host: Mini IT13
Kernel: 6.9.12-1-liquorix-amd64
CPU: 13th Gen Intel i9-13900H (20) @ 3.001GHz
GPU: Intel Raptor Lake-P [Iris Xe Graphics]
Memory: 3346MiB / 31858MiB

I'm trying to backup on SSD NTFS

Use the program FreeFileSync to sync your backup. The first time It will take the full time to backup. But after that it will only backup what's new or changed since the last sync.

Also, you can delete the export files as you won't need them.

https://freefilesync.org/download.php

Moogwi · 08-03-2024, 06:36 PM

Quote:

Originally Posted by JSWolf

Use the program FreeFileSync to sync your backup. The first time It will take the full time to backup. But after that it will only backup what's new or changed since the last sync.

Also, you can delete the export files as you won't need them.

https://freefilesync.org/download.php

Thank you ! I appreciate ^^

BetterRed · 08-03-2024, 08:06 PM

Quote:

Originally Posted by theducks

The old way was to manually backup the ENTIRE CONFIGURATION FOLDER and Library folder(s)

I've been using file sync tools for data backup for almost 30 years, I switched to GoodSync in 2007. My calibre data (libraries, configuration, portable editions, etc) get backed up because of where they are, not because of what they are.

BR

Deskisamess · Today, 02:25 PM

Can someone clarify about the "configuration" folder? I don't seem to be able to find it.

Sirtel · Today, 02:40 PM

Quote:

Originally Posted by Deskisamess

Can someone clarify about the "configuration" folder? I don't seem to be able to find it.

On Windows, it's usually in User/AppData/Roaming - the entire folder named calibre. If you're not on Windows, click Preferences -> Miscellaneous -> Open calibre configuration folder, to see where it is.

Deskisamess · Today, 02:54 PM

Thanks, found it. There is also a "Calibre-ebook.com" folder.

I needed a current backup of my books, and in the past used the Export option.

My use of Windows file structure is very rusty, and it seems more difficult than it was in the past.

Sirtel · Today, 03:04 PM

Quote:

Originally Posted by Deskisamess

Thanks, found it. There is also a "Calibre-ebook.com" folder.

I needed a current backup of my books, and in the past used the Export option.

My use of Windows file structure is very rusty, and it seems more difficult than it was in the past.

The config folder is the one named calibre. I don't know what the other one is, something to do with the viewer when used separately, perhaps?

08-03-2024, 04:38 PM	#1
Moogwi Junior Member Posts: 7 Karma: 10 Join Date: Sep 2023 Device: Kobo Libra H2O	backup Hi, My Calibre library size like 100 Go (75k of .epub) but it takes too long to backup: my config: OS: Debian GNU/Linux 12 (bookworm) x86_64 Host: Mini IT13 Kernel: 6.9.12-1-liquorix-amd64 CPU: 13th Gen Intel i9-13900H (20) @ 3.001GHz GPU: Intel Raptor Lake-P [Iris Xe Graphics] Memory: 3346MiB / 31858MiB I'm trying to backup on SSD NTFS

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
How and what to backup	HibDelyatt	Calibre	7	12-18-2021 08:30 AM
Not enough space to export/backup library. How to do partial backup?	droopy	Calibre	68	02-10-2021 03:00 AM
How do I backup CC?	HarryT	Calibre Companion	3	07-07-2014 10:55 AM
Backup	transmitthis	Calibre	2	02-11-2012 01:22 PM
Backup - how???	vxf	Sony Reader	0	06-23-2010 11:22 AM

08-03-2024, 04:57 PM	#2
Sirtel Grand Sorcerer Posts: 10,953 Karma: 226946844 Join Date: Jan 2014 Location: Estonia Device: Kobo Sage & Libra 2	Export/Import is meant for data transfer between two computers, not for backup. For backup just copy both the library folder and the configuration folder, and paste them to your backup drive. Going forward, you can make incremental backups (updating only the files that have been changed) via FreeFileSync, using its mirror (one-way) option.

08-03-2024, 05:02 PM	#3
theducks Well trained by Cats Posts: 30,247 Karma: 57979022 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Calibre Export creates a custom Spanned Zip 100G is a huge amount of data to process and compress. The old way was to manually backup the ENTIRE CONFIGURATION FOLDER and Library folder(s) Export just keeps all the pieces together. Including multiple Libraries if Calibre is configured that way Another common way is to use something like FreeFileSync IN MIRROR MODE ONLY After the initial run, it does an incremental (just the changed pieces)

08-03-2024, 05:04 PM	#4
Sirtel Grand Sorcerer Posts: 10,953 Karma: 226946844 Join Date: Jan 2014 Location: Estonia Device: Kobo Sage & Libra 2	Given how many posts we've had here complaining about not being able to restore their libraries from the export/import files, I would not use that method for backup.

Today, 02:25 PM	#10
Deskisamess Wizard Posts: 2,654 Karma: 43070209 Join Date: Sep 2012 Location: Ohio Device: iPhone 7+, iPad mini, 2021 iPad Pro 12.9",Paperwhite 6.8"	Can someone clarify about the "configuration" folder? I don't seem to be able to find it.

Today, 02:54 PM	#12
Deskisamess Wizard Posts: 2,654 Karma: 43070209 Join Date: Sep 2012 Location: Ohio Device: iPhone 7+, iPad mini, 2021 iPad Pro 12.9",Paperwhite 6.8"	Thanks, found it. There is also a "Calibre-ebook.com" folder. I needed a current backup of my books, and in the past used the Export option. My use of Windows file structure is very rusty, and it seems more difficult than it was in the past.

Advert

Advert