[FanFicFare] Metadata Management for Fanfiction - Page 2

Amalthia · 05-23-2023, 04:17 PM

Hello, with more author's restricting their work / archive locking is anyone else here experiencing the problem where "genre" or "additional tags" information isn't downloaded into Calibre through FanFicFare?

Thanks,
Amalthia

ownedbycats · 05-23-2023, 05:14 PM

Do they appear on the title page of the fic, at least?

Amalthia · 05-23-2023, 05:18 PM

Quote:

Originally Posted by ownedbycats

Do they appear on the title page of the fic, at least?

Sadly, no. Everything else is on the title page, but not "additional tags/genre" I'm officially baffled.

ownedbycats · 05-23-2023, 05:19 PM

Is the long-text metadata column enabled? I would check whether they're present there. If they aren't that indicates a failure in getting them from the site.

Amalthia · 05-23-2023, 05:30 PM

Quote:

Originally Posted by ownedbycats

Is the long-text metadata column enabled? I would check whether they're present there. If they aren't that indicates a failure in getting them from the site.

I'm not sure if it's enabled, where would I go to check? I did review the "genre" custom column and I don't see that as an option to select there.

I would assume it was enabled because the "genre" information is downloaded for non-restricted stories into a custom column and on the title page of the stories. It's just not working for restricted fics.

ownedbycats · 05-23-2023, 05:40 PM

Custom Columns tab, at the bottom is 'saved metadata column.' It needs to be a long-text column.

Click image for larger version

Name: 2023-05-23 17_40_07-Customize FanFicFare.png
Views: 770
Size: 44.9 KB
ID: 201658

If column needs to be made, I suggest setting it to plain-text.

Amalthia · 05-23-2023, 06:17 PM

Quote:

Originally Posted by ownedbycats

Custom Columns tab, at the bottom is 'saved metadata column.' It needs to be a long-text column.

Attachment 201658

If column needs to be made, I suggest setting it to plain-text.

I don't have this column in my custom columns or have anything selected in the "Saved Metadata" field of FFF custom columns. I'll try your suggestion and let you know if it worked.

Thanks,
Amalthia

ownedbycats · 05-23-2023, 06:19 PM

If the tags don't appear in it, suggest posting in the FFF thread (or github) with a link to the story so Jim can investigate.

If they do appear, it's more indicative of a configuration issue resulting in them getting filtered out. in/exclude_metadata and replace_metadata with screwed up regexes, for instance.

Amalthia · 05-23-2023, 06:30 PM

Quote:

Originally Posted by ownedbycats

If the tags don't appear in it, suggest posting in the FFF thread (or github) with a link to the story so Jim can investigate.

If they do appear, it's more indicative of a configuration issue resulting in them getting filtered out. in/exclude_metadata and replace_metadata with screwed up regexes, for instance.

Okay I tried it and for the non-restricted stories my "Genre / Additional Tags" information is download and populates the "Saved Metadata" column. It did not work for any story that is restricted access.

I tried asking Jim for help but he says it should work, that's why I was trying to find out from other people if it's actually working or not.

Here is the story I tried: https://archiveofourown.org/works/34105225

ownedbycats · 05-23-2023, 06:41 PM

In that case, report it. If it's not showing up in saved metadata it's not being scraped.

I had this typed out and decided to post it even though not useful for your case.

For trying to figure out tricky config issues, my suggestion is a bit tedious but it does help the few times I've done it. Create a new library (just call it 'Test'). Don't use the 'copy library structure' as that also copies personal.ini.

Create a few basic columns. Also I'd set the username/pass in personal.ini just to make things less tedious. Once you confirm that it's working on a (mostly) clean config, start copying things over. I would start with replace_metadata and in/exclude_metadata.

Once you figure out which part broke it, comment out all its lines with ## and then uncomment them one at a time until it breaks again.

Also note that occasionally interactions between two different lines can break things - extraneous spaces (after removal of '(Video Game)' or something) resulting in failed matches is one I occasionally bump into.

Amalthia · 05-23-2023, 06:46 PM

Quote:

Originally Posted by ownedbycats

For trying to figure out tricky config issues, my suggestion is a bit tedious but it does help the few times I've done it. Create a new library (just call it 'Test'). Don't use the 'copy library structure' as that also copies personal.ini.

Create a few basic columns. Also I'd set the username/pass in personal.ini just to make things less tedious. Once you confirm that it's working on a (mostly) clean config, start copying things over. I would start with replace_metadata and in/exclude_metadata.

Once you figure out which part broke it, comment out all its lines with ## and then uncomment them one at a time until it breaks again.

Also note that occasionally interactions between two different lines can break things - extraneous spaces (after removal of '(Video Game)' or something) resulting in failed matches is one I occasionally bump into.

Sadly I've already done that without success. To be clear, you are getting "genre / additional tags" information in your Calibre for restricted stories?

Thanks,
Amalthia

ownedbycats · 05-23-2023, 06:47 PM

Sorry - I forgot to mention I had the 'config troubleshooting' bit typed out in advance and posted it despite its not-helpfulness in this case.

If it's failing to show in saved metadata, I'd report it as it's failing to scrape from site.

AO3 recently made some anti-bot measures so that may be interfering.

ownedbycats · 05-23-2023, 06:55 PM

I had to look through my library a bit for a login-restricted story. What I got in saved metadata column matches what I had before.

Amalthia · 05-23-2023, 07:09 PM

Going back a few years none of the restricted stories have "genre" information populating the genre column. I don't think this is a recent change to AO3. That's why i was trying to find out from other people if it's just my Calibre or if it's a AO3 or FFF problem.

Amalthia · 05-23-2023, 07:11 PM

I think what is most frustrating is I'm using the same settings as everyone else and the "genre" works for non-restricted stories but as soon as it's restricted the "genre" metadata download fails. All the other metadata comes through though...hence I'm completely baffled. It would make more sense if "characters," "relationships," "collections," and "warnings" would all fail to download, but it's just "genre."

05-23-2023, 05:40 PM	#21
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Custom Columns tab, at the bottom is 'saved metadata column.' It needs to be a long-text column. If column needs to be made, I suggest setting it to plain-text.

05-23-2023, 06:41 PM	#25
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	In that case, report it. If it's not showing up in saved metadata it's not being scraped. I had this typed out and decided to post it even though not useful for your case. For trying to figure out tricky config issues, my suggestion is a bit tedious but it does help the few times I've done it. Create a new library (just call it 'Test'). Don't use the 'copy library structure' as that also copies personal.ini. Create a few basic columns. Also I'd set the username/pass in personal.ini just to make things less tedious. Once you confirm that it's working on a (mostly) clean config, start copying things over. I would start with replace_metadata and in/exclude_metadata. Once you figure out which part broke it, comment out all its lines with ## and then uncomment them one at a time until it breaks again. Also note that occasionally interactions between two different lines can break things - extraneous spaces (after removal of '(Video Game)' or something) resulting in failed matches is one I occasionally bump into. Last edited by ownedbycats; 05-23-2023 at 06:46 PM.

05-23-2023, 06:47 PM	#27
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Sorry - I forgot to mention I had the 'config troubleshooting' bit typed out in advance and posted it despite its not-helpfulness in this case. If it's failing to show in saved metadata, I'd report it as it's failing to scrape from site. AO3 recently made some anti-bot measures so that may be interfering. Last edited by ownedbycats; 05-23-2023 at 06:51 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Library management issues after editing metadata	dra	Library Management	26	04-11-2020 06:10 PM
Best strategy for metadata management for Kobo using Calibre?	ceridwen	Kobo Developer's Corner	16	05-13-2019 03:51 AM
Will automatic metadata management also transfer updated cover images to device?	TheSacredSoul	Library Management	2	01-11-2013 07:05 AM
Metadata Management on Android not working?	TheStretchedElf	Devices	0	08-08-2012 10:10 AM
Automatic Metadata Management	gxxshock	Calibre	2	12-28-2008 01:48 PM

05-23-2023, 04:17 PM	#16
Amalthia Wizard Posts: 1,173 Karma: 32196 Join Date: Jan 2007 Location: Anchorage, AK Device: Sony Reader PRS-505, PRS-650, PRS-T3, Pocketbook HD2	Hello, with more author's restricting their work / archive locking is anyone else here experiencing the problem where "genre" or "additional tags" information isn't downloaded into Calibre through FanFicFare? Thanks, Amalthia

05-23-2023, 05:14 PM	#17
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Do they appear on the title page of the fic, at least?

05-23-2023, 05:19 PM	#19
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Is the long-text metadata column enabled? I would check whether they're present there. If they aren't that indicates a failure in getting them from the site.

05-23-2023, 06:19 PM	#23
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	If the tags don't appear in it, suggest posting in the FFF thread (or github) with a link to the story so Jim can investigate. If they do appear, it's more indicative of a configuration issue resulting in them getting filtered out. in/exclude_metadata and replace_metadata with screwed up regexes, for instance.

05-23-2023, 06:55 PM	#28
ownedbycats Custom User Title Posts: 9,884 Karma: 68367739 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	I had to look through my library a bit for a login-restricted story. What I got in saved metadata column matches what I had before.

05-23-2023, 07:09 PM	#29
Amalthia Wizard Posts: 1,173 Karma: 32196 Join Date: Jan 2007 Location: Anchorage, AK Device: Sony Reader PRS-505, PRS-650, PRS-T3, Pocketbook HD2	Going back a few years none of the restricted stories have "genre" information populating the genre column. I don't think this is a recent change to AO3. That's why i was trying to find out from other people if it's just my Calibre or if it's a AO3 or FFF problem.

05-23-2023, 07:11 PM	#30
Amalthia Wizard Posts: 1,173 Karma: 32196 Join Date: Jan 2007 Location: Anchorage, AK Device: Sony Reader PRS-505, PRS-650, PRS-T3, Pocketbook HD2	I think what is most frustrating is I'm using the same settings as everyone else and the "genre" works for non-restricted stories but as soon as it's restricted the "genre" metadata download fails. All the other metadata comes through though...hence I'm completely baffled. It would make more sense if "characters," "relationships," "collections," and "warnings" would all fail to download, but it's just "genre."

Advert

Advert