[GUI Plugin] FanFictionDownLoader

[ClairePMR]

Thank you once again! Love the new Cover options.

[JimmXinu]

Testing support for a new site:

"The WWOMB" http://www.squidge.org/peja/cgi-bin/index.php

This is a bit different than others--there's several unrelated areas under the domain squidge.org. This is support only for stories in the eFiction instance under squidge.org/peja.

This necessitated some changes to the internals and will require more if we ever want to add support for additional sites under squidge.org.

Let me know what you think.

[anesthezea]

I got an email this morning from the mod of the 852 Prospect Archive (I'm a member of the TS mailing list) and it seems there are plans in place to move the entire archive over to Archive of Our Own. I'm not sure when this will take place, but I'm looking forward to it!

I thought I'd pass word along since 852 is on your list of possible sites to include in future.

[JimmXinu]

Thanks! I've made a notation to the list.

[bb63]

hi all. i'm very new to calibre and to the plug in concept!

love all the work you guys do here!!!

are there any plans to add live journal to this?

[JimmXinu]

@bb63 - Glad you like it.

As for live journal, nope. From what I've seen it really isn't meant to be a story system. But if you can give me several URLs to live journal stories, I might reconsider it.

There are other tools available. Another user said: "...Squeebook.net is an online tool that grabs/formats stories from livejournal/dreamwidth journals." The GrabMyBooks FireFox plugin is another possibility.

[Firedancer885]

Hi,

I just found the plugin but fell in love with it already. I have a support question/request.
I downloaded a great deal of stories from fanfiction net via the deffnetizer program or the ficsavers.com website. Both of those put the story url at the beginning of the story text in id:xxxxxxx link format. Is there a way to make the "get URLs from selected books" option recognize those links as "url:" identifiers? I don't want to troll through all of my nearly 150 epubs for those urls.

[JimmXinu]

@Firedancer885 - Hmm. Not a bad idea. Can you provide a (preferably smallish) example of each?

[Firedancer885]

Originally Posted by JimmXinu

@Firedancer885 - Hmm. Not a bad idea. Can you provide a (preferably smallish) example of each?

Ok, I've run into a snag. I thought the ficsavers.com site uses the same template as the deffnetizer program but it doesn't. The ficsavers.com template uses a botched up url It's "story name" by "author", and the story name is the link to the story. Only some slashes are missing along with the chapter number

Harrowed uses the id:xxxxxxx template, The Leap uses "story name" by "author". I'd be thankful for any help.

ps: And then I realize not all of the ficsavers.com stories have botched up urls. Sorry

[JimmXinu]

I've looked at deffnetizer and ficsavers.com a bit. Neither outputs epub directly, so apparently you've already converted from html to epub.

The deffnetizer epub you posted does contain a proper story URL, but that depends on the output template used. The first two templates I tried, "Default Template" and "Minimal" do not include the story URL anywhere.

The ficsaver.com epub you posted, as you say, contains a broken version of the story URL. Although it looks like that may only be a problem with ffnet stories.

All told:

• The user would have to have converted the story to epub;
• Then the plugin would have to scan at least the first three html files (cover page, ToC/splash page and first real page) for URLs, while;
• Checking for both valid story URLs and at least one form of broken URL;
• And even then, it wouldn't work for half of the included deffnetizer output templates.

So, while possible, it would be a bit of a pain and not work all the time anyway. At this point, I'll add it to the 'wishlist' of features I might add some day, but it's not going to be a priority.

[Firedancer885]

Thank you. I used the template called "SimpleTemplate" for deffnetizer.

[JimmXinu]

v1.5.20 posted with new sites:
(1.5.19 skipped)

• www.libraryofmoria.com by Ida
• www.wraithbait.com by Ida
• www.squidge.org/peja (WWOMB) by Jim (This does not support other sections of www.squidge.org, or the other files under www.squidge.org/peja that aren't in the Fiction instance.)

As usual, there may be a delay before calibre notices the new version. You can get the latest by going in and telling calibre to install it again.

Jim

[Firedancer885]

Hi,

I need some help again. I always reconvert the epubs I download from Twisting the Hellmouth to put my calibre generated covers into them. The problem is, the "update existing fanfiction book(s)" option gives a "no story url found" error after the conversion. Can you help me? The url is always included at the beginning of the text in "downloaded from: http://www.tthfanfic.org/Story-xxxxx" format.
And the get urls from selected books option gives a no url found in selected books error.

[iatheia]

@Firedancer885, when did you download those particular stories?

[JimmXinu]

Apparently, calibre epub->epub conversion discards the <dc:source> tag that FFDL expects to hold the URL.

(That strikes me as a bug in Convert, but there may be some reason for it, such as the fact other formats don't have it and the conversion process is very generalized.)

FFDL doesn't currently look inside the html files for the URLs. I've been a bit reluctant to do that, because, depending on the epub and where it came from, it could contain URLs to *other* stories, not itself. But I'll consider it.

Ida--I think Firedancer885 is talking about epubs downloaded directly from tth.