Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 06-12-2024, 02:00 PM   #9676
John Maverick
Connoisseur
John Maverick began at the beginning.
 
Posts: 53
Karma: 10
Join Date: Oct 2018
Device: none
Quote:
Originally Posted by JimmXinu View Post
FFF used to use the story URL without title for scribblehub, the title was added to the canonical story URL four years ago, when somebody asked for chapter titles to be accepted. I don't remember if that was also requested, but it is something that was requested for other sites around the same time.
I think I was one of those that asked for FFF accepting chapter URLs from scribblehub so I can update stories from my email.

Quote:
Originally Posted by JimmXinu View Post
FFF has special code for finding ffnet story URLs regardless of title in the URL. I'm not really keen on trying to make it more universal.
I was hoping that the URL normalization was more easy to fix here.

I'm not in front of my PC now, but I think that with the function of getting URLs from email there is an option to ignore those of stories that aren't in the library.

I can pass the "Get URLs from Email" the first time to get only the stories already in the library. And after checking the emails not read if those are not of stories already in the library. Then get the emails checked by disable that option. Or add them manually if those are few.

I can do that to avoid what happened 2 days ago of downloading a whole story of 553 chapters that was already in may library and only needed do be updated with the last two.

A bit of a shame because I can't do things like sending myself a email with stories to download if I'm reading out of my house. Not is easy as before, but at least is usable.

Thanks for checking this JimmXinu
John Maverick is offline   Reply With Quote
Old 06-12-2024, 03:41 PM   #9677
MorbPtact
Junior Member
MorbPtact began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jun 2024
Device: kindle
Quote:
That output looks more than a little weird. It looks like trying to update the plugin, not trying to run the plugin. If it is, you might try downloading the plugin manually from the first post of the thread and installing it directly (Calibre Preferences > Plugins > Load Plugin from file button).

What OS are you on? And are you using the official Calibre release?
I'm on windows 11, with the official release, and that's the text that pops up when I press download new plugins. I was just using it as an example; I don't need to download the plugin as I already have it.

My main question was about using
[overrides]
[www.royalroad.com]
use_ssl_unverified_context:true

and if I wrote it correctly (I don't really understand how personal.ini is supposed to be used), and if so, why doesn't it work

Thanks again
Morb
MorbPtact is offline   Reply With Quote
Old 06-12-2024, 07:21 PM   #9678
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
Quote:
Originally Posted by MorbPtact View Post
I'm on windows 11, with the official release, and that's the text that pops up when I press download new plugins. I was just using it as an example; I don't need to download the plugin as I already have it.
Okay, but if you're having troubles with that, your Calibre may be broken in some fundamental way I can't help you address.

Quote:
Originally Posted by MorbPtact View Post
My main question was about using

and if I wrote it correctly (I don't really understand how personal.ini is supposed to be used), and if so, why doesn't it work
In this example:
Code:
[overrides]
[www.royalroad.com]
use_ssl_unverified_context:true
The [overrides] section doesn't do anything because there are no lines in it before the [www.royalroad.com] section starts. It's not a modifier. See wiki page about personal.ini.

Other than that, I don't see anything wrong. Technically, the use_ssl_unverified_context setting isn't really recommended for long term use--it's more intended for temporary use when sites forget to renew certs, things like that. It's not officially supported.

I'd need to see a debug log of your failure to tell anything further. 'Restart in debug mode' is under Calibre Preferences dropdown.
JimmXinu is offline   Reply With Quote
Old 06-13-2024, 03:05 PM   #9679
MorbPtact
Junior Member
MorbPtact began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jun 2024
Device: kindle
Apparently this is windows 10, my bad
Here's the log without adding use_ssl_unverified_context:
Spoiler:


ApplicationPaletteChange event ignored
Using calibre Qt style: True
ApplicationPaletteChange event received
FFF: DEBUG: 2024-06-13 20:59:48,113: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\ezril\AppData\Roaming\calibre\p lugins\fanficfare_macmenuhack.txt
calibre Debug log
calibre 7.12 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: FanFicFare (4, 35, 0)
calibre 7.12 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: FanFicFare (4, 35, 0)
QPA platform: windows
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 100.86162790697674 x 101.07357512953367
[0.00] Starting up...
[0.01] Initializing db...
[0.03] db initialized
[0.03] Constructing main UI...
[0.80] GUI main window shown
[0.83] main UI initialized...
[0.83] Started up in 0.83 seconds with 248 books
Failed to check for plugin update: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)
FFF: DEBUG: 2024-06-13 21:00:09,479: calibre_plugins.fanficfare_plugin.fff_plugin(1151) : FanFicFare v4.35.0
FFF: DEBUG: 2024-06-13 21:00:09,580: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-06-13 21:00:09,580: configurable.py(1100): use_basic_cache:true
FFF: DEBUG: 2024-06-13 21:00:09,580: adapter_royalroadcom.py(161): URL: https://www.royalroad.com/fiction/55687
FFF: DEBUG: 2024-06-13 21:00:09,580: cache_basic.py(116):
========== MISS (GET) BasicCache
https://www.royalroad.com/fiction/55687
FFF: DEBUG: 2024-06-13 21:00:09,580: fetcher_requests.py(114):
---------- REQ (GET) RequestsFetcher
https://www.royalroad.com/fiction/55687
FFF: ERROR: 2024-06-13 21:00:09,863: calibre_plugins.fanficfare_plugin.dialogs(726): Exception: {'title': 'All The Skills - A Deckbuilding LitRPG', 'author_sort': 'HonourRae', 'author': ['HonourRae'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 10, 'begin': None, 'end': None, 'comment': "HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')))", 'url': 'https://www.royalroad.com/fiction/55687', 'site': 'www.royalroad.com', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'www.royalroad.com', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:HTTPSConnectionPool(host='www.royalroad .com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')))
Traceback (most recent call last):
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 699, in urlopen
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 382, in _make_request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 1010, in _validate_conn
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connection.py", line 411, in connect
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\ssl_.py", line 449, in ssl_wrap_socket
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\ssl_.py", line 493, in _ssl_wrap_socket_impl
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\adapters.py", line 439, in send
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 755, in urlopen
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\retry.py", line 574, in increment
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 713, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1357, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1237, in get_story_metadata_only
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_royalroad com.py", line 163, in extractChapterUrlsAndMetadata
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\requestable.py", line 119, in get_request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\requestable.py", line 111, in get_request_redirected
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\base_fetcher.py", line 133, in get_request_redirected
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\cache_basic.py", line 122, in fetcher_do_request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\decorators.py", line 102, in fetcher_do_request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\base_fetcher.py", line 106, in do_request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\fetcher_requests. py", line 121, in request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\sessions.py", line 542, in request
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\sessions.py", line 655, in send
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\adapters.py", line 514, in send
requests.exceptions.SSLError: HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')))

And here is the log with it:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
ApplicationPaletteChange event received
FFF: DEBUG: 2024-06-13 21:03:59,389: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\ezril\AppData\Roaming\calibre\p lugins\fanficfare_macmenuhack.txt
calibre Debug log
calibre 7.12 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: FanFicFare (4, 35, 0)
calibre 7.12 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: FanFicFare (4, 35, 0)
QPA platform: windows
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 100.86162790697674 x 101.07357512953367
[0.00] Starting up...
[0.02] Initializing db...
[0.03] db initialized
[0.03] Constructing main UI...
[0.77] GUI main window shown
[0.83] main UI initialized...
[0.83] Started up in 0.83 seconds with 248 books
Failed to check for plugin update: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006)
FFF: DEBUG: 2024-06-13 21:04:05,764: calibre_plugins.fanficfare_plugin.fff_plugin(1151) : FanFicFare v4.35.0
FFF: DEBUG: 2024-06-13 21:04:05,865: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-06-13 21:04:05,865: configurable.py(1100): use_basic_cache:true
FFF: DEBUG: 2024-06-13 21:04:05,865: adapter_royalroadcom.py(161): URL: https://www.royalroad.com/fiction/55687
FFF: DEBUG: 2024-06-13 21:04:05,865: cache_basic.py(116):
========== MISS (GET) BasicCache
https://www.royalroad.com/fiction/55687
FFF: DEBUG: 2024-06-13 21:04:05,865: fetcher_requests.py(114):
---------- REQ (GET) RequestsFetcher
https://www.royalroad.com/fiction/55687
C:\Users\ezril\AppData\Roaming\calibre\plugins\Fan FicFare.zip\urllib3\connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.royalroad.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1....l#ssl-warnings
FFF: DEBUG: 2024-06-13 21:04:05,941: fetcher_requests.py(127): response code:200
FFF: DEBUG: 2024-06-13 21:04:05,941: decorators.py(112): fromcache:False
FFF: DEBUG: 2024-06-13 21:04:05,941: requestable.py(55): Encoding:utf8
FFF: ERROR: 2024-06-13 21:04:05,945: calibre_plugins.fanficfare_plugin.dialogs(726): Exception: {'title': 'All The Skills - A Deckbuilding LitRPG', 'author_sort': 'HonourRae', 'author': ['HonourRae'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 10, 'begin': None, 'end': None, 'comment': "'NoneType' object has no attribute 'text'", 'url': 'https://www.royalroad.com/fiction/55687', 'site': 'www.royalroad.com', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'www.royalroad.com', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:'NoneType' object has no attribute 'text'
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 713, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1357, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1237, in get_story_metadata_only
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata
File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_royalroad com.py", line 175, in extractChapterUrlsAndMetadata
AttributeError: 'NoneType' object has no attribute 'text'

Last edited by theducks; 06-13-2024 at 05:46 PM. Reason: SPOILER LOG files
MorbPtact is offline   Reply With Quote
Old 06-13-2024, 03:15 PM   #9680
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
Quote:
Originally Posted by MorbPtact View Post
Apparently this is windows 10, my bad
Here's the log without adding use_ssl_unverified_context:
Even with use_ssl_unverified_context you are apparently not getting a valid story page. FFF is failing to find the story title.

I checked and royalroad's SSL cert comes back valid for me. Considering you are getting reports of an invalid self-signed cert first, it looks like you may have a network proxy or even a man-in-the-middle malware situation.

We've seen SSL with FFF fail before with intrusive network proxy servers. Some people have had better success using a VPN.

You might try using FFF's Proxy Feature or Browser Cache Feature. However, I don't recall ever trying them with royalroad.

FYI, wrapping logs with [code] tags helps readability. And long logs with [spoiler] for people on mobile.
JimmXinu is offline   Reply With Quote
Old 06-15-2024, 03:53 PM   #9681
MorbPtact
Junior Member
MorbPtact began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jun 2024
Device: kindle
Thanks again for all of the help, and sorry for the long block of text
MorbPtact is offline   Reply With Quote
Old 06-21-2024, 10:16 PM   #9682
Elaine T
Enthusiast
Elaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolateElaine T is generous with chocolate
 
Posts: 39
Karma: 33664
Join Date: Jun 2015
Device: kindle paperwhite
Images disappear on downloading updates?

My kid who uses fanficfare a lot has been grumbling recently about the hoops necessary to put images back, or keep them from disappearing when an illustrated story (usually on Ao3, if that matters) updates.

The vanishing images are always ones linked within the story from outside sites, that the kid has manually fiddled with to get them to show up as desired.

There are also images that were not embedded but that the kid has embedded after downloading the files, and they disappear. This is annoying.

I've read through the personal.ini file, which seems the most likely place to find such a setting, and haven't found a way to tell it not to touch images in the existing file, just update text.

IS there such a setting?

I'd appreciate any pointers. Thanks
Elaine T is offline   Reply With Quote
Old 06-21-2024, 10:52 PM   #9683
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 9,537
Karma: 64960939
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
That shouldn't be happening, at least for the ones downloaded by FFF itself.

Years ago, there was a bug where updating would unintentionally delete image files. I wonder if that's recurred?
ownedbycats is offline   Reply With Quote
Old 06-22-2024, 12:35 AM   #9684
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
I do generally say that FFF doesn't change manually edited chapters, but that isn't entirely true.

There are a number of FFF's HTML processing steps that are applied to updated chapters, including image processing.

Image files included in FFF epubs are given normalized names, ffdl-0.jpg, ffdl-1.jpg, etc. We can't trust the original image names to be unique or reasonable length.

In order to recognize duplicate images, FFF records the image's original URL in the 'longdesc' attribute, eg: <img longdesc="origurl" ...> longdesc is a recognized, but little used attribute to make epub checkers happy.

Long story short, if an img tag is found on epub update without a longdesc attribute, FFF declares it a failed download and discards it. I'm reluctant to change that.

Searching the thread for longdesc, this past post seems the most helpful.
Quote:
Originally Posted by JimmXinu View Post
...
Put the <img> tags in the chapter text with src attr pointing to the URL of the image on disk (or where ever) and then run an FFF Update Always (if there aren't new chapters) and FFF will process it as if the author had put it in.

Your custom image will be 'downloaded', mapped to an ffdl-# name and included in the epub.
In fact, it should be easier for Elaine T's kid because they only need to change/copy the links to img tags and don't need to download and embedded the images.
JimmXinu is offline   Reply With Quote
Old 06-22-2024, 07:27 AM   #9685
Da Man
Enthusiast
Da Man began at the beginning.
 
Posts: 27
Karma: 10
Join Date: Jun 2018
Device: none
Once again a problem with FFN. I always get the error 'NoneType' object is not subscriptable.

Here's the debug file.
Spoiler:
Code:
ApplicationPaletteChange event ignored
Using calibre Qt style: True
EpubMerge: DEBUG: 2024-06-22 12:07:08,694: calibre_plugins.epubmerge.epubmerge_plugin(156): macmenuhack file_path:/home/chr/.config/calibre/plugins/fanficfare_macmenuhack.txt
FFF: DEBUG: 2024-06-22 12:07:08,698: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:/home/chr/.config/calibre/plugins/fanficfare_macmenuhack.txt
calibre Fehlerdiagnoseprotokoll
calibre 7.12  embedded-python: True
Linux-6.5.0-41-generic-x86_64-with-glibc2.38 Linux ('64bit', 'ELF')
('Linux', '6.5.0-41-generic', '#41-Ubuntu SMP PREEMPT_DYNAMIC Mon May 20 15:55:15 UTC 2024')
Python 3.11.5
Interface language: de
EXE path: /opt/calibre/bin/calibre-debug
Successfully initialized third party plugins: EpubMerge (2, 18, 0) && FanFicFare (4, 35, 5) && Find Duplicates (1, 10, 9) && Reading List (1, 15, 4)
calibre 7.12  embedded-python: True
Linux-6.5.0-41-generic-x86_64-with-glibc2.38 Linux ('64bit', 'ELF')
('Linux', '6.5.0-41-generic', '#41-Ubuntu SMP PREEMPT_DYNAMIC Mon May 20 15:55:15 UTC 2024')
Python 3.11.5
Interface language: de
EXE path: /opt/calibre/bin/calibre-debug
Successfully initialized third party plugins: EpubMerge (2, 18, 0) && FanFicFare (4, 35, 5) && Find Duplicates (1, 10, 9) && Reading List (1, 15, 4)
QPA platform: xcb
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 127.66492146596858 x 127.59069767441859
[0.00] Starting up...
[0.00] Showing splash screen...
[0.04] splash screen shown
[0.04] Initializing db...
[0.51] db initialized
[0.51] Constructing main UI...
[1.61] GUI main window shown
[1.67] main UI initialized...
[1.67] Hiding splash screen
FFF: DEBUG: 2024-06-22 12:07:41,253: calibre_plugins.fanficfare_plugin.fff_plugin(1151): FanFicFare v4.35.5
FFF: INFO: 2024-06-22 12:07:41,364: calibre_plugins.fanficfare_plugin.prefs(216): Using default settings
FFF: DEBUG: 2024-06-22 12:07:41,371: story.py(749): use_flaresolverr_proxy:true
FFF: DEBUG: 2024-06-22 12:07:41,374: configurable.py(1055): use_flaresolverr_proxy:true
FFF: WARNING: 2024-06-22 12:07:41,374: configurable.py(1059): FlareSolverr v2+ doesn't work with images: include_images automatically set false
FFF: WARNING: 2024-06-22 12:07:41,374: configurable.py(1060): Set use_flaresolverr_proxy:withimages if your are using FlareSolver v1 and want images
FFF: WARNING: 2024-06-22 12:07:41,374: configurable.py(1061): Set use_flaresolverr_proxy:directimages to download images directly while using FlareSolver
FFF: DEBUG: 2024-06-22 12:07:41,374: fetcher_flaresolverr_proxy.py(42): using FlareSolverr_ProxyFetcher
FFF: DEBUG: 2024-06-22 12:07:41,374: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-06-22 12:07:41,374: configurable.py(1100): use_basic_cache:true
FFF: DEBUG: 2024-06-22 12:07:41,375: adapter_fanfictionnet.py(111): URL: https://www.fanfiction.net/s/14283911/1/The-Will-of-the-Force
FFF: DEBUG: 2024-06-22 12:07:41,375: cache_basic.py(116): 
========== MISS (GET) BasicCache
https://www.fanfiction.net/s/14283911/1/The-Will-of-the-Force
FFF: DEBUG: 2024-06-22 12:07:41,375: fetcher_flaresolverr_proxy.py(101): 
---------- REQ (GET) FlareSolverr_ProxyFetcher
https://www.fanfiction.net/s/14283911/1/The-Will-of-the-Force
FFF: DEBUG: 2024-06-22 12:07:41,375: fetcher_flaresolverr_proxy.py(182): url:https://www.fanfiction.net/s/14283911/1/The-Will-of-the-Force
FFF: DEBUG: 2024-06-22 12:07:41,375: fetcher_requests.py(114): 
---------- REQ (POST) RequestsFetcher
http://localhost:8191/v1
FFF: DEBUG: 2024-06-22 12:07:50,153: fetcher_requests.py(127): response code:200
FFF: DEBUG: 2024-06-22 12:07:50,153: fetcher_flaresolverr_proxy.py(123): response code:200
FFF: DEBUG: 2024-06-22 12:07:50,153: decorators.py(112): fromcache:False
FFF: DEBUG: 2024-06-22 12:07:50,153: decorators.py(123): random sleep(33.00-99.00):62.39
FFF: ERROR: 2024-06-22 12:08:52,549: calibre_plugins.fanficfare_plugin.dialogs(726): Exception: {'title': 'The Will of the Force', 'author_sort': 'DeathRanger', 'author': ['DeathRanger'], 'comments': '', 'good': False, 'status': 'Fehler', 'showerror': True, 'calibre_id': 17951, 'begin': None, 'end': None, 'comment': "'NoneType' object is not subscriptable", 'url': 'https://www.fanfiction.net/s/14283911/1/The-Will-of-the-Force', 'site': 'www.fanfiction.net', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'www.fanfiction.net', 'listorder': 0, 'collision': 'EPUB aktualisieren, wenn neue Kapitel vorhanden sind'}:'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.dialogs", line 713, in do_loop
    self.foreach_function(book)
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1357, in prep_download_loop
    story = self.get_story_metadata_only(adapter)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1237, in get_story_metadata_only
    adapter.getStoryMetadataOnly(get_cover=False)
  File "/home/chr/.config/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 325, in getStoryMetadataOnly
    self.doExtractChapterUrlsAndMetadata(get_cover=get_cover)
  File "/home/chr/.config/calibre/plugins/FanFicFare.zip/fanficfare/adapters/adapter_fanfictionnet.py", line 129, in doExtractChapterUrlsAndMetadata
    canonicalurl = soup.select_one('link[rel=canonical]')['href']
                   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
[5.09] splash screen hidden
[5.09] Started up in 5.09 seconds with 15348 books
kf.service.services: KApplicationTrader: mimeType "x-scheme-handler/file" not found
Da Man is offline   Reply With Quote
Old 06-22-2024, 10:30 AM   #9686
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
Quote:
Originally Posted by Da Man View Post
Once again a problem with FFN. I always get the error 'NoneType' object is not subscriptable.
The error suggests you're not getting the story page, and that you're using Flaresolverr. There's a new version of Flaresolverr just came out Jun 21st. That may help.

BrowserCache is still working for me for ffnet.
JimmXinu is offline   Reply With Quote
Old 06-22-2024, 04:30 PM   #9687
Da Man
Enthusiast
Da Man began at the beginning.
 
Posts: 27
Karma: 10
Join Date: Jun 2018
Device: none
Quote:
Originally Posted by JimmXinu View Post
The error suggests you're not getting the story page, and that you're using Flaresolverr. There's a new version of Flaresolverr just came out Jun 21st. That may help.

BrowserCache is still working for me for ffnet.
I'm using that version of Flaresolverr and it gives me this error. The old version that worked until recently started giving me the very same error, that's why I tried the latest one. I guess something changed at FFN, no idea what it could be.
Da Man is offline   Reply With Quote
Old 06-22-2024, 05:10 PM   #9688
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
I would suspect you're being served some cloudflare page. I think Flaresolverr hasn't worked for me for a good while.
JimmXinu is offline   Reply With Quote
Old 06-23-2024, 07:20 AM   #9689
Da Man
Enthusiast
Da Man began at the beginning.
 
Posts: 27
Karma: 10
Join Date: Jun 2018
Device: none
What cloudflare page?

Flaresolverr worked for me, but was unreliable. Meaning a day or two it didn't work at all stopping at the challenge until timeout, but on days it did it worked perfectly fine, probably depending on whatever cloudflare settings FFN used. About two weeks ago was the last time I tried and it worked.

Four days ago I tried once again, seemed to work fine but gave the none type error. That was new. Same the day after and the next. So I thought it's time to try the new version that just came out, but same error.

Since flaresolverr does work, challenge and all, I guess it must be some change at FFN, since none type errors usually are AFAIK. BTW, when there's no cloudflare challenge at all the result is the same error.
Da Man is offline   Reply With Quote
Old 06-23-2024, 11:57 AM   #9690
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,590
Karma: 4600349
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
New Test Version Posted

2024-06-23
- Catch bad href searches during internal link anchor search.

Problem reported on mail list.
JimmXinu is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 495 10-19-2024 07:06 AM
[GUI Plugin] Open With kiwidude Plugins 403 04-01-2024 09:39 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 12:53 PM.


MobileRead.com is a privately owned, operated and funded community.