Saved Search/Regex Functions - Page 3

kovidgoyal · 07-02-2020, 10:10 PM

That's because builtin function are not simple standalone functions you can learn from, they use other calibre code, however if you want to see them look in function_replace.py in the calibre source code.

EbookMakers · 12-01-2020, 07:10 PM

In the <head> section, the absence of a <title> tag causes an epubcheck error. It also happens to find something like (depends on the language):
<title>Unknown</title> or <title></title>

In these cases, the regex-function will look for the title in the metadata to fill in the <title> tag of the <head> sections of the xhtml pages. If the title in the metadata is not filled in or itself has the default value “Unknown”, the function leaves it as is. You can then fill in the <dc: title> tag in the opf, save the epub, re-open it in the editor and then restart the regex-function.

The function is commented out. You must adapt the regex and the function to the language of the epub if it is not English or French to add the equivalent word to “Unknown”.

The regex :

Code:

<title>(?:[Ii]nconnu\(e\)|[Uu]nknown)?</title>|<head>(?:(?!<title).)+\K(</head>)

Dot matches all (new lines).

The function :

Code:

# execute the function with this regex : 
# <title>(?:[Ii]nconnu\(e\)|[Uu]nknown)?</title>|<head>(?:(?!<title).)+\K(</head>)
# Dot matches all

def replace(match, number, file_name, metadata, dictionaries, data, functions, *args, **kwargs):
    # Funct-regex to fill in (with <dc:title> of the opf) a <title> tag in xml files
    # if there is no such tag or if it's 'Unknown', or localized equivalent


    # This tuple and the regex should be adapted to the language of the epub
    # Add in this tuple the string to target, in your language
    #  +++ Must be in lower case +++, since the string in the test is lowered
    no_title =  ('unknown', 'inconnu(e)')


    # 'is_dc_title' is true if metada.title is defined
    # Warning : if no <dc:title> in the opf, metada.title will take
    # the value 'Unknown' or its localized value (ex : Inconnu(e) for french)
    is_dc_title =  ( metadata.title is not None \
            and len(metadata.title) > 0         \
            and metadata.title.lower() not in no_title )

    # no capturing group : <title> is empty or 'Unknown'
    # (we capture a group only if we reach </head> without finding <title>)
    if not match.group(1):
        if is_dc_title:
            title = "  <title>" + metadata.title + "</title>"
        else:
            title = match.group()

    # found (</head>), thus <title> tag is missing 
    else:
        if is_dc_title:
            title = "  <title>" + metadata.title + "</title>"  + '\n' + match.group(1)
        else:
            title =  match.group(1)
            ######## Shall we fill in a tag if none ? ###########
            # comment/uncomment this line below if you want to write <title></title>
            # in case tag <title> is missing and <dc:title> is not defined 
            # if commented, tag will be still missing
            # title = "  <title></title>\n"  + title

    return title

Ted Friesen · 09-22-2021, 06:11 PM

Quote:

Originally Posted by kovidgoyal

That's because builtin function are not simple standalone functions you can learn from, they use other calibre code, however if you want to see them look in function_replace.py in the calibre source code.

Found them. Thanks you.

firsikov · 10-17-2021, 05:19 PM

Hi there!

I have code like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>

And i need to change class of P tag only inside of blockquote tag.

Regex search string, like "<blockquote class="email">(.*?)<p class="text">(.*?)</blockquote>" work only if blockquote have only one p tag.

I don't understand, how to create correct search string or even how to ask google for it.

Hope for your help. Thanks.

Brett Merkey · 10-17-2021, 06:09 PM

@firsikov:
Using regex can be difficult and tricky at times. Consider another way to accomplish the same thing, without changing the HTML code.

What you seem to want is to control the look of text within a particular type of blockquote. Consider using CSS contextual styles:

Quote:

blockquote.email p.text {put your desired styles here}

This form of style selector will only affect the precise text you want to change.

firsikov · 10-18-2021, 05:21 AM

Quote:

Originally Posted by Brett Merkey

@firsikov:
Using regex can be difficult and tricky at times. Consider another way to accomplish the same thing, without changing the HTML code.

What you seem to want is to control the look of text within a particular type of blockquote. Consider using CSS contextual styles:

Code:

blockquote.email p.text {put your desired styles here}

This form of style selector will only affect the precise text you want to change.

This was the first thought that came to my mind. But for some reason it didn't help. The point is that the p.text style is already defined in the stylesheet earlier in a different way. It may be necessary to use Python here, but I'm not a programmer.

davidfor · 10-18-2021, 06:02 AM

Quote:

Originally Posted by firsikov

Hi there!

I have code like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>

And i need to change class of P tag only inside of blockquote tag.

Regex search string, like "<blockquote class="email">(.*?)<p class="text">(.*?)</blockquote>" work only if blockquote have only one p tag.

I don't understand, how to create correct search string or even how to ask google for it.

Hope for your help. Thanks.

Just to check, you want to change the class of the paragraph within the blockquote from "text" to something else? If so, it does work, but, you need to have the "Dot all" option selected. And the replace string is:

Code:

<blockquote class="email">\1<p class="newclassname">\2</blockquote>

But, I would do this with:

Code:

(<blockquote class="email">.*?<p class=")text(">.*?</blockquote>)

And the substitution is:

Code:

\1newclassname\2

Which is basically to use all the put the constant bits into groups and the bit you want to change not selected. This also needs the "Dot all" option to be selected.

For both, you have to run them multiple times. If you do "Replace all", it only makes one change in each blockquote.

lomkiri · 10-18-2021, 06:44 AM

Quote:

Originally Posted by davidfor

For both, you have to run them multiple times. If you do "Replace all", it only makes one change in each blockquote.

It is possible to do everything on one pass, with replace all, using a regex-function
Select the mode "regex-function"

Your "find" field is :
(<blockquote class="email">)(.*?)(</blockquote>)

Create the regex-function with this code:

Code:

def replace(match, number, file_name, metadata, dictionaries, data, functions, *args, **kwargs):  
    inside_block = match.group(2).replace(
                '<p class="text"',
                '<p class="newtext"')
    return match.group(1) + inside_block + match.group(3)

Obviously, you have to replace "text" and "newtext" with the names you need.
Be careful, there is a simple quote after the double quote in "text"' and newtext"', it is mandatory to keep it.

Then, you can go to "replace all"

firsikov · 10-18-2021, 08:30 AM

Quote:

Originally Posted by davidfor

Just to check, you want to change the class of the paragraph within the blockquote from "text" to something else? If so, it does work, but, you need to have the "Dot all" option selected. And the replace string is:

Code:

<blockquote class="email">\1<p class="newclassname">\2</blockquote>

But, I would do this with:

Code:

(<blockquote class="email">.*?<p class=")text(">.*?</blockquote>)

And the substitution is:

Code:

\1newclassname\2

Which is basically to use all the put the constant bits into groups and the bit you want to change not selected. This also needs the "Dot all" option to be selected.

For both, you have to run them multiple times. If you do "Replace all", it only makes one change in each blockquote.

Thanks a lot. It works. But! If you have code like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>
<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>

First opened <blockquote> and last closed </blockquote> will work too. And when i finish replace all, result will be like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="newclass>some <i>text</i></p>
   <p class="newclass><b>some</b> text</p>
   <p class="newclass>some text</p>
</blockquote>
<p class="newclass>some text</p>
<p class="newclass>some text</p>
<blockquote class="email">
   <p class="newclass>some <i>text</i></p>
   <p class="newclass><b>some</b> text</p>
   <p class="newclass>some text</p>
</blockquote>
<p class="text">some text</p>

davidfor · 10-18-2021, 09:32 AM

Quote:

Originally Posted by firsikov

Thanks a lot. It works. But! If you have code like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>
<p class="text">some text</p>
<blockquote class="email">
   <p class="text">some <i>text</i></p>
   <p class="text"><b>some</b> text</p>
   <p class="text">some text</p>
</blockquote>
<p class="text">some text</p>

First opened <blockquote> and last closed </blockquote> will work too. And when i finish replace all, result will be like that:

Code:

<p class="text">some text</p>
<blockquote class="email">
   <p class="newclass>some <i>text</i></p>
   <p class="newclass><b>some</b> text</p>
   <p class="newclass>some text</p>
</blockquote>
<p class="newclass>some text</p>
<p class="newclass>some text</p>
<blockquote class="email">
   <p class="newclass>some <i>text</i></p>
   <p class="newclass><b>some</b> text</p>
   <p class="newclass>some text</p>
</blockquote>
<p class="text">some text</p>

Sorry, I didn't run it all the way through. Just ran enough replace alls to check it was making the changes you wanted. But, it will eventually match across the blockquotes. You need to block that, but I can't think of how to do that at the moment.

lomkiri · 10-18-2021, 11:58 AM

Quote:

Originally Posted by firsikov

hanks a lot. It works. But! If you have code like that:[…]

Just a question: why don't you want to use my solution? It works like a charm on the example you gave, in one shot on the whole book (or on the page, if you chose "current file")

Screenshot of the diff-screen: https://i.imgur.com/v5oxiFy.jpeg

firsikov · 10-18-2021, 12:24 PM

Quote:

Originally Posted by lomkiri

Just a question: why don't you want to use my solution? It works like a charm on the example you gave, in one shot on the whole book (or on the page, if you chose "current file")

Screenshot of the diff-screen: https://i.imgur.com/v5oxiFy.jpeg

This is weird. At first I tried to do as you told me, and nothing worked for me. The text in the nested tag continued to display with the old characteristics.

But now, when I wanted to take a screenshot to show you, everything worked as i need!

Anyway, thanks for the advice.

lomkiri · 10-18-2021, 01:02 PM

Quote:

Originally Posted by firsikov

This is weird. At first I tried to do as you told me, and nothing worked for me..

Maybe because "Dot all" wasn't checked? The group 2 of the regex must be able to pass through newlines (dot all means that (.*?) won't stop at next newline).
My mistake if it's the case, I should have told you to check it, but as Davidfor already said it, I thought it was unnecessary to repeat it.

Anyway, it's fine if your problem is solved :-).

firsikov · 10-19-2021, 12:00 PM

Quote:

Originally Posted by lomkiri

Maybe because "Dot all" wasn't checked? The group 2 of the regex must be able to pass through newlines (dot all means that (.*?) won't stop at next newline).
My mistake if it's the case, I should have told you to check it, but as Davidfor already said it, I thought it was unnecessary to repeat it.

Anyway, it's fine if your problem is solved :-).

Suddenly I found a great tool. Adobe Dreamweaver.

Unfortunately it's not free. It would be cool if Mr. Kovid added such a tool to his editor.

Doitsu · 10-19-2021, 03:48 PM

Quote:

Originally Posted by firsikov

Suddenly I found a great tool. Adobe Dreamweaver.

Unfortunately it's not free. It would be cool if Mr. Kovid added such a tool to his editor.

There's a plugin by DiapDealer that offers similar options: Diap's Editing Toolbag

10-17-2021, 05:19 PM	#34
firsikov Junior Member Posts: 9 Karma: 10 Join Date: Oct 2021 Device: Kindle Voyager	Hi there! I have code like that: Code: <p class="text">some text</p> <blockquote class="email"> <p class="text">some <i>text</i></p> <p class="text"><b>some</b> text</p> <p class="text">some text</p> </blockquote> <p class="text">some text</p> And i need to change class of P tag only inside of blockquote tag. Regex search string, like "<blockquote class="email">(.?)<p class="text">(.?)</blockquote>" work only if blockquote have only one p tag. I don't understand, how to create correct search string or even how to ask google for it. Hope for your help. Thanks.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
About saved searches and regex	Carpatos	Editor	22	09-30-2020 10:56 PM
Regex-Functions - getting user input	CalibUser	Editor	8	09-09-2020 04:26 AM
Difference in Manual Search and Saved Search	phossler	Editor	4	10-04-2015 12:17 PM
Help - Learning to use Regex Functions	weberr	Editor	1	06-13-2015 01:59 AM
Limit on length of saved regex?	ElMiko	Sigil	0	06-30-2013 03:32 PM

07-02-2020, 10:10 PM	#31
kovidgoyal creator of calibre Posts: 44,483 Karma: 24495778 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That's because builtin function are not simple standalone functions you can learn from, they use other calibre code, however if you want to see them look in function_replace.py in the calibre source code.

Advert

Advert