abx_plugin_title.extractor

Module Contents

Classes

TitleParser

Functions

get_html	Try to find wget, singlefile and then dom files. If none is found, download the url again.
get_output_path
should_save_title
extract_title_with_regex
save_title	try to guess the page’s title from its content

Data

HTML_TITLE_REGEX

API

abx_plugin_title.extractor.HTML_TITLE_REGEX

‘compile(…)’

class abx_plugin_title.extractor.TitleParser(*args, **kwargs)

Bases: html.parser.HTMLParser

property title

handle_starttag(tag, attrs)

handle_data(data)

handle_endtag(tag)

abx_plugin_title.extractor.get_html(link: archivebox.index.schema.Link, path: pathlib.Path, timeout: int = CURL_CONFIG.CURL_TIMEOUT) → str

Try to find wget, singlefile and then dom files. If none is found, download the url again.

abx_plugin_title.extractor.get_output_path()

abx_plugin_title.extractor.should_save_title(link: archivebox.index.schema.Link, out_dir: Optional[str] = None, overwrite: Optional[bool] = False) → bool

abx_plugin_title.extractor.extract_title_with_regex(html)

abx_plugin_title.extractor.save_title(link: archivebox.index.schema.Link, out_dir: Optional[pathlib.Path] = None, timeout: int = CURL_CONFIG.CURL_TIMEOUT) → archivebox.index.schema.ArchiveResult

try to guess the page’s title from its content