archivebox.services.resource_admission

Admission signals, not estimates of how much RAM an extractor will need.

Module Contents

Classes

ResourceAdmission

Functions

zram_swap_identifiers	Return zram block names and major:minor IDs known to sysfs.
swap_source_identifiers	Identify a swap source by its visible name and, for block devices, ID.
disk_backed_swap_free_bytes	Sum free active swap except zram, whose capacity is already backed by RAM.
host_swap_free_bytes	Use only independently backed swap as extra capacity on Linux.

Data

RESOURCE_RECHECK_SECONDS
MEMORY_FULL_STALL_PERCENT
ZRAM_DEVICE_NAME
resource_admission

API

archivebox.services.resource_admission.RESOURCE_RECHECK_SECONDS

2.0

archivebox.services.resource_admission.MEMORY_FULL_STALL_PERCENT

10.0

archivebox.services.resource_admission.ZRAM_DEVICE_NAME

‘compile(…)’

archivebox.services.resource_admission.zram_swap_identifiers(sys_block: pathlib.Path = Path('/sys/block')) → set[str]

Return zram block names and major:minor IDs known to sysfs.

archivebox.services.resource_admission.swap_source_identifiers(filename: str) → set[str]

Identify a swap source by its visible name and, for block devices, ID.

archivebox.services.resource_admission.disk_backed_swap_free_bytes(swaps: str, zram_identifiers: set[str]) → int

Sum free active swap except zram, whose capacity is already backed by RAM.

archivebox.services.resource_admission.host_swap_free_bytes(meminfo_swap_free: int) → int

Use only independently backed swap as extra capacity on Linux.

class archivebox.services.resource_admission.ResourceAdmission

Initialization

static cgroup_paths() → list[pathlib.Path]

snapshot_limit(configured: int) → int

additional_snapshot_slots(configured: int, active: int, observed_cost: int | None) → int

static slots_for_headroom(configured: int, active: int, observed_cost: int, available: int) → int

memory_headroom() → tuple[int, int] | None

Return workload RAM+swap usage and effective available headroom.

observe_memory_stalls(source: str, total: int, avg10: float, sampled_at: float) → bool

memory_pressure() → str | None

archivebox.services.resource_admission.resource_admission

‘ResourceAdmission(…)’