oio.rebuilder package

Submodules

oio.rebuilder.blob_improver module

class oio.rebuilder.blob_improver.BlobImprover(conf, logger, beanstalkd_addr, **kwargs)

Bases: oio.rebuilder.rebuilder.Rebuilder

Move chunks of objects declared as “perfectible”, if possible to improve them (increased distance between chunks or better hosting service).

exit_gracefully(signum, frame)

supported_events = ('storage.content.perfectible',)

class oio.rebuilder.blob_improver.BlobImproverWorker(rebuilder, **kwargs)

Bases: oio.rebuilder.rebuilder.RebuilderWorker

content_factory

move_perfectible_from_event(event, dry_run=False, max_attempts=3, **kwargs)

Move one or more “perfectible” chunks described in a “storage.content.perfectible” event.

oio.rebuilder.meta1_rebuilder module

class oio.rebuilder.meta1_rebuilder.Meta1Rebuilder(conf, logger, **kwargs)

Bases: oio.rebuilder.meta_rebuilder.MetaRebuilder

class oio.rebuilder.meta1_rebuilder.Meta1RebuilderWorker(rebuilder, **kwargs)

Bases: oio.rebuilder.meta_rebuilder.MetaRebuilderWorker

oio.rebuilder.meta_rebuilder module

class oio.rebuilder.meta_rebuilder.MetaRebuilder(conf, logger, volume, **kwargs)

Bases: oio.rebuilder.rebuilder.Rebuilder

Abstract class for directory rebuilders.

class oio.rebuilder.meta_rebuilder.MetaRebuilderWorker(rebuilder, type_, max_attempts=5, **kwargs)

Bases: oio.rebuilder.rebuilder.RebuilderWorker

oio.rebuilder.rebuilder module

class oio.rebuilder.rebuilder.Rebuilder(conf, logger, volume, input_file=None, **kwargs)

Bases: object

Base class for rebuilders or movers. Subclass and implement

_create_worker() _fill_queue() _item_to_string() _get_report() _read_retry_queue()

DEFAULT_CONCURRENCY = 1

DEFAULT_ITEM_PER_SECOND = 30

DEFAULT_REPORT_INTERVAL = 3600

exit_gracefully(signum, frame)

log_report(status, force=False, **kwargs)

rebuilder_pass(**kwargs)

update_processed(item, info, error=None, increment=1, **kwargs)

update_totals(**kwargs)

class oio.rebuilder.rebuilder.RebuilderWorker(rebuilder, **kwargs)

Bases: object

Base class for rebuilder or mover workers. Subclass and implement _rebuild_one().

log_report(**kwargs)

rebuilder_pass(num, queue, retry_queue=None, **kwargs)

update_processed(item, info, error=None, **kwargs)

Module contents