oio.crawler package

Submodules

oio.crawler.integrity module

Recursively check account, container, content and chunk integrity.

class oio.crawler.integrity.Checker(namespace, concurrency=50, error_file=None, rebuild_file=None, full=True, limit_listings=0, request_attempts=1)[source]

Bases: object

check(target)[source]
check_account(target, recurse=False)[source]
check_chunk(target)[source]
check_container(target, recurse=False)[source]
check_obj(target, recurse=False)[source]
check_obj_policy(target, obj_meta, chunks)[source]

Check that the list of chunks of an object matches the object’s storage policy.

report()[source]
wait()[source]
write_chunk_error(target, obj_meta, chunk=None)[source]
write_error(target)[source]
write_rebuilder_input(target, obj_meta, ct_meta)[source]
class oio.crawler.integrity.Target(account, container=None, obj=None, chunk=None)[source]

Bases: object

copy()[source]
oio.crawler.integrity.main()[source]

oio.crawler.storage_tierer module

class oio.crawler.storage_tierer.StorageTierer(conf, **kwargs)[source]

Bases: oio.common.daemon.Daemon

run(*args, **kwargs)[source]
class oio.crawler.storage_tierer.StorageTiererWorker(conf, logger)[source]

Bases: object

change_policy(container_id, content_id)[source]
run()[source]
safe_change_policy(container_id, content_id)[source]

Module contents