oio.xcute.jobs package

Submodules

oio.xcute.jobs.blob_mover module

class oio.xcute.jobs.blob_mover.RawxDecommissionJob(conf, logger=None)[source]

Bases: oio.xcute.jobs.common.XcuteRdirJob

DEFAULT_MAX_CHUNK_SIZE = 0
DEFAULT_MIN_CHUNK_SIZE = 0
DEFAULT_RAWX_TIMEOUT = 60.0
DEFAULT_USAGE_CHECK_INTERVAL = 60.0
DEFAULT_USAGE_TARGET = 0
JOB_TYPE = 'rawx-decommission'
TASK_CLASS

alias of RawxDecommissionTask

get_chunk_infos(job_params, marker=None)[source]
get_tasks(job_params, marker=None)[source]

Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker

get_total_tasks(job_params, marker=None)[source]

Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed

get_usage(service_id)[source]
classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

class oio.xcute.jobs.blob_mover.RawxDecommissionTask(conf, job_params, logger=None)[source]

Bases: oio.xcute.common.job.XcuteTask

process(task_id, task_payload, reqid=None)[source]

oio.xcute.jobs.blob_rebuilder module

class oio.xcute.jobs.blob_rebuilder.RawxRebuildJob(conf, logger=None)[source]

Bases: oio.xcute.jobs.common.XcuteRdirJob

DEFAULT_ALLOW_FROZEN_CT = False
DEFAULT_ALLOW_SAME_RAWX = True
DEFAULT_DECLARE_INCIDENT_DATE = False
DEFAULT_DRY_RUN = False
DEFAULT_RAWX_TIMEOUT = 60.0
DEFAULT_TRY_CHUNK_DELETE = False
JOB_TYPE = 'rawx-rebuild'
TASK_CLASS

alias of RawxRebuildTask

get_chunk_infos(job_params, marker=None)[source]
get_tasks(job_params, marker=None)[source]

Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker

get_total_tasks(job_params, marker=None)[source]

Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed

prepare(job_params)[source]

Allow to execute code only once when the job is run for the first time. This method is executed before the generation of the tasks and the total.

classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

class oio.xcute.jobs.blob_rebuilder.RawxRebuildTask(conf, job_params, logger=None)[source]

Bases: oio.xcute.common.job.XcuteTask

process(task_id, task_payload, reqid=None)[source]

oio.xcute.jobs.common module

class oio.xcute.jobs.common.XcuteRdirJob(conf, logger=None)[source]

Bases: oio.xcute.common.job.XcuteJob

DEFAULT_RDIR_FETCH_LIMIT = 1000
DEFAULT_RDIR_TIMEOUT = 60.0
classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

oio.xcute.jobs.meta2_decommissioner module

class oio.xcute.jobs.meta2_decommissioner.Meta2DecommissionJob(conf, logger=None)[source]

Bases: oio.xcute.jobs.common.XcuteRdirJob

JOB_TYPE = 'meta2-decommission'
TASK_CLASS

alias of Meta2DecommissionTask

get_tasks(job_params, marker=None)[source]

Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker

get_total_tasks(job_params, marker=None)[source]

Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed

classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

class oio.xcute.jobs.meta2_decommissioner.Meta2DecommissionTask(conf, job_params, logger=None)[source]

Bases: oio.xcute.common.job.XcuteTask

process(task_id, task_payload, reqid=None)[source]

oio.xcute.jobs.meta2_rebuilder module

class oio.xcute.jobs.meta2_rebuilder.Meta2RebuildJob(conf, logger=None)[source]

Bases: oio.xcute.jobs.common.XcuteRdirJob

JOB_TYPE = 'meta2-rebuild'
TASK_CLASS

alias of Meta2RebuildTask

get_tasks(job_params, marker=None)[source]

Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker

get_total_tasks(job_params, marker=None)[source]

Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed

classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

class oio.xcute.jobs.meta2_rebuilder.Meta2RebuildTask(conf, job_params, logger=None)[source]

Bases: oio.xcute.common.job.XcuteTask

process(task_id, task_payload, reqid=None)[source]

oio.xcute.jobs.tester module

class oio.xcute.jobs.tester.TesterJob(conf, logger=None)[source]

Bases: oio.xcute.common.job.XcuteJob

DEFAULT_END = 5
DEFAULT_ERROR_PERCENTAGE = 0
DEFAULT_LOCK = 'tester_lock'
DEFAULT_START = 0
JOB_TYPE = 'tester'
TASK_CLASS

alias of TesterTask

get_tasks(job_params, marker=None)[source]

Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker

get_total_tasks(job_params, marker=None)[source]

Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed

classmethod sanitize_params(job_params)[source]

Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one

class oio.xcute.jobs.tester.TesterTask(conf, job_params, logger=None)[source]

Bases: oio.xcute.common.job.XcuteTask

process(task_id, task_payload, reqid=None)[source]

Module contents