oio.xcute.jobs package
Submodules
oio.xcute.jobs.blob_mover module
-
class
oio.xcute.jobs.blob_mover.
RawxDecommissionJob
(conf, logger=None)[source] Bases:
oio.xcute.jobs.common.XcuteRdirJob
-
DEFAULT_MAX_CHUNK_SIZE
= 0
-
DEFAULT_MIN_CHUNK_SIZE
= 0
-
DEFAULT_RAWX_TIMEOUT
= 60.0
-
DEFAULT_USAGE_CHECK_INTERVAL
= 60.0
-
DEFAULT_USAGE_TARGET
= 0
-
JOB_TYPE
= 'rawx-decommission'
-
TASK_CLASS
alias of
RawxDecommissionTask
-
get_chunk_infos
(job_params, marker=None)[source]
-
get_tasks
(job_params, marker=None)[source] Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker
-
get_total_tasks
(job_params, marker=None)[source] Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed
-
get_usage
(service_id)[source]
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
-
class
oio.xcute.jobs.blob_mover.
RawxDecommissionTask
(conf, job_params, logger=None)[source] Bases:
oio.xcute.common.job.XcuteTask
-
process
(task_id, task_payload, reqid=None)[source]
-
oio.xcute.jobs.blob_rebuilder module
-
class
oio.xcute.jobs.blob_rebuilder.
RawxRebuildJob
(conf, logger=None)[source] Bases:
oio.xcute.jobs.common.XcuteRdirJob
-
DEFAULT_ALLOW_FROZEN_CT
= False
-
DEFAULT_ALLOW_SAME_RAWX
= True
-
DEFAULT_DECLARE_INCIDENT_DATE
= False
-
DEFAULT_DRY_RUN
= False
-
DEFAULT_RAWX_TIMEOUT
= 60.0
-
DEFAULT_TRY_CHUNK_DELETE
= False
-
JOB_TYPE
= 'rawx-rebuild'
-
TASK_CLASS
alias of
RawxRebuildTask
-
get_chunk_infos
(job_params, marker=None)[source]
-
get_tasks
(job_params, marker=None)[source] Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker
-
get_total_tasks
(job_params, marker=None)[source] Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed
-
prepare
(job_params)[source] Allow to execute code only once when the job is run for the first time. This method is executed before the generation of the tasks and the total.
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
-
class
oio.xcute.jobs.blob_rebuilder.
RawxRebuildTask
(conf, job_params, logger=None)[source] Bases:
oio.xcute.common.job.XcuteTask
-
process
(task_id, task_payload, reqid=None)[source]
-
oio.xcute.jobs.common module
-
class
oio.xcute.jobs.common.
XcuteRdirJob
(conf, logger=None)[source] Bases:
oio.xcute.common.job.XcuteJob
-
DEFAULT_RDIR_FETCH_LIMIT
= 1000
-
DEFAULT_RDIR_TIMEOUT
= 60.0
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
oio.xcute.jobs.meta2_decommissioner module
-
class
oio.xcute.jobs.meta2_decommissioner.
Meta2DecommissionJob
(conf, logger=None)[source] Bases:
oio.xcute.jobs.common.XcuteRdirJob
-
JOB_TYPE
= 'meta2-decommission'
-
TASK_CLASS
alias of
Meta2DecommissionTask
-
get_tasks
(job_params, marker=None)[source] Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker
-
get_total_tasks
(job_params, marker=None)[source] Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
-
class
oio.xcute.jobs.meta2_decommissioner.
Meta2DecommissionTask
(conf, job_params, logger=None)[source] Bases:
oio.xcute.common.job.XcuteTask
-
process
(task_id, task_payload, reqid=None)[source]
-
oio.xcute.jobs.meta2_rebuilder module
-
class
oio.xcute.jobs.meta2_rebuilder.
Meta2RebuildJob
(conf, logger=None)[source] Bases:
oio.xcute.jobs.common.XcuteRdirJob
-
JOB_TYPE
= 'meta2-rebuild'
-
TASK_CLASS
alias of
Meta2RebuildTask
-
get_tasks
(job_params, marker=None)[source] Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker
-
get_total_tasks
(job_params, marker=None)[source] Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
-
class
oio.xcute.jobs.meta2_rebuilder.
Meta2RebuildTask
(conf, job_params, logger=None)[source] Bases:
oio.xcute.common.job.XcuteTask
-
process
(task_id, task_payload, reqid=None)[source]
-
oio.xcute.jobs.tester module
-
class
oio.xcute.jobs.tester.
TesterJob
(conf, logger=None)[source] Bases:
oio.xcute.common.job.XcuteJob
-
DEFAULT_END
= 5
-
DEFAULT_ERROR_PERCENTAGE
= 0
-
DEFAULT_LOCK
= 'tester_lock'
-
DEFAULT_START
= 0
-
JOB_TYPE
= 'tester'
-
TASK_CLASS
alias of
TesterTask
-
get_tasks
(job_params, marker=None)[source] Yields the job tasks as (task_id, task_payload) task_id must be a string and can be used as a marker
-
get_total_tasks
(job_params, marker=None)[source] Yields numbers of tasks as (marker, tasks_incr) The sum of all tasks_incr yielded must be the total of tasks in the job NB: do not define if not needed
-
classmethod
sanitize_params
(job_params)[source] Validate and sanitize the job parameters Ex: cast a string as integer, set a default Also return the lock id if there is one
-
-
class
oio.xcute.jobs.tester.
TesterTask
(conf, job_params, logger=None)[source] Bases:
oio.xcute.common.job.XcuteTask
-
process
(task_id, task_payload, reqid=None)[source]
-