User Guide
Reference
Release Notes
FAQs
Contributing
KEPs
Index
Symbols
|
_
|
A
|
B
|
C
|
D
|
E
|
F
|
G
|
H
|
I
|
J
|
K
|
L
|
M
|
N
|
P
|
R
|
S
|
T
|
U
|
V
|
W
Symbols
--blocking
klioexec-run command line option
--bottom-up
klio-message-publish command line option
--config-file <config_file>
klio-image-build command line option
klio-job-audit command line option
klio-job-config-get command line option
klio-job-config-set command line option
klio-job-config-show command line option
klio-job-config-unset command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
,
[1]
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
,
[1]
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-audit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
klioexec-run command line option
klioexec-stop command line option
klioexec-test command line option
--create-resources
klio-job-verify command line option
--direct-runner
klio-job-deploy command line option
klio-job-run command line option
klioexec-run command line option
--force
klio-message-publish command line option
--force-build
klio-job-audit command line option
klio-job-deploy command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-test command line option
--gcp-project <gcp_project>
klio-job-create command line option
klio-job-stop command line option
--gcs-location <gcs_location>
klio-job-profile-collect-profiling-data command line option
--help
command line option
--image-tag <image_tag>
klio-image-build command line option
klio-job-audit command line option
klio-job-deploy command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-test command line option
klioexec-run command line option
--include-children
klio-job-profile-memory command line option
klioexec-profile-memory command line option
--input-file <input_file>
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
--interval <interval>
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
--iterations <iterations>
klio-job-profile-timeit command line option
klioexec-profile-timeit command line option
--job-dir <job_dir>
klio-image-build command line option
klio-job-audit command line option
klio-job-config-get command line option
klio-job-config-set command line option
klio-job-config-show command line option
klio-job-config-unset command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
,
[1]
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
,
[1]
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
--job-name <job_name>
klio-job-create command line option
klio-job-stop command line option
--list
klio-job-audit command line option
klioexec-audit command line option
--maximum
klio-job-profile-memory-per-line command line option
klioexec-profile-memory-per-line command line option
--multiprocess
klio-job-profile-memory command line option
klioexec-profile-memory command line option
--no-blocking
klioexec-run command line option
--no-update
klio-job-deploy command line option
klio-job-run command line option
klioexec-run command line option
--non-klio
klio-message-publish command line option
--output <output>
klio-job-create command line option
--output-file <output_file>
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
--override <override>
klio-image-build command line option
klio-job-audit command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
--per-element
klio-job-profile-memory-per-line command line option
klioexec-profile-memory-per-line command line option
--ping
klio-message-publish command line option
--plot-graph
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
--region <region>
klio-job-stop command line option
--show-logs
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
--since <since>
klio-job-profile-collect-profiling-data command line option
--sort-stats <sort_stats>
klio-job-profile-collect-profiling-data command line option
--template <template>
klio-image-build command line option
klio-job-audit command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
--top-down
klio-message-publish command line option
--until <until>
klio-job-profile-collect-profiling-data command line option
--update
klio-job-deploy command line option
klio-job-run command line option
klioexec-run command line option
--use-defaults
klio-job-create command line option
--version
command line option
-b
klio-message-publish command line option
-c
klio-image-build command line option
klio-job-audit command line option
klio-job-config-get command line option
klio-job-config-set command line option
klio-job-config-show command line option
klio-job-config-unset command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
,
[1]
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
,
[1]
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-audit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
klioexec-run command line option
klioexec-stop command line option
klioexec-test command line option
-f
klio-message-publish command line option
-g
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
-i
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
-j
klio-image-build command line option
klio-job-audit command line option
klio-job-config-get command line option
klio-job-config-set command line option
klio-job-config-show command line option
klio-job-config-unset command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
,
[1]
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
,
[1]
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
-n
klio-job-profile-timeit command line option
klio-message-publish command line option
klioexec-profile-timeit command line option
-O
klio-image-build command line option
klio-job-audit command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
-o
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
-p
klio-message-publish command line option
-T
klio-image-build command line option
klio-job-audit command line option
klio-job-delete command line option
klio-job-deploy command line option
klio-job-profile-collect-profiling-data command line option
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-job-run command line option
klio-job-stop command line option
klio-job-test command line option
klio-job-verify command line option
klio-message-publish command line option
klioexec-run command line option
-t
klio-message-publish command line option
_
__init__() (klio.transforms.io.KlioReadFromText method)
(klio.transforms.io.KlioWriteToBigQuery method)
(klio.transforms.io.KlioWriteToText method)
A
abstract_attr() (in module klio.metrics.base)
AbstractRelayClient (class in klio.metrics.base)
acquire() (klio.utils.ThreadLimiter method)
ADDL_JOB_OPTS
klio-job-create command line option
allow_non_klio_messages (klio_core.config.KlioJobConfig attribute)
anyone
command line option
as_dict() (klio_core.config.KlioConfig method)
(klio_core.config.KlioJobConfig method)
(klio_core.config.KlioPipelineConfig method)
B
BaseMetric (class in klio.metrics.base)
BaseMetricDispatcher (class in klio.metrics.dispatcher)
BaseShumwayMetric (class in klio.metrics.shumway)
blocking (klio_core.config.KlioJobConfig attribute)
C
command line option
--help
--version
anyone
data
data_location
downstream
element
entity_id
force
gcp_project
inputs
intended_recipients
job_audit_log
job_config DICT
job_config.<additional_key> ANY
job_config.allow_non_klio_messages BOOL
job_config.blocking BOOL
job_config.data.inputs[].<custom-key> ANY
job_config.data.inputs[].<type_specific_config>
job_config.data.inputs[].file_suffix STR
job_config.data.inputs[].location STR
job_config.data.inputs[].ping BOOL
,
[1]
,
[2]
job_config.data.inputs[].skip_klio_existence_check BOOL
,
[1]
,
[2]
job_config.data.inputs[].type
job_config.data.inputs[].type STR
,
[1]
job_config.data.outputs[].<custom-key> ANY
job_config.data.outputs[].<type_specific_config>
job_config.data.outputs[].file_suffix STR
job_config.data.outputs[].force BOOL
,
[1]
,
[2]
job_config.data.outputs[].location STR
job_config.data.outputs[].skip_klio_existence_check BOOL
,
[1]
,
[2]
job_config.data.outputs[].type
job_config.data.outputs[].type STR
,
[1]
job_config.events.inputs[].<custom-key> ANY
job_config.events.inputs[].<type_specific_config>
job_config.events.inputs[].coder STR
,
[1]
job_config.events.inputs[].columns[]
job_config.events.inputs[].columns[].<column> STR
job_config.events.inputs[].compression_type STR
job_config.events.inputs[].dataset STR
job_config.events.inputs[].file_pattern STR
job_config.events.inputs[].flatten_results BOOL
job_config.events.inputs[].kms_key STR
job_config.events.inputs[].location STR
job_config.events.inputs[].min_bundle_size INT
job_config.events.inputs[].project STR
job_config.events.inputs[].query STR
job_config.events.inputs[].skip_header_lines INT
job_config.events.inputs[].skip_klio_read BOOL
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.inputs[].skip_klio_write BOOL
,
[1]
,
[2]
job_config.events.inputs[].strip_trailing_newlines BOOL
job_config.events.inputs[].subscription STR
job_config.events.inputs[].table STR
job_config.events.inputs[].topic STR
job_config.events.inputs[].type
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.inputs[].type STR
job_config.events.inputs[].use_standard_sql BOOL
job_config.events.inputs[].validate BOOL
,
[1]
job_config.events.outputs[].<custom-key> ANY
job_config.events.outputs[].<type_specific_config>
job_config.events.outputs[].append_trailing_newlines BOOL
job_config.events.outputs[].codec STR
job_config.events.outputs[].coder STR
job_config.events.outputs[].compression_type STR
job_config.events.outputs[].create_disposition STR
job_config.events.outputs[].dataset STR
job_config.events.outputs[].file_name_suffix STR
,
[1]
job_config.events.outputs[].file_pattern STR
job_config.events.outputs[].footer STR
job_config.events.outputs[].header STR
job_config.events.outputs[].location STR
,
[1]
job_config.events.outputs[].mime_type STR
job_config.events.outputs[].num_shards INT
job_config.events.outputs[].num_shards STR
job_config.events.outputs[].project STR
job_config.events.outputs[].schema DICT
job_config.events.outputs[].shard_name_template STR
,
[1]
job_config.events.outputs[].skip_klio_write BOOL
,
[1]
job_config.events.outputs[].table STR
job_config.events.outputs[].topic STR
job_config.events.outputs[].type
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.outputs[].type STR
job_config.events.outputs[].write_disposition STR
job_config.metrics.logger DICT | BOOL
job_config.metrics.logger.level STR
job_config.metrics.logger.timer_unit STR
job_config.metrics.native DICT | BOOL
job_config.metrics.native.timer_unit STR
job_config.metrics.shumway DICT | BOOL
job_config.metrics.shumway.timer_unit STR
job_name
job_name STR
klio_job
limited
metadata
payload
ping
pipeline_options DICT
pipeline_options.autoscaling_algorithm STR
pipeline_options.disk_size_gb INT
pipeline_options.experiments[] LIST(STR)
pipeline_options.max_num_workers INT
pipeline_options.num_workers INT
pipeline_options.project STR
pipeline_options.region STR
pipeline_options.runner STR
pipeline_options.setup_file STR
pipeline_options.staging_location STR
pipeline_options.streaming BOOL
pipeline_options.temp_location STR
pipeline_options.worker_disk_type STR
pipeline_options.worker_harness_container_image STR
pipeline_options.worker_machine_type STR
recipients
subscription
timestamp
topic
trigger_children_of
UNKNOWN
V1
V2
version
version INT
visited
config() (klio.transforms.core.KlioContext property)
counter() (klio.metrics.base.AbstractRelayClient method)
(klio.metrics.client.MetricsRegistry method)
(klio.metrics.logger.MetricsLoggerClient method)
(klio.metrics.native.NativeMetricsClient method)
(klio.metrics.shumway.ShumwayMetricsClient method)
CounterDispatcher (class in klio.metrics.dispatcher)
D
data
command line option
data (klio_core.config.KlioJobConfig attribute)
data_location
command line option
DATAFLOW_REGIONS (in module klio_core.variables)
DataflowClient (class in klio_core.dataflow)
DEFAULT (klio.utils.ThreadLimit attribute)
DEFAULT_FFWD_ADDR (klio.metrics.shumway.ShumwayMetricsClient attribute)
DEFAULT_TIME_UNIT (klio.metrics.native.NativeMetricsClient attribute)
delete_global() (in module klio_core.utils)
direct_runner() (in module klio_core.options)
downstream
command line option
E
element
command line option
emit() (klio.metrics.base.AbstractRelayClient method)
(klio.metrics.logger.MetricsLoggerClient method)
(klio.metrics.shumway.ShumwayMetricsClient method)
entity_id
command line option
ENTITY_IDS
klio-job-profile-cpu command line option
klio-job-profile-memory command line option
klio-job-profile-memory-per-line command line option
klio-job-profile-timeit command line option
klio-message-publish command line option
klioexec-profile-cpu command line option
klioexec-profile-memory command line option
klioexec-profile-memory-per-line command line option
klioexec-profile-timeit command line option
events (klio_core.config.KlioJobConfig attribute)
F
find_job_by_name() (klio_core.dataflow.DataflowClient method)
force
command line option
from_klio_message() (in module klio.message.serializer)
G
gauge() (klio.metrics.base.AbstractRelayClient method)
(klio.metrics.client.MetricsRegistry method)
(klio.metrics.logger.MetricsLoggerClient method)
(klio.metrics.native.NativeMetricsClient method)
(klio.metrics.shumway.ShumwayMetricsClient method)
GaugeDispatcher (class in klio.metrics.dispatcher)
gcp_project
command line option
GcsLoadBinary (class in klio_audio.transforms.io)
GcsUploadPlot (class in klio_audio.transforms.io)
get_config_by_path() (in module klio_core.utils)
get_config_job_dir() (in module klio_core.utils)
get_dataflow_client() (in module klio_core.dataflow)
get_global() (in module klio_core.utils)
get_job_detail() (klio_core.dataflow.DataflowClient method)
get_job_input_topic() (klio_core.dataflow.DataflowClient method)
get_or_initialize_global() (in module klio_core.utils)
get_publisher() (in module klio_core.utils)
GetMelSpec (class in klio_audio.transforms.audio)
GetMFCC (class in klio_audio.transforms.audio)
GetSpec (class in klio_audio.transforms.audio)
GetSTFT (class in klio_audio.transforms.audio)
H
handle_binary() (in module klio_audio.decorators)
handle_klio() (in module klio.transforms.decorators)
I
image_tag() (in module klio_core.options)
inc() (klio.metrics.dispatcher.CounterDispatcher method)
include_children() (in module klio_core.options)
inject_klio_context() (in module klio.transforms.decorators)
inputs
command line option
intended_recipients
command line option
interval() (in module klio_core.options)
iterations() (in module klio_core.options)
J
job() (klio.transforms.core.KlioContext property)
job_audit_log
command line option
job_config (klio_core.config.KlioConfig attribute)
job_config DICT
command line option
job_config.<additional_key> ANY
command line option
job_config.allow_non_klio_messages BOOL
command line option
job_config.blocking BOOL
command line option
job_config.data.inputs[].<custom-key> ANY
command line option
job_config.data.inputs[].<type_specific_config>
command line option
job_config.data.inputs[].file_suffix STR
command line option
job_config.data.inputs[].location STR
command line option
job_config.data.inputs[].ping BOOL
command line option
,
[1]
,
[2]
job_config.data.inputs[].skip_klio_existence_check BOOL
command line option
,
[1]
,
[2]
job_config.data.inputs[].type
command line option
job_config.data.inputs[].type STR
command line option
,
[1]
job_config.data.outputs[].<custom-key> ANY
command line option
job_config.data.outputs[].<type_specific_config>
command line option
job_config.data.outputs[].file_suffix STR
command line option
job_config.data.outputs[].force BOOL
command line option
,
[1]
,
[2]
job_config.data.outputs[].location STR
command line option
job_config.data.outputs[].skip_klio_existence_check BOOL
command line option
,
[1]
,
[2]
job_config.data.outputs[].type
command line option
job_config.data.outputs[].type STR
command line option
,
[1]
job_config.events.inputs[].<custom-key> ANY
command line option
job_config.events.inputs[].<type_specific_config>
command line option
job_config.events.inputs[].coder STR
command line option
,
[1]
job_config.events.inputs[].columns[]
command line option
job_config.events.inputs[].columns[].<column> STR
command line option
job_config.events.inputs[].compression_type STR
command line option
job_config.events.inputs[].dataset STR
command line option
job_config.events.inputs[].file_pattern STR
command line option
job_config.events.inputs[].flatten_results BOOL
command line option
job_config.events.inputs[].kms_key STR
command line option
job_config.events.inputs[].location STR
command line option
job_config.events.inputs[].min_bundle_size INT
command line option
job_config.events.inputs[].project STR
command line option
job_config.events.inputs[].query STR
command line option
job_config.events.inputs[].skip_header_lines INT
command line option
job_config.events.inputs[].skip_klio_read BOOL
command line option
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.inputs[].skip_klio_write BOOL
command line option
,
[1]
,
[2]
job_config.events.inputs[].strip_trailing_newlines BOOL
command line option
job_config.events.inputs[].subscription STR
command line option
job_config.events.inputs[].table STR
command line option
job_config.events.inputs[].topic STR
command line option
job_config.events.inputs[].type
command line option
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.inputs[].type STR
command line option
job_config.events.inputs[].use_standard_sql BOOL
command line option
job_config.events.inputs[].validate BOOL
command line option
,
[1]
job_config.events.outputs[].<custom-key> ANY
command line option
job_config.events.outputs[].<type_specific_config>
command line option
job_config.events.outputs[].append_trailing_newlines BOOL
command line option
job_config.events.outputs[].codec STR
command line option
job_config.events.outputs[].coder STR
command line option
job_config.events.outputs[].compression_type STR
command line option
job_config.events.outputs[].create_disposition STR
command line option
job_config.events.outputs[].dataset STR
command line option
job_config.events.outputs[].file_name_suffix STR
command line option
,
[1]
job_config.events.outputs[].file_pattern STR
command line option
job_config.events.outputs[].footer STR
command line option
job_config.events.outputs[].header STR
command line option
job_config.events.outputs[].location STR
command line option
,
[1]
job_config.events.outputs[].mime_type STR
command line option
job_config.events.outputs[].num_shards INT
command line option
job_config.events.outputs[].num_shards STR
command line option
job_config.events.outputs[].project STR
command line option
job_config.events.outputs[].schema DICT
command line option
job_config.events.outputs[].shard_name_template STR
command line option
,
[1]
job_config.events.outputs[].skip_klio_write BOOL
command line option
,
[1]
job_config.events.outputs[].table STR
command line option
job_config.events.outputs[].topic STR
command line option
job_config.events.outputs[].type
command line option
,
[1]
,
[2]
,
[3]
,
[4]
job_config.events.outputs[].type STR
command line option
job_config.events.outputs[].write_disposition STR
command line option
job_config.metrics.logger DICT | BOOL
command line option
job_config.metrics.logger.level STR
command line option
job_config.metrics.logger.timer_unit STR
command line option
job_config.metrics.native DICT | BOOL
command line option
job_config.metrics.native.timer_unit STR
command line option
job_config.metrics.shumway DICT | BOOL
command line option
job_config.metrics.shumway.timer_unit STR
command line option
job_name
command line option
job_name (klio_core.config.KlioConfig attribute)
(klio_core.config.KlioJobConfig attribute)
(klio_core.config.KlioPipelineConfig attribute)
job_name STR
command line option
K
klio-image-build command line option
--config-file <config_file>
--image-tag <image_tag>
--job-dir <job_dir>
--override <override>
--template <template>
-c
-j
-O
-T
klio-job-audit command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--job-dir <job_dir>
--list
--override <override>
--template <template>
-c
-j
-O
-T
klio-job-config-get command line option
--config-file <config_file>
--job-dir <job_dir>
-c
-j
SECTION.PROPERTY
klio-job-config-set command line option
--config-file <config_file>
--job-dir <job_dir>
-c
-j
SECTION.PROPERTY=VALUE...
klio-job-config-show command line option
--config-file <config_file>
--job-dir <job_dir>
-c
-j
klio-job-config-unset command line option
--config-file <config_file>
--job-dir <job_dir>
-c
-j
SECTION.PROPERTY
klio-job-create command line option
--gcp-project <gcp_project>
--job-name <job_name>
--output <output>
--use-defaults
ADDL_JOB_OPTS
klio-job-delete command line option
--config-file <config_file>
--job-dir <job_dir>
--override <override>
--template <template>
-c
-j
-O
-T
klio-job-deploy command line option
--config-file <config_file>
--direct-runner
--force-build
--image-tag <image_tag>
--job-dir <job_dir>
--no-update
--override <override>
--template <template>
--update
-c
-j
-O
-T
klio-job-profile-collect-profiling-data command line option
--config-file <config_file>
,
[1]
--gcs-location <gcs_location>
--input-file <input_file>
--job-dir <job_dir>
,
[1]
--output-file <output_file>
--override <override>
--since <since>
--sort-stats <sort_stats>
--template <template>
--until <until>
-c
,
[1]
-i
-j
,
[1]
-o
-O
-T
RESTRICTIONS
klio-job-profile-cpu command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--input-file <input_file>
--interval <interval>
--job-dir <job_dir>
--output-file <output_file>
--override <override>
--plot-graph
--show-logs
--template <template>
-c
-g
-i
-j
-o
-O
-T
ENTITY_IDS
klio-job-profile-memory command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--include-children
--input-file <input_file>
--interval <interval>
--job-dir <job_dir>
--multiprocess
--output-file <output_file>
--override <override>
--plot-graph
--show-logs
--template <template>
-c
-g
-i
-j
-o
-O
-T
ENTITY_IDS
klio-job-profile-memory-per-line command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--input-file <input_file>
--job-dir <job_dir>
--maximum
--output-file <output_file>
--override <override>
--per-element
--show-logs
--template <template>
-c
-i
-j
-o
-O
-T
ENTITY_IDS
klio-job-profile-timeit command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--input-file <input_file>
--iterations <iterations>
--job-dir <job_dir>
--output-file <output_file>
--override <override>
--show-logs
--template <template>
-c
-i
-j
-n
-o
-O
-T
ENTITY_IDS
klio-job-run command line option
--config-file <config_file>
--direct-runner
--force-build
--image-tag <image_tag>
--job-dir <job_dir>
--no-update
--override <override>
--template <template>
--update
-c
-j
-O
-T
klio-job-stop command line option
--config-file <config_file>
,
[1]
--gcp-project <gcp_project>
--job-dir <job_dir>
,
[1]
--job-name <job_name>
--override <override>
--region <region>
--template <template>
-c
,
[1]
-j
,
[1]
-O
-T
klio-job-test command line option
--config-file <config_file>
--force-build
--image-tag <image_tag>
--job-dir <job_dir>
--override <override>
--template <template>
-c
-j
-O
-T
PYTEST_ARGS
klio-job-verify command line option
--config-file <config_file>
--create-resources
--job-dir <job_dir>
--override <override>
--template <template>
-c
-j
-O
-T
klio-message-publish command line option
--bottom-up
--config-file <config_file>
--force
--job-dir <job_dir>
--non-klio
--override <override>
--ping
--template <template>
--top-down
-b
-c
-f
-j
-n
-O
-p
-t
-T
ENTITY_IDS
klio.message
module
klio.message.exceptions
module
klio.message.serializer
module
klio.metrics
module
klio.metrics.base
module
klio.metrics.client
module
klio.metrics.dispatcher
module
klio.metrics.logger
module
klio.metrics.native
module
klio.metrics.shumway
module
klio.transforms
module
klio.utils
module
klio_cli.cli
module
klio_core.config
module
klio_core.dataflow
module
klio_core.options
module
klio_core.utils
module
klio_core.variables
module
klio_job
command line option
KlioCheckRecipients (class in klio.transforms.helpers)
KlioConfig (class in klio_core.config)
KlioConfigTemplatingException
KlioContext (class in klio.transforms.core)
KlioDebugMessage (class in klio.transforms.helpers)
KlioDrop (class in klio.transforms.helpers)
klioexec-audit command line option
--config-file <config_file>
--list
-c
klioexec-profile-cpu command line option
--config-file <config_file>
--input-file <input_file>
--interval <interval>
--output-file <output_file>
--plot-graph
--show-logs
-c
-g
-i
-o
ENTITY_IDS
klioexec-profile-memory command line option
--config-file <config_file>
--include-children
--input-file <input_file>
--interval <interval>
--multiprocess
--output-file <output_file>
--plot-graph
--show-logs
-c
-g
-i
-o
ENTITY_IDS
klioexec-profile-memory-per-line command line option
--config-file <config_file>
--input-file <input_file>
--maximum
--output-file <output_file>
--per-element
--show-logs
-c
-i
-o
ENTITY_IDS
klioexec-profile-timeit command line option
--config-file <config_file>
--input-file <input_file>
--iterations <iterations>
--output-file <output_file>
--show-logs
-c
-i
-n
-o
ENTITY_IDS
klioexec-run command line option
--blocking
--config-file <config_file>
--direct-runner
--image-tag <image_tag>
--job-dir <job_dir>
--no-blocking
--no-update
--override <override>
--template <template>
--update
-c
-j
-O
-T
klioexec-stop command line option
--config-file <config_file>
-c
klioexec-test command line option
--config-file <config_file>
-c
PYTEST_ARGS
KlioFilterForce (class in klio.transforms.helpers)
KlioFilterPing (class in klio.transforms.helpers)
KlioGcsCheckInputExists (class in klio.transforms.helpers)
KlioGcsCheckOutputExists (class in klio.transforms.helpers)
KlioJobConfig (class in klio_core.config)
KlioMessageCounter (class in klio.transforms.helpers)
KlioMessageException
KlioMessagePayloadException
KlioMissingConfiguration
KlioPipelineConfig (class in klio_core.config)
KlioReadFromAvro (class in klio.transforms.io)
KlioReadFromBigQuery (class in klio.transforms.io)
KlioReadFromPubSub (class in klio.transforms.io)
KlioReadFromText (class in klio.transforms.io)
KlioRunner (class in klio_core.variables)
KlioSetTrace (class in klio.transforms.helpers)
KlioTriggerUpstream (class in klio.transforms.helpers)
KlioUpdateAuditLog (class in klio.transforms.helpers)
KlioWriteToAvro (class in klio.transforms.io)
KlioWriteToBigQuery (class in klio.transforms.io)
KlioWriteToEventOutput (class in klio.transforms.helpers)
KlioWriteToPubSub (class in klio.transforms.io)
KlioWriteToText (class in klio.transforms.io)
L
level
metrics-config command line option
limited
command line option
LoadAudio (class in klio_audio.transforms.audio)
logger() (klio.metrics.dispatcher.BaseMetricDispatcher property)
(klio.metrics.logger.MetricsLoggerClient property)
(klio.transforms.core.KlioContext property)
LoggerCounter (class in klio.metrics.logger)
LoggerGauge (class in klio.metrics.logger)
LoggerMetric (class in klio.metrics.logger)
LoggerTimer (class in klio.metrics.logger)
M
marshal() (klio.metrics.client.MetricsRegistry method)
maximum() (in module klio_core.options)
MelSpecToPlot (class in klio_audio.transforms.audio)
metadata
command line option
metrics (klio_core.config.KlioJobConfig attribute)
metrics() (klio.transforms.core.KlioContext property)
metrics-config command line option
level
timer_unit
MetricsLoggerClient (class in klio.metrics.logger)
MetricsRegistry (class in klio.metrics.client)
MFCCToPlot (class in klio_audio.transforms.audio)
module
klio.message
klio.message.exceptions
klio.message.serializer
klio.metrics
klio.metrics.base
klio.metrics.client
klio.metrics.dispatcher
klio.metrics.logger
klio.metrics.native
klio.metrics.shumway
klio.transforms
klio.utils
klio_cli.cli
klio_core.config
klio_core.dataflow
klio_core.options
klio_core.utils
klio_core.variables
multiprocess() (in module klio_core.options)
N
NativeCounter (class in klio.metrics.native)
NativeGauge (class in klio.metrics.native)
NativeMetricsClient (class in klio.metrics.native)
NativeTimer (class in klio.metrics.native)
NONE (klio.utils.ThreadLimit attribute)
P
payload
command line option
per_element() (in module klio_core.options)
ping
command line option
pipeline_options (klio_core.config.KlioConfig attribute)
pipeline_options DICT
command line option
pipeline_options.autoscaling_algorithm STR
command line option
pipeline_options.disk_size_gb INT
command line option
pipeline_options.experiments[] LIST(STR)
command line option
pipeline_options.max_num_workers INT
command line option
pipeline_options.num_workers INT
command line option
pipeline_options.project STR
command line option
pipeline_options.region STR
command line option
pipeline_options.runner STR
command line option
pipeline_options.setup_file STR
command line option
pipeline_options.staging_location STR
command line option
pipeline_options.streaming BOOL
command line option
pipeline_options.temp_location STR
command line option
pipeline_options.worker_disk_type STR
command line option
pipeline_options.worker_harness_container_image STR
command line option
pipeline_options.worker_machine_type STR
command line option
plot_graph() (in module klio_core.options)
profile() (in module klio.transforms.decorators)
PYTEST_ARGS
klio-job-test command line option
klioexec-test command line option
R
recipients
command line option
RELAY_CLIENT_NAME (klio.metrics.base.AbstractRelayClient attribute)
release() (klio.utils.ThreadLimiter method)
RESTRICTIONS
klio-job-profile-collect-profiling-data command line option
retry() (in module klio.transforms.decorators)
S
SECTION.PROPERTY
klio-job-config-get command line option
klio-job-config-unset command line option
SECTION.PROPERTY=VALUE...
klio-job-config-set command line option
serialize_klio_message() (in module klio.transforms.decorators)
set() (klio.metrics.dispatcher.GaugeDispatcher method)
set_global() (in module klio_core.utils)
set_klio_context() (in module klio.transforms.decorators)
show_logs() (in module klio_core.options)
ShumwayCounter (class in klio.metrics.shumway)
ShumwayGauge (class in klio.metrics.shumway)
ShumwayMetricsClient (class in klio.metrics.shumway)
ShumwayTimer (class in klio.metrics.shumway)
SpecToPlot (class in klio_audio.transforms.audio)
start() (klio.metrics.dispatcher.TimerDispatcher method)
stop() (klio.metrics.dispatcher.TimerDispatcher method)
submit() (klio.metrics.dispatcher.BaseMetricDispatcher method)
subscription
command line option
T
ThreadLimit (class in klio.utils)
ThreadLimiter (class in klio.utils)
timeout() (in module klio.transforms.decorators)
timer() (klio.metrics.base.AbstractRelayClient method)
(klio.metrics.client.MetricsRegistry method)
(klio.metrics.logger.MetricsLoggerClient method)
(klio.metrics.native.NativeMetricsClient method)
(klio.metrics.shumway.ShumwayMetricsClient method)
timer_unit
metrics-config command line option
TIMER_UNIT_MAP (in module klio.metrics.logger)
(in module klio.metrics.native)
(in module klio.metrics.shumway)
TimerDispatcher (class in klio.metrics.dispatcher)
timestamp
command line option
to_klio_message() (in module klio.message.serializer)
topic
command line option
trigger_children_of
command line option
U
UNKNOWN
command line option
unmarshal() (klio.metrics.base.AbstractRelayClient method)
(klio.metrics.client.MetricsRegistry method)
(klio.metrics.logger.MetricsLoggerClient method)
(klio.metrics.shumway.ShumwayMetricsClient method)
update() (in module klio_core.options)
V
V1
command line option
V2
command line option
version
command line option
version (klio_core.config.KlioConfig attribute)
(klio_core.config.KlioJobConfig attribute)
(klio_core.config.KlioPipelineConfig attribute)
version INT
command line option
visited
command line option
W
WaveformToPlot (class in klio_audio.transforms.audio)
with_klio_config() (in module klio_core.utils)