Helpers

class klio.transforms.helpers.KlioGcsCheckInputExists

Klio transform to check input exists in GCS.

class klio.transforms.helpers.KlioGcsCheckOutputExists

Klio transform to check output exists in GCS.

class klio.transforms.helpers.KlioFilterPing

Klio transform to tag outputs if in ping mode or not.

class klio.transforms.helpers.KlioFilterForce

Klio transform to tag outputs if in force mode or not.

class klio.transforms.helpers.KlioWriteToEventOutput

Klio composite transform to write to the configured event output.

class klio.transforms.helpers.KlioDrop

Klio DoFn to log & drop a KlioMessage.

class klio.transforms.helpers.KlioCheckRecipients

Check if current job should handle a received v2 message.

class klio.transforms.helpers.KlioUpdateAuditLog

Update a KlioMessage’s audit log to include current job.

class klio.transforms.helpers.KlioDebugMessage

Log KlioMessage.

Parameters
  • prefix (str) – logging prefix. Default: "DEBUG".

  • log_level (str or int) – The desired log level for the KlioMessage logs. See available log levels for what’s supported. Default: "INFO".

class klio.transforms.helpers.KlioSetTrace

Insert a Python debugger trace point.