FAQs

General

• What is Klio used for at Spotify?
• What doesn’t Klio do?
• Why not other open source frameworks?
• Do I need Google Cloud Dataflow to use Klio?
• What’s the performance of a Klio pipeline?
• Can Klio be used for smaller loads for ongoing research? or just production loads?

Klio vs …

• How does Klio compare to Spotify Scio?
• How does Klio compare to Kubeflow?
• How does Klio compare to Tensorflow Serving?

Beam and Klio

• How does Klio relate to Apache Beam?
• Does Klio allow you to use native Beam components?

Technical

• Does Klio take care of downloading input/uploading output data files to/from workers?
• How are DAGs described within Klio?
• Can I consume a non-KlioMessage?
• Can I publish KlioMessages from a non-Klio job to a Klio job?
• Can I use my own protobuf definition for the KlioMessage?
• How Do I Migrate from FnAPI to setup.py?
• How Do I Migrate from setup.py to FnAPI?
• What do I need to know about using setup.py to package dependencies in Klio?
• Converting a Streaming Pipeline to Batch