Talks | Tutorials
Tutorial: From Notebook to Kubeflow Pipelines with HP Tuning: A Data Science Journey

by | September 2020

3 min read

August 17, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 An introduction to Kubeflow, the ML toolkit for K8s and the workflows you can use as a data scientist to scale up your ML code effortlessly. Ever thought how hard it is to convert your Jupyter Notebooks into deployable and composable pipelines, scale up computation […]
KubeCon Amsterdam 2020 - Tutorial - From Notebook to Kubeflow Pipelines with HP Tuning - A Data Science Journey

August 17, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020

An introduction to Kubeflow, the ML toolkit for K8s and the workflows you can use as a data scientist to scale up your ML code effortlessly.

Ever thought how hard it is to convert your Jupyter Notebooks into deployable and composable pipelines, scale up computation and run hyperparameter tuning? With Kubeflow, this process becomes extremely easy as you make use of the many components of this ML toolkit: Pipelines, Kale, Katib, Snapshot Store.

You will learn how to deploy Kubeflow in minutes, explore your ML code inside a Jupyter Notebook, convert it to a composable and scalable workflow with the click of a button, make the pipeline reproducible using immutable snapshots, go back in history and debug it, run hyperparameter tuning and distribute your computation.

Did we mention you won’t need any specific SDK or CLI command to do this? Sounds like magic? Come and see for yourself!

Speakers

Ilias Katsakioris

Ilias Katsakioris

Software Engineer

Ilias Katsakioris is a Software Engineer at Arrikto. He holds a Diploma in Electrical and Computer Engineering from the National Technical University of Athens. He is a Kubernetes and Kubeflow enthusiast, and he has been contributing to the Kubeflow project for almost a year. His main Kubeflow contributions are in the area of Data Management and Data Pipelines. Ilias extended the Kubeflow Pipelines DSL to support K8s Persistent Volumes and Volume Snapshots.

Stefano Fioravanzo

Stefano Fioravanzo

Software Engineer

Stefano Fioravanzo is a Software Engineer at Arrikto, his background is in Data Science and ML Research. He understands the value of building robust Machine Learning infrastructure and providing Data Scientist with the necessary tools to scale up their workflows. He works as a full-time contributor to Kubeflow and he is the creator of the Kubeflow Kale project which enables Jupyter Notebooks deployments to Kubeflow Pipelines.

Want the presentations?

More Like This

Kubeflow 1.1 Community Release Update

September, 2020 @ Kubeflow Community Update Call Josh Bottum, Kubeflow Community Product Manager, leads the community call giving us all an update on the great things that came in Kubeflow 1.1 This includes updates from; Josh Bottum, Arrikto, Kubeflow Product...

Kubeflow 1.0 Update By A Kubeflow Community Product Manager

August 20, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 This session will provide a Kubeflow 1.0 Update by a Kubeflow Community Product Manager. The presentation will include a review of the Kubeflow Community and feature development process, the Kubeflow...

Build An End-to-End ML Workflow: From Notebook to HP Tuning to Kubeflow Pipelines with Kale

In this tutorial, we will use Kale to unify the workflow across the above components, and present a seamless process to create ML pipelines for HP tuning, starting from your Jupyter Notebook. We will use Kale to convert a Jupyter Notebook to a Kubeflow Pipeline without any modification to the original Python code. Pipeline definition and deployment is achieved via an intuitive GUI, provided by Kale’s JupyterLab extension.

You May Also Like

k3d + GitHub Actions: Kubernetes E2E Testing Made Easy

Combining k3d and GitHub Actions for easy, quick and cheap E2E testing The Old Way During my first year of Software Engineering, I understood the importance of two things: E2E tests running with CI. They save a ton of manual effort testing the software, increase...

Kubeflow 1.1 Community Release Update

September, 2020 @ Kubeflow Community Update Call Josh Bottum, Kubeflow Community Product Manager, leads the community call giving us all an update on the great things that came in Kubeflow 1.1 This includes updates from; Josh Bottum, Arrikto, Kubeflow Product...

Kubeflow 1.0 Update By A Kubeflow Community Product Manager

August 20, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 This session will provide a Kubeflow 1.0 Update by a Kubeflow Community Product Manager. The presentation will include a review of the Kubeflow Community and feature development process, the Kubeflow...

Accelerate your ML lifecycle with Kubeflow 1.1 and the new MiniKF

We are very excited to announce that Kubeflow 1.1 and a new version of MiniKF have been released!  Kubeflow 1.1 Kubeflow 1.1 brings ML workflow automation with Fairing and Kale. The latter enables you to work on your notebook, write your ML code, define the...