Talks
Enabling Multi-user Machine Learning Workflows for Kubeflow Pipelines

by | September 2020

3 min read

August 18, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 Kubeflow is an open source machine learning platform built on Kubernetes. Every service in Kubeflow is implemented either as a Custom Resource Definition (CRD) (e.g., TensorFlow Job) or as a standalone service (e.g., Kubeflow Pipelines). As enterprises start to adopt Kubeflow, the need for access […]
KubeCon Amsterdam 2020 - Enabling Multi-User Workflows for Kubeflow Pipelines

August 18, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020

Kubeflow is an open source machine learning platform built on Kubernetes. Every service in Kubeflow is implemented either as a Custom Resource Definition (CRD) (e.g., TensorFlow Job) or as a standalone service (e.g., Kubeflow Pipelines).

As enterprises start to adopt Kubeflow, the need for access control, authentication, and authorization is emerging. Kubernetes CRDs come with their own auth story, but what about Services with their own API and database, like Kubeflow Pipelines? In this talk, we explore how we enabled multi-user workflows for Kubeflow Pipelines, in a Kubernetes-native way.

We present how we combined open-source, cloud-native technologies to design and implement a flexible, Kubernetes-native solution for services with their own API and database.

The talk will include a live demo.

Speakers

Yannis Zarkadas

Yannis Zarkadas

Software Engineer

Yannis is a software engineer at Arrikto, working with Kubeflow and the Kubernetes sig-storage group. He loves contributing to open source projects and has authored the Cassandra Operator in Rook and the official Scylla Operator, which he is currently maintaining.

Yuan Gong

Yuan Gong

Google Cloud – Software Engineer

I’m a software engineer at Google Cloud working on Kubeflow Pipelines project.

Want the presentations?

More Like This

Kubeflow 1.1 Community Release Update

September, 2020 @ Kubeflow Community Update Call Josh Bottum, Kubeflow Community Product Manager, leads the community call giving us all an update on the great things that came in Kubeflow 1.1 This includes updates from; Josh Bottum, Arrikto, Kubeflow Product...

Kubeflow 1.0 Update By A Kubeflow Community Product Manager

August 20, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 This session will provide a Kubeflow 1.0 Update by a Kubeflow Community Product Manager. The presentation will include a review of the Kubeflow Community and feature development process, the Kubeflow...

Panel: Enterprise-grade, On-prem Kubeflow in the Financial Sector

November 20, 2019 @ KubeCon + CloudNativeCon North America 2019 This presentation will explore the journeys of two ML architects from JPMorgan Chase and US Bank, who have deployed Kubeflow into their on-premise environments. These subject matter experts will review...

You May Also Like

k3d + GitHub Actions: Kubernetes E2E Testing Made Easy

Combining k3d and GitHub Actions for easy, quick and cheap E2E testing The Old Way During my first year of Software Engineering, I understood the importance of two things: E2E tests running with CI. They save a ton of manual effort testing the software, increase...

Kubeflow 1.1 Community Release Update

September, 2020 @ Kubeflow Community Update Call Josh Bottum, Kubeflow Community Product Manager, leads the community call giving us all an update on the great things that came in Kubeflow 1.1 This includes updates from; Josh Bottum, Arrikto, Kubeflow Product...

Kubeflow 1.0 Update By A Kubeflow Community Product Manager

August 20, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 This session will provide a Kubeflow 1.0 Update by a Kubeflow Community Product Manager. The presentation will include a review of the Kubeflow Community and feature development process, the Kubeflow...

Accelerate your ML lifecycle with Kubeflow 1.1 and the new MiniKF

We are very excited to announce that Kubeflow 1.1 and a new version of MiniKF have been released!  Kubeflow 1.1 Kubeflow 1.1 brings ML workflow automation with Fairing and Kale. The latter enables you to work on your notebook, write your ML code, define the...