Accelerate your ML lifecycle with Kubeflow 1.1 and the new MiniKF

by | August, 2020 | News

3 min read
Accelerate your ML lifecycle with Kubeflow 1.1 and the new MiniKF

We are very excited to announce that Kubeflow 1.1 and a new version of MiniKF have been released! 

Kubeflow 1.1

Kubeflow 1.1 brings ML workflow automation with Fairing and Kale. The latter enables you to work on your notebook, write your ML code, define the pipeline steps using an intuitive UI, and then build a multi-step pipeline automatically.

The latest release extends isolation and security through the delivery of multi-user pipelines. User authorization in the various Kubeflow web apps is enforced using subject access review.

Finally, the installation and operations of Kubeflow have been enhanced to support GitOps methodologies.

MiniKF

The latest MiniKF comes with brand-new support for HP tuning with Kubeflow Pipelines, Katib, and Kale. The same way you are using Kale to convert a Notebook to a Kubeflow Pipeline, you can now use it to optimize a model with the click of a button. Kale provides you with an intuitive UI to configure the parameters, search algorithm, and search objective. Then, it orchestrates Katib and Kubeflow Pipelines so that every Katib Trial is an individual Run on KFP. Kale groups all these runs under a single KFP experiment.

When performing hyperparameter tuning, some steps of the pipeline produce the same output every time, as they don’t include parameters that change. This is why it’s important to cache these steps and use your resources wisely to speed up the computation time. Rok caches individual pipeline steps for enhanced performance when performing hyperparameter tuning. 

This ML workflow completely unifies Katib with Kubeflow Pipelines, providing full visibility, and reproducibility for each step of the hyperparameter tuning process.

Moreover, Kubeflow Pipelines now run in the same, isolated namespace as your notebooks, and have access to the same resources. This is a great feature, especially when deploying Kubeflow and Rok on a multi-user environment.

After interacting with a lot of MiniKF users, as well as with our customers, who are using Arrikto’s curated version of Kubeflow on public clouds, we realized that the Kubeflow Central Dashboard needed some enhancements. That’s why in the latest version of MiniKF, we redesigned Kubeflow Central Dashboard sidebar, making it more intuitive and tailored to the needs of data scientists.

Another great feature is that we now expose the MiniKF dashboard at a standard `https://<minikf_name>.<project>.cloud.goog` URL for seamless HTTPS support.

If you want to experience a seamless data science workflow, where you will optimize a model using hyperparameter tuning with the click of a button, then follow this tutorial: https://codelabs.developers.google.com/codelabs/cloud-kubeflow-minikf-kale-katib/#0

The Kubeflow Community is pretty active and welcoming. We’d love you to join us!

More Like This

MiniKF: a fast and easy way to deploy Kubeflow on your laptop

Enterprises and organizations are discovering the power of cloud-based, distributed training using cloud-native Machine Learning solutions like Kubeflow. However, the vast majority of data science exploration and experimentation occurs on the laptops of data...

You May Also Like

Kubeflow 1.1 Community Release Update

September, 2020 @ Kubeflow Community Update Call Josh Bottum, Kubeflow Community Product Manager, leads the community call giving us all an update on the great things that came in Kubeflow 1.1 This includes updates from; Josh Bottum, Arrikto, Kubeflow Product...

Kubeflow 1.0 Update By A Kubeflow Community Product Manager

August 20, 2020 @ KubeCon + CloudNativeCon Europe Amsterdam 2020 This session will provide a Kubeflow 1.0 Update by a Kubeflow Community Product Manager. The presentation will include a review of the Kubeflow Community and feature development process, the Kubeflow...

MiniKF 20200812.0.0

NEW! Now with brand-new support for HP tuning with Kubeflow Pipelines, Katib, and Kale New MiniKF release including Kubeflow 1.0Rok 1.0 Get MiniKF New Features Upgrade Kubeflow to latest 1.0 release with custom featuresUpgrade Rok to latest 1.0 pre-releaseKubeflow...