hypernephelist n. [from Greek nepho-, cloud] someone who goes above the clouds.

Data preparation at scale on Azure Machine Learning using Dask

In a recent project, we worked with our customer on a sustainability project whose goal was to leverage geospatial and climate data to build a platform to perform machine learning model training and inference. The project was of the “machine learning operationalization” type, where we take a codebase that was written by data scientists and machine learning engineers, in the form of experimental Python notebooks, and we port this code to a platform where the processes of data preparation and model training can be automated using workflows and pipelines, and performed at scale.


Adding a trusted certificate for containerd on Kubernetes using a DaemonSet

The Kubernetes project is currently in the process of migrating its container runtime from Docker to containerd, and is planning to obsolete Docker as a container runtime after version 1.20. In most cases, this should be fairly transparent, but if you click through to the Dockershim Deprecation FAQ, you can see a pretty long list of possible ways this could impact you.


Scalable Azure DevOps Agent Pools using VM Scale Sets

When using Azure DevOps Pipelines, you can get started very quickly by using Microsoft-hosted build agents to run your build and test jobs. However there are some cases where custom (a.k.a. “self-hosted”) build agents might be desirable, the typical case being that you need to install a bunch of tools that are not present in the Microsoft-hosted agents. It is always possible to install custom tools on the fly, and it mostly works when all you need is a couple dependencies, however this method will not be practical when you need a full toolchain installed.


Azure VM Custom Script Extensions with Terraform

Terraform provides support for Azure Virtual Machine Custom Script extensions, that are often used to configure a newly created virtual machine and prepare it so it is ready to perform its role. Typical tasks performed in these custom scripts include installing additional packages, configuring system services, creating users, etc.


Installing SUSE CAP on AKS

This article describes the steps to deploy the SUSE Cloud Application Platform (CAP) on Azure Kubernetes Service (AKS). SUSE Cloud Application Platform is a software platform for cloud-native application deployment based on SUSE Cloud Foundry; SUSE Cloud Foundry differentiates itself from other Cloud Foundry distributions by running in Linux containers managed by Kubernetes, rather than virtual machines managed with BOSH, for greater fault tolerance and lower memory use.