Virtualization Technology News and Information
Giant Swarm 2019 Predictions: Double Down on K8s, Day 2 Operations, Big Data, The Control Plane, and Extending the K8s API

Industry executives and experts share their predictions for 2019.  Read them in this 11th annual series exclusive.

Contributed by Oliver Thylmann, Co-Founder and CCO, Giant Swarm

Double Down on K8s, Day 2 Operations, Big Data, The Control Plane, and Extending the K8s API

1. The big ones will double down on Kubernetes

You have already seen that with the big cloud providers as well as other players like IBM and VMWare. The acquisitions of Red Hat and Heptio respectively show that these companies are getting more into the game. These are mostly support plays though and if you look at the managed services market, with companies like Accenture, there are still plenty of companies that service enterprises that will need to increase their capabilities. The cards are being shuffled again, as with all major changes in infrastructure.

The big ones might also be some bigger Fortune 500 companies that decide to rebuild internal platforms on Kubernetes and go their own way based on Open Source tools. Partly due to hiring pressure you will see an increase in Open Source tools around Kubernetes being released from these companies. We cover this same topic below in prediction #5.

2. The Focus will be on Day 2 Operations

Installing Kubernetes is easy, but then what? Our focus on day 2 operations, honing in on security, updates, post mortems, and more has been tested and proven. The big players will be in a race to get newer versions out the fastest with CVEs fixed in production in next to no time. Customers will demand it and adapt their processes to allow for it.

We have talked with many people that were burned here. They are still running Kubernetes 1.8 or lower with no upgrade on the horizon. This leaves them with a gaping security hole, since recent patches have only been released for 1.10 and above.

3. Big Data will move to Kubernetes

You will see big data players support Kubernetes with all their might. Companies will move their production systems away from huge, but old big data stacks. They will also move away from proprietary cloud provider stacks, towards specialized Kubernetes solutions in multi-cluster environments. The distinction between cloud and non-cloud will blur as a side effect but this will take a bit longer than a year.

I recommend keeping an eye on companies like Dotscience and Aljabr.

4. The rise of the control planes

We could not run Kubernetes at the scale we do without running our own control plane in Kubernetes. We use Operators (custom controllers) to manage our tenant clusters. Other players will focus on this, with or without Operators, as it becomes apparent that one cluster to rule them all does not cut it. The cluster API is one project that needs to be mentioned here.

More clusters will be created at the edge for retail, industrial, and IoT workloads. A cluster per site makes it easier to deploy and update apps to these locations. However, this increase in cluster numbers will make automation even more important.

5. Extending the Kubernetes API

This is a 2-part prediction:

First: More and more apps will be deployed and managed by Custom Resource Definitions (CRDs). Independent Software Vendor (ISVs), especially will provide their software as packages that will either include or use operators to roll-out continuous updates. This software will often be packaged as Helm charts.

Second: Kubernetes providers new and old will mainly extend Kubernetes using CRDs. On the one hand, this will go towards cluster APIs like Giant Swarm or the upstream cluster API. On the other hand, towards platforms on top of Kubernetes, e.g. ML/AI platforms, PaaS-like offerings, CI/CD pipelines, all as native Kubernetes extensions.

At Giant Swarm we are replacing our API gateway with CRDs and using the Kubernetes API directly. This lets us benefit from Kubernetes features such as RBAC and Admission Controllers. It also makes it easier for our API to interact with our Operators.

This at scale will increase the load on API servers as event managers. As a result, either the community will work on scaling API servers and Etcd itself or resort to out-of-cluster solutions.

In conclusion, Kubernetes is now well entrenched in the mainstream. It is an increased focus both for the big providers and for the big users. Yet, it has by no means plateaued. This means operational challenges at scale on the one hand, and many changes and rapid developments to the ecosystem on the other hand. I am looking forward to your comments with your predictions for 2019.


About the Author

Oliver Thylmann 

Husband, Father of 3, Internet Entrepreneur since 1996, developer whisperer, geek, compulsive first adopter, co-founder @giantswarm in Cologne, Germany.

Published Thursday, January 17, 2019 10:03 AM by David Marshall
There are no comments for this post.
To post a comment, you must be a registered user. Registration is free and easy! Sign up now!
<January 2019>