Velero wants to become the Kubernetes backup standard

Open source Velero offers modular data protection and disaster recovery functionality via API for Kubernetes container clusters in an effort to become the standard in the field

By

Published: 09 Mar 2023 11:30

In the margins of the commercial products aimed at backup for Kubernetes clusters – Kasten from Veeam, Trilio and Pure’s Portworx – the open source project from Velero aims at becoming a standard.  

“Velero’s ambition is to take into account the most possible scenarios,” said Shubham Pampattiwar, chief engineer at Red Hat, who oversees contributions to Velero, and who met ComputerWeekly’s sister publication LeMagIt at a recent IT Press Tour event.  

“We have developed, for example, hooks or modules that quiesce an activity for the time needed to backup its data so as not to save it with incoherencies,” said Pampattiwar.

“But also modules that will carry out asynchronous backups so that data is backed up without stopping production. And an engine that parallelises several backup processes and/or restores so that activity can be restored as quickly as possible in case of cyber attack.”

It’s quite probable that the likes of Dell, Veritas or IBM could integrate Velero as a Kubernetes extension to their backup products, while Red Hat and VMware could enhance their Kubernetes offers, namely OpenShift and Tanzu, with a native backup function.

An assembler of storage processes

Initially called Heptio Ark, Velero offers just three functions for now. These are backup scheduling, backup and recovery. These take the form of a CRD – a Kubernetes CustomResourceDefinition – or a functional extension to Kubernetes and its configuration that’s defined in the ectd registry to configure the entire cluster.

Velero doesn’t implement backup functionality as such – rather, it acts as an engine to manage functionality on the cluster that can carry out backup. It manages snapshots, for example, offered through the CSI drivers provided by vendors for block storage, Restic or Kopia for file backup, or the Kubernetes API for emergency volumes in object storage mode.

“The availability of a growing number of modules that can integrate with surrounding infrastructure is the advantage of Velero,” said Pampattiwar. “For example, it is due to this that we can connect via API to cloud hosts to protect their resources. For the user, everything is transparent. They schedule their backup or carry out restores without having to be concerned with the underlying infrastructure.”

Drilling down, the user runs or schedules the running of commands such as “velero backup create ” and that launches the right scripts for the right APIs in the underlying infrastructure.

Concerning the infrastructure that hosts the backups, that can be an S3 cloud volume or file volume. All there needs to be is a module that defines the destination storage that the admin can point to in backup settings. The admin can enter, for example, “–provider aws” or “–provider Portworx” followed by necessary details such as the name of the volume or access credentials.

In the same way, the hooks are maintenance scripts adapted to run before or after backup functions.

For example, to backup files of a functioning pod running on a Linux system it’s enough to define a “pre-hook” during pod deployment that asks for a container to run the command “/sbin/fsfreeze” – where “freeze” stops access before the backup – then the command “/sbin/fsfreeze” to unfreeze it and reactivate I/O. In the same way, it can act on requests formulated by application APIs, sent in JSON format, at restore time, for example.

A plug-in engine for backup

Pampattiwar admits that to execute all backup functions from the command line could be complex for system administrators. But according to him, it’s a detail.

“The attraction of Velero is that it is open source,” said Pampattiwar. “That means it is useable by all storage vendors who have developed a CSI driver for their solution that is recognised by Kubernetes. Now vendors can integrate Velero functionality into a graphical console to administer systems.”

“The challenge for Velero is to focus on the mechanisms,” said Pampattiwar. “It’s a platform that’s sufficiently raw that anyone can come and propose improvements that will be useful for lots of people. It is up to everyone how they want to implement the final product so that it’s easy for their customers to use.”

Pampattiwar explained that storage vendors can only offer local backups with their CSI drivers. The first issue here is that these backups are potentially non-functional because they do not make sure that data is coherent before and after backup operations. The second is that these backups aren’t restorable to a different infrastructure. Integrating Velero into their products would offer reliable, multicloud protection.

“The commercial backup products are pre-packaged. Velero doesn’t have that ambition for now. Instead Velero wants to be a plug-in engine, capable of backup for everything, useable by new storage products as well as the historic incumbents,” said Pampattiwar, who promised regular arrivals of new functionality to smooth backup processes.

Read more on Containers

Read More
Zonia Antes

Latest

Will Spain keep finding a way? Re-ranking the World Cup teams with six games remaining – The Athletic – The New York Times

Forty-eight teams started these World Cup finals a month ago — now only six remain. Tomorrow that will be whittled down to a final four. Morocco became the first quarter-finalists to be knocked out, losing 2-0 to the seemingly unstoppable France on Thursday, before brave Belgium finally succumbed to Spain in Los Angeles on Friday

Erling Haaland is Norway’s World Cup machine — and the internet’s ‘babygirl’ – AP News

Erling Haaland stands at 6 feet, 5 inches, an intimidating force who can make fellow soccer players look tiny in stature and talent. Scoring seven goals across four World Cup matches entering Saturday, the Norwegian player has been described as a machine. But if you ask some loyal new fans, he’s also a babygirl and

Woody Marks and 5 fantasy football sleepers trending toward a much bigger role

One way to get an edge in fantasy football? By keeping a close eye on offseason chatter. Which players are impressing reporters in OTAs? Which roster battles could go a different way than the average fan expects? Which rookie is going to end up rocketing up draft boards by August? These five players are fairly

Matt Miller Announces Indefinite Leave From ESPN Amid Investigation Over Alleged Fantasy Football Fraud

On June 23, ESPN NFL Draft analyst Matt Miller revealed that he was in a car crash and was brutally injured. The accident nearly caused him to lose his life, as his arm had to be amputated to keep him alive. Now that he is making his way back after a drastic change, Miller announced

Newsletter

Don't miss

Will Spain keep finding a way? Re-ranking the World Cup teams with six games remaining – The Athletic – The New York Times

Forty-eight teams started these World Cup finals a month ago — now only six remain. Tomorrow that will be whittled down to a final four. Morocco became the first quarter-finalists to be knocked out, losing 2-0 to the seemingly unstoppable France on Thursday, before brave Belgium finally succumbed to Spain in Los Angeles on Friday

Erling Haaland is Norway’s World Cup machine — and the internet’s ‘babygirl’ – AP News

Erling Haaland stands at 6 feet, 5 inches, an intimidating force who can make fellow soccer players look tiny in stature and talent. Scoring seven goals across four World Cup matches entering Saturday, the Norwegian player has been described as a machine. But if you ask some loyal new fans, he’s also a babygirl and

Woody Marks and 5 fantasy football sleepers trending toward a much bigger role

One way to get an edge in fantasy football? By keeping a close eye on offseason chatter. Which players are impressing reporters in OTAs? Which roster battles could go a different way than the average fan expects? Which rookie is going to end up rocketing up draft boards by August? These five players are fairly

Matt Miller Announces Indefinite Leave From ESPN Amid Investigation Over Alleged Fantasy Football Fraud

On June 23, ESPN NFL Draft analyst Matt Miller revealed that he was in a car crash and was brutally injured. The accident nearly caused him to lose his life, as his arm had to be amputated to keep him alive. Now that he is making his way back after a drastic change, Miller announced

Garrett Nussmeier’s QB Brother Receives Upsetting News on Football Career

Colton Nussmeier has run out of options to fix his eligibility for 2026. On July 9, the UIL State Executive Committee voted 4–1 to reject his appeal, a decision first shared by 247Sports’ Mike Roach. With that, his plan to play his senior season at Denton Ryan is over. The door at his old school

Breitbart Business Digest: Stacking Those $250 Trump Bills

Weekly Wrap: Making It Rain with Trump Bills Welcome back to Friday! This is the Breitbart Business Digest weekly wrap, our septidialogic sweep through the economic and financial news. This week the economy failed to get indigestion from the high price of gas, Treasury Secretary Scott Bessent told us about getting fed at the Fed, Trump

Business seminar in Munich highlights Hong Kong’s strategic roles amidst global shifts (with photos)

Business seminar in Munich highlights Hong Kong's strategic roles amidst global shifts (with photos) ******************************************************************************************      The Hong Kong Economic and Trade Office, Berlin (HKETO Berlin), promoted Hong Kong's unique advantages and strategic roles at the seminar "Hong Kong's strategic role amidst geopolitical tensions" on June 18 (Munich time) in Munich, Germany.             Senior executives, investors

AI for business services: From job fears to productivity

AI for business services: From job fears to productivity