Operations | Monitoring | ITSM | DevOps | Cloud

Monitoring MLOps Workflows with Flyte-powered Grafana Dashboards - Civo Navigate NA 2023

Learn how to monitor MLOps workflows effectively with Flyte-powered Grafana dashboards in this talk from Navigate NA 2023. Shivay Lamba discusses the importance of monitoring in the MLOps journey, highlighting the unique challenges in monitoring machine learning models compared to standard software development. Discover how Flyte, an open-source project, can help manage and monitor ML tasks efficiently, and see a live demonstration of setting up Grafana dashboards to visualize system metrics like CPU and GPU utilization. Take advantage of this opportunity to enhance your MLOps monitoring skills and optimize your machine learning workflows.
Sponsored Post

Kubernetes Monitoring Best Practices

Kubernetes can be installed using different tools, whether open-source, third-party vendor, or in a public cloud. In most cases, default installations have limited monitoring capabilities. Therefore, once a Kubernetes cluster is running, administrators must implement monitoring solutions to meet their requirements. Typical use cases for Kubernetes monitoring include: Effective Kubernetes monitoring requires a mix of tools, strategy, and technical expertise. To help you get it right, this article will explore seven essential Kubernetes monitoring best practices in detail.

Best Practices for Monitoring Kubernetes with Grafana

There are tons of tools to choose from when it comes to visualizing data, but Grafana has become one of the best ways for organizations to visualize information and get notified about events happening within their infrastructure or data. According to Kubernetes: In this article, we will take a look at the best practices for monitoring Kubernetes using Grafana.

Kubernetes Gateway API (Everything You Should Know)

The Kubernetes networking landscape is shifting. The traditional Kubernetes Ingress approach is being complemented and, in some cases, replaced by a more powerful, flexible, and extensible standard: the Kubernetes Gateway API. Kubernetes has become the go-to platform for orchestrating and managing containerized applications. A key aspect of Kubernetes that's crucial for the functionality of these applications? Networking.

Introduction to Azure Kubernetes Service

In the constantly evolving world of technology, managing containerized applications at a scale that can match growing business demands is a challenging task. Microsoft, however, has emerged as a leader in this field, offering the Azure Kubernetes Service (AKS). AKS is a managed container orchestration service that provides a rich and robust platform for developers to deploy, scale, and manage their applications.

Komodor Announces the Availability of Amazon Elastic Kubernetes Service [Amazon EKS] Blueprints as an Add-On

We’re pleased to announce that the Komodor platform has published an Amazon Elastic Kubernetes Service (Amazon EKS) Blueprints CDK Add-On. Amazon EKS is a managed Kubernetes service that streamlines the deployment and scaling of cloud-based or on-prem K8s clusters.

Troubleshooting Kubernetes Deployment at Every Level!

Kubernetes has emerged as the de facto standard for container orchestration, with its ability to automate deployment, scaling, and management of containerized applications. However, even with the best practices and expertise, Kubernetes deployment can sometimes be a complex and challenging process. It involves multiple layers of infrastructure, including the application, Kubernetes cluster, nodes, network, and storage, and each layer can have its own set of issues and challenges.

ClickOps over GitOps - Civo Navigate NA 2023

In this presentation, Laszlo Fogas, the founder of Gimlet.io, introduces "ClickOps over GitOps." Discover how ClickOps revolutionizes cloud operations, enabling infrastructure as code changes with dashboard actions. Learn about the benefits of this approach, its role in platform engineering, and see practical use cases with live demos. Streamline your DevOps processes and avoid configuration drift by exploring ClickOps in this Navigate NA 2023 talk.

Cloud-Based vs Cloud-Native: What's the difference?

Get to know the differences between cloud-native and cloud-based applications, their benefits, and why a cloud-native tool like Cloudsmith is a game-changer for efficient and secure software artifact management. The term 'cloud' has become a buzzword in the tech industry, often used interchangeably to describe anything from online storage to complex computing services. But what does it really mean? And more importantly, what does it mean for your business?

Container Security Fundamentals - Linux Namespaces (Part 3): The Network Namespace

In this video, we continue our examination of Linux namespaces by looking at some details of how the network namespace can be used to isolate a container’s view of network resources, and how this feature can be used for troubleshooting container problems.

How to monitor your Apache Mesos clusters with Grafana Cloud

We’re excited to introduce a dedicated Grafana Cloud solution for Apache Mesos, an open-source project for managing clusters in your data center and at cloud scale. Apache Mesos is a distributed systems kernel, running on every machine in a cluster and providing easy orchestration of every resource in the cluster. This allows you to treat compute units, memory, and disk as a single pool of resources.

Say Goodbye to Your Staging Environment. Use Ephemeral Environments!

Oh god! Are you not yet using Ephemeral Environments? Join this live session (recorded) with Romaric (CEO of Qovery) to learn more about Ephemeral Environments and why they will help you eliminate all the downsides of static environments like your Staging. During this session, Romaric has covered: This live session was free and perfect for technical people - CTO, VP Engineering, DevOps engineers, Platform Engineers, and Developers.

A Software Developer's Guide to Getting Started With Kubernetes: Part 2

In Part 1 of this series, you learned the core components of Kubernetes, an open-source container orchestrator for deploying and scaling applications in distributed environments. You also saw how to deploy a simple application to your cluster, then change its replica count to scale it up or down. In this article, you’ll get a deeper look at the networking and monitoring features available with Kubernetes.

Building a Reliable and Scalable Infrastructure: Partoo's Journey with Qovery

Discover how Qovery empowered Partoo, a SaaS company focused on enhancing businesses' customer journey, to overcome their infrastructure challenges and achieve exceptional results. We met Antoine Boileau, Engineering Manager at Partoo, that told us more about their journey. With Qovery, Partoo found the ideal platform to integrate seamlessly, scale effortlessly, and receive reliable support.

Kubernetes Community Day Munich Recap: A Meeting of Tech Minds and Ideas

This July, the community spirit was profoundly vibrant in the scenic city of Munich, as Kubernetes Community Day (KCD) Munich brought together a meeting of minds and inspired the open-source collaboration we all know and love. The event was a testament to the strength and vitality of the Kubernetes community, which pulsed with an energy of shared intellectual curiosity and passion for all things Kubernetes.

Optimizing Network Performance using Topology Aware Routing with Calico eBPF and Standard Linux dataplane

In this blog post, we will explore the concept of Kubernetes topology aware routing and how it can enhance network performance for workloads running in Amazon. We will delve into topology aware routing and discuss its benefits in terms of reducing latency and optimizing network traffic flow. In addition, we’ll show you how to minimize the performance impact of overlay networking, using encapsulation only when necessary for communication across availability zones.

A Detailed Guide to Docker Secrets

This post was written by Talha Khalid, a full-stack developer and data scientist who loves to make the cold and hard topics exciting and easy to understand. No one has any doubt that microservices architecture has already proven to be efficient. However, implementing security, particularly in an immutable infrastructure context, has been quite the challenge.

10 Burning Questions CTOs Have About Kubernetes

As enterprise architecture and technology innovation leaders, it's crucial to understand the benefits, limitations and best practices associated with building cloud native apps and modernizing legacy workloads. Gartner recently published a worthwhile read addressing what keeps CTOs up at night while assessing Kubernetes and container adoption.

Architecting Cloud Instrumentation

Architecting cloud instrumentation to secure a complex and diverse enterprise infrastructure is no small feat. Picture this: you have hundreds of virtual machines, some with specialized purposes and tailor-made configurations, thousands of containers with different images, a plethora of exposed endpoints, s3 buckets with both public and private access policies, backend databases that need to be accessed through secure internet gateways, etc.

Docker Container Lifecycle Management

Managing an application's dependencies and tech stack across numerous cloud and development environments is a regular difficulty for DevOps teams. Regardless of the underlying platform it uses, it must maintain the application's stability and functionality as part of its regular duties. However, one possible solution to this problem is to create an OS image that already contains the required libraries and configurations needed to run the application.

Embracing Asynchronous Communication at Qovery

In today’s face-paced and interconnected business environment, effective communication is at the heart of a successful organisation. After the pandemic and as companies expand across timezones, rely on remote teams that enhance diversity, and seek to increase productivity, our traditional approach of synchronous communication can become a struggle.

Comparing Networking Solutions for Kubernetes: Cilium vs. Calico vs. Flannel

In Kubernetes, networking holds immense significance as it enables seamless communication among various components and facilitates uninterrupted data flow. To allow pods within a Kubernetes cluster to engage with other pods and cluster services, each of them requires an exclusive IP address. Consequently, networking solutions in Kubernetes encompass more than mere interconnecting machines and devices.

Hacking our Way Towards ML-first Jupyter Notebooks - Civo Navigate NA 2023

In this Navigate 2023 talk, Matt Dupree discusses various challenges in data work and machine learning and proposes potential solutions. He highlights the importance of static analysis to address the problem of refactoring in data notebooks. Dupree emphasizes the need for automated testing workflows using IPython's hooks and profiles to minimize errors and missed opportunities. Furthermore, he suggests the development of Jupyter Bridge plugins to alleviate the repetitive typing of code and simplify the interaction between Python and JavaScript.

A Software Developer's Guide to Getting Started With Kubernetes: Part 1

Put simply, Kubernetes is an orchestration system for deploying and managing containers. Using Kubernetes, you can operate containers reliably across different environments by automating management tasks such as scaling containers across Nodes and restarting them when they stop. Kubernetes provides abstractions that let you think in terms of application components, such as Pods (containers), Services (network endpoints), and Jobs (one-off tasks).

Discover, Learn, and Experience: The Qovery Playground is Now Open!

In the dynamic world of development and operations (DevOps), one thing is clear: there's always room for new, innovative platforms that make life easier for developers and platform engineers. And today, we're thrilled to introduce our latest contribution to this dynamic sphere – the Qovery Playground.

A Chasm Crossed: The Unstoppable Surge of Kubernetes Adoption

In the ever-evolving landscape of enterprise technology, certain milestones mark the transition from innovation to recognition by early adopters to widespread adoption. Gone are the days when Kubernetes was just a segmented buzzword or something only the tech-savvy companies played with. Today, it's a force to be reckoned with, and we need to take a closer look at what it means for us.

How to monitor Kubernetes network and security events with Hubble and Grafana

Anna Kapuścińska is a Software Engineer at Isovalent, who has a rich experience wearing both developer and SRE hats across the industry. Now she works on Isovalent observability products such as Hubble, Tetragon, and Timescape, as well as the respective Grafana integrations for all of them.

Choosing the Right DevOps Stack in 2023: A Guide for Startups

Startups operate in a fast-paced and highly competitive landscape, where delivering high-quality software quickly is crucial for success. This is where the right DevOps stack becomes a game-changer. DevOps practices and tools enable startups to streamline their development processes, improve collaboration, and accelerate software delivery. In this comprehensive guide, we aim to empower startups with the knowledge they need to choose the best DevOps stack for their unique needs and goals.

Deploy Kubernetes Dashboard through Civo Marketplace - Civo.com

In this video @KunalKushwaha goes through how to deploy the Kubernetes Dashboard using the Civo Marketplace. Discover the step-by-step process of accessing your cluster, obtaining the necessary token, and starting the server on your local system. The Kubernetes Dashboard offers a user-friendly interface for managing clusters, deploying applications, and monitoring workloads. Explore its benefits such as centralized management, simplified troubleshooting, and resource management.

Installing FerretDB through Civo Marketplace - Civo.com

In this video @KunalKushwaha introduces FerretDB, an open-source alternative to MongoDB built on PostgreSQL. It explains how to install FerretDB through the Civo Marketplace, highlighting the prerequisites and installation process. The video covers basic CRUD operations using FerretDB, including creating, reading, updating, and deleting documents. It also mentions the benefits of using FerretDB, such as its open-source nature, transparency, simplicity, and supportive community.

Canonical Kubernetes 1.28 pre-announcement

Kubernetes 1.28 is currently planned to be released on the 15th of August 2023. Canonical Kubernetes 1.28 is scheduled to release swiftly afterwards, with MicroK8s 1.28 expected to be generally available within 24 hours of upstream, and Charmed Kubernetes expected to follow within days. We consistently follow the upstream release cadence to provide our users and customers with the latest improvements and fixes, together with security maintenance and enterprise support for Kubernetes on Ubuntu.

Monitor the past, present, and future of your Kubernetes resource utilization

Greetings, Kubernetes Time Lords! Through a series of recent updates to our multi-purpose Kubernetes Monitoring solution in Grafana Cloud, we’ve made it easier than ever to assess your resource utilization, whether you’re looking at yesterday, today, or tomorrow. All companies that use Kubernetes, regardless of size, should monitor their available resource utilization. If a fleet is under-provisioned, the performance and availability of applications and services are at serious risk.

[Product Klip] Application View

Guy Menahem, our resident Cloud Native Computing Foundation (CNCF) Ambassador, showcases Komodor's brand new dashboard for developers! The dashboard takes an app-centric approach, which provides devs with a single, unified view of their workloads even if they're running on multiple clusters or clouds. It reduces noise for devs, and allows them to focus on the metrics and KPIs that matter to them, which enables devs to finally own their apps end-to-end and stop relying on DevOps and Platform teams.

Real-World Container & Image Security: Present & Future - Civo Navigate NA 2023

Bret Fisher shares his extensive knowledge and experience in Docker and Kubernetes during this session from Civo Navigate NA 2023. He emphasizes the importance of addressing security challenges in container and image deployments. Bret discusses various aspects of container and image security, including CI/CD practices, vulnerability scanning, standardizing pods, and automation. As potential solutions, he also introduces concepts such as SSH signing of Git commits and GetOps signature verification.

Using SigNoz to Monitor Your Kubernetes Cluster

Kubernetes and OpenTelemetry are both CNCF projects, and both are closely associated with modern microservice architecture. Despite their connection, there isn’t a single cohesive solution to monitoring your Kubernetes cluster with OpenTelemetry. Large teams that use complex clusters in production have generally ended up building their own tools for monitoring both their infrastructure and application code.

Deploy Your Production Infrastructure on AWS in 15 Minutes with Qovery

You don't know yet about Qovery? Watch this live session from Romaric (CEO of Qovery) to learn more about Qovery and deploy your production infrastructure on AWS. During this session, Romaric covers: This session is free and perfect for technical people - CTO, VP Engineering, DevOps engineers, Platform Engineers, and Developers.

Top Container Monitoring Tools

Container monitoring refers to the process of monitoring and managing containers deployed within a containerization platform, such as Docker or Kubernetes. As containerization has become increasingly popular in software development and deployment, monitoring and managing containerized environments has become increasingly important.

Day 2 Challenges - Why Hiring a Platform Team is Not Enough

If you’ve been anywhere in the DevOpsphere in recent times, you have certainly encountered the Platform Engineering vs. DevOps vs. SRE debates that are all the rage. Is DevOps truly dead?! Is Platform Engineering all I need?! Have I been doing it wrong all along? These have become more popular than the mono vs. multi-repo flame wars from a few years back.

Turbocharging host workloads with Calico eBPF and XDP

In Linux, network-based applications rely on the kernel’s networking stack to establish communication with other systems. While this process is generally efficient and has been optimized over the years, in some cases it can create unnecessary overhead that can impact the overall performance of the system for network-intensive workloads such as web servers and databases.

Troubleshooting Bad Health Checks on Amazon ECS

Health checks are an important factor when working with containerized applications in the cloud and are the source of truth for many applications in terms of their running status. In the context of AWS Elastic Container Service (ECS), health checks are a periodic probe to assess the functioning of containers. In this blog, we will explore how Lumigo, a troubleshooting platform built for microservices, can help provide insights into container crashes and failed health checks.

The Secret Ingredients to Building a Thriving Company Culture - Civo Navigate NA 2023

Kunal Kushwaha, DevRel Manager at Civo, discusses the importance of company culture whilst highlighting various challenges such as cross-team communication, remote work, growth, imposter syndrome, and layoffs. Kunal shares insights from studies indicating that job seekers prioritize company culture and that retention is heavily influenced by it.

Densify Talks, Automated Cloud Instance Selection with Josh Hilliker from Intel

On this episode of Densify Talks, Josh and Andrew discuss automated instance selection and the importance of letting machines make the resource decisions as cloud environments scale. Speaking from the perspective of a hardware manufacturer, Josh offers unique insight into some of the criteria that affect the performance and cost of hosting apps in the cloud, and how to leverage “optimization as code” to automate the optimization process.

Kubernetes Optimization: Focus on the Highest Impact Actions

The ’80-20’ Rule Applied to Kubernetes Optimization. Watch this 20-min session to hear Densify’s experts discuss strategies for optimizing Kubernetes environments while minimizing the required work. During this session Densify will present an analysis of a large scale Kubernetes environment showing how 80% of optimization savings can be achieved by focusing on 20% of the container deployments.

Meet Elemental: Cloud Native OS Management in Kubernetes

Wouldn’t it be great if Rancher could provision and manage not only Kubernetes clusters but also the OS running on the cluster nodes? This is the goal we had in mind when we started working on Elemental. Elemental adds to Rancher the ability to install and manage a minimal OS based on SUSE Linux Enterprise technology, delivered and managed in a fully cloud native way. This simplifies the infrastructure (you only need a container registry) and day 2 operations.

Qovery Demo Day Summary - June 2023

Join us for a recap of the latest updates from Qovery Demo Day, held on June 29th, 2023! Our event provides insight into what we accomplished in the past month and what's to come while showcasing some exciting new features with a special guest: Hamza, Senior Solution Engineer at Doppler. From our new deployment and audit logs to parallelize build and deployment and demos, get ready for an exciting look at what's new with Qovery and what’s next! ✨

Docker Compose Logs: Guide & Best Practices

Docker Compose is a tool for defining and running multi-container Docker applications. It allows developers to streamline the process of configuring, building, and running multiple containers as a single unit with a docker-compose.yml. This configuration file specifies the services, networks, and volumes required for an application, and their relationships and dependencies. The docker-compose logs command displays the logs of all services defined in the docker-compose.yml file.