Operations | Monitoring | ITSM | DevOps | Cloud

May 2023

ChatGPT and Elasticsearch: APM instrumentation, performance, and cost analysis

In a previous blog post, we built a small Python application that queries Elasticsearch using a mix of vector search and BM25 to help find the most relevant results in a proprietary data set. The top hit is then passed to OpenAI, which answers the question for us. In this blog, we will instrument a Python application that uses OpenAI and analyze its performance, as well as the cost to run the application.

ChatGPT and Elasticsearch: Faceting, filtering, and more context

In a recent blog post, we discussed how ChatGPT and Elasticsearch® can work together to help manage proprietary data more effectively. By utilizing Elasticsearch's search capabilities and ChatGPT's contextual understanding, we demonstrated how the resulting outcomes can be improved. In this post, we discuss how users’ experience can be further enhanced with the addition of facets, filtering, and additional context.

Revolutionizing SAP observability: The Elastic-Kyndryl partnership

Across industries and geographies, businesses rely heavily on Systems Applications and Products (SAP) systems. These powerful and versatile systems streamline operations and manage critical data spanning areas like finance, human resources, and supply chain. However, the real-time monitoring of these systems, with an in-depth understanding of performance metrics and quick anomaly detection, is paramount for smooth operations and business continuity. It's here that our unique offering steps in.

Unleash the power of Elastic and Amazon Kinesis Data Firehose to enhance observability and data analytics

As more organizations leverage the Amazon Web Services (AWS) cloud platform and services to drive operational efficiency and bring products to market, managing logs becomes a critical component of maintaining visibility and safeguarding multi-account AWS environments. Traditionally, logs are stored in Amazon Simple Storage Service (Amazon S3) and then shipped to an external monitoring and analysis solution for further processing.

Elastic Enterprise Search 8.8: Easy AI-powered search for your enterprise

Elastic Enterprise Search 8.8 seamlessly bundles new Elastic developed semantic search capabilities with an expanding catalog of open code database and storage connectors. Additionally this release adds rich capabilities to measure and simplify adding features to your search application. These new capabilities allow customers to: Elastic Enterprise Search 8.8 is available now on Elastic Cloud — the only hosted Elasticsearch offering to include all of the new features in this latest release.

Gain insights into Kubernetes errors with Elastic Observability logs and OpenAI

As we’ve shown in previous blogs, Elastic® provides a way to ingest and manage telemetry from the Kubernetes cluster and the application running on it. Elastic provides out-of-the-box dashboards to help with tracking metrics, log management and analytics, APM functionality (which also supports native OpenTelemetry), and the ability to analyze everything with AIOps features and machine learning (ML).

Challenges of observing Kubernetes: Understanding a complex and dynamic system

As technology evolves in the enterprise, oftentimes the processes and tools used to manage it must also evolve. The increased adoption of Kubernetes has become a major inflection point for those of us in the monitoring and management side of the IT operations world. What has worked for decades (traditional infrastructure monitoring) has to be adjusted to the complexity and ephemeral nature of modern distributed systems where Kubernetes has a prime role.

Trace your Azure Function application with Elastic Observability

Adoption of Azure Functions in cloud-native applications on Microsoft Azure has been increasing exponentially over the last few years. Serverless functions, such as the Azure Functions, provide a high level of abstraction from the underlying infrastructure and orchestration, given these tasks are managed by the cloud provider. Software development teams can then focus on the implementation of business and application logic.

The impact of NWDAF on telco service providers: Embracing vendor agnostic data analytics

Network Data Analytics Function (NWDAF) is a key component in 5G networks, designed to collect, analyze, and deliver valuable insights to service providers. NWDAF provides an unbiased, vendor-vendor agnostic view of the network, expanding telco visibility beyond traditional use cases. As network complexities grow, service providers require unbiased and accurate data to make informed decisions, driving the demand for vendor agnostic data analytics.

The Met Office gains valuable data insights to make informed decisions with Elastic

The Met Office, the UK's national weather service, is tasked with predicting the unpredictable - the ever-changing weather patterns that can have a huge impact on people's lives. Having been in the business for over 150 years, they require a reliable and powerful monitoring and insights capability to ensure their systems and processes run optimally.

Using AIOps effectively with Elastic Observability

Over the past several years, one topic that has become of increasing importance for DevOps and site reliability engineering (SRE) teams is AIOps. Artificial intelligence for IT Operations (AIOps) is the application of artificial intelligence (AI), machine learning (ML), and analytics to improve the day-to-day operational work for IT operations teams.

How to use Elasticsearch and Time Series Data Streams for observability metrics

Elasticsearch is used for a wide variety of data types — one of these is metrics. With the introduction of Metricbeat many years ago and later our APM Agents, the metric use case has become more popular. Over the years, Elasticsearch has made many improvements on how to handle things like metrics aggregations and sparse documents. At the same time, TSVB visualizations were introduced to make visualizing metrics easier.

RCA Series: Accelerate security investigations w/ machine learning and Elastic (3/4)

Comprehensive security requires multiple layers of threat protection. Sophisticated threats exploit idiosyncrasies in your environment. Unsupervised machine learning identifies patterns of normal activity from your data, and therefore can catch attacks that standard approaches to threat hunting, such as pre-defined rules, are likely to miss. This video explains how machine learning adds a layer to your threat protection, and how interactive tools offered in the Elastic Security solution accelerate the investigation of security incidents.

RCA Series: Root Cause Analysis in Manufacturing, Electric Grids & Connected Devices (4/4)

With digitization adopted in many industries, real-time data from manufacturing and operational equipment can be used to monitor and optimize operation - by applying data-driven modeling including machine learning. Learn how you can ingest sensor data from industrial processes and operational equipment into Elastic, build monitoring dashboards and set up automated alerts in Kibana, and apply predictive modeling to optimize your operations (OT).

RCA Series: Root Cause Analysis in Observability with Elastic AIOps (2/4)

Root cause analysis empowers you to prevent issues from recurring that were revealed by your monitoring IT systems and online applications including eCommerce sites. See Elastic engineers walk you through applying four AIOps capabilities and accelerate MTTR by automatically categorizing logs, explaining log rate spikes, visually inspecting anomalous components in their context, and correlating slow or failed transactions with potential root causes.

Logging for public sector: How to make the most of your mission-critical data

With governments doubling down on logging compliance, many public sector organizations have been focusing on optimizing their log management, especially to ensure they retain logs for required periods of time. Logs — though seemingly straightforward — are the backbone of many mission-based use cases and therefore have the potential to accelerate mission success when centrally organized and leveraged strategically. In public sector, logs are instrumental in.