If you are like me, I always look forward to reading (here writing) a company's Year in Review and this year is no different. However, as I reflect back on 2022, I realized we achieved a five year anniversary. An anniversary of completing a very big vision of transforming customer’s cloud object storage such as AWS S3 into the first stream-based Search+SQL Analytic Database. Initially providing access via the Elastic (Search) API, then Presto (SQL), at scale and in production.

Amazon’s native monitoring and management service AWS CloudWatch is great for basic monitoring and alerts. However, on its own, it may not be the best solution for analyzing log data at scale — especially if you need to analyze data outside of AWS. Many teams may find themselves restricted by retention issues and basic analytic features with Amazon CloudWatch logs for troubleshooting use cases.

As you adopt modern, serverless, microservices-based architectures, it can become more challenging to monitor and understand the state of your applications at any given time. That’s where event bus capabilities from services like Amazon EventBridge can come in handy. AWS EventBridge can help you build loosely coupled, event-driven architectures and applications, and deploy new features faster.

Opportunities for growth are all around us, but it takes the ability to be open and an eager growth mindset to see them. In this episode, David Noblet, Co-Founder + Chief Architect at ChaosSearch, shares how he and his team find innovative ways to improve digital services for their clients by constantly taking inspiration from their daily lives.

The market for enterprise observability solutions is growing in 2022, as organizations search for more effective ways to maintain security and oversight of increasingly complex and distributed IT systems. Traditional observability solutions like Splunk, Datadog and New Relic are still widely used by enterprises to analyze logs, metrics, and traces from their IT environments. But as enterprises generate increasing volumes of log data, two things tend to happen.

If your IT department is generating a tsunami of JSON-based log and event data, ChaosSearch® JSON Flex® can fast-track automatic, flexible indexing for custom insights of your valuable business data. JavaScript Object Notation (JSON) has become the de facto standard for log and event data created by business applications and services. The easy-to-read, semi-structured format can hold a wealth of information and statistics.

Many people wonder what the difference is between monitoring vs. observability. While monitoring is simply watching a system, observability means truly understanding a system’s state. DevOps teams leverage observability to debug their applications, or troubleshoot the root cause of system issues. Peak visibility is achieved by analyzing the three pillars of observability: Logs, metrics and traces.

As businesses generate, capture, and seek to analyze more data than ever before, they often find themselves limited by high data storage costs, expensive data processing fees, and high management overhead. For organizations who wish to expand their log analytics programs and become more data-driven, maximizing cost efficiency has become a critical operational objective.

In my last blog post, Building a Cost-Effective Full Observability Solution Around Open APIs and CNCF Projects, we introduced using ChaosSearch in combination with the most popular open source front- and back-ends in the application observability space. In case you missed it, the TL;DR version is that you can use a variety of open source projects and open API-based components to build the best-of-breed observability stack of your choice rather than relying on expensive, all-in-one solutions.

As high-scale Financial Technology (FinTech) companies build on their data-driven capabilities and establish product-market fit, they often experience rapid growth that creates challenges for IT and DevOps teams.