Operations | Monitoring | ITSM | DevOps | Cloud

In Elasticsearch 8.8, we’re introducing the reroute processor in technical preview that makes it possible to send documents, such as logs, to different data streams, according to flexible routing rules. When using Elastic Observability, this gives you more granular control over your data with regard to retention, permissions, and processing with all the potential benefits of the data stream naming scheme. While optimized for data streams, the reroute processor also works with classic indices.

Data is like the oxygen that fuels the digital revolution. While critical and readily available, data becomes dangerous when misused. Leaders and users alike are becoming concerned with how organizations can protect data, especially personal information. It’s a complex and dynamic challenge, making it harder than ever to share data to the extent needed to facilitate innovation and research. To meet these challenges, many organizations are leveraging federated data systems.

Logging provides a wealth of information about system events, errors, warnings, and activities. When troubleshooting issues, logs can be invaluable for identifying the root cause of problems, understanding the sequence of events leading to an issue, and determining the necessary steps for resolution. By regularly analyzing logs, administrators can identify performance bottlenecks, resource limitations, and abnormal system behavior.

Papertrail has had the ability to alert on searches that match events for years, but what about when they don’t? When a cron job, backup, or other recurring job doesn’t run, it’s not easy to notice the absence of an expected message. But now, Papertrail can do the noticing for you with inactivity alerts. Papertrail inactivity alerts allow you to setup notifications when searches don’t match events.

Today’s IT systems are ever more fragmented. It is commonplace to see polyglot systems, written in multiple programming languages, and using a plethora of tools and cloud services as infrastructure building blocks, whether data stores, web proxy or other functions. In this dynamic cloud-native realm, open standards and open specifications have become integral drivers of compatibility, collaboration, and convergence – the Three C’s of Open Standards, if you will.

Classless Inter-Domain Routing (CIDR) is the dominant IP addressing scheme in the modern web. By enabling network engineers to create subnets that encapsulate a set range of IP addresses, CIDR facilitates the flexible and efficient allocation of IPs in virtual private clouds (VPCs) and other networks.

Gaming apps are complex systems. They combine multi-function systems, like the game engine, to other resources such as server containers, proxies and CDNs in order to give users a real-time interactive experience. At the same time, managing cross-functional behavior also means that games could generate massive amounts of data, commonly known as logs. You’ll want to turn that data into useful information to help improve game performance.

A reference architecture is a lovely document, but they rarely help engineers and architects implement their tools effectively. Most reference architectures offer plenty of suggestions and ideas, but not enough context. We will explore ways to make reference architectures more useful while reducing reliance on the vague and dreaded “It Depends. Cribl has just released its first official reference architecture.