Operations | Monitoring | ITSM | DevOps | Cloud

Checkly

How good is GitHub Copilot at generating Playwright code?

People keep asking us here at Checkly if and how AI can help create solid and maintainable Playwright tests. To answer all these questions, we started by looking at ChatGPT and Claude to conclude that AI tools have the potential to help with test generation but that "normal AI consumer tools" aren't code-focused enough. High-quality results require too complex prompts to be a maintainable solution.

Prometheus Blackbox Exporter vs Kuberhealthy for K8s monitoring

We all implement tools to monitor our nodes and keep our entire cluster up and running. But how often do updates, failures, or errors mean that users suffer outages, even though our status boards look green? As Kubernetes has enabled more complex microservice architecture, the gap between the state of the dashboard, and the health of services for the user, has grown wider.

The new "toMatchAriaSnapshot" assertion and Aria in Playwright

Dive into the latest Playwright 1.49 release with Stefan Judis, Playwright ambassador, as he discusses "toMatchAriaSnapshot", a new assertion for end-to-end page validations. In this video, Stefan discusses using recommended Playwright locators, the importance of ARIA and accessibility in end-to-end testing and demonstrates the new "toMatchAriaSnapshot" assertion.

Are ChatGPT or Claude better than Playwright Codegen?

I'm a bit of an AI skeptic. And even though GitHub Copilot is my daily auto-completion on steroids, I always double-check the code generated by LLMs. If you're using AI for coding, you probably know that the results are sometimes surprisingly good and other times shockingly terrible. Lately, I have seen more and more articles and even docs recommending ChatGPT to generate Playwright tests. Could this be true? Are ChatGPT and friends really that good at generating test code?

Write Playwright Tests in Seconds with ChatGPT!?

Can AI generate good Playwright code? Join Stefan as he explores AI-driven Playwright scripting, using tools like the language models ChatGPT and Claude. Watch as he demonstrates the capabilities of Playwright's 'codegen' command and pits it against AI-generated test scripts. Despite initial skepticism, the results from AI were surprising!

Add global beforeEach / afterEach hooks using Playwright automatic fixtures

Join Stefan Judis, Checkly's Playwright ambassador, as he shows you how to make your end-to-end testing life easier using Playwright's automatic fixtures. Learn how to implement global "beforeEach" and "afterEach" test hooks to add runtime annotation and JavaScript exception monitoring without repeating yourself across spec files.

Checkly Changelog: New Features and Updates - Traces, Visual Regression Checks, and Degraded States

Join María and Nočnica as we go over three major new features from Checkly: Checkly Traces - integrate OpenTelemetry data from your stack with synthetic monitoring traces Visual Regression Checks - Check for pixel-by-pixel changes to your website Degraded Checks - want to note a problem but don't want it to trigger alerts like a failing check? Try soft assertions and the 'degraded' state.

How to control time zones and timeouts in Playwright

Join Stefan Judis (Playwright Ambassador) as we explore advanced testing strategies for time zones and timers using Playwright. You'll learn about seamless time zone testing techniques and how to use Playwright's Clock API to manage timers effectively. What we'll cover: Time Zone Testing: Learn how to test across multiple time zones with Playwright to ensure your applications perform consistently worldwide. JavaScript Timers: Discover how to control and test JavaScript timeouts using the Clock API, enhancing the reliability of your scripts.

Five Playwright CLI features you should know

Thanks to Microsoft's Playwright, running end-to-end tests with real browsers is quickly done. Initialize a new Playwright project, install all the dependencies, and off you go! Then, any new headless browser test run is only one npx playwright test away. But have you checked all the test command's CLI options? playwright test includes a few real gems to help you create better tests faster. Let me share a mixed bag of my favorite CLI tricks in this post.