New In Playwright 1.51 - Can AI Fix Failing Tests With The New Error Prompt?

In this episode, Stefan Judis, Playwright ambassador, explores the new 'Copy as prompt' feature in Playwright 1.51. This feature allows you to copy a pre-filled LLM prompt with all the context of a failing test case. Does this mean that AIs can take over and magically fix all the failing tests? Let's find out!

If you have questions or feedback, drop a comment below! And don't forget to subscribe for more Playwright tips!

00:00 Intro

00:35 Base setup

01:11 Breaking and Fixing the First Test Case with AI (happy case)

03:25 Breaking and Fixing the Second Test Case (happy case)

04:32 Fixing the Third Test Case to discover that the AI changes test behavior

06:48 Fixing the Fourth test — don't trust the results!

09:23 Conclusion and Final Thoughts

#playwright #checkly #syntheticmonitoring