Visual Regression Testing Improvement
Craig Wilson
Currently, the visual regression testing on the Safe Update feature struggles with websites that include animations, resulting in false positives. Many of the websites I manage use 'Fade In' effects for elements, typically lasting no longer than 300-500ms. It seems screenshots are often taken before these animations complete, leading to unnecessary alerts.
- Screenshot Delay Option:
Allow users to configure a delay (e.g., in milliseconds) before screenshots are taken. This would ensure that fade-in animations or similar effects have time to complete before the visual snapshot.
- Customisable Change % Threshold:
Provide an option to adjust the percentage threshold for what constitutes a visual change. This would allow users to fine-tune sensitivity based on their website's specific requirements.
- Animation Blocking Option:
Add a setting where users can check a box to disable animations on a website during testing. This could be implemented by injecting CSS such as:
*,
*::before,
*::after {
animation: none !important;
transform: none !important;
transition: none !important;
}
Luther Harrity
I agree 100%. I've been unable to use this feature because nearly every update I do fails VRT. Great feature, but it need some tuning. Thanks!
G
Gabriel
That´s why I cannot use visual regression at all, because it won´t work with most of my websites. Not only animations, but cookie consent banners too etc. make the visual comparison / regression senseless, better to say it has no value in a decision if the website look the same as before the update.