Visual Regression Testing Improvement
complete
Craig Wilson
Currently, the visual regression testing on the Safe Update feature struggles with websites that include animations, resulting in false positives. Many of the websites I manage use 'Fade In' effects for elements, typically lasting no longer than 300-500ms. It seems screenshots are often taken before these animations complete, leading to unnecessary alerts.
- Screenshot Delay Option:
Allow users to configure a delay (e.g., in milliseconds) before screenshots are taken. This would ensure that fade-in animations or similar effects have time to complete before the visual snapshot.
- Customisable Change % Threshold:
Provide an option to adjust the percentage threshold for what constitutes a visual change. This would allow users to fine-tune sensitivity based on their website's specific requirements.
- Animation Blocking Option:
Add a setting where users can check a box to disable animations on a website during testing. This could be implemented by injecting CSS such as:
*,
*::before,
*::after {
animation: none !important;
transform: none !important;
transition: none !important;
}
Aurelio Volle
marked this post as
complete
We've release a major improvement about this in the past weeks. Shall you still have false negatives, please reach out to support@wp-umbrella.com and we will look into this further!
Luther Harrity
I agree 100%. I've been unable to use this feature because nearly every update I do fails VRT. Great feature, but it need some tuning. Thanks!
G
Gabriel
That´s why I cannot use visual regression at all, because it won´t work with most of my websites. Not only animations, but cookie consent banners too etc. make the visual comparison / regression senseless, better to say it has no value in a decision if the website look the same as before the update.