Unfortunately, I do not reproduce this on DSS 4.1.5 for any:
- metrics with Auto compute after build activated
- checks with Run after build (Launch computation after each build) activated
Could you share a sample project where you reproduce this faulty behavior?
ADDITION: Maybe you are referring to a situation where the dataset is not built from DSS, but the underlying data changes? In this cases, the behavior is expected. In this case, you will need a manual action to recompute metrics and checks; or to create a scenario to automate the re-computation.