It should represent the intended population and remain inaccessible to training and tuning decisions. Reusing test results to guide changes gradually turns the set into development data.
A test set is held-out data reserved for estimating final performance after development choices are complete.
It should represent the intended population and remain inaccessible to training and tuning decisions. Reusing test results to guide changes gradually turns the set into development data.