Testing a custom metric: where the expected value in the test should come from (macro vs micro F1 worked example)
If you write your own metric or loss, a test whose expected value is computed with the same formula as the function only checks that the function agrees with itself. It catches regressions, but not a wrong reading of what the metric should be. A small example. Six samples, three classes: y_true = […
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-28 02:21 · r/deeplearning
Testing a custom metric: where the expected value in the test should come from (macro vs micro F1 worked example)