19 Comments
⭠ Return to thread

Thanks, this is great feedback. It's unlikely that the applications we considered have that type of leakage as these models make predictions about the current (not future) state of the patients - the observed negative association between sample size and accuracy serves as evidence that leakage/bias is related with sample size. Nevertheless, you bring up an important clarification for what types of data leakage we're considering - will update the arxiv.

Expand full comment