본문 바로가기

세미나

쓰기

 

Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applications

by김누리 2021.10.05 18:12
발표자 김누리 
발표일자 2021-10-05 
저자 Carlini, Nicholas, Ulfar Erlingsson, and Nicolas Papernot 
학회명 arXiv preprint arXiv:1910.13427 (2019). 
논문지  
We develop techniques to quantify the degree to which a given (training or testing) example is an outlier in the underlying distribution. We evaluate five methods to score examples in a dataset by how well-represented the examples are, for different plausible definitions of "well-represented", and apply these to four common datasets: MNIST, Fashion-MNIST, CIFAR-10, and ImageNet. Despite being independent approaches, we find all five are highly correlated, suggesting that the notion of being well-represented can be quantified. Among other uses, we find these methods can be combined to identify (a) prototypical examples (that match human expectations); (b) memorized training examples; and, (c) uncommon submodes of the dataset. Further, we show how we can utilize our metrics to determine an improved ordering for curriculum learning, and impact adversarial robustness. We release all metric values on training and test sets we studied.

첨부 [1]
목록

    2022

      GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism
      2022.02.22
      발표자: 조영성     발표일자: 2022-02-22     저자: Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, Zhifeng Chen     논문지: https://arxiv.org/abs/1811.06965    
      Contrastive Code Representation Learning
      2022.02.15
      발표자: 최윤석     발표일자: 2022-02-15     저자: Paras Jain, Ajay Jain, Tianjun Zhang, Pieter Abbeel, Joseph E. Gonzalez, Ion Stoica     학회명: EMNLP 2021    
      MUTUAL INFORMATION STATE INTRINSIC CONTROL
      2022.01.11
      발표자: 길창배     발표일자: 2022-01-11     저자: Rui Zhao, Yang Gao, Pieter Abbeel, Volker Tresp, Wei Xu     학회명: ICLR 2021    
      Asynchronous Methods for Deep Reinforcement Learning (A3C)
      2022.01.11
      발표자: 채경훈     발표일자: 2022-01-11     저자: Volodymyr Mnih, Adrià Puigdomènech Badia, Mehdi Mirza, Alex Graves, Tim Harley, Timothy P. Lillicrap, David Silver, Koray Kavukcuoglu     학회명: ICML-2016    

    2021

이전 Prev 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 다음 Next