Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

by안재한 2023.03.22 18:29

발표자	안재한
발표일자	2023-03-22
저자	Zeyuan Allen-Zhu, Yuanzhi Li
학회명	ICLR2023
논문지

그림1.png

첨부 [3]

2024

Tunable Soft Prompts are Messengers in Federated Learning

2024.04.09

발표자: 강용훈 발표일자: 2024-04-09 저자: Chenhe Dong, Uexiang, Xie, Bolin Ding, Ying Shen, Yaliang Li 학회명: EMNLP 2023 Findings

Thought Cloning: Learning to Think while Acting by Imitating Human Thinking

2024.04.09

발표자: 홍만수 발표일자: 2024-04-09 저자: Shengran Hu, Jeff Clune 학회명: NeurIPS 2023

Lion: Adversarial Distillation of Proprietary Large Language Models

2024.04.03

발표자: 김호승 발표일자: 2024-04-03 저자: Yuxin Jiang, Chunkit Chan, Mingyang Chen, Wei Wang 학회명: EMNLP 2023

A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Network

2024.04.03

발표자: 김도영 발표일자: 2024-04-03 저자: Ruichen Ma, Guanchao Qiao, Yian Liu, Liwei Meng, Ning Ning, Yang Liu, Shaogang Hu* 학회명: CVPR 2024

Multimodal Prompting with Missing Modalities for Visual Recognition

2024.04.03

발표자: 양희재 발표일자: 2024-04-03 저자: Yi-Lun Lee 학회명: CVPR 2023

Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering

2024.04.03

발표자: 배수영 발표일자: 2024-04-03 저자: Jinheon Baek,Alham Fikri Aji,Amir Saffari 학회명: ACL 2023

Towards Domain-invariant Self-supervised Learning with Batch Styles Standardization

2024.03.27

발표자: 이진섭 발표일자: 2024-03-27 저자: Marin Scalbert & Maria Vakalopoulou, Florent Couzinie-Devy 학회명: ICLR 2024

PAL: Program-aided Language Models

2024.03.27

발표자: 이재훈 발표일자: 2024-03-27 저자: Luyu Gao , Aman Madaan, Shuyan Zhou, Uri Alon, Pengfei Liu, Yiming Yang, Jamie Callan, Graham Neubig 학회명: ICML 2023

DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning

2024.03.27

발표자: 홍만수 발표일자: 2024-03-27 저자: Sikai Bai, Jie Zhang, Shuaicheng Li, Song Guo, Jingcai Guo, Jun Hou, Tao Han, Xiaocheng Lu 학회명: CVPR 2024

Enhancing Minority Classes by Mixing: An Adaptative Optimal Transport Approach for Long-tailed Classification

2024.03.20

발표자: 임지영 발표일자: 2024-03-20 학회명: NeurIPS 2023

PEFTDebias : Capturing debiasing information using PEFTs

2024.03.21

발표자: 양정안 발표일자: 2024-03-20 저자: Sumit Agarwal, Aditya Veerubhotla, Srijan Bansal 학회명: EMNLP 2023

A Relevant and Diverse Retrieval-enhanced Data Augmentation Framework for Sequential Recommendation

2024.03.13

발표자: 김한별 발표일자: 2024-03-13 저자: Shuqing Bian, Wayne Xin Zhao, Jinpeng Wang, Ji-Rong Wen 학회명: CIKM 2022

Generative Adversarial Training with Perturbed Token Detection for Model Robustness

2024.03.13

발표자: 나철원 발표일자: 2024-03-13 저자: Jiahao Zhao, Wenji Mao 학회명: EMNLP 2023

Parameter-efficient Tuning for Large Language Model without Calculating Its Gradients

2024.03.13

발표자: 이지형 발표일자: 2024-03-13 저자: Feihu Jin, Jiajun Zhang, Chengqing Zong 학회명: EMNLP 2023

Real-Time Evaluation in Online Continual Learning: A New Hope

2024.02.28

발표자: 이성준 발표일자: 2024-02-28 저자: Yasir Ghunaim, Adel Bibi. Kumail Alhamoud, Motasem Alfarra, Hasan Abed Al Kader Hammoud, Ameya Prabhu, Philip H.S. Torrm, Bernard Ghanem 학회명: CVPR 2023

SoTTA: Robust Test-Time Adaptation on Noisy Data Streams

2024.02.28

발표자: 이재준 발표일자: 2024-02-28 학회명: NeurIPS 2023

FlexiViT: One Model for All Patch Sizes

2024.02.23

발표자: 김영재 발표일자: 2024-02-23 저자: Lucas Beyer, Pavel Izmailov, Alexander Kolesnikov, Mathilde Caron, Simon Kornblith, Xiaohua Zhai, Matthias Minderer, Michael Tschannen, Ibrahim Alabdulmohsin, Filip Pavetic 학회명: CVPR2023