[AI Boostcamp Day 32]

What did I learn today

• Finished the note for transformer
• Researched Hugging Face
• Researched Baseline Models to Benchmark for our competition
  • Candidate 1: Pytorch Lightning + Hugging Face
  • Candidate 2: HanBert + Hugging Face
  • Candidate 3: KcBert + Transfer Learning
  • Candidate 4: KoGTP2 + Transfer Learning
• Researched Librarys
  • Hydra
  • Deep Speed Zero
• The competition is about multitasking model
  • Multimodal Transformer

Peer Session

• What is KLUE?
• What do we do in the upcoming P-stage?
• etc