πŸ˜€ $\textbf{\textsf{Welcome to my Study Log!}}$

β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”

이 νŽ˜μ΄μ§€μ—μ„œλŠ” λ¨Έμ‹ λŸ¬λ‹ μ—”μ§€λ‹ˆμ–΄λ‘œμ¨μ˜ 기초 μ†Œμ–‘ 및 개인적 ν₯λ―Έλ₯Ό λ°”νƒ•μœΌλ‘œ μ„ μ •ν•œ λ‹€μ–‘ν•œ 연ꡬ μ£Όμ œμ— λŒ€ν•œ ν•™μŠ΅ 과정을 κΈ°λ‘ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. 각각의 기둝은 더 λ‚˜μ€ μ—°κ΅¬μžκ°€ 되기 μœ„ν•œ λ‚˜λ¦„λŒ€λ‘œμ˜ 지식 μž¬κ΅¬μΆ• κ³Όμ •μ΄μž, κ²°κ³Όμž…λ‹ˆλ‹€. 즐거운 방문이 λ˜μ‹œκΈΈ λ°”λžλ‹ˆλ‹€ :)

<aside> <img src="/icons/search_lightgray.svg" alt="/icons/search_lightgray.svg" width="40px" /> $\textbf{\textsf{More about me!}}$

πŸ“„ Resume

πŸ“š Portfolio

πŸ‘¨πŸ»β€πŸ’» Github

</aside>



πŸ“ $\textbf{\textsf{Paper \space Review}}$

β€”β€”β€”β€”β€”β€”β€”β€”β€”β€”

<aside> <img src="/icons/book_lightgray.svg" alt="/icons/book_lightgray.svg" width="40px" /> μ£Όμš” 연ꡬ 논문듀을 주제 λ³„λ‘œ μ •λ¦¬ν•˜λ©° 연ꡬ 동ν–₯을 μ‚΄ν•λ‹ˆλ‹€

</aside>

Foundataion Architecture


Transformer

GPT 1

BERT


Toward Better Performance


XLNet

BART

T5


Toward Better Efficiency


ALBERT

DistilBERT

BigBird


Train Strategy


SeqGAN

Sem-Ent

LoRA