🗞️Paper Goat

#efficient_models #foundation_models #generation #optimization #DDPM #GAN #Langevin dynamics #U-Net #compression #denoising score matching #diffusion #diffusion model #generative model #noise schedule #progressive lossy compression

#efficient_models #foundation_models #generation #object_detection #optimization #segmentation #COCO #ImageNet #Imagen #ResNet #batch normalization #bottleneck #deep CNN #degradation problem #identity mapping #

#efficient_models #foundation_models #generation #optimization #vision_transformer #CLS #token #Imagen #ViT #Vision #Transformer #attention #image #classification #image #patch #embedding #inductive #bias #large-scale #pre-training #position #embedding

#efficient_models #foundation_models #GPT #GPT-3 #autoregressive transformer #emergent #emergent abilities #few-shot learning #fine-tuning #in-context learning #language model #prompt engineering #scaling laws #sparse attention #zero-shot

#foundation_models #self_supervised #BERT #Masked Language Model #Next Sentence Prediction #Transformer #WordPiece #bidirectional #fine-tuning #pre-training #self-attention #transfer learning

#foundation_models #optimization #Encoder-Decoder #GPU #Machine Translation #Multi-Head Attention #Positional Encoding #Scaled Dot-Product Attention #Self-Attention #Sequence-to-Sequence #Transformer #attention