The workshop offers a comprehensive exploration of deep learning and natural language processing, focusing on practical applications and hands-on exercises. Participants will learn about the PyTorch framework, attention mechanisms for text processing, and efficient implementation using the einops library. They'll delve into Hugging Face Transformers for integrating pre-trained models like BERT and GPT, and gain insights into Large Language Models (LLMs) such as GPT-3 and evaluation mechanisms. Visualization frameworks will be introduced for model interpretation, and participants will learn to work with LLMs locally, focusing on retrieval-augmented generation tasks. Practical exercises throughout the workshop reinforce learning, empowering participants to apply these techniques effectively.

Workshop Source: sharif-llm.ir