CIS 057 - Foundations of Large Language Models and Natural Language Processing

    Recent Professors
    Not yet assigned
    Recent Semesters
    Fall 2026
    Class Size
    35 students
    Credits
    4
    Prerequisite
    CIS 053
    Fall 2026 Sections
    View Fall 2026 sections of CIS 057
    Transfers To
    CSU
    Description
    This course focuses on in-depth understanding of Generative AI, Large Language Models (LLM), prompt engineering concepts, architectures and applications. The course starts off with the comparison of the original AI methodology and generative AI paradigm and continues to Natural Language modelling, generation and transformers. Large language model concept is introduced next. Training an LLM with over a few billion parameters can be a challenging task and requires a good understanding of the nature of storage format and memory and efficiency optimization. The focus will shift towards new learning algorithms unique to LLMs such as multimodal, agent-based learning and embeddings. LLM frameworks such as PyTorch, Hugging Face, LangChain, LlamaIndex are discussed next. The course concludes with applications of the GenAI and LLMs such as image generation models, prompt engineering and search engines and Security, Ethics and Bias (SEB) in Generative AI.<br />