04-652   Artificial Intelligence System Design

Course description

In a world where classical approaches increasingly fall short of the demands placed on modern intelligent systems, responsible AI-driven solutions have become essential. This course guides students through the process of transforming real-world problems into working AI systems that are effective, reliable, scalable, and responsible. Students learn core principles of machine learning, deep learning, and data workflows, along with best practices for model development, evaluation, and deployment. Throughout the course, students develop the ability to design robust data pipelines, select appropriate models, and anticipate system behavior in real-world contexts. By the end of the course, students are equipped to build AI systems that are both technically sound and ethically grounded. A strong emphasis is placed on design trade-offs, including:

• Lightweight vs. heavy models
• Accuracy vs. latency
• Scalability vs. resource constraints

Students learn to justify architectural decisions based on context, ensuring their AI solutions are practical, optimized, and deployable.

Learning objectives

By the end of the course, students will be able to understand the foundational theories and principles of machine learning, deep learning, and AI workflows, analyze and define business and technical problems to determine appropriate AI solutions, design and implement data pipelines and model development processes for end-to-end AI systems, and select and apply suitable machine learning and neural network models while balancing performance and efficiency. Furthermore, they will be able to evaluate, deploy, and maintain AI systems responsibly, ensuring reliability, ethical integrity, and scalability.

Outcomes

Upon completing this course, students will be able to:

• Explain the end-to-end AI system workflow, from data collection to deployment and monitoring.
• Build and evaluate both classical ML and deep learning models for real-world tasks.
• Design AI systems that are optimized for performance, efficiency, and resource constraints.
• Apply responsible AI principles to ensure fairness, transparency, and ethical deployment.
• Present a complete AI system design, justifying choices of models, architecture, and workflows.

Course content overview

This course is organized into seven (7) modules, progressing from foundational AI system concepts to deployment and responsible AI practices.

Module 1: Foundations of AI System Design

• Overview of AI systems and their components
• AI problem framing and system requirements
• Principles of reliability, scalability, and maintainability

Module 2: Data Pipelines & Feature Engineering

• Data collection, cleaning, and preprocessing
• Feature engineering and transformation
• Ensuring data quality, consistency, and representativeness

Module 3: Machine Learning Principles

• Supervised and unsupervised learning
• Classical machine learning algorithms and evaluation metrics
• Bias–variance trade-offs and model selection

Module 4: Deep Learning & Neural Networks

• Neural network fundamentals and training principles
• Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and embedding-based models
• Optimization, regularization, and generalization

Module 5: Recommender Systems & Applied Case Studies

• Collaborative filtering, content-based, and hybrid approaches
• Designing AI pipelines for recommendation tasks
• Evaluating system performance and user impact

Module 6: Deployment, Serving, and System Architecture

• Model serving patterns: batch, real-time, and streaming
• APIs, microservices, and lightweight containerization with Docker
• Monitoring, drift detection, and continuous system improvement

Module 7: Responsible and Reliable AI

• Fairness, transparency, and explainability
• Robustness, risk mitigation, and ethical considerations
• Balancing lightweight vs heavy models and resource trade-offs

Prerequisites

• Basic Python programming (including NumPy and Pandas)
• Comfort working with data
• Foundational mathematics:
• Linear algebra
• Calculus fundamentals
• Basic probability and statistics