Probability and Statistics syllabus
PCC-253-AID · Second Year Artificial Intelligence and Data Science, SPPU 2024 pattern. Every unit, the marks scheme, course outcomes and books, copied from the official syllabus PDF.
Unit-wise syllabus
Introduction to Probability and Set Theory
9 hoursBasics of set Theory: Introduction to sets and algebra of sets, Random Experiment, Sample Space, Events, Complementary Events, Union and Intersection of Two Events, Difference Events, Exhaustive Events, Mutually Exclusive Events, Equally Likely Events, Independent Events. Probability Theory: Mathematical & Statistical definition of Probability, Need of probability theory in Data science, Axiomatic definition of probability, Addition Theorem, Multiplication Theorem, Theorems of Probability, Conditional Probability, Inverse Probability, Joint Probability, Total Probability and Bayes Theorem.
Case Study: Use of probability in real-life situations, like weather forecasting, sports betting, sales forecasting etc
Introduction to Statistics
9 hoursIntroduction to Statistics: Introduction, Origin and Development and scope of Statistics, Population and Sample, Sampling –Introduction, Types of Sampling, Purposive Sampling, Random Sampling, Simple Sampling, Stratified Sampling, Parameter and Statistic, Sampling Distribution Sampling With and Without Replacement, Population Parameters, Sample Statistics. Introduction, Arithmetic Mean, Simple and weighted mean for raw data, Discrete frequency distribution, Continuous frequency distribution, Properties of A.M.,Merits & Demerits of A.M. Median, Mode for raw data, Merits and demerits of Median and Mode.
Case Study : Create measures of central tendency for a real-life example dataset, such as the payroll dataset or titanic dataset.
Case study of sampling for any real-world problem like exit poll statistics
Descriptive Statistics
9 hoursMeasures of Dispersion, Skewness and Kurtosis: Dispersion, Characteristics for an Ideal Measure of Dispersion, Measures of Dispersion, Range, Quartile Deviation, Mean Deviation, Standard Deviation and Root Mean Square Deviation, Coefficient of Dispersion, Coefficient of Variation, Skewness, Kurtosis. Correlation and Regression : Bivariate Distribution, Scatter diagrams, Correlation, Karl Pearson’s coefficient of correlation, Rank correlation, Regression, Regression Coefficients, Lines of Regression.
Case study: Create measures of dispersion for a real-life example dataset like students dataset, iris detection etc.
Random Variables and Probability Distributions
9 hoursRandom Variables and Distribution Functions: Random Variable, Distribution Function, Properties of Distribution Function, Discrete Random Variable, Probability Mass Function, Discrete Distribution Function, Continuous Random Variable, Probability Density Function, moment generating function, median and quantiles, Markov inequality, Chebyshev’s inequality. Theoretical Discrete Distributions: Binomial and multinomial distributions, Bernoulli Distribution, Mean Deviation about Mean of Binomial Distribution, Mode of Binomial Distribution, Additive Property of Binomial Distribution, Characteristic Function of Binomial Distribution, Cumulants of Binomial Distribution, Poisson distribution, Uniform distribution, Exponential distribution, Gaussian distribution, Log-normal distribution, Chi-square distribution.
Case study : Use Binomial distribution for the problem of reducing errors by vendors who process credit-card applications for a large credit-card bank etc.
Inferential Statistics
9 hoursHypothesis and Testing of Hypothesis: Introduction, Statistical Hypothesis (Simple and-Composite), Test of a Statistical Hypothesis, Null Hypothesis, Alternative Hypothesis, Critical Region, Two Types of Errors, level of Significance, Power of the Test. Steps in Solving Testing of Hypothesis Problem, Optimum Tests Under Different Situations, Most Powerful Test (MP Test), Uniformly Most Powerful Test, Likelihood Ratio Test, Properties of Likelihood Ratio Test. Neyman-Pearson Fundamental Lemma, Test for the Mean of a Normal Population, Test for the Equality of Means of Two Normal Populations, Test for the Variance of a Normal Population, Test for Equality of Variances of two Normal Populations, Non-parametric Methods, Advantages and Disadvantages of Non-parametric Methods.
Case study: Study hypothesis testing for any examples like to determine whether the female proportion of the adult population is high or any similar example
Marks and credits
| Head | Marks | Credit |
|---|---|---|
| CCE (continuous comprehensive evaluation) | 30 | 3 |
| End-semester exam | 70 |
Prerequisite: Set theory fundamentals.
Course outcomes
- CO1Utilize key probability theorems to solve practical problems in decision-making and risk analysis.
- CO2Apply fundamentals of Statistics for Artificial Intelligence and Data Science
- CO3Apply statistical techniques to examine relationships between variables and make predictions.
- CO4Use the basic principles of random variables and random processes needed in applications to model and interpret real-world scenarios.
- CO5Use probability and statistical models to analyze data and support decision-making in fields like finance, engineering, healthcare, and machine learning.
Books
Text books
- S. C. Gupta, V. K. Kapoor, “Fundamentals of Mathematical Statistics (A Modern Approach)”, Sultan Chand & Sons Educational Publishers, Tenth revised edition, ISBN: 81-7014-791-3
- J. Medhi, “Statistical Methods: An Introductory Text”, Second Edition, New Age International Ltd, ISBN: 8122419577
Reference books
- Glen Cowan, “ Statistical Data Analysis” , University Of Siegen, Clarendon Press, Oxford, 1998, ISBN: 0198501552
- Probability, random variables and stochastic processes by A. Papoulis and S.U. Pillai, TMH
- Ken Black, “Applied Business Statistics”, Wiley, 7th Edition, ISBN:788126537075
- Probability, Statistics and Random Process by T Veerarajan, TMH.
- Introduction to Probability Theory and Statistical Inference by H.J. Larson. E books Links: -
- https://www.itl.nist.gov/div898/handbook/
- https://web.stanford.edu/~hastie/ElemStatLearn/index.html
NPTEL and SWAYAM links
Listed in the official syllabus:
- onlinecourses.nptel.ac.in/noc20_ma22/preview
- onlinecourses.nptel.ac.in/noc21_ma74/preview
- onlinecourses.nptel.ac.in/noc23_ma77/preview
FAQ
How many units are in Probability and Statistics?
Probability and Statistics (PCC-253-AID) has 5 units and 45 hours of theory: Unit I Introduction to Probability and Set Theory (9 h); Unit II Introduction to Statistics (9 h); Unit III Descriptive Statistics (9 h); Unit IV Random Variables and Probability Distributions (9 h); Unit V Inferential Statistics (9 h).
What is the marks scheme for Probability and Statistics?
The official Artificial Intelligence and Data Science 2024 pattern syllabus lists continuous comprehensive evaluation (CCE) for 30 marks and the end-semester exam for 70 marks, for 3 credits.
What should I know before Probability and Statistics?
Prerequisite listed in the syllabus: Set theory fundamentals.