Data Science Notes | B.Sc. (Computer Science) Semester 6 | Mumbai University | munotes
Official Notes munotes.in
Data Science
B.SC. (COMPUTER SCIENCE) · SEMESTER 6
Strictly as per the University of Mumbai NEP syllabus in force for B.Sc. (Computer Science)
For B.Sc. (Computer Science) students of the University of Mumbai and all its affiliated colleges
Open the book ↓munotes.in Third Year
Contents
Module I Data science and its scope, data preprocessing, exploratory data analysis and the machine learning algorithms
- What Data Science Is, and Its Definition 1
- The Scope of Data Science: From a Question to a Decision 7
- Applications and Domains of Data Science 14
- Data Science Compared with Business Intelligence 20
- Data Science Compared with Artificial Intelligence 25
- Data Science Compared with Machine Learning 31
- Data Science Compared with Data Warehousing and Data Mining 36
- The Types of Data, and Structured Data 42
- Unstructured Data 48
- Semi-Structured Data 54
- Data Sources, and Databases 59
- Data Sources: Files 64
- Data Sources: APIs 69
- Data Sources: Web Scraping 74
- Data Sources: Sensors and Social Media 79
- Data Preprocessing: What It Is and Why It Comes First 84
- Data Cleaning: Handling Missing Values 89
- Data Cleaning: Handling Outliers 95
- Data Cleaning: Handling Duplicates 100
- Practical: Data Frames and Basic Pre-processing 105
- Data Transformation, and Scaling 111
- Normalization as a Data Transformation 117
- Encoding Categorical Variables 122
- Feature Selection: Choosing the Relevant Columns 126
- Data Merging: Combining Multiple Datasets 131
- Data Wrangling Techniques, and Reshaping 136
- Pivoting Data 141
- Aggregating Data with Group By 145
- Exploratory Data Analysis: What It Is and How It Is Done 149
- Feature Engineering: Creating New Features 154
- Handling Time-Series Data 158
- Dummification: Categorical Variables as Binary Indicators 163
- Feature Scaling: Standardization 167
- Feature Scaling: Normalization and Standardization Compared 171
- Data Visualization in EDA: Histograms 181
- Data Visualization in EDA: Scatter Plots 189
- Data Visualization in EDA: Box Plots and Other Plots 195
- Descriptive Statistics, and the Mean 201
- The Median and the Mode 207
- The Standard Deviation and Other Measures of Spread 212
- Hypothesis Testing: Null and Alternative Hypotheses and the p-Value 218
- The t-Tests 226
- Chi-Square Tests 233
- ANOVA: Comparing the Means of Several Groups 243
- Post-Hoc Tests after ANOVA 250
- Machine Learning Algorithms: How a Model Learns from Data 257
- Supervised Learning: Classification and Regression 263
- Unsupervised Learning, and Clustering 268
- K-Means Clustering 273
- Choosing the Number of Clusters: The Elbow Method and Silhouette Analysis 280
- Unsupervised Learning: Dimensionality Reduction 290
- Principal Component Analysis 296
- The Bias-Variance Tradeoff 304
- Underfitting and Overfitting 311
- Simple Linear Regression 317
- Reading a Regression: Coefficients and Goodness of Fit 324
- Multiple Linear Regression 334
- Stepwise Regression 343
- Logistic Regression for Classification 350
- Decision Trees 360
- Random Forests 370
- Support Vector Machines 377
- Artificial Neural Networks 385
- Ensemble Learning, and Boosting 395
- Bagging 404
- K-Nearest Neighbors 410
- Gradient Descent for Optimization 417
Module II Model evaluation and selection, data visualization and communication, tools and libraries, data management, and data ethics and privacy
- Model Evaluation: Training Error, Test Error and the Hold-Out Split 427
- Evaluating a Classifier: Accuracy 434
- Precision and Recall 440
- The F1-Score 445
- The Confusion Matrix 451
- ROC Curves and AUC 456
- Evaluating Models on Imbalanced Datasets 461
- Cross-Validation, and k-Fold Cross-Validation 467
- Stratified Cross-Validation 473
- Hyperparameter Tuning 478
- Model Selection 483
- Principles of Effective Data Visualization 489
- Types of Visualizations: Bar Charts 495
- Types of Visualizations: Line Charts 501
- Types of Visualizations: Scatter Plots and Choosing a Chart 507
- Data Storytelling: Communicating Insights through Visualizations 514
- Practical: Telling a Data Story with Several Charts 522
- Tools and Libraries of Data Science: An Overview 528
- pandas 533
- NumPy 539
- scikit-learn 546
- Visualization Tools: matplotlib 553
- Visualization Tools: seaborn 560
- Visualization Tools: Tableau 568
- Excel: Conditional Formatting and Pivot Tables 574
- Excel: VLOOKUP and Goal Seek 582
- Data Management and Its Activities 590
- Data Pipelines: Extraction, Transformation and Loading (ETL) 598
- Data Governance 605
- Data Quality Assurance 611
- Data Privacy and Security Considerations 617
- Data Ethics across the Data Lifecycle 625
- Privacy Risks and Consent 632
- The GDPR: A Basic Overview 637
- The DPDP Act 2023: A Basic Overview 643
- Responsible Data Handling Practices 650
- The Examination: How Data Science Is Asked 657
The chapters
Every chapter of this book comes with the B.Sc. (Computer Science) Semester 6 notes.
The cover and the contents are free to look through. Buy the notes once to read every chapter of every subject in this semester.
Notes + practical solutions + solved papers: ₹798 Already bought it? Sign in
Or notes + practical solutions: ₹499
Or solved papers only: ₹499
Free either way: question papers, the syllabus, and the cover and contents of every book.
The rest of this subject
These notes are cut from the University's printed syllabus. Open the syllabus itself, or the past papers, for the same subject.