munotes®

Data Science Notes | B.Sc. (Computer Science) Semester 6 | Mumbai University | munotes

Official Notes munotes.in

Data Science

B.SC. (COMPUTER SCIENCE) · SEMESTER 6

Strictly as per the University of Mumbai NEP syllabus in force for B.Sc. (Computer Science)

For B.Sc. (Computer Science) students of the University of Mumbai and all its affiliated colleges

Open the book ↓

munotes.in Third Year

Contents

Module I Data science and its scope, data preprocessing, exploratory data analysis and the machine learning algorithms

  1. What Data Science Is, and Its Definition 1
  2. The Scope of Data Science: From a Question to a Decision 7
  3. Applications and Domains of Data Science 14
  4. Data Science Compared with Business Intelligence 20
  5. Data Science Compared with Artificial Intelligence 25
  6. Data Science Compared with Machine Learning 31
  7. Data Science Compared with Data Warehousing and Data Mining 36
  8. The Types of Data, and Structured Data 42
  9. Unstructured Data 48
  10. Semi-Structured Data 54
  11. Data Sources, and Databases 59
  12. Data Sources: Files 64
  13. Data Sources: APIs 69
  14. Data Sources: Web Scraping 74
  15. Data Sources: Sensors and Social Media 79
  16. Data Preprocessing: What It Is and Why It Comes First 84
  17. Data Cleaning: Handling Missing Values 89
  18. Data Cleaning: Handling Outliers 95
  19. Data Cleaning: Handling Duplicates 100
  20. Practical: Data Frames and Basic Pre-processing 105
  21. Data Transformation, and Scaling 111
  22. Normalization as a Data Transformation 117
  23. Encoding Categorical Variables 122
  24. Feature Selection: Choosing the Relevant Columns 126
  25. Data Merging: Combining Multiple Datasets 131
  26. Data Wrangling Techniques, and Reshaping 136
  27. Pivoting Data 141
  28. Aggregating Data with Group By 145
  29. Exploratory Data Analysis: What It Is and How It Is Done 149
  30. Feature Engineering: Creating New Features 154
  31. Handling Time-Series Data 158
  32. Dummification: Categorical Variables as Binary Indicators 163
  33. Feature Scaling: Standardization 167
  34. Feature Scaling: Normalization and Standardization Compared 171
  35. Data Visualization in EDA: Histograms 181
  36. Data Visualization in EDA: Scatter Plots 189
  37. Data Visualization in EDA: Box Plots and Other Plots 195
  38. Descriptive Statistics, and the Mean 201
  39. The Median and the Mode 207
  40. The Standard Deviation and Other Measures of Spread 212
  41. Hypothesis Testing: Null and Alternative Hypotheses and the p-Value 218
  42. The t-Tests 226
  43. Chi-Square Tests 233
  44. ANOVA: Comparing the Means of Several Groups 243
  45. Post-Hoc Tests after ANOVA 250
  46. Machine Learning Algorithms: How a Model Learns from Data 257
  47. Supervised Learning: Classification and Regression 263
  48. Unsupervised Learning, and Clustering 268
  49. K-Means Clustering 273
  50. Choosing the Number of Clusters: The Elbow Method and Silhouette Analysis 280
  51. Unsupervised Learning: Dimensionality Reduction 290
  52. Principal Component Analysis 296
  53. The Bias-Variance Tradeoff 304
  54. Underfitting and Overfitting 311
  55. Simple Linear Regression 317
  56. Reading a Regression: Coefficients and Goodness of Fit 324
  57. Multiple Linear Regression 334
  58. Stepwise Regression 343
  59. Logistic Regression for Classification 350
  60. Decision Trees 360
  61. Random Forests 370
  62. Support Vector Machines 377
  63. Artificial Neural Networks 385
  64. Ensemble Learning, and Boosting 395
  65. Bagging 404
  66. K-Nearest Neighbors 410
  67. Gradient Descent for Optimization 417

Module II Model evaluation and selection, data visualization and communication, tools and libraries, data management, and data ethics and privacy

  1. Model Evaluation: Training Error, Test Error and the Hold-Out Split 427
  2. Evaluating a Classifier: Accuracy 434
  3. Precision and Recall 440
  4. The F1-Score 445
  5. The Confusion Matrix 451
  6. ROC Curves and AUC 456
  7. Evaluating Models on Imbalanced Datasets 461
  8. Cross-Validation, and k-Fold Cross-Validation 467
  9. Stratified Cross-Validation 473
  10. Hyperparameter Tuning 478
  11. Model Selection 483
  12. Principles of Effective Data Visualization 489
  13. Types of Visualizations: Bar Charts 495
  14. Types of Visualizations: Line Charts 501
  15. Types of Visualizations: Scatter Plots and Choosing a Chart 507
  16. Data Storytelling: Communicating Insights through Visualizations 514
  17. Practical: Telling a Data Story with Several Charts 522
  18. Tools and Libraries of Data Science: An Overview 528
  19. pandas 533
  20. NumPy 539
  21. scikit-learn 546
  22. Visualization Tools: matplotlib 553
  23. Visualization Tools: seaborn 560
  24. Visualization Tools: Tableau 568
  25. Excel: Conditional Formatting and Pivot Tables 574
  26. Excel: VLOOKUP and Goal Seek 582
  27. Data Management and Its Activities 590
  28. Data Pipelines: Extraction, Transformation and Loading (ETL) 598
  29. Data Governance 605
  30. Data Quality Assurance 611
  31. Data Privacy and Security Considerations 617
  32. Data Ethics across the Data Lifecycle 625
  33. Privacy Risks and Consent 632
  34. The GDPR: A Basic Overview 637
  35. The DPDP Act 2023: A Basic Overview 643
  36. Responsible Data Handling Practices 650
  37. The Examination: How Data Science Is Asked 657
munotes.in

The chapters

Every chapter of this book comes with the B.Sc. (Computer Science) Semester 6 notes.

The cover and the contents are free to look through. Buy the notes once to read every chapter of every subject in this semester.

Notes + practical solutions + solved papers: ₹798 Already bought it? Sign in

Or notes + practical solutions: ₹499
Or solved papers only: ₹499

Free either way: question papers, the syllabus, and the cover and contents of every book.

The rest of this subject

These notes are cut from the University's printed syllabus. Open the syllabus itself, or the past papers, for the same subject.

Issue
Done!