Link Search Menu Expand Document

Checklist DS

DS

checklist

Pre-Processing

  • Check for missing values
  • Dropping of unwanted columns
  • Removing the Noisy Data
    • Binning Method
    • Regression
    • Clustering
    • Outliers
  • Check for Inconsistent values
  • Check for categorical data
  • Check for Duplicate values
  • Feature Aggregation
  • Feature Encoding (Encoding caegorical values or numeric values or text)
  • Train / Validation / Test Split
  • Data Transformation
    • Normalization
    • Attribute Selection
    • Discretization
    • Concept Hierarchy Generation
  • Data Reduction
    • Data Cube Aggregation
    • Attribute Subset Selection
    • Numerosity Reduction
    • Dimensionality Reduction
  • Feature engineering
  • Skewness/Kurtosis
  • Feature correlation
  • Imbalance Dataset (Data imputation)
  • Feature scaling
  • Handling Dates
  • Multicollinearity
  • Feature selection
  • Domain knowledge