Data Engineering Summary Statistics

Summary statistics give valuable insights as one of the first steps in data engineering after the data is gathered. Statistics help to assess data quality and diversity. Data discovery with statistics is a common first activity and there are many excellent packages to help with the standard analysis.We explore the Python packages that are commonly used for statistical analysis and data exploration including numpy, pandas and pandas-profiling. 0:00 Summary Statistics 1:25 Pandas Profiling 7:23 Smallpox Case Study 8:29 Math Review 10:08 Matrix, Vector, Scalar 15:48 Dot Product 16:37 Summation and Product 18:17 Derivatives and Gradients 21:49 Data Distribution 26:43 Summary Stats 29:40 Kurtosis and Skew 34:35 Data Engineering Overview Machine Learning for Engineers: https://apmonitor.com/pds Source Code: https://apmonitor.com/pds/index.php/M...