weekly sales forecasting - kevin davenport | machine...
TRANSCRIPT
![Page 1: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/1.jpg)
Weekly Sales Forecasting
!
San Diego Data Science and R Users Group | June 2014
Thank you to our sponsors:
Kevin Davenport!http://kldavenport.com [email protected] @KevinLDavenport
![Page 2: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/2.jpg)
San Diego Data Science: Weekly Sales Forecasting
The competition
Use historical markdown data to predict store sales. Predict weekly sales for a set of store & department pairs in 2013 given the weekly sales from 2010-2012.
![Page 3: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/3.jpg)
San Diego Data Science: Weekly Sales Forecasting
The Data1. train/test: weekly sales for each combination of store, department, and date.
2. features: markdowns, CPI, unemployment rate, temperature, fuel price, and holiday (T/F)
3. stores: size and type of each store
![Page 4: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/4.jpg)
San Diego Data Science: Weekly Sales Forecasting
![Page 5: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/5.jpg)
San Diego Data Science: Weekly Sales Forecasting
Joining the datasets
http://pandas.pydata.org/pandas-docs/stable/comparison_with_sql.html#compare-with-sql-join
![Page 6: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/6.jpg)
San Diego Data Science: Weekly Sales Forecasting
Time Series and ForecastingLet’s assume that a relationship between all observations or measurements can be expressed by a linear or non-linear function.
Consider a measurement of 100 RPM @ 11:00am, it’s highly probable that the observation before or after it (10:59am and 11:01am) are close to 100 RPM.
!
![Page 7: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/7.jpg)
San Diego Data Science: Weekly Sales Forecasting
Seasonality vs Trend
![Page 8: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/8.jpg)
San Diego Data Science: Weekly Sales Forecasting
Seasonality vs Trend
Average sales of all stores/departments per week.
Two significant peaks at November and December.
![Page 9: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/9.jpg)
San Diego Data Science: Weekly Sales Forecasting
Correlation and Distribution
http://docs.ggplot2.org/0.9.3.1/plotmatrix.html#
![Page 10: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/10.jpg)
San Diego Data Science: Weekly Sales Forecasting
Holidays
One randomly selected store/department
![Page 11: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/11.jpg)
San Diego Data Science: Weekly Sales Forecasting
Holidays
All stores/departments
![Page 12: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/12.jpg)
San Diego Data Science: Weekly Sales Forecasting
Feature Engineering
1. Naive Previous Year’s Sales
2. Smoothed Sales
3. Additional features (features.csv)
![Page 13: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/13.jpg)
San Diego Data Science: Weekly Sales Forecasting
Numerical FeaturesScale!
1. Consumer Price Index (CPI)
2. Fuel price
3. Temperature
4. Markdowns
5. Unemployment rate
6. Store size
Dummy encode!
1. Department
2. Holiday
3. Store type
4. Date
![Page 14: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/14.jpg)
San Diego Data Science: Weekly Sales Forecasting
Dummy encoding
![Page 15: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/15.jpg)
San Diego Data Science: Weekly Sales Forecasting
Date EncodingThe Date column can be binarily encoded to create the following features:
- Hour of the day (24 boolean features)
- Day of the week (7 boolean features)
- Day of the month (up to 31 boolean features)
- Month of the year (12 boolean features)
- Year (as many boolean features as they are different years in your dataset)
![Page 16: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/16.jpg)
San Diego Data Science: Weekly Sales Forecasting
Gradient Descent
![Page 17: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/17.jpg)
San Diego Data Science: Weekly Sales Forecasting
the gradient of the loss is estimated each sample at a time and the model is updated along the way with a decreasing strength schedule (aka learning rate). SGD allows minibatch (online/out-of-core) learning with the partial_fit method.
![Page 18: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/18.jpg)
San Diego Data Science: Weekly Sales Forecasting
http://www.libfm.org/
Gradient Descent - consider entire dataset !Stochastic Gradient Descent - Each step pick one random data point continue as if entire dataset was just the one point !Minibatch SGD - Each step pick small subset of data points continue as if entire dataset was just the this subset
Gradient Descent
![Page 19: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/19.jpg)
San Diego Data Science: Weekly Sales Forecasting
Gradient Descent
http://www.onmyphd.com/?p=gradient.descent
![Page 20: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/20.jpg)
San Diego Data Science: Weekly Sales Forecasting
Gradient Descent
![Page 21: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/21.jpg)
San Diego Data Science: Weekly Sales Forecasting
Gradient Descent
![Page 22: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/22.jpg)
San Diego Data Science: Weekly Sales Forecasting
libFM
Factorization machines (FM) are a generic approach that allows to mimic most factorization models by feature engineering. This way, factorization machines combine the generality of feature engineering with the superiority of factorization models in estimating interactions between categorical variables of large domain
http://www.libfm.org/ haven’t tried: https://github.com/coreylynch/pyFM
![Page 23: Weekly Sales Forecasting - Kevin Davenport | Machine ...kldavenport.com/.../uploads/2014/05/weekly_sales_forecasting2.pdf · San Diego Data Science: Weekly Sales Forecasting The competition](https://reader031.vdocuments.site/reader031/viewer/2022021822/5b18e1997f8b9a46258c10d4/html5/thumbnails/23.jpg)
San Diego Data Science: Weekly Sales Forecasting
Evaluation
1. Smoothed last year’s sales.
2. Ridge regression
3. Factorization machines