How to Win a Data Science Competition

Feature preprocessing and generation with respect to models

ByAdmin July 10, 2021

Week – 1 Feature preprocessing and generation with respect to models

Apply np.log1p(x) transform to the data

Apply rank transform to the features

Winsorization

Apply np.sqrt(x) transform to the data

MinMaxScaler

StandardScaler

When categorical feature is ordinal

When the number of categorical features in the dataset is huge

When we can come up with label encoder, that assigns close labels to similar (in terms of target) categories

If target dependence on the label encoded feature is very non-linear, i.e. values that are close to each other in the label encode feature correspond to target values that aren’t close.

When the feature have only two unique values

Label encoding is always better than one-hot encoding

One-hot encoding is always better than label encoding

Depending on the dataset either of label encoder or one-hot encoder could be better

How to Win a Data Science Competition

Validation
ByAdmin July 10, 2021

Week – 2 Validation >>> How to Win a Data Science Competition: Learn from Top Kagglers 1. Select true statements 1 point Performance increase on a fixed cross-validation split guaranties…

Read More Validation
How to Win a Data Science Competition

Mean encodings
ByAdmin July 11, 2021July 11, 2021

Week – 3 Mean encodings >>> How to Win a Data Science Competition: Learn from Top Kagglers 1. What can be an indicator of usefulness of mean encodings? 1 point…

Read More Mean encodings
How to Win a Data Science Competition

Exploratory data analysis
ByAdmin July 10, 2021

Week – 2 Exploratory data analysis >>> How to Win a Data Science Competition Learn from Top Kagglers 1. Suppose we are given a data set with features XX, YY,…

Read More Exploratory data analysis
How to Win a Data Science Competition

Graded Advanced Features II Quiz
ByAdmin July 11, 2021

Week – 4 Graded Advanced Features II Quiz >>> How to Win a Data Science Competition Learn from Top Kagglers 1. Imagine that we apply X = PCA(n_components=5).fit_transform(data) and data…

Read More Graded Advanced Features II Quiz
How to Win a Data Science Competition

Feature extraction from text and images
ByAdmin July 10, 2021

Week – 1 Feature extraction from text and images >>> How to Win a Data Science Competition: Learn from Top Kagglers 1. Select true statements about n-grams 2 points N-grams…

Read More Feature extraction from text and images
How to Win a Data Science Competition

Metrics
ByAdmin July 11, 2021

week – 3 Metrics >>> How to Win a Data Science Competition Learn from Top Kagglers 1. Suppose we solve a binary classification task and our solution is scores with…

Read More Metrics

Week – 1 Feature preprocessing and generation with respect to models

Similar Posts