Ideas2IT Technologies Senior Data Scientist Interview Questions, Process, and Tips

Different metrics used to evaluate Classification Problems

• Accuracy

• Precision

• Recall

• F1 Score

• ROC-AUC

• Confusion Matrix

Feature selection methods include filter methods, wrapper methods, and embedded methods.

• Filter methods: Select features based on statistical measures like correlation, chi-squared test, or information gain.

• Wrapper methods: Use a specific machine learning algorithm to evaluate the importance of features by selecting subsets of features.

• Embedded methods: Feature selection is integrated into the model training process, li...read more

Chi-square test is commonly used for testing categorical features.

• Chi-square test is used to determine if there is a significant association between two categorical variables.

• It is commonly used in market research, biology, and social sciences.

• Example: Testing if there is a relationship between gender and voting preference.

XGBoost is a popular machine learning algorithm known for its speed and performance, with various hyperparameters to tune for optimal results.

• XGBoost hyperparameters include max_depth, learning_rate, n_estimators, subsample, colsample_bytree, and more

• max_depth controls the maximum depth of each tree in the ensemble

• learning_rate determines the step size shrinkage used to prevent overfitting

• n_estimators specifies the num...read more