ISYE 6501 Midterm 1 EXAM QUESTIONS WITH 100% SOLUTIONS LATEST UPDATE 2023/2024

ISYE 6501 Midterm 1 EXAM QUESTIONS WITH 100% SOLUTIONS LATEST UPDATE 2023/2024 True or false: In a regression tree, every leaf of the tree has a different regression model that might use different attributes, have different coefficients, etc. - ANSWER True - Each leaf's individual model is tailored to the subset of data points that follow all of the branches leading to the leaf. True or false: Tree-based approaches can be used for other models besides regression. - ANSWER True - For example, a classification tree might have a different SVM or KNN model at each leaf. It might even use SVM at some leaves and KNN at others (though that's probably rare). A common rule of thumb is to stop branching if a leaf would contain less than 5% of the data points. Why not keep branching and allow models to find very close fits to each very small subset of data? - ANSWER Fitting to very small subsets of data will cause overfitting. - With too few data points, the models will fit to random patterns as well as real ones. True or False: When using a random forest model, it's easy to interpret how its results are determined. - ANSWER False - Unlike a model like regression where we can show the result as a simple linear combination of each attribute times its regression coefficient, in a random forest model there are so many different trees used simultaneously that it's difficult to interpret exactly how any factor or factors affect the result. A logistic regression model can be especially useful when the response... - ANSWER - ...is a probability (a number between zero and one).