ExtraTreeRegressor in scikit-learn (Python) -



ExtraTreeRegressor in scikit-learn (Python) -

i have 2 questions on extratreeregressor in scikit-learn (python).

1) why not possible increment number of features above dimension of input space? algorithm in [1] not restrict number of maximum features. in cases selection higher max_feature can result in improve results.

2) want utilize extratreeregressor implementation of fitted q-iteration, execute extratreeregressor within loop (96 timesteps). first, set max_features 1 , plotted mse after ever iteration (upper graph). increased max_features dimension of input space ('auto') , plotted mse. why mse increases in lastly case?

we expect mse smaller larger value of max_features...

![the upper graph shows mse within loop max features set 1, lower graph shows mse within loop max_features set 'auto'][1]

figure: http://imgur.com/aqgcveu

[1] p. geurts, d. ernst., , l. wehenkel, "extremely randomized trees", machine learning, 63(1), 3-42, 2006.

i believe parameter max_features refers maximum number of features per tree can selected. means each tree in forest can select n_features - result in overfitting since each tree seeing (which opposite of want in bagged tree algorithms). improve diagnostic plot @ training , testing error on range of max_features - should see sweetness spot model complexity captures training , testing error without overfitting.

to create n_features larger number of features in data, build pipeline , random projection higher dimensional space, fit model in new space. default, don't believe extratreesregressor has functionality, since sklearn has pipeline objects can this.

python scikit-learn regression

Comments

Post a Comment

Popular posts from this blog

ruby on rails - Devise Logout Error in RoR -

ruby on rails - Devise Logout Error in RoR - while using devise in ror, encountering unusual error when trying log out url different root url. displays me : actioncontroller::invalidauthenticitytoken in devise::sessionscontroller#destroy" for illustration if rooting path after log in '/structure', , seek log out '/general' error, while logging out '/structure' fine. any help highly appreciated. ruby-on-rails ruby devise
Read more

c# - Create a Notification Object (Email or Page) At Run Time -- Dependency Injection or Factory -

c# - Create a Notification Object (Email or Page) At Run Time -- Dependency Injection or Factory - i have code emails me notification when happens. trying add together page , also remove dependency on email. for reference; have name of notification want send stored string in database. @ runtime have list of people , string representation of want receive. i thought dependency injection ninject, kernel bindings got big , seemed hacking together. then thought simple factory, activator.createinstance(email/page) inotifcation, don't know how handle differing constructor parameters (unless utilize common, complex property, employee, has info need). so far have this: public interface inotification { void sendmessage(); } public class email: inotification { private readonly string _toemailaddress; private string body { { homecoming "email"; } } private static string smtphost { ...
Read more

model view controller - MVC Rails Planning -

model view controller - MVC Rails Planning - i'm starting rails , i'm building app stores films info, user can watch film , give grade on web application. i have coded cinema model, controller , views. now, have 2 questions: should need create model , controller grading? in case, should create or should wait , create first users model , controller? yes, on model , controller grades. that'd feasible way maintain track of who's graded what. it's create first, i'd start users, since grades depend on both films , users. ruby-on-rails model-view-controller
Read more