Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] online probabilistic regression meta-algorithms wishlist #464

Open
2 tasks
fkiraly opened this issue Sep 13, 2024 · 0 comments
Open
2 tasks

[ENH] online probabilistic regression meta-algorithms wishlist #464

fkiraly opened this issue Sep 13, 2024 · 0 comments
Labels
feature request New feature or request good first issue Good for newcomers implementing algorithms Implementing algorithms, estimators, objects native to skpro module:regression probabilistic regression module

Comments

@fkiraly
Copy link
Collaborator

fkiraly commented Sep 13, 2024

Implementation wishlist for simple online probabilistic regression meta-algorithms.

  • fit separate copies of regressor on the batches, and then return Mixture with weights by the number of samples in each batch. Batches under a certain size (hyperparameter) are ignored; or, collected, until a minimum size is reached (hyperparameter).
  • remember a smaller bootstrap sample of size n_remember from the fit data, and pool this with data in a new batch. At each update, bootstrap so the remembered sample stays n_remember size. Predict Mixture from fit_predict on the remembered plus new sample, in update, with appropriate weights.

Further, general Bayesian algorithms will support a Bayesian update, this should be included in the API design for Bayesian estimators.

@fkiraly fkiraly added good first issue Good for newcomers module:regression probabilistic regression module implementing algorithms Implementing algorithms, estimators, objects native to skpro feature request New feature or request labels Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request good first issue Good for newcomers implementing algorithms Implementing algorithms, estimators, objects native to skpro module:regression probabilistic regression module
Projects
None yet
Development

No branches or pull requests

1 participant