Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add basic Constraints support #100

Open
9 tasks
zaleslaw opened this issue Jun 3, 2021 · 2 comments
Open
9 tasks

Add basic Constraints support #100

zaleslaw opened this issue Jun 3, 2021 · 2 comments
Assignees

Comments

@zaleslaw
Copy link
Collaborator

zaleslaw commented Jun 3, 2021

Add basic constraints to the following list of layers:

  • Dense
  • Conv2d
  • Conv1d
  • (optional) SeparableConv2D
  • (optional) DepthwiseConv2D

The following constraints should be implemented:

  • MaxNorm
  • MinMaxNorm
  • NonNeg
  • UnitNorm
@zaleslaw zaleslaw self-assigned this Jun 3, 2021
@zaleslaw zaleslaw added this to the 0.3 milestone Jun 3, 2021
@avan1235
Copy link
Contributor

avan1235 commented Jun 6, 2021

Please take into account my refactor of conv layers which is going to be done here. I created AbstractConv so I suppose it would be easier to introduce these constrains after merge of this change if possible (case looks similar to regularizers as i think about it)

@zaleslaw
Copy link
Collaborator Author

zaleslaw commented Jun 7, 2021

@avan1235 looks like the constraint will be postponed because I have no idea how to apply them to the variables.
It should become a part of the weight update in the optimizer, but I could not pass it to the optimizer and minimize function to apply on each step. The weight update mechanism is hidden from our control in the optimizer functions provided via TF Java API

@zaleslaw zaleslaw modified the milestones: 0.3, 0.4 Jun 7, 2021
@zaleslaw zaleslaw modified the milestones: 0.4, 0.5 Dec 15, 2021
@ermolenkodev ermolenkodev removed this from the 0.5 milestone Sep 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants