Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finetuning the public models #49

Open
fabianwindbacher opened this issue Oct 18, 2022 · 1 comment
Open

Finetuning the public models #49

fabianwindbacher opened this issue Oct 18, 2022 · 1 comment

Comments

@fabianwindbacher
Copy link

Hi, very cool repo!

I am trying to fine-tune one of your public models (e.g. metrabs_mob3l_y4t) on a new dataset.
Since these are the packaged multi-person models, I extracted the crop model itself.

However, using the checkpoint system implemented in main.py, it seems like the weights are not copied.
log_detailed.txt:

WARNING:tensorflow:Value in checkpoint could not be found in the restored object: (root).variables.0
WARNING:tensorflow:Value in checkpoint could not be found in the restored object: (root).variables.1
...
WARNING:tensorflow:Value in checkpoint could not be found in the restored object: (root).variables.265

Can you point me in the right direction?
@isarandi
Copy link
Owner

Hmm. Probably the variable names get messed up or lost after packaging into the multi-person SavedModel. For this use case it would be best to provide the original checkpoint files too. I'll look into this.

Young-Yoon pushed a commit to Young-Yoon/metrabs that referenced this issue Mar 8, 2024
@mubbasirkapadia @ylee-rbx
Step 2 of 2: Removal of 3D soft argmax calculations from METRABS Head…
9751e10 
… for NCNN compatibility (isarandi#49)

* Removal of 3D soft argmax calculations from METRABS Head

Modification of METRABS Head to remove 3D soft argmax functionality. This is now computed in Loom SDK to support NCNN compatibility.

METRABS Trainer class had to be modified to do these calculations during training and testing time.

* Migrating duplicate functionality to separate function

Migrating shared functionality in MetrabsTrainer.forward_train and MetrabsTrainer.forward_test to _shared_process_inps

* fix error

---------

Co-authored-by: ylee <ylee@roblox.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@isarandi @fabianwindbacher