There has been some issues raised about some mistakes made in the current CoCa implementation and there are also some improvements that can be made. This issue will enumerate them and we can track progress here. Once the TODO's are completed we can attempt another set of re-training runs and maybe even scale if the results make sense.
Problems:
Improvements:
Please add anything that I might've missed
cc: @gpucce @rom1504 @rwightman
There has been some issues raised about some mistakes made in the current CoCa implementation and there are also some improvements that can be made. This issue will enumerate them and we can track progress here. Once the TODO's are completed we can attempt another set of re-training runs and maybe even scale if the results make sense.
Problems:
Improvements:
Please add anything that I might've missed
cc: @gpucce @rom1504 @rwightman