Hello vsenderov!
Thanks for your comment, we all chose different approaches for each task, regarding Task 2 we were not able to identify the error with the BERT implementation. Finally, there was not enough time to adapt the architectures used in Task 1. However, as you said, we’re aware that BERT is outperforming as solution for different problems and we will definitely use it in the future.