Does WPML not have a way of conditionally displaying widgets per language? I haven’t tested this feature of WPML before so I’m not sure. If WPML doesn’t have this built in then you can perhaps try something like: https://wordpress.org/plugins/wpml-widgets/.
WPML Widget plugin works like a charm. I guess that if that plugin exist it is probably because WPML does not feature a “language aware” widget manager… Thanks for the help