In the end it was decided to stick with 2D frame by frame animation and Pix2PixHD to keep all the mascot characters as a cohesive group in the film, dealing with the limitations by keeping them in mind while animating and through for example the use of EbSynth.
Here you can view the progress of shots I and others have been working on that includes machine learning.