So, I just had a small breakthrough. The same way in which I am async loading fonts, I can async load assets, my images, this has improved performance greatly.
This link is Expo example code showing how: https://github.com/expo/new-project-template/blob/master/App.js
Hope this helps.