The is quite a distinct reggae influence in the early Ultravox material. Island studios were full of reggae artists, and the band were recording at the same time as Bob Marley and Lee 'Scratch' Perry, who introduced a lot of techniques and ideas to John and the others.
Chris Cross brought this to the Ultravox sound I think, influenced by the dub sound from the streets and clubs in Tottenham - check 'Dangerous Rhythm' for example.
You can still hear elements of this in Underpass especially, which has a 'dub' bassline - carried over from the earliest versions of Touch and Go an He's a Liquid which (when performed by Ultravox in 1979) started with a lot of reggae-based guitar sounds.
Hope this helps.
I hadn't noticed it in Young Savage though - so thanks for a great excuse to listen to that again.