Mahmoud Ahmed was born in Addis Ababa's Mercato district, where he was captivated by the music he heard on Ethiopian radio from a young age. Despite having a poor educational experience, Mahmoud found work as a shoeshiner before becoming a handyman at the Arizona Club, a popular hangout spot for Emperor Haile Selassie I's Imperial Bodyguard Band.
One fateful night in 1962, when the band's singer failed to show up, Mahmoud was given the opportunity to sing a few songs, which ultimately led to him becoming a regular member of the band until 1974.