The Muslim merchants and visitors build a Muslim district or section in the Ghana Empire. They were able to build twelve mosques for the Friday prayers, have scholars, scribes and Islamic jurists. Since most of them staying there were merchants, most likely it's also the business district.
