Nyarugenge District authorities have closed down a church because it was constructed without authorisation.