An allegedly mentally ill man was shot and killed by a bystander outside a Moscow church after attacking people and badly injuring at least one paramedic with a shovel, Russian media reported Tuesday.