The Russian official accused of attacking the rapper has not been identified.
In a statement, the Russian embassy said it was investigating press and social media reports of the assault.
"According to our preliminary information," it said, the reports were "distorted, particularly about the date, the number of participants and the circumstances of the accident".
Tens of millions of Soviet citizens died fighting the forces of Nazi Germany during World War Two.
Symbol of eternity
The swastika is believed to have originated in India thousands of years ago, and was used in Mongolia as a symbol of eternity centuries before the Third Reich.
Amarmandakh Sukhbaatar - who is known as Amraa and is the lead singer of the band Khar Sarnai [Black Rose] - frequently wears the symbol on stage, and his songs often refer to his country's history, culture and identity.
The swastika is also used by groups on Mongolia's far-right however.
The musician's lawyer, father, and a band member denied reports on social media that he shouted "Heil Hitler" at the show.

Lawyer Gankhuugiin Batbayar said the suspect in the beating had not been arrested, adding: "[He] must be investigated according to Mongolian law, no matter his status or immunity as a diplomat".
A police spokesman told the AFP news agency that the case was under investigation.
"The suspect is a Russian diplomatic officer and the reason he wasn't kept in detention is the injury is not serious," he said.
"It's not true that the suspect wasn't arrested because of diplomatic immunity."