According to the NHK broadcaster, the demonstrators were mostly former Japanese residents of the disputed islands of Kunashir, Iturup, Shikotan and Habomai.
The demonstration was attended by Mitsuhiro Miyakoshi, state minister in charge of Okinawa and Northern Territories, as the Japanese call Kuril Islands.
"I will do my best to convey to the global community the unanimous primary position of our country on solving the problem of the Northern Territories and concluding a peace treaty," the minister told the broadcaster.
READ MORE: Moscow's Lavrov Discusses Territorial Dispute With Tokyo Counterpart Kono
The march was timed to the anniversary of the beginning of the movement for the "return" of the four islands to Japan on December 1, 1945.
The islands dispute has been souring relations between the two countries for decades and serves as the main stumbling block to signing a permanent peace treaty after the end of World War II. Both countries claim a group of four islands — Iturup, Kunashir, Shikotan and Habomai — referred to as the Southern Kurils by Russia and the Northern Territories by Japan.