"Frode Berg will come to Norway as soon as it will practically be possible", Solberg said, adding she had briefly spoken with him over the phone to welcome him back to Norway.
Norwegian Foreign Minister Ine Eriksen Soereide said his arrest in 2017 had not had a negative effect on the Nordic nation's relationship with Russia.
"We do not think that this case had a negative impact on the relationship between Norway and Russia. This should be emphasised," she told reporters at a press conference.
Exchanges between the two neighbors had only intensified, Soereide said. She met four times with Russian Foreign Minister Sergey Lavrov lately. She also added that Norway had been working on Berg's release since his arrest.
Berg was freed from a jail in Russia, where he was sentenced to 14 years on espionage charges, and handed over to the Norwegian Embassy in Vilnius in a spy swap that also involved two Lithuanians and two Russians.
The retired Norwegian border agent was detained in Moscow in late 2017 over obtaining classified information concerning the Russian Navy. He has denied the charges though, and his lawyer insisted that the intelligence might have used Berg to get the classified documents without him knowing.