"Our suggestion is a new deal with Europe that will bring a new opportunity for economy development. We will discuss these questions with the European Central Bank, colleagues from other countries as soon as possible," Varoufakis said.
The finance minister added that he is going to enter into negotiations with the president of Eurogroup Jeroen Dijsselbloem, who is arriving in Athens on Friday.
"We are changing the logic of fighting the big debt problem," Varoufakis stressed.
Earlier on Wednesday, Greek Prime Minister Alexis Tsipras said during his first cabinet meeting that he plans to negotiate the country's $270 billion bailout debt with creditors.
The Syriza party, or the Coalition of the Radical Left, won Sunday's parliamentary elections in Greece with 36.34 percent of votes. The party secured 149 seats, two seats short of a parliamentary majority.
In its pre-election promises, Syriza pledged to put an end to the country's painful austerity plan and to resolve the issue of its debt with its EU partners.