Nepal had a parliamentary Communist government in 1994-95.
"5.1. The Party's Government after the Mid-Term Election
The CPN (UML) formed minority government in December, 1994 as the largest Party in the Parliament after the Elections. Comrade Man Mohan Adhikari - Chairman of the Party and its Parliamentary leader, became the first Communist Prime Minister and 15 member Cabinet was formed. The government was successfully run for nine months implementing many new policies and programs following the Party's election pledges and people's aspirations. The government gave the priority to improving the life of people launching the program of Build Your Village Yourself and welfare schemes. Policy orientation of controlling of inflation and corruption, smooth supply of necessary consumer goods, old age allowance to elderly citizens, resettlement schemes for the landless people, protection of human rights and ensured public security and economic and industrial policy suitable to the country, foreign policy based on the UN Principle and non-alignment and good neighbourly relations both with China and India on the basis of equality, mutual respect and benefit were well responded by the people. The popularity of the Party irked the rightist political forces in the country and they orchestrated designs to overthrow the CPN (UML) Government contrary to the people's mandate and against to their own commitments made right after the Election. Consequently the CPN (UML) was ousted from the government in August, 1995 and a rightist coalition government, led by the Nepali Congress, was formed."
http://www.cpnuml.org/aboutuml.html