The Japan Finance Ministry's top bureaucrat resigned Tuesday over sexual harassment allegations aired in the media, with criticism mounting about the government's response to the scandal.

Vice Finance Minister Junichi Fukuda denied the allegations but offered to give up his post last week, saying it had become difficult to perform his duties at a time when the ministry is mired in a number of controversies.

Opposition parties took issue with the government's decision to accept Fukuda's resignation without reprimanding him. But Finance Minister Taro Aso said the ministry needs to gather facts to determine the accuracy of sexual harassment claims made by female reporters in the story, first reported in the Shukan Shincho weekly magazine.

"It's extremely regrettable our vice finance minister who oversees administrative affairs is stepping down over sexual harassment allegations," Aso told reporters after the Cabinet approved Fukuda's resignation.

Aso himself has faced increasing calls from opposition parties to resign to take responsibility for having picked Fukuda for the position. But he said Tuesday he has no intention of doing so, adding his priority is to uncover the truth and take measures to ensure there is no recurrence.

Fukuda will not receive retirement benefits, estimated to be around 53 million yen ($487,000), until the ministry decides whether to take disciplinary action against him. If Fukuda is deemed to deserve punishment, the amount will be cut accordingly, Aso said.

In order to build a full picture, the Finance Ministry has been asking female reporters who feel they have been sexually harassed by Fukuda to come forward and contact lawyers the ministry has selected.

The approach, however, has been criticized by lawmakers and people supporting sexual harassment victims as lacking sensitivity and neutrality.

"There are various views, including one that he was framed," Aso said. "In that sense, we need to protect his human rights so we can't decide (on punishment) unless we hear both sides of the story."

That comment drew the ire of some opposition lawmakers who have demanded Fukuda be reprimanded.

"He's treating the victim (of sexual harassment) as if she were a perpetrator," said Mizuho Fukushima of the Social Democratic Party.

The sexual harassment allegations have become yet another headache for the administration of Prime Minister Shinzo Abe, already shaken by multiple scandals that have sent public support ratings sinking.

Abe apologized to Natsuo Yamaguchi, who heads Komeito, the junior coalition partner of the ruling Liberal Democratic Party.

"A series of events have damaged the people's confidence in the government. I am sorry," Abe told Yamaguchi during a meeting at the prime minister's office

Wataru Takeshita, chairman of the LDP's General Council, said at a press conference, "Stepping down is an option while fully explaining is another (for Aso)."

"Even though it is a matter of the government ministries and administration, a political responsibility falls on Cabinet members," he said.

The Finance Ministry has faced a barrage of criticism since admitting it doctored documents related to the heavily discounted sale of a state-owned property to a school operator that had ties to the prime minister's wife Akie Abe.

The Shukan Shincho magazine reported earlier in the month that Fukuda had made sexually suggestive comments to female reporters. It later released an audio clip which is allegedly a recording of Fukuda asking a female reporter "Can I give you a kiss?" and "Can I give you a hug?"

In the face of Fukuda's denial, TV Asahi said one of its female employees was the victim of the alleged sexual harassment by the bureaucrat, revealing she had handed the audio recording over to the magazine.

TV Asahi has already protested to the Finance Ministry over its top bureaucrat's actions, while the ministry is seeking cooperation from the broadcaster in looking into the issue.

The weekly magazine report also raised questions about how TV Asahi handled the allegations, particularly why the alleged reporter needed to approach the Shukan Shincho with the story at all.

"We deeply regret that we have failed to take appropriate action when one of our employees was sexually harassed," TV Asahi President Gengo Sunami said at a press conference.

The broadcaster has said the female employee asked her superior about the possibility of reporting Fukuda's behavior in a TV Asahi news program but she was told it would be "difficult."

Kaori Sato, who seeks to protect the rights of women as a labor union member, said Fukuda, the top bureaucrat, should apologize for creating an environment where the female reporter had to come forward with the sexual harassment allegation.

Sato described the situation in which the government approved the resignation without getting to the bottom of the issue as "grave," adding, "I will continue to protest because I can't tolerate her voice being treated as if it doesn't exist."

Independent journalist Soichiro Tahara said Finance Minister Aso's defense of his subordinate Fukuda has eroded public confidence in the ministry.

"When the victim feels like she has suffered sexual harassment, that is what it is. A denial from someone who made the remarks is nonsense," Tahara said.


Related coverage:

LDP lawmaker calls sexual harassment whistleblowing almost "crime"

Social media in Japan defends allegedly sexually harassed TV Asahi reporter

TV Asahi protests to Finance Ministry over alleged sexual harassment

"Can I touch your boobs?"- Harassment scandal shakes Japan's troubled Finance Ministry

Sexual harassment allegations claim most powerful bureaucrat in Japan