Louis van Gaal claimed he had no doubts his Holland side would finish victorious even before substitute Memphis Depay's decisive strike in the 3-2 World Cup Group B defeat of Australia.

Holland beat defending world champions Spain 5-1 in their opening match, but the Oranje had to come from 2-1 down to win 3-2 against the battling Socceroos to put one foot in the knockout stages ahead of their concluding group game with Chile.

"I'm not relieved, because I believe in the second half we played better than Australia," Van Gaal said on fifa.com.

"In the first half they played better, but in the second half we had five, six, seven chances.

"I expected us to win. When (Australia's Mathew Leckie) missed that chance, I said to Patrick Kluivert, 'We're going to win this match.'"

Depay's swerving 30-yard strike, which deceived Australia goalkeeper Maty Ryan, came seconds after Leckie's missed opportunity and settled an end-to-end contest which came alive when Arjen Robben ran at the Socceroos defence and put Holland in front.

It was a sublime strike which was almost immediately surpassed in quality by a goal reminiscent of memorable strikes from Dutchmen Marco van Basten and Robin van Persie.

Right-back Ryan McGowan drilled a cross-field pass over the Dutch defence and Tim Cahill's exquisite left-footed volley went in off the bar in what is sure to be one of the goals of the tournament.

Van Persie - booked to earn a suspension which rules him out of the contest with Chile - swiftly cancelled out Mile Jedinak's penalty before Depay's winner eliminated Australia.

Man of the match Robben said: "We've seen so many great goals at this World Cup. It's great for everybody, great for the fans, and we saw (some more) today."

Robben praised Australia's performance.

"They played really aggressively," he said. "They played like it was their last chance.

"We were a little bit under pressure, but we gave the ball away too easily.

"But we made big step today. We have maximum points. Goal difference can make a difference, so the first game was like an extra point for us."

Australia coach Ange Postecoglou lauded his players' performance, which he believes deserved more than defeat.

Postecoglou said: "I put pressure on the players and the staff to go and get at the big teams. Saying it and doing it two different things.

"But today they did that and they didn't get a reward. It's heartbreaking.

"Everyone was outstanding. For the majority of the game, we looked more likely to win than game than not."

New York Red Bulls forward Cahill was thrilled with his strike.

Cahill said on ITV.com: "It's a great moment. Gowser (McGowan) crossed from the right, the ball was sitting beautifully.

"It just felt so right to hit it. I hit it sweetly and it's what it's all about. Defining moments."

Cahill will miss Australia's final match with Spain through suspension, effectively ending his World Cup career.

He added: "It is what it is. I leave everything on the pitch."

But Cahill was proud of the display.

"It was an amazing performance," he added.

"We knew this was a chance. We thought we could win this game.

"We got close. We'll earn a lot of respect from today's game."