After famously falling short in all of their previous World Cup penalty shootouts, England finally won on spot kicks Tuesday night, booking a place in the Russia 2018 quarterfinals following a 1-1 draw with Colombia.

The 4-3 victory on penalties will become part of English soccer lore and go some way to erasing painful memories of shootout failures at the 1990, 1998 and 2006 World Cups.

With all signs pointing to heartbreak after Colombian keeper David Ospina saved Jordan Henderson's third attempt to give the South Americans the advantage, a miss by Mateus Uribe and a save by England stopper Jordan Pickford sent the outnumbered fans of the Three Lions into rapture at Spartak Stadium.

"I think we deserved it...We played so well in the 90 minutes," said England boss Gareth Southgate. "We showed resilience to come back from huge disappointment and kept calm."

"Shootouts are tough. We had talked long and hard about owning the process of a shootout. They kept calm. The players have taken it all on board, it's a special moment for us."

"They have created their own story and made history. I don't want to go home yet."

(England goalkeeper Jordan Pickford saves Carlos Bacca's penalty.)

With scores 1-1 after injury time, the two sides played out a goalless extra time. The match only got that far because of a stunning Yerry Mina header in the 93rd minute that canceled out Harry Kane's 57th-minute spot kick.

The win books England a place in the quarterfinals for the first time since Germany 2006. There, they will meet a Swedish team that grabbed their place in the final eight with a 1-0 win over Switzerland on Tuesday.

England started the brighter side, but Colombia worked their way into the match after 15 minutes and began to build some sustained periods of pressure.

Things began to heat up late in the half as frustration mounted on both sides. It appeared to have boiled over when Henderson went down after apparently being headbutted by Wilmar Barrios in the box.

In a match that had been testy throughout, American referee Mark Geiger was forced to point to the spot when Carlos Sanchez became tangled with Kane as the big Englishman rumbled toward goal hoping to meet a corner kick.

The Colombians spent minutes haranguing the referee, but when Kane eventually stepped to the spot, he calmly slotted down the middle as Ospina went right.

(Colombia's Yerry Mina, top center, equalizes with a header.)

England then saw two headers creep over the bar, one by Dele Alli and the other from Harry Maguire, but the shock was yet to come.

First, Uribe forced Pickford to save a thunderous shot from deep, but when the towering Mina rose to meet a cross, Trippier was unable to help the bouncing ball over and Colombia were level with just minutes to spare.

The first half of extra time was all Colombia, but when the teams swapped ends it was England in the ascendency. Subs Danny Rose and Eric Dier had chances but neither could net and the game was destined to be decided from the spot.

In Saint Petersburg earlier on Tuesday, a 66th-minute Emil Forsberg goal paved Sweden's path to the quarterfinals.

The RB Leipzig winger's shot deflected off unfortunate defender Manuel Akanji, giving Swiss goalkeeper Yann Sommer no chance to keep his team level.

(Sweden's Emil Forsberg breaks the deadlock.)

Switzerland dominated possession, had more shots and could have easily scored a number of times, but they were left frustrated as the Scandinavians reached the World Cup final-eight for the first time since 1994.

For Switzerland, the loss will be seen as a squandered chance to snap an extended period of knockout futility at the tournament. The Swiss have reached the last 16 at four of their last five World Cups, but have not managed to go any further.