They finally did.
Brain McCann hit a three-run homer in the 12th inning four batters after a leadoff walk to Brett Gardner, rallying the Yankees for a second time Friday night and giving them a 7-5 victory over the Rays.
"If we're dwelling on one inning, the walk to Gardner is kind of what sticks out," Rays manager Kevin Cash said, "and then you let their big boppers come up there and use right field to their advantage a little bit."
The Rays walked six after Mark Teixeira hit a tying three-run homer in the eighth against Kevin Jepsen — without allowing a hit. But after Gardner's walk, Steve Geltz (1-4) lost command and the Rays' 5-3 lead soon followed.
Geltz struck out Chase Headley before allowing singles to Alex Rodriguez and Teixeira, his hit driving in Gardner just as fireworks began shooting off behind the scoreboard in right field.
McCann then homered into the right-field stands for New York's first walk-off win since Derek Jeter's final home game last September.
"The ball got too much plate and McCann put a good swing on it," Rays catcher Rene Rivera said. "Those things happen."
Tampa Bay lost its sixth in a row and second straight in extra innings.
Chasen Shreve (6-1) walked two and gave up two hits and a run in the 12th but got a key inning-ending, 5-4-3 double play.
With the score 3-all, Adam Warren walked Logan Forsythe starting the 12th, Brandon Guyer sacrificed. Shreve relieved and walked Asdrubal Cabrera.
Kevin Kiermaier, the No. 8 batter, singled over leaping shortstop Didi Gregorius, and Rivera followed with another RBI hit to put Tampa Bay up 5-3.
The Rays had two baserunners called out trying to stretch singles late — and Tampa was on the wrong end of both replay reviews.
Cabrera was nailed in the ninth on a throw from Gardner, the center fielder. The Rays challenged the call but it was upheld after a review of 2 minutes, 53 seconds.
In the 11th, Evan Longoria slid into second safely but the Yankees requested a review, saying Longoria's foot came off the base popping up, and he was tagged out by second baseman Jose Pirela. New York got the call after a review of 2:06.
"It is unfortunate. I don't know if it's right, wrong, I don't think this is what it was made for," Cash said of the use of replay in this instance. "Whether he was pushed off, tagged off, or the tag was just held on, all of those things, I just don't think that that's, that's not why we have this."
A-Rod had two hits and three walks on the day he finally received his 3,000th hit ball.
Teixeira's drive into the second deck in short right field spoiled another stellar outing against the Yankees for Rays starter Chris Archer, who pitched three-hit ball for 6 2-3 innings to lower his ERA to 1.78 against New York in eight starts. He threw a career- high 122 pitches, struck out eight and walked three.
"We played a great game, we battled, we made some pitches, it was just their night," Archer said. "But for us to give up the lead and then get the lead back, that showed some character."
Masahiro Tanaka looked as if he was headed for a third straight rough outing, falling behind 2-0 in the first on Evan Longoria's RBI double and James Loney's sacrifice fly. Rivera hit a sacrifice fly in the fourth after Kiermaier's triple.
Tanaka allowed three runs and six hits in six innings.
Rays: RHP Jake Odorizzi (oblique) is to make one more rehabilitation start before returning to the rotation, manager Kevin Cash said.
Yankees: OF Carlos Beltran went on the DL with a left oblique strain.
Rays: Nathan Karns had his shortest start of the season April 27, when he went 4 2-3 innings in his one start at Yankee Stadium. He is 1-0 with a 3.07 ERA in three starts this year against the Yankees.
Yankees: Michael Pineda (8-5) pitched his first career complete game in his last start, a 3-1 loss to Houston.
The 360-person Mormon Tabernacle Choir performed on the field before the game, singing a medley of patriotic tunes and the national anthem.
Tampa Bay's Steven Souza Jr. struck out as a pinch hitter in the 10th inning after getting ahead 3-0 in the count, and he extended his hitless skid to 25 at-bats, including 15 strikeouts. Souza walked in the 12th.