ST. PETERSBURG, Fla. -- The early wakeup call, the rush to the airport, the on-board peanuts ... as much as Matt Barnes was happy to be back in the big leagues Saturday afternoon, the thought may have occurred to him that he might have been better off sleeping in.

Barnes returned to the Boston Red Sox Saturday, almost two weeks after he was sent down. In between, he celebrated his 25th birthday.

But alas, there would be little for Barnes to feel festive about Saturday, despite the callup. The Tampa Bay Rays, who had scored their only runs off Sox starter Wade Miley on a two-run home run by Jake Elmore, padded their advantage with long home runs by Rene Rivera and Evan Longoria off Barnes in a 4-1 Rays victory before 23,876 in the Trop.

Barnes's last three outings prior to his demotion had not gone well. He was charged with the loss in two of them, allowing seven hits and five runs in three innings, and in the last of the three had been taken deep by Russell Martin of the Blue Jays for a game-winning home run in the 12th inning at Fenway Park.

But with his bullpen depleted, manager John Farrell opted for an extra bullpen arm, and Barnes was summoned to take the place of infielder Travis Shaw, optioned back to the PawSox. Barnes entered with one out in the seventh in place of Miley and promptly struck out Elmore, but Rivera, who came into the game batting .162, buried a first-pitch fastball from Barnes deep into the left-field stands.

That extended the Rays' lead to 3-0, and after Alejandro De Aza homered off Rays reliever Kevin Jepsen for Boston's only run in the top of the eighth, Longoria answered in the bottom of the inning by crushing an 0-and-1 fastball to deep center field for his eighth home run of the season.

That was plenty of offense on an afternoon the Sox managed just one hit -- Xander Bogaerts' opposite-field single -- in six innings against Rays rookie Matt Andriese. Their only other hit, besides De Aza's fifth home run in the eighth, was a flared two-out single by Brock Holt in the ninth, before Brad Boxberger struck out Bogaerts to end it.

The Sox fell nine games behind the Rays again in the AL East, and are faced on Sunday with Rays ace Chris Archer, who leads the American League in ERA, is third in strikeouts and already has nine wins.

Miley pitched very well, allowing 5 hits in 6 1/3 innings while walking two and striking out eight, but a triple by Asdrubal Cabrera to open the fifth, followed two batters later by Elmore's home run just inside the left-field foul pole, was enough to pin him with the loss.