Holders Arsenal are through to the fifth round of the FA Cup, but they were made feel uncomfortable away to Brighton.
Arsenal eventually ran out 3-2 winners, with the returning Theo Walcott and Mesut Ozil both on the scoresheet.
Aston Villa brought an end to more than nine scoreless hours of football by beating Championship leaders Bournemouth 2-1 at Villa Park.
Recent signing Carlos Gil and Andi Weimann got the second-half Villa goals.
Callum Wilson pulled one back late-on for the Cherries.
Before that game, it was announced that Villa had tied midfielder Fabian Delph down to a new contract that will notionally keep him at the club until the end of the 2018-19 season.
Earlier, a late goal from substitute Diafra Sakho gave West Ham a 1-0 win against League One high-fliers Bristol City.
Full-time scores
Bristol City 0-1 West Ham
(WH; Sakho 81')
Aston Villa 2-1 Bournemouth
(AV: Gil 51', Weimann 71' // B: Wilson 90+2')
Brighton 2-3 Arsenal
(B: O'Grady 50', Baldock 75' // A: Theo Walcott 2', Ozil 24', Rosicky 59')