The Magpies surged ahead courtesy of a wonderful opener from the Frenchman, but had to battle for a share of the spoils after Luis Suarez had levelled and visiting captain Fabricio Coloccini had seen red.
"It was a good point from a very hard and difficult away game," Cabaye told Newcastle's official website in the aftermath.
"In the first 10 minutes they put us under a lot of pressure but we stayed solid and they didn't have a really good chance to score.
"It was really important that we didn't concede early on because it meant we stayed in the game.
"After 20-25 minutes we kept the ball better, played in their half and had a few chances before my goal.
"Going in 1-0 up at half-time was great, but the goal we conceded in the second half we could have done much better with. However, a point here is a good point."