Liverpool are just four points off league leaders Chelsea with 11 games remaining in the campaign and have been tipped as surprise title contenders.
Brendan Rodgers' side conceded three goals to Swansea last weekend before running out 4-3 winners and Toure admits they need to tighten up at the back if they are to keep pace in the leading pack.
"We know we need to control games better than that as a team," Toure told the Liverpool Echo.
"If you want to be in the top four or win the league, you need to defend well. We are scoring a lot of goals but for sure we need to get a better balance.
"It was a tough game against Swansea. The fact that the other top teams played on Saturday and all won put a bit more pressure on us. The manager spoke to us about that before the game.
"Simon Mignolet made a great save at 3-3 to make the team believe and we went up the other end and scored a fourth.
"The most important thing was that we got the three points. Now we need to go to Southampton and defend well as a team.
"Every player here is so committed. I see that in training every day. Everyone wants to play, everyone wants to win. It's a great group."
Toure lost his place in the starting XI for the last two games against Arsenal and Swansea after errors against West Brom and Fulham.
The former Arsenal and Manchester City man insists he has recovered from those mistakes and that he is working hard to regain his spot in Rodgers' side.
"Of course I was able to put those things behind me because it's part of the game," added Toure. "Only people who take responsibility make mistakes. For me, I like to take responsibility. I like to pass the ball. That's my job.
"Like a basketball player, if you miss one shot, you have to be brave and take another one.
"You don't feel sorry for yourself. You don't think 'I missed so I won't try again'. I've just kept working hard."