House Speaker John Boehner is almost certain to win re-election in his suburban Cincinnati district, but that will only get him back to Congress.

To get another term as speaker, he'll need to win a floor vote that doesn't happen until January — and Boehner's prospects in that contest are far less clear.

Boehner has led the more conservative of the parties, but the most conservative members of that party have never been his fan club.

They see him as a deal-maker who's too willing to compromise — and that was before Boehner said this to a hometown Rotary Club about a House vote on immigration:

A few days later, Boehner told his Republican caucus he was only kidding.

"There was no mocking," he said. "You all know me. You know, you tease the ones you love."

Some Boehner critics think they see his joking as a sign.

"I don't think John Boehner is running for speaker," says Rep. Mo Brooks, R-Ala. "Just the way he has conducted himself. I just don't think he's going to run."

Brooks has a long list grievances. He blames Boehner for the fact that there are no committee chairmen from the eight states that Brooks calls the heart of the South, even though they account for more than a fifth of all House Republicans.

Boehner has also allowed bills such as the Violence Against Women Act to pass with more Democratic votes than Republican, and, Brooks says, Boehner threw his Republican caucus under the bus during the government shutdown last fall.

Brooks says the video of Boehner mocking his colleagues was a popular conversation topic at a gathering last week in the office of Sen. Ted Cruz, R-Texas. Like-minded conservatives have continued to meet regularly with Cruz since he led the shutdown effort.

"I would say, right now, there are at least two dozen members of the House that have pretty firm views about the way in which the House of Representatives operates, and we'll take whatever steps are necessary to ensure that we better rise to the challenge that our country faces," Brooks says.

That two dozen is about the same number that had supposedly agreed to vote against Boehner for speaker in 2013, before several got cold feet and backed out at the last minute.

Lynn Westmoreland, R-Ga., helped Boehner survive that earlier challenge. He says two dozen votes could be enough to make things dicey for Boehner again, if the majority margin remains at about 30 seats.

But if Republicans do well in the mid-term elections, like they think they will, Boehner's life would be a lot easier.

"Republicans take the Senate, you gain 12 or 15 seats in the House, now, you've got a different speaker's position than you have right now," Westmoreland says.

For the record, Boehner's office says he fully intends to be speaker in the next Congress.

Congressional scholar Norm Ornstein, for one, thinks Boehner has a Machiavellian plan to get there.

"Part of what Boehner is doing is operating maybe even with a little bit of a game of chicken, but believing that all of those people who are now bitching and moaning and saying he's not going to be able to make it back don't have a plan, and in the end they aren't going to be able to do what they threaten to do," Ornstein says.

That's what happened last time. Brooks says he's confident next time will be different.

Copyright 2016 NPR. To see more, visit http://www.npr.org/.