Help — Frequently Asked Questions
- What is the Public Whip?
- First, can you explain "division" and other political jargon?
- How does the Public Whip work?
- What time period does it cover?
- What do the "rebellion" and "attendance" figures mean exactly?
- Why do you refer to Majority and Minority instead of Aye and No?
- What is a motion to sit in private?
- Why do you incorrectly say people are rebels in free votes?
- Why is the division numbering different between the Commons and the Lords?
- What are Policies and how do they work?
- Legal question, what can I use this information for?
- Can I play with the software?
- Why are you giving everything away for free?
- What organisation is behind the Public Whip?
- What's your connection with TheyWorkForYou.com?
- Are you happy to give interviews about Public Whip?
- Do you make any money out of Public Whip?
- How do you earn enough to make a living?
- I've just got a job at a company that's been contracted ... to process Parliamentary data ...
- Have you had any problems from MPs or other politicians with what you are doing?
- Are there any RSS syndication feeds?
- Where is the data in spreadsheet file format or in XML?
- How does this XML nonsense all work?
- What is the fuss about software patents?
- Can I help with the project?
- What do you mean by editing the motion description?
- What other projects are similar to Public Whip?
- How can I keep up with what you are doing?
- There's something wrong with your webpage / I've found an error / Your wording is dreadfully unclear / Can I make a suggestion?
What is the Public Whip?
Public Whip is a project to watch Members of the United Kingdom Parliament, so that the public (people like us) can better understand and influence their voting patterns. We're an independent, non-governmental project.
First, can you explain "division" and other political jargon?
The House of Commons divides several times each week into MPs (Members of Parliament) who vote Aye (yes, for the motion) and those who vote No (against the motion).
Each political party has whips who try to persuade their members to vote for the party line. In return for loyalty, the party promotes them into desirable jobs and supports their re-election campaigns at the General Election. The whip sometimes refers to the letter sent to each MP by their party at the start of the week informing them of the divisions they are expected to attend. The word whip can also refer to the membership of the party -- so that removing the whip from a member is considered the ultimate sanction.
An MP rebels by voting against the party whip.
A teller is an MP involved in the counting of the vote. There are two tellers for the Ayes and two for the Noes, unless it is a deferred division in which case voting takes place by signing a sheet of paper rather than walking through the division lobbies. Although the tellers technically don't vote, it is conventional to assume that they do; an exception being when the vote would have been unanimous, but for the two MPs who are required to report on the lack of votes for the other side.
For more information on all these terms, see the Parliament factsheet on divisions.
The House of Lords is the second chamber of the Parliament. Proposed legislation passes through both Houses before it becomes law. Lords become members by a complex mixture of appointment, religion, appelation, hereditary entitlement and self election. They still divide, as in the House of Commons, but instead of Aye and No they are Content and Not-Content.
How does the Public Whip work?
All the House of Commons and House of Lords debate transcripts (collectively, Hansard) back to 1988 are published electronically on the World Wide Web. We've written a program to read them for you and separate out all the records of voting. This information has been web-scraped into an online database which you can access.
What time period does it cover?
Voting and membership data for MPs extends back to the May 1997 General Election, although there are a few divisions missing in the 1997 parliament. Lords membership data extends back to the big reform in 1999, because nobody can remember who the members were before then. Lords divisions currently go back to July 2001. New divisions usually appear in Public Whip the next morning, but sometimes take a day or two longer. We give no warranty for the data; there may be factual inaccuracies. Let us know if you find any.
Numerics: The database contains 3,582 distinct MPs and Lords from 38 parties who have voted across 13,246 divisions. In total 4,405,154 votes were cast giving an average of 332.6 per division. Of these 81,153 were against the majority vote for their party giving an average rebellion rate of 1.84%.
What do the "rebellion" and "attendance" figures mean exactly?
The apparent meaning of the data can be misleading, so do not to jump to conclusions about MPs or Lords until you have understood it.
"Attendance" is for voting or telling in divisions. An MP may have a low attendance because they have abstained, have ministerial or other duties or they are the speaker. Perhaps they consider each division carefully, and only vote when they know about the subject. Lords are appointed for life, so they may have decided to retire. Sinn Féin MPs, because they haven't taken the oath of allegiance, are unable to vote. A full list of reasons for low attendance can be found in the Divisions section on page 11 of a House of Commons library research paper. Note also that the Public Whip does not currently record if a member spoke in the debate but did not vote.
Extra note, October 2008: We have found that people take the attendance in divisions too seriously, when it is really pretty meaningless. At Public Whip, we'd rather an MP actually scrutinised law and made it better, and voted well on it, rather than voted more often. Therefore we have removed attendance from the main MP table.
"Rebellion" on this website means a vote against the majority vote by members of the MP's party. Unfortunately this will indicate that many members have rebelled in a free vote. Until precise data on when and how strongly each party has whipped is made available, there is no true way of identifying a "rebellion". We know of no heuristics which can reliably detect free votes. See also the next question.
What is a motion to sit in private?
There are a number of arcane procedures listed in the Standing Orders which have been carried over for hundreds of years. All recent versions and their renumberings are listed there.
The 2007 Standing Order 163 (Motions to sit in Private) says:
If any MP moves 'That the House sit in private' the Speaker shall put the question to a division. Such a Motion may be made no more than once per day.
The 2007 Standing Order 41 (Quorum) says:
If it should appear that fewer than forty Members have taken part in a division, the business under consideration shall be suspended.
(As an aside, the Quorum rule has a second part which says: "The House shall not be counted at any time." which prevents anyone from putting on record how badly the debate is attended in relation to the number of MPs who lend their weight to the vote when the division bell sounds. It is also made explicit by 2007 Standing Order 39 that "A Member may vote in a division although he did not hear the question put".)
These two rules combine into the gambit used by Andrew Dismore MP in March 2003 to end discussion of the Government Powers (Limitation) Bill when only 23 MPs presented themselves to vote -- there may have been many more in the building who were ordered to stay away to ensure lack of quorum.
The counter-measure to this gambit, often exercised by the late Eric Forth MP, was to call for the motion to sit in private at the start of the sitting, which then rules it out for the rest of the day.
The Speaker has ruled that Motion to sit in private can be moved at any time no matter how nonsensical it is, as she did just before Andrew Dismore MP called for it in May 2007 to head off an attempted filibuster on the matter of whether Parliament and MPs' correspondence should be off limits to the Freedom of Information Act.
If you don't like the way Parliamentary procedures get written and used in order to obscure the divide between what you believe is an overwhelming public position and their personal power play, then learn more about it, organize, and write to them.
Why do you incorrectly say people are rebels in free votes?
The short answer to this question is succinctly given by the Speaker. Here is the long answer.
There is no official, public data about the party whip. At the moment we guess based on the majority vote by MPs or Lords for each party. In order to correctly identify rebels, we need to know each party's whip in each division. There are two ways this could be officially recorded.
- Hansard clerks could record the whip. They could either be officially told the whip by each party's whips' office, or they could deduce it from the presence of offical whips. The whip would then be written in Hansard next to the division listing.
- Each whips' office could publish their official whip on their website after each vote. If you are a member of a political party, and want to fix the Public Whip site, lobby them to do this, then let us know.
Parties can't have it both ways—complain that we don't take account of what the whip is, and at the same time not tell us what it is. There is no contradiction in admitting the whip exists and recording it officially—after all some whips are paid a salary by the taxpayer so there is a precedent for admitting they exist.
Why do you refer to Majority and Minority instead of Aye and No?
Whether a vote is an Aye or a No is less informative than it seems, because it depends exactly on the words of the question put (for example: "Motion that the amendment be made" versus "Motion that the original words shall stand"), as well as the meaning of the amendment which itself carries the possibility of a further negation by its use of words ("insert the clause" versus "delete the clause").
In truth it would be less confusing if the votes were between "Option (a)" and "Option (b)" with their meanings clearly expressed. Indeed, this form of words in the motion text has been tried out, as in "Those voting No wanted this, and the Ayes wanted that", but then you have to know which side won in order to determine what happened.
But we don't need to express it like that, because all the votes are in the past and we always know which side won, and it's the winning side that determines what happens, as opposed to what could have happened. (What could have happened does matter, because if it was an alternative version of the law that turned out to be better in the long run than what was chosen, then it ought to reflect on the quality of the judgment of the MPs who were in the minority.)
Accordingly, in many of the explanations and lists we say Majority and Minority because it gives a clearer picture of what happened (as well as which side was which in the case of the absolute majority for the Government that is in the House of Commons), even though the words are less easy to understand than the often misleading "Aye" and "No".
Why is the division number different between the Commons and the Lords?
Good question. In the Commons, Division No. 1 is the first vote of the Parliamentary session or year, but in the Lords it is the first vote of the day. It would appear that, although both Houses are in the same building and operate the same procedure, they are run on completely different sets of paperwork that may have been the same at one point in the past, but has since evolved apart.
We would be grateful to someone with access to some very old volumes of Hansard if they could check out when these different numbering systems became established and let us know.
With great difficulty, we have generalized the software that supports Public Whip to run both houses after it was initially designed only to run the Commons. We therefore have learnt more about the syntactic incompatibilities between the two houses than we care to know. The process is fraught with possible errors. Please email us if you see any mistakes where we have said that the MPs were 'Content'.
What are Policies and how do they work?
On Public Whip, a Policy is a set of votes that represent a view on a particular issue. They can be used to automatically measure the voting characteristics of a particular MP or Lord (or someone who has been both) without the need to examine and compare the votes individually.
You do not have to agree with a Policy to have a valid opinion about the clarity of its description or choice of votes. This is why we've based their maintenance on a Wiki where everyone who is logged in can edit them. This means that when a Policy gets out of date, for example new votes have appeared that it should be voting on, it's up to anyone who sees it to fix it. It also means you can make a new policy yourself.
Policies are intended be a tool for checking the voting behaviour of an MP or a Lord, on top of the ability to read their individual votes. They provide nothing more than a flash summary of the data, a summary which you can drill down through to get to the raw evidence.
Legal question, what can I use this information for?
Anything, as long as you share it. This website is copyrighted by us, and the software is free open source. The data is licensed under an open data license. See the next two questions for details.
Amongst other things, this means that if you use it, you should double check the information. It may be wrong. If you are going to rely on it, at the very least do some random cross-checking to make sure it is valid. Whichever way, use it at your own risk. Of course we'd rather you helped us fix the software and correct any contact. See the answer to I've found an error for details.
If you reproduce this information, or derive any interesting results from it, you must refer your readers to www.publicwhip.org.uk. This way they can use and contribute themselves.
Public Whip's data meets with the Open Knowledge Definition.
Can I play with the software?
Sure. All the software we've written is free (libre and gratuit), protected by the GNU Affero General Public License (which means you can use it and change it, but you have to release any changes you make). It's not complicated, anyone can have a go running them. But there's only a point in doing this if you are going to change it as otherwise you will see the same results. For more details go to the special coding section of this website.
What license is the data under?
To the extent which we have rights to this database of MPs voting records and related information, it is licensed under the Open Data Commons Open Database License. This is an attribution, share-alike license. That means that you must credit the Public Whip, for example via a link, if you use the data. It also means that if you build on this data, you must also share the result under a compatible open data license.
Why are you giving everything away for free?
We're not; we're letting you take copies. Whatever you do, we still have our computers, all the programs, and our domain name. The more people who are playing with this sort of thing, the more cool ideas can come out of it.
We could wrap it up as a service and sell it to political lobbying organizations for cash. This would, however, be pointless since it would take away the notion of the public having access to it. All that would happen is that the people who are already organized influentially would retain all the power but would have slightly better software (which they probably have already).
What organisation is behind the Public Whip?
It was started by just two guys Francis and Julian who had an idea and made it happen. In August 2011 it was handed over to Bairwell Ltd to further develop and expand the project. The site will remain true to its open source roots.
What's your connection with TheyWorkForYou.com?
Both of Public Whip's founders, Francis and Julian, are members of that project, but Bairwell and Public Whip are not. Both projects currently use code and data in the separate Parliament Parser project.
Are you happy to give interviews about Public Whip?
Yes, email team@publicwhip.org.uk for press enquiries (we're always happy to hear from bloggers as well as major news organisations).
Do you make any money out of Public Whip?
Public Whip is run on a not-for-profit basis: we do have a couple of small affiliated links on the website to help cover the costs, but if you are interested in sponsorship, please email team@publicwhip.org.uk .
How do you earn enough to make a living?
We're a small web development company that works on many commercial projects. We run Public Whip in our .spare. time, and fund it out of our own pocket, because we believe in it.
I've just got a job at a company that's been contracted by Parliament, or some other organisation, to process Parliamentary data. I don't understand why you have written your software for free in your spare time when I'm paid to do the same thing.
Good for you! Feel free to approach us for any advice we can offer on solving the problems we have encountered during the development of the software.
There's also quite a lot of information posted on Parliament Parse.
Have you had any problems from MPs or other politicians with what you are doing?
Mostly they ignore us. If anyone in power has had an objection to what we are doing, they have kept it to themselves. As a rule, politicians must contrive to frame their desires into something that relates to the public interest. We can't rule out the possibility that some creative genius will eventually invent a reason which explains how what we are doing causes more harm than good, but it's unlikely.
Most of the problems have had to do with the inaccuracies in the attendance and rebellion rates. Once we point out that we can only be improved the data only when the politicians are willing to publish their secret party whip information, the criticism generally falls silent.
Are there any RSS syndication feeds?
First an explanation. RSS is a way to let you easily read news from lots of different sources. You need a special program called a newsreader to do this. On the BBC website, there's a full description of how to do it. We provide the following RSS feeds:
interestingdivisions.xml — Find out every time there are more than 10 "rebellions" in a division.
alldivisions.xml — Keep on top of every division in Parliament, after it happens.
Where is the data in spreadsheet file format or in XML?
Take a look at our Raw Data page.
How does this XML nonsense all work?
To us XML is nothing more than a standard text file for structured information, so any highfalutin' claims you may have heard about it do not apply in our case.
When the Hansard debates go online on the parliament.uk website, our parsing software starts to work on it. Step one is to download all the pages and 'de-pagenate' them. This turns each day into one page, which you can see a directory of here.
You can browse through our full list of archived original data in this directory, including a daily copy of frequently updated pages such as lists of ministerial positions, which is how we keep track of this data when it becomes history and is nowhere else recorded.
After downloading, or 'scraping', the pages are parsed into a fairly self-explanatory XML format, examples of which can be seen in this directory. For further information, please see the Parliament Parser homepage.
Often there are typos, mistakes, or unusual unusual formatting that the parser can't cope with, in which case they need to get patched up before the process can complete. This usually accounts for the delay in the morning. Some examples of patch files can be found in this directory. Later in the day some sharp-eyed MP or clerk might spot them independently and ask for a correction in the text which they could have found out about by checking these diff files. When there are corrections, we keep both versions and mark up the differences. Look for XML files where there is both an 'a' and 'b' version on the same date.
What is the fuss about software patents?
A new European directive on software patents threatens the existence of websites like The Public Whip. We'd like your help to stop it. For more information see here.
Can I help with the project?
Sure! We're looking for people who are interested in editing the motion descriptions on some of the divisions. See the following question for details. If you have particular skill-sets that you feel you could contribute, then do please email us at team@publicwhip.org.uk.
What do you mean by editing the motion description?
When there is a division in Parliament, it is not always easy to see what it means. Quite often you have to scan through all of the debate in which the division took place (looking for the phrase "I beg to move"), and have a good knowledge of the the jargon to work it out. Also, many votes are about making changes in other documents (eg "to leave out line 5 on page 13 of the Ordinary Persons Pensions Bill") which needs to be found and made available through a link.
The Public Whip software isn't currently sophisticated enough to do this automatically, and it requires help from a person like you. You can find out more about it on our Research page, where there is a page of ideas on how to do it.
In the longer term, it would be better if Parliament told us the meanings of their votes in plain english from the beginning, rather than hiding what they were doing behind layers of unnecessary technicalities so that people didn't have to invent sites like Public Whip to make it possible to work out what was going on. If enough of us got involved we would be able to tell MPs in exact detail everything we expect their record to be, and get something close to what we want.
What other projects are similar to Public Whip?
We currently rely on the Parliament Parser project.
Outside of the Open Source community, some academics have worked in this area. Usually, however, after going through the expense of gathering their data, and writing their academic books and papers and giving their interviews, they throw it all away and don't get round to building a live website. The most active person in this field at the moment is Philip Cowley who makes much of his research available in PDF form.
Many news organizations publish Parliamentary data, and so therefore must be doing some of the same work we are doing, without necessarily knowing that they can use everything we have done for free as a basis.
You can read more about this subject in the Parliamentary Informatics Wikipedia article.
How can I keep up with what you are doing?
You can ask us questions and get updates via and our Twitter account.
There's something wrong with your webpage / I've found an error / Your wording is dreadfully unclear / Can I make a suggestion?
You can contact us via email at team@publicwhip.org.uk or reach us via our Twitter account.