Thoughts on the UK Cabinet Office’s 90 day auto-deletion of emails

The Financial Times [1] reported this week that the Cabinet Office auto-deletes their e-mails after 90 days.

In the article several officials and aides are quoted describing day to day problems that Cabinet Office staff have experienced in the absence of an adequate correspondence record:

  • A special advisor is quoted as saying that ‘It means that people don’t remember things…It is dysfunctional.  Then they check their emails and they don’t exist anymore’.
  • An aide is quoting as expressing their frustration that colleagues often had different recollections of what had been agreed at meetings.

The Cabinet Office’s  90 day deletion policy was introduced in 2004.   The Freedom of Information Act for England and Wales came into force on the 1 January 2005.    The article quotes  Maurice Frankel of the Campaign for Freedom of Information  as stating that the proximity of those two dates ‘was not a co-incidence’.   However the article  also reports: 

An official said the system had been recommended by the National Archives for  ‘best records management’ and it was a coincidence that it began at the same time as Freedom of Information

On the one hand I do not believe that the Cabinet Office’s 90 day deletion policy was introduced in 2004 purely as a conspiracy:

  • In 2004 many Whitehall departments were introducing electronic records management (ERM) systems, into which they told staff to capture significant documents and correspondence.   
  • It is quite possible that the Cabinet Office’s routine deletion policy dates from the time of their roll out of their ERM system
  • The UK National Archives advice was at the time (and still is now) [2] that Departments should capture significant correspondence into a designated records system and should routinely delete correspondence from e-mail accounts.
  • As FOI man [3] points out,  back in 2004 most records managers would have recommended that an organisation implementing an ERM system  should also routinely delete e-mail left in email accounts
  • At the time, in 2004, we as archivists and records managers genuinely hoped and believed that the policy of requiring colleagues to declare important emails and documents into an ERM system would capture a reasonable record of their correspondence
  • The ERM systems introduced around 2004 by many UK government departments, including the Cabinet Office, had been tested and certified by the UK National Archives as meeting their specification of requirements for the management of electronic records
  • The UK government was the first administration in the English speaking world to implement ERM systems on a large scale.  If felt like an experiment at the time – powered by the Blair government’s modernising government agenda, the coming of FOI in England and Wales (and separately in Scotland), and by the fact that paper records systems had been blown apart by the coming of email in the mid 1990s.

On the other hand :

  • just because archivists and records managers in the UK government sector and elsewhere  recommended the routine deletion of email from email accounts in good faith,  back in 2004, whilst embarking out on the electronic records management system journey ,  and in the hope and on the assumption that the policy instruction to save significant emails into electronic records management systems would be followed….
  • …..does not mean that we should continue to recommend or support such routine deletions now, in 2015,  in the light of the experience that we have gained in the intervening decade.

Experience has taught us that asking users to declare important emails as records into any sort of record system does not result in the capture of an adequate correspondence record

The experience we have had in the UK, in continental Europe, in Australia and in the US is that asking colleagues to choose which of their e-mails are significant, declare them as a record, and move them to some sort of electronic file (or paper file, or SharePoint document library) does not capture an even vaguely adequate record of correspondence.    

It is interesting to read the quotes of the special advisors/aides/officials in the FT article.   One presumes that some emails have been captured into the Cabinet Office’s ERM system (for nearly a decade they had a system provided by Meridio, but have recently replaced it with Google Docs).   And yet the officials quoted by the FT  talk as though there was no correspondence record at all. My guess is that this is because individuals saved so little correspondence into the system,  and saved into the system so selectively, that to all intents and purposes there was and is no Cabinet correspondence record outside of e-mail accounts.

This is only a guess – we would need to know the figures.  The most relevant figures being:

  • how many e-mails did Cabinet Office staff send in any given year?
  • how many e-mails were captured into the Cabinet Office record system in that same year?

We do have these figures for the US State Department, thanks to a report [4] published by the Office of Inspector General in March 2015.   The report states that in 2009 the State Department implemented a record system that was built into the Outlook email client, whereby individuals could declare important emails as records.   This was backed up by a policy instruction that individuals were responsible for preserving important emails as records, and by training.

The Office of Inspector General’s report sates that in 2011 the State Department sent 1 billion emails, but only 61,556 were declared as records.   Robert Smallwood [5] calculates that the emails captured into the State Department’s  record system constitute only .0061%  of their total email communications.  In 2013 the situation was even worse – only 41,749 State Department emails were declared as records.   Interestingly the report states that one of the reasons for the lack of the declaration of emails as records was a fear that they would show up in searches (which I am interpreting to mean that they would show up in searches conducted in response to Freedom of Information requests).

If the Cabinet Office no longer knows how many emails it received in a given year then the headcount of the Cabinet Office in that year would be the next best figure.    Chris Prom [6] quotes statistics from Radicati [7] stating that on average a business user sends 33 emails a day.

I recently spoke to an organisation who had a reasonably good electronic records management system, no fear of Freedom of Information, and a strong commitment to record keeping.  They told me that the number of items contributed to their records system equated to one item per member of staff every two days.  If the figures Prom quotes are correct that would give a ration of  around 1 email saved to their records system for every emails 66 sent.  That is several orders of magnitutude better than the State Department’s ratio, but for an important organisation that ratio is still nowhere near high enough to function as a useable and defensible correspondence record.

Most UK government bodies operate routine deletion policies, albeit significantly less drastic than the Cabinet Office’s 90 day deletion.    Rather than a 90 day deletion it is more common for the deletion to occur  1 or 2 years after the email is sent, or six months to a year after the individual email account holder has left employment.  Alternatively or additionally some departments operate a limit on email box size rather than an automatic deletion.  

Individuals in such departments do not experience the inconveniences reported by Cabinet Office staff.   They are cushioned from the impact of the deletions, but the net result is the same.  The correspondence record being kept is inadequate and cannot support basic succession planning/staff handover in the short term, corporate memory in the medium term and historical accountability in the long term.

References

[1] Pickard, Jim and Stacey, Kiran   2015.   Freedom of information is Mission Impossible for Downing St emails.   Financial Times, June 16, 2015 8:17 pm,   available from http://on.ft.com/1QCbS8a (it requires a log-in).  Accessed 17 June 2015

[2] The National Archives (TNA) (date unknown) Managing emails.   Available from http://www.nationalarchives.gov.uk/information-management/manage-information/policy-process/managing-email/  (Accessed 18 June 2015).    TNA’s policy advice to Government departments is  that

”You will need to…..limit what users can keep in personal email accounts by the use of:
– email account quotas OR
– automatic deletion after a set period of time”

[3] Gibbons Paul (FOI man) 17 June 2015.  FOI avoidance or good records management?  Cabinet Office Email Policy.  Available from http://www.foiman.com/archives/1584  accessed 18 June 2015

[4] Office of Inspector General, March 2015. Review of State Messaging and Archive Retrieval Toolset and Record Email (ISP-I-15-15) Available from https://oig.state.gov/reports/inspection?page=1 or access the pdf directly from https://oig.state.gov/system/files/isp-i-15-15.pdf

[5] Smallwood, R, 2015.  Clinton Email Kerfuffle: Call for Cabinet-level Information Governance.  Available at  https://www.linkedin.com/pulse/clinton-email-kerfuffle-call-cabinet-level-governance-smallwood(accessed 17 June 2015)

[6] Prom, Christopher J, 2011.  Preserving email (Digital Preservation Coalition Technology Watch Report)  pdf available from http://www.dpconline.org/newsroom/latest-news/805-email-tomorrow-and-next-year-and-forever-preserving-email-report-published  On page three of the report Prom writes ‘Over 3.1 billion email accounts currently exist, and the average business user sends 33 email messages per day (Radicati Group, Inc. 2011a). ‘

[7] Radicati Group, Inc., 2011a. Email Statistics Report, 2011–2015, Executive Summary. Available at: http://www.radicati.com/?p=7261 [Accessed July 17, 2011]. (Quoted by Prom)

2 thoughts on “Thoughts on the UK Cabinet Office’s 90 day auto-deletion of emails

  1. With reference to the paragraph below can you point me to information about the Australian experience. Thanks.
    Peter Timmins
    Open and Shut
    Sydney
    “The experience we have had in the UK, in continental Europe, in Australia and in the US is that asking colleagues to choose which of their e-mails are significant, declare them as a record, and move them to some sort of electronic file (or paper file, or SharePoint document library) does not capture an even vaguely adequate record of correspondence.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s