skip to main | skip to sidebar

The LHC at PIC

When later this year the LHC proton collider will switch on at CERN, it will generate an unprecedented amount of scientific data. In order to process and analyse this data the largest Grid infrastructure in the world has been built: the LHC Computing Grid, joining more than 100 sites in more than 30 countries. PIC is one of the eleven Tier-1 centres of this Grid. Follow the adventure of the real-time LHC data taking in this blog.

Thursday, 18 March 2010

Tape write performance and check_written_file

To me this was quite a discovery. As usually happens, we already had this information since several months in our mailboxes. FNAL folks told us about this Enstore parameter but we did not pay much attention at that time. Another effect of the "too much information to swallow daily" syndrome (at least for me).
Anyway, there is this funny parameter in Enstore called "check_written_file" which tells Enstore whether to check files were correctly written to tape... by reading them back! So, quite an expensive check, indeed.
Bottom line is that we had it set up at 10 without really realizing. On average, one every 10 files written was read back for checking. A bit too much, isn't it?
Last tuesday 16th in the evening this parameter was increased by a factor of at least 50.
The good news is that the ATLAS performance we report to SLS clearly shows a 30% improvement in the expected moment (top plot). Good!
The not so good news is that the same plot for CMS (bottom plot) does not show any hint of improvement... one could even see a degradation! We believe (hope!) this is due to the fact that CMS is not writting many files in one go these days, so it is dominated by tape mounts.
Will keep an eye on this, but to me it looks like we saved some Euros in tape drive throghput this week ;-)

Posted by Gonzalo at 18:28

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

Blog Archive

  • ▼  2010 (20)
    • ►  July (3)
    • ►  June (3)
    • ►  May (4)
    • ►  April (2)
    • ▼  March (6)
      • CMS Statement for the 7 TeV collisions
      • Last week we finally started receiving ATLAS TAG d...
      • Tape write performance and check_written_file
      • Hammered!
      • LHC is back!
      • January availability report
    • ►  February (1)
    • ►  January (1)
  • ►  2009 (21)
    • ►  December (1)
    • ►  November (4)
    • ►  October (1)
    • ►  September (2)
    • ►  August (2)
    • ►  June (3)
    • ►  May (2)
    • ►  March (3)
    • ►  February (3)
  • ►  2008 (26)
    • ►  December (1)
    • ►  October (2)
    • ►  September (1)
    • ►  August (1)
    • ►  July (3)
    • ►  June (2)
    • ►  May (7)
    • ►  April (4)
    • ►  March (3)
    • ►  February (2)

Other LHC blogs or interesting sites

  • Planet WLCG
  • RAL Tier-1
  • Descobrint la Física de Partícules amb l'LHC

Contributors

  • Gerard B.
  • Gonzalo
  • JoseFlix
  • Xavier Espinal
  • joseflix