SPARC Reanalysis Intercomparison Project

Various S-RIP Related Datasets

S-RIP Community Data Archive

The British Atmospheric Data Centre (BADC) of the Centre for Environmental Data Analysis (CEDA), UK has agreed to provide S-RIP with a virtual machine for data processing and a group workspace for storing data.

The information on this page was last updated on 6 May 2016.

General Information

The CEDA (BADC) Helpdesk is available via . Inquiries should be sent directly to the Helpdesk. The manager of the S-RIP group workspace is Charlotte Pascoe.

General information regarding the JASMIN facility can be found at

How to Access JASMIN

The instructions for JASMIN access are posted at this link. James Anstey and Sean Davis have also documented the following steps (Masatomo Fujiwara updated the information on 12 April 2016):

  1. Create a CEDA account by following this link. (If you already have an account with 'MyBADC', you can use the same username and password.)
  2. Generate an SSH key. Instructions are available here; in particular do the following step from section 2:
    $ ssh-keygen -t rsa -C "you@youremail.edu"
    It is important that you say yes when ssh-keygen asks you if you want to use a passphrase. CEDA requires that the ssh key uses a passphrase. Also note that the default name for the key is "id_rsa"; ssh-keygen gives you the option to choose a different name (such as "id_rsa_badc") in case you already have an "id_rsa" key in your ~/.ssh directory that you don't want to overwrite. After this process, you should have the files "id_rsa_badc" (private key) and "id_rsa_badc.pub" (public key) in your ~/.ssh directory.
  3. Add the public key to your CEDA account: After logging into CEDA, click the "Edit" button in "My details", and then copy and paste the contents of your public key file (i.e., "id_rsa_badc.pub") into the "Public Key" box. Complete this step by clicking the "Save" button at the bottom of the page.

  4. Apply for access to JASMIN by clicking on the "Apply for JASMIN login account" link under Step 3 on this page and following the instructions. The CEDA Helpdesk will then send you an email, likely within several hours, saying that your JASMIN account is set up. (If you do not get a response from the Helpdesk in a timely fashion - within 1-2 days - email them. A couple of S-RIP users have experienced delays at this step. If this happens to you, let know so that we can find out if this is a systematic problem. The same is for #5 and #6 below.)
  5. You may need to register your network domain (for non ac.uk domains) by sending an email to the CEDA Helpdesk to give them your IP address. The instruction is found under Step 4 on this page or directly at this page. (The exception is if your institution is already on a "pre-approved" list of institutions. The litmus test is whether you can successfully login to both jasmin-login1 and, from there, into jasmin-sci1. If you can, then this step is not required.) (See the end of #4 above.)
  6. You then need to follow the link on this page, Step 5 "Apply for an existing Group Workspace", to apply for access to the S-RIP group workspace ("JASMIN - SPARC Reanalysis Intercomparison Project (SRIP)"). As with step #4, the CEDA Helpdesk will then send you an email saying that you now have access to the group workspace. (See the end of #4 above.) The S-RIP group workspace is found on jasmin-sci1 at: /group_workspaces/jasmin2/srip

  7. You can then log into JASMIN using the following commands (at your linux prompt in the ~/.ssh directory):
    $ cd ~/.ssh
    $ exec ssh-agent bash (to set bash as the preferred shell)
    $ ssh-add id_rsa_badc (you will be asked for your ssh key passphrase)
    $ ssh -AX your-username@jasmin-login1.ceda.ac.uk
    This should log you into jasmin-login1 without requiring a password. If you skip the second step (exec ssh-agent) then the result is the same except that a small window will pop up and ask you for your passphrase. You should only need to do the first two steps once; after completing this step you should be able to log in to JASMIN using only the last line (ssh -AX).

What You Can Do With JASMIN

Once you are logged into jasmin-login1 (do not forget to do the processes #7 above before going further!), you can connect to jasmin-sci1 and then go to the S-RIP group workspace:
ssh -X jasmin-sci1
cd /group_workspaces/jasmin2/srip/

jasmin-sci1 is the virtual machine that is available for analyzing data. The list of packages installed on jasmin-sci1 is available at this link, and includes ipython, nco, and cdo. IDL is not available by default, but can be added by typing
module add idl
at the jasmin-sci1 prompt. Matlab is not available and CEDA/BADC have no plans to install it, but octave (Matlab's open source clone) is available for running Matlab scripts.

Data can be uploaded to the JASMIN by using rsync as
rsync -tpu filename username@jasmin-xfer1.ceda.ac.uk:/group_workspaces/jasmin2/srip/.../

Data can be downloaded from the JASMIN by using rsync as
rsync -tpu username@jasmin-xfer1.ceda.ac.uk:/group_workspaces/jasmin2/srip/.../ .
(Adding the "r" flag in rsync will grab all the underlying dir structure. The options "tpu" will compare timestamps and update files as needed; this is good when the transfer dies while incomplete or when you want to verify you have the most up-to-date data.)

The S-RIP group workspace (/group_workspaces/jasmin2/srip) contains 10TB (expanded to 30TB in Dec. 2015) of disk space. There is the possibility of increasing its size if necessary. Note that this group workspace is not backed up! CEDA/BADC are currently considering implementing a backup system for group workspaces. Storage in one's home directory is limited to 10GB, according to the Helpdesk. You can find out how much space is currently available in the S-RIP workspace by typing
pan_df -h /group_workspaces/jasmin2/srip

S-RIP Common Grid Files

The S-RIP common grid files are being prepared by Sean Davis of NOAA and an initial draft is temporarily available at:

  • ftpshare.al.noaa.gov
  • user name: srip
  • password: Contact Sean Davis
  • Go to 'cgv2' directory (NOT 'cgv1')

(A copy is also available at the BADC S-RIP workspace, at the following directory.)
/group_workspaces/jasmin2/srip/ftpshare.al.noaa.gov/cgv2/

Notes about this data set (by Sean Davis):

  • Data set size: ~26 GB
  • Reanalyses included are CFSR, ERA-I, JRA-25, JRA-55, and MERRA
  • Variables include T (variable name ta), u (ua), v (va), O3 (tro3), WV (hus), and GPH (zg)
  • Data are based off of the ana4mips data set
  • Data are on a 2.5 deg x 2.5 deg grid
  • All values are monthly means
  • Pressure levels are (1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 70, 50, 30, 20, 10, 7, 5, 3, 2, 1, 0.7, 0.5, 0.3, 0.1 hPa)
  • 3 time periods are provided:
    • The "full" time period (different for each reanalysis)
    • The "S-RIP base period" (i.e., 197901-201312)
    • The "climatology" period (198101-201012)
    • Both 3D (lon,lat,level) and zonal mean 2D (lat, level) files are provided
  • Both timeseries and climatology data are provided. Files with "ltm" in the name are climatologies
  • Reanalysis "Ensemble" files are located in the /ensemble directory (See note below*)
  • Data should be considered to be in “beta” form as they have not undergone extensive QC. Please report any problems to Sean Davis (see above)

*Regarding the "ensemble" data - I highly recommend using the "ensemble" files in the "ensemble" folder for climatological intercomparisons.

You can use a single file (e.g., hus_Amon_reanalysis_ENS_198101-201012.cg.ltm.nc for water vapor) that contains the climatologies for each reanalysis.

The data in these files are of dimension (lon, lat, level, "record"), where record 0 = CFSR, 1=ERA-I, 2=JRA-25, 3=JRA-55, and 4=MERRA.

There is also a corresponding "ensemble mean" file (e.g., hus_Amon_reanalysis_ENS_198101-201012.cg.ltm.ensmean.nc) that is simply the ensemble mean climatology from the 4 core reanalyses (CFSR, ERA-I, JRA-55, MERRA — EXCLUDING JRA-25).

You may use the following wget command to get all data:
wget -Nr ftp://srip:PASSWORD@ftpshare.al.noaa.gov/cgv2/*
(You need to replace "PASSWORD" with the actual password.)