Accounting Working Group

From TeraGrid Wiki

Jump to: navigation, search

THIS PAGE CONTAINS OLD/OUTDATED INFORMATION.

The current page for the accounting-wg is UFC-RP. This page is being retained for the historical record.

Contents

Biweekly telecons

NEW TIME as of Aug. 14, 2008
Held every other Thursday at 9am Pacific, 11am Central.
Toll-Free: 866-740-1260
Alt. Toll: 303-248-0285
Access Code: 8229741#
Coord. Code: 4075

Click on the header or this link to see the agenda and meeting minutes.

Primary and Secondary Site Contacts 20-Apr-2011

  • IU: Erik Cornet <ecornet@iupui.edu>, Rich Knepper<rknepper@indiana.edu>
  • LONI: Steven Brandt <sbrandt@cct.lsu.edu>, Charles Cavanaugh <ccava@cct.lsu.edu>
  • NCAR: Ingmar Thompson <ingmar@ucar.edu>, Michelle Smart <msmart@ucar.edu>
  • NICS: Gary Rogers <grogers@eecs.utk.edu>, Victor Hazlewood <vhazlewo@utk.edu>
  • NCSA: Steve Quinn <squinn@ncsa.uiuc.edu>, Michael Shapiro <mshapiro@ncsa.uiuc.edu>
  • ORNL: Dennis Hamrick <hamrickdk@ornl.gov>
  • PSC: Ed Hanna <ehanna@psc.edu>, Rob Light <light@psc.edu>
  • Purdue: Bill Whitson <wiw@purdue.edu>, Benjamin Lewis <bhlewis@purdue.edu>
  • SDSC: Leo Carson <lcarson@sdsc.edu>
  • TACC: David Walling <walling@tacc.utexas.edu>, Akhil Seth <akhil@tacc.utexas.edu>

Related TeraGrid Policies

TG-6 Staff Roaming Grants

TG-10 Community Account Policy

TG-15 Persistent Storage Allocations Policy

TG-16 Storage Peer Review Option

Related TeraGrid RATs

Authentication and Authorization -- not really a RAT, but close enough.

NCAR Integration

Science Impact and Metrics

AURA - Accounting/Allocations

Accounting

Science Gateways

User Portal

AMIE

Timeline for AMIE upgrade on July 14, 2010. All times are Pacific Standard Time.

  • 10:00 AMIE central instance disables send and receive capabilities by editing servers crontab and ~amietgdb/.ssh/authorized_keys. AMIE processes at the central instance finish.
    • TGCDB central runs the old AMIE process once more manually to clear any packets in the incoming/received directory.
  • 10:15 Michael Shapiro sends the new amie.pl to the accounting-wg mail-list and puts it in CVS.
    • The new amie.pl is installed at TGCDB central.
    • Each site runs their old amie a couple of times to clear any packets in the incoming/received directory.
    • Each site turns off their amie cron, waits for the current run to complete, copies the old version of amie.pl to a safe place, installs the new amie.pl, and turns cron back on and notifies the working group via email (accounting-wg@teragrid.org) or the con-call.
    • Sites will see send failures until the AMIE central instance re-enables its receive capability. These send error messages will go away once the TGCDB enables receive.
  • 11:00 Roll call. Those sites who have successfully installed the new version will be activated at the central instance.
  • 12:00 All sites running the new AMIE version. Upgrade completed.

Failures will need to be assessed according to their severity. If nothing works at all, then all sites have to revert to the saved copy of AMIE. If there are local problems, we will assess the situation and decide how to proceed on a case-by-case basis.

  • Post Op Notes

The operation was completed at 11:30, 30 minutes ahead of schedule. It went smoothly with one exception: Three sites used the Mac mail client to receive the new amie.pl program. It introduced an extra CR character when it assumed the file was being written to a Windows platform and Perl didn't like it. The solution is either to use another mail client, or scp the file from one Unix platform to another avoiding mail altogether, download it from repo.teragrid.org or use this handy Perl script to remove the unwanted CR.

#!/usr/bin/env perl

# stripcr - Strips those nasty carriage returns retained by the Windoze
# community.  This program goes out to all of those poor students that
# have to transfer their work between *nix, Windoze, and back again.
# Created by Chris Baumbauer (cbaumba1@purdue.edu).
# Protected under the GNU General Public License Version 2.
#
# stripcr files1 file2 ... filen

foreach $arg ( @ARGV ) {
    open (INDATA, $arg);
    ($device, $inode, $mode,$nlink,$uid,$gid,$rdev,$size,$atime,$mtime,$ctime,$blksize,$blocks) = stat ($arg);
    read(INDATA, $current_file, $size);
    close (INDATA);
    open (OUTDATA, "> $arg~");
    print (OUTDATA "$current_file");
    close (OUTDATA);
    open (OUTDATA, "> $arg");
    $current_file =~ s/\r\n/\n/g;
    print (OUTDATA "$current_file");
    close (OUTDATA);
}


July 13 are you ready? There are 10 RP sites. NCSA and TG-POPS are treated as one.

  • 1.) IU  : Erik Cornet yes
  • 2.) LONI: Steven Brandt yes
  • 3.) NCAR: Ingmar Thompson yes
  • 4.) NICS: Mike McCarty yes
  • 5.) NCSA: Steve Quinn yes
  • 6.) ORNL: David Giles yes
  • 7.) PSC: Rob Light yes
  • 8.) Purdue: Bill Whitson yes
  • 9.) SDSC: Leo Carson yes
  • 10.)TACC: David Walling yes

Official AMIE documentation and software (mirror of repo CVS contents for AMIE)

Chris Baumbauer's AMIE Benchmark Report

TeraGrid Compute Resources

xRAC Allocations Process

And a detailed article on the process of getting allocations.

Core2.0 Working Space

Core Services 2.0

TGUsage

Documentation and changes to the TeraGrid allocation usage utility.

TeraGrid Central Data Base (aka TGCDB)

Information and API documentation for accessing the TGCDB.

Personal tools