logo operations poral

logo egi


Operations Portal is an EGI service provided by CCIN2P3,
co-funded by EGI.eu and EGI-Engage



Release Version : 4.2 - October 12th

For any contact, use this section: Contact Us



The Operations Portal is a central portal for the EGI operations management that offers a different capabilities, such as the broadcast tool, VO management facilities and various of dashboards (Security, VO and Operations) to facilitate infrastructure oversight.

Latest news

Dear all, 

EUGridPMA have announced a new set of CA rpms. Based on this IGTF release a new set of CA RPMs have been packaged for EGI. 

Please upgrade until 2017.10.16 at your earliest convenience. When this timeout is over, SAM will throw critical errors on CA tests if old CAs are still detected. 

Please check https://wiki.egi.eu/wiki/EGI_IGTF_Release for more details 

EGI UMD software provisioning Team 

The following release notes accompany this release: 


European Grid Infrastructure EGI Trust Anchor release 1.86          2017.10.09

------------------------------------------------------------------------------
   For release DOCUMENTATION available on this EGI Trust Anchor release see   
               https://wiki.egi.eu/wiki/EGI_IGTF_Release                      
------------------------------------------------------------------------------

This is the EGI Trust Anchor release, based on the updated IGTF Accredited CA
distribution version 1.86-1 with the specific DOGWOOD CA in
meta-package "ca-policy-egi-combined-adequacy-model-1.86-1"
that supports the model of joint assurance provision as detailed in the
EGI Policy on Acceptable Authentication Assurance.

  IMPORTANT NOTICE:
   This release contains a new "cam" (combined assurance/adequacy) package 
   based on the approved policy on differentiated assurance. See details on
   the EGI Wiki at <https://wiki.egi.eu/wiki/EGI_IGTF_Release#cam-impl>
  TECHNICALLY THIS MEANS THAT
   you must ONLY install the new ca-policy-egi-cam packages if you ALSO
   at the same time implement VO-specific authorization controls in your
   software stack. This may require reconfiguration or a software update. See
     https://wiki.egi.eu/wiki/EGI_IGTF_Release#cam-impl
  OTHERWISE
   just only install or update the regular ca-policy-egi-core package. There 
   are no changes in this case. The ca-policy-egi-core package is approved for
   all VOs membership and assurance models. No configuration change is needed.

The following notices are republished from the IGTF, inasfar as pertinent to
this release. Details are found in the newsletter https://www.eugridpma.org/

Changes from 1.85 to 1.86
-------------------------
(9 October 2017)

* updated MaGrid CA with extended validity period (MA)
* removed discontinued pkIRISGrid CA (ES)
* discontinued depricated yum v2 and rpm-apt package management support
  (only affects yum installs on RHEL/CentOS 2&3, Fedora Core 1-3, and bespoke
  support for installing RPM packages using APT for pre-2006 RedHat systems)


The CA modifications encoded in both "requires" and "obsoletes" clauses (RPM)
and Conflicts/Replaced clauses (Debian)  have been incorporated in the above-
mentioned meta-packages.  This release is best enjoyed with  fetch-crl v3  or 
better, available from GNU/Linux OS add-on repositories Fedora, EPEL, Debian,
and from the IGTF at https://www.igtf.net/fetch-crl

Policy on Acceptable Authentication Assurance (Updated 1 Feb 2017)
------------------------------------------------------------------
If a VO registration service or e-Infrastructure registration service is
accredited by EGI to meet or exceed the approved authentication assurance
profiles, an IGTF accredited Authority meeting the Assurance Profile DOGWOOD
- used solely in combination with said registration service - is also
adequate for user authentication. This policy has been adopted on Feb 1st,
2017, and is available at <https://documents.egi.eu/document/2930>
In the PKI Technology Rendering, EGI thus approves the IGTF SLCS, MICS, and
Classic APs for general use (egi-core), and in addition the IOTA AP for use 
in combination with VO registration services that themselves meet the 
aforementioned requirements. This additional restriction must be implemented
by each service in the authorization software. The "combined assurance"
model package must not be installed unless the additional authorization is
in place. You will need to reconfigure and may need to install upgrades.

Version information: ca-policy-egi-combined-adequacy-model = 1.86-1
Dear All, 

This is to inform you that the following hosts (services) at TOKYO-LCG2 will be decommissioned. 

lcg-ce01.icepp.jp (CREAM-CE) 
lcg-px01.icepp.jp (MyProxy) 

The downtime will start on 28/10/2017 00:00 (UTC). The services will be disabled and removed directory after the downtime. 

Best regards, 
Tomoe
Dear RC administrators,

There is currently an issue affecting the display of storage accounting data in the Accounting Portal.

Records are being received and loaded at the Accounting Repository and will appear in the Portal once the issue is resolved, so for the moment please only raise tickets if you have errors appearing in your logs.

regards,
APEL Accounting Team
CFP-IST is now starting its decommissioning procedure. The timeline is as follows:

* Job submissions are no longer accepted.

* UI login will be available until October 31st (4 weeks).

* SE data will be available for retrieval until November 30th (8 weeks):

VOs affected:

fusion

phys.vo.ibergrid.eu

Hosts affected:

CE: golp-ce.ist.utl.pt

SE: golp-se.ist.utl.pt

UI: golp-ui.ist.utl.pt

site BDII: golp-bdii.ist.utl.pt

site APEL: golp-apel.ist.utl.pt
=============== Contents: ==================

1) change in computing the weights for the NGIs average A/R values
2) campaign for upgrading cASO to version 1.1.1 (OpenStack sites)
3) CMD-ONE 1.0.0 (Could Middleware Distribution for OpenNebula 5, for CentOS7)
4) CMD-OS 1.1.3 (revision update for Could Middleware Distribution for OpenStack Mitaka on CentOS7 and Ubuntu Xenial)

============================================

1) change in the weights for the NGIs average A/R values

we would like to implement a new way for computing the weights for the NGIs average A/R values, introducing the concept of CE's "computation power": hep-spec * LogicalCPUs

This is a quantity that can be addable up over the CEs of a site (and over the sites). Until now it has been simply added up the CEs hep-spec values for getting a site global value, but this is not correct, because the hep-spec refers to a particular CE (to the cluster behind that particular CE) and it is not addable up. 
That is why, first of all, we asked VAPOR to implement the "computation power" as well as the site/NGI "average hep-spec". Have a look for example at the "figures" section: http://operations-portal.egi.eu/vapor/resources/GL2ResSummary

In the ARGO development instance the new weights have been used for computing the September average A/R values: http://web-egi-devel.argo.grnet.gr/lavoisier/ngi_reports?accept=html
so you can compare them with the official values: http://argo.egi.eu/lavoisier/ngi_reports?accept=html

As expected, there were some improvements and some worsening, perhaps more accentuated in the case of NGIs with few sites; take also in mind that with the new way the sites providing more than one CE (either with the same or different hep-spec) weight less than before (in the good and in the evil), because we compute an average hep-spec, not a simple sum over the benchmark values.
Moreover several sites are still missing the necessary information for computing the weights in both the methods: please check on VAPOR the values published by your site, and if the number of logical CPUs and the Hep-Spec06 benchmark values are missing, you need to publish them.

We would like to move in production this new way starting from November, so if during October many sites fix the information, the computation of new NGIs A/R average values will improve.

2) Upgrade cAso to 1.1.1 version

there is an ongoing update campaign of cASO to version 1.1.1 on OpenStack-based cloud sites: sites that are currently running 1.0.X or were running it in the past should upgrade and republish the period that 1.0.X was in use; CMD-OS 1.1.3 can be used to get the new version of cASO and future updates.
Tickets have been already assigned to sites by EGI Operations.

See release notes https://appdb.egi.eu/store/software/caso/releases/1.x/1.1.0/

3) CMD-ONE 1.0.0 (Could Middleware Distribution for OpenNebula 5, for CentOS7) released: http://repository.egi.eu/2017/09/21/release-cmd-one-1-0-0/
    oneacct 0.4.6-1 - tool for exporting accounting data from OpenNebula into APEL
    rOCCI-server 1.1.9 - server implementation of the Open Cloud Computing Interface[*]
    APEL-SSM 2.1.7 - Secure STOMP Messenger
    cloudkeeper 1.5.0 - tool to synchronize cloud appliances between AppDB and cloud platforms
    cloudkeeper-one 1.2.4 - OpenNebula backend for cloudkeeper
    gridsite 2.3.3 -  set of extensions to the Apache web server and a toolkit for Grid credentials, GACL access control lists and HTTP(S) protocol operations
    cloud-bdii-infoprovider 0.8.3 - generates a representation of cloud resources, that can be published inside a BDII or any other component like the INDIGO Configuration Management Database (CMDB)
    rOCCI-client 4.3.9 -  A client implementation of the Open Cloud Computing Interface

4) CMD-OS 1.1.3 (revision update for Could Middleware Distribution for OpenStack Mitaka on CentOS7 and Ubuntu Xenial) released: http://repository.egi.eu/2017/09/21/release-cmd-os-1-1-3/
    cASO 1.1.1, providing important fixes ()
    cloud-info-provider 0.8.3
    ooi 1.1.2
Dear RCs administrators,
 
during the September meeting (https://indico.egi.eu/indico/event/3241/ ), OMB has approved the full-scale deployment of storage accounting. The APEL team has tested it with a group of early adopters sites, and the results prove that storage accounting is now production-ready.
 
Storage accounting is currently supported only for the DPM and dCache storage elements therefore only the resource centres deploying these kind of storage elements are requested to publish storage accounting data.
 
In order to properly install and configure the storage accounting scripts, please follow the instructions reported in the wiki https://wiki.egi.eu/wiki/APEL/Storage
 
After setting up a daily cron job and running the accounting software, look for your data in the Accounting Portal: http://accounting-devel.egi.eu/storage.php. If it does not appear within 24 hours, or there are other errors, please open a GGUS ticket to APEL who will help debug the process.
 
Please enable on your resources the storage accounting in 1 month time, by Oct 30th: after this day, EGI Operations will open a GGUS ticket to all RCs that haven't started the deployment yet.
 
Best regards and thanks for your collaboration,
EGI Operations

>>> More news <<<

Dear all,

This is to notify you of the decommissioning of the following services hosted at NCG-INGRID-PT:

wms01.ncg.ingrid.pt (WMS)
wms01.ncg.ingrid.pt (LB)

The timeline is the following:

05/09/2017 - Announcement and Broadcast to all VO users
20/09/2017 - Start of downtime and will last 2 weeks.
06/10/2017 - Service decommissioned and removed from the GOCDB.

The process can be tracked via the following GGUS ticket:
https://ggus.eu/?mode=ticket_info&ticket_id=130381

Cheeers
Joao Pina
We wish to inform you that we are beginning the decommissioning process (https://wiki.egi.eu/wiki/PROC12) for the NGI-level monitoring services at Resource Centre NGI_UA_SERVICES in NGI_UA.
There are no production VOs affected.
Below is a list of affected services and a decommissioning timeline.
=============
Services affected
====
+ mon-ua.bitp.kiev.ua (ngi.SAM) 
==================
Timeline
====
29th August 2017
- GGUS Ticket 130284 opened
=================
29th August 2017
- The service will begin scheduled downtime until 29th September 2017
=================
29th September 2017
- Services may become inaccessible without further notice to NGI managers, users, etc. from this date.
The service will be set to "production=N" "monitored=N" in the GOCDB on 29th September 2017
=============== Contents: ==================

1) VAPOR 2.3
2) Fourth release of the Accounting Portal
3) UMD 4.5.0 (C7/SL6)
4) UMD 3.14.10 (SL6)

============================================

1) VAPOR 2.3

The VAPOR application v2.3 was released on Jul 27th: https://operations-portal.egi.eu/vapor

Background work
-----------------------
- upgrade of the different javascript libraries to improve the performances
- identify the duplicated values published by the sites

Improvements
-----------------------
- a map has been added with a global view of all the sites
- a summary of the figures is now available for each site
- the global storage capacity computation has been improved
- one new metric has been added in agreement with EGI Operations team : “the Computation power”

For more details : http://operations-portal.egi.eu/vapor/releases?name=VAPOR+2.3
Don't hesitate to contact us for comments, feedback, bugs at cic-information@in2p3.fr

2) Fourth release of the Accounting Portal

A new version of the Accounting Portal was released on Aug 8th: https://accounting.egi.eu/

It includes:
* UI and layout improvements.
* New Cloud schema support, including VM Status and number of CPUs used.
* Added geographical data display on country views.
* Add day,month,quarter,halfyear and year scaling to hour based units
* New URL specification for programmatic access to CSV and JSON feeds.
* Added new composite metric to restricted views.
* Changed menus and labels to conform to new EGI terminology.
* Miscellaneous fixes and improvements to WLCG reports.
* Improved file downloading of JSON and CSV data.
* API queries available

Documentation at https://wiki.egi.eu/wiki/Accounting_Portal
API information: https://wiki.egi.eu/wiki/Accounting_Portal_API

3) UMD 4.5.0 released (C7/SL6) http://repository.egi.eu/2017/08/10/release-umd-4-5-0/

- SL6
        APEL 1.5.1 - Add support for Torque 5.1.2 time duration format; change dirq call to use absolute path to support versions of dirq >= 1.7; fix crash when StAR loader encouters a valid XML file with no records in it.
        APEL-SSM 2.1.7 - Added a delay when receiver is reconnecting to improve reliability. Improved the log output for SSM receivers so that there are fewer trivial entries and so it's more useful in tracking messages on the filesystem.
        CVMFS 2.3.5 - various bug fixes (see release notes http://cvmfs.readthedocs.io/en/2.3/cpt-releasenotes.html)
        DynaFed 1.3.1 - various bug fixes and improvements (see http://lcgdm.web.cern.ch/dynafed-131-available-epel-testing)
        ARC 15.03.14 - bugfix release, previous version 15.03u13 suffering from a memory leak causing crashes
        Globus GridFTP 11.8.4 - new build with 2 patches from DPM applied
        dpm-dsi 1.9.13 - bug fix (dpm-gsiftp startup script seen to stop and then report daemon already running); use the new gridftp api to remove hack for gridftp redirection.
        Davix 0.6.6 - bug fixes http://dmc.web.cern.ch/release/davix-060
        dmlite 0.8.6 - bug fix release bringing small changes http://lcgdm.web.cern.ch/dmlite-086-released-epel
        gfal2-utils 1.5.0 - bug fixes/improvements http://dmc.web.cern.ch/release/gfal2-util-1.5.0
        CERN Frontier 3.5.25 - see release notes http://frontier.cern.ch/dist/rpms-debug/frontier-squidRELEASE_NOTES
        ARC nagios-probes 1.9.1 - bug fixes, see release notes http://www.nordugrid.org/arc/releases/15.03u14/release_notes_15.03u14.html
        QCG Broker 4.2.0 - added support for Array Jobs; instant information about resources for the new qcg-resources command; bug fixes
        gfal2-python 1.9.2 - see release notes http://dmc.web.cern.ch/release/gfal2-python-1.9.2
        XROOTD 4.6.1 - several new features and bug fixes http://xrootd.org/download/ReleaseNotes.html
        dCache 3.0.25 - see release notes https://www.dcache.org/downloads/1.9/release-notes-3.0.shtml#25
        FTS 3.6.8 - several new features and bug fixes http://fts3-service.web.cern.ch/documentation/releases#qt-release-ui-tabs3
        lcgdm 0.18.2 - bug fixes
        gfal2 2.13.4 - Default checksum for local copy was removed 

- CentOS7
        APEL 1.5.1 - first release in UMD4/C7. Add support for Torque 5.1.2 time duration format; change dirq call to use absolute path to support versions of dirq >= 1.7; fix crash when StAR loader encouters a valid XML file with no records in it.
        APEL-SSM 2.1.7 - first release in UMD4/C7. Added a delay when receiver is reconnecting to improve reliability. Improved the log output for SSM receivers so that there are fewer trivial entries and so it's more useful in tracking messages on the filesystem.
        CVMFS 2.3.5 - first release in UMD4/C7. Various bug fixes (see release notes http://cvmfs.readthedocs.io/en/2.3/cpt-releasenotes.html)
        WN 4.0.5 - first release in UMD4/C7
        DynaFed 1.3.1 - first release in UMD4/C7
        ARC 15.03.14 - bugfix release, previous version 15.03u13 suffering from a memory leak causing crashes
        Globus GridFTP 11.8.4 - new build with 2 patches from DPM applied
        dpm-dsi 1.9.13 - bug fix (dpm-gsiftp startup script seen to stop and then report daemon already running); use the new gridftp api to remove hack for gridftp redirection.
        Davix 0.6.6 - bug fixes http://dmc.web.cern.ch/release/davix-060
        dmlite 0.8.6 - bug fix release bringing small changes http://lcgdm.web.cern.ch/dmlite-086-released-epel
        gfal2-utils 1.5.0 - bug fixes/improvements http://dmc.web.cern.ch/release/gfal2-util-1.5.0
        CERN Frontier 3.5.25 - see release notes http://frontier.cern.ch/dist/rpms-debug/frontier-squidRELEASE_NOTES
        ARC nagios-probes 1.9.1 - bug fixes, see release notes http://www.nordugrid.org/arc/releases/15.03u14/release_notes_15.03u14.html
        QCG Broker 4.2.0 - first release in UMD4/C7; added support for Array Jobs; instant information about resources for the new qcg-resources command; bug fixes
        gfal2-python 1.9.2 - see release notes http://dmc.web.cern.ch/release/gfal2-python-1.9.2
        XROOTD 4.6.1 - several new features and bug fixes http://xrootd.org/download/ReleaseNotes.html
        dCache 3.0.25 - see release notes https://www.dcache.org/downloads/1.9/release-notes-3.0.shtml#25
        ARGUS 1.7.3 - this release introduces support for different X.509 CA Authentication profiles via the new Authentication Profile Policy Information Point (PIP); see release notes http://argus-documentation.readthedocs.io/en/stable/release_notes/v_1_7_1.html (1.7.3 refers to UMD version numbering, so reference to 1.7.1 release notes is correct)
        lcgdm 0.18.2 - bug fixes
        gfal2 2.13.4 - Default checksum for local copy was removed 


4) UMD 3.14.10 (SL6) released http://repository.egi.eu/2017/07/21/release-umd-3-14-10/

    yaim-core.sl6.x86_64-5.1.4 updated
Dear all,

There may be a delay of up to two days in accounting data reaching the Accounting Portal due to hardware maintenance currently occurring at  the Accounting Repository. All data from sites is being saved and will appear in the Portal once the maintenance is complete.

regards,
APEL Accounting Team
There was a break in network connectivity to the RAL Tier1 for about an hour this morning. The break lasted between 11:15 and 12:15 local time (10:15 to 11:15 UTC). Connectivity has now been restored and we are checking services.
Dear all, 

EUGridPMA have announced a new set of CA rpms. Based on this IGTF release a new set of CA RPMs have been packaged for EGI. 

Please upgrade until 2017.08.07 at your earliest convenience. When this timeout is over, SAM will throw critical errors on CA tests if old CAs are still detected. 

Please check https://wiki.egi.eu/wiki/EGI_IGTF_Release for more details 

EGI UMD software provisioning Team 

The following release notes accompany this release: 

European Grid Infrastructure EGI Trust Anchor release 1.85          2017.07.31

------------------------------------------------------------------------------
   For release DOCUMENTATION available on this EGI Trust Anchor release see   
               https://wiki.egi.eu/wiki/EGI_IGTF_Release                      
------------------------------------------------------------------------------

This is the EGI Trust Anchor release, based on the updated IGTF Accredited CA
distribution version 1.85-1 with Classic, SLCS and MICS profiles, encoded in
meta-package "ca-policy-egi-core-1.85-1" (new installs) and "lcg-CA-1.85-1"
(for sites upgrading from EGEE/JSPG releases).

IMPORTANT NOTICE:
  Sites that need compliance with the WLCG policy should install BOTH packages,
  or you will miss out the CERN WLCG IOTA CA specific exception. Details, see:
    https://documents.egi.eu/document/2745

  The next release 1.85 will add support for differentiated assurance in the
  EGI trust fabric infrastructure in the form of an additional trust anchor
  meta-package, which replaces the specific policy mechanism described above.
  Please review the documentation for the new software that will be needed
  to support differentiated assurance and the Collaborative Assurance Model.
  We ask for your support in implementing the requisite changes, and deploy
  new trust anchor meta-packages and the new local policies only in unison.

The following notices are republished from the IGTF, inasfar as pertinent to
this release. Details are found in the newsletter https://www.eugridpma.org/

Changes from 1.84 to 1.85
-------------------------
(31 July 2017)

* Updated URL domain information for CyGrid (CY)

The CA modifications encoded in both "requires" and "obsoletes" clauses (RPM)
and Conflicts/Replaced clauses (Debian)  have been incorporated in the above-
mentioned meta-packages.  This release is best enjoyed with  fetch-crl v3  or 
better, available from GNU/Linux OS add-on repositories Fedora, EPEL, Debian,
and from the IGTF at https://www.igtf.net/fetch-crl

Version information: ca-policy-egi-core = 1.85-1
Since about 05:30 (BST)  this morning there have been network problems at the RAL Tier1.  Staff are en route to work and the problem will be investigated when they arrive.
=============== Contents: ==================

1) CMD-OS 1.1.0, 1.1.1, 1.1.2 released
2) CREAM 1.16.5 for CentOS7 available in Preview

============================================

1) CMD-OS 1.1.0, 1.1.1, 1.1.2 (C7/Xenial) released:

- CentOS7: bdii-infoprovider 0.7.0, rOCCI client 4.3.8, APEL SSM 2.1.7, Infrastructure Manager 1.5.1, Site BDII 1.2.1, ooi 1.1.1, keystone-VOMS 9.0.4, cASO 1.1.0
- Ubuntu Xenial: bdii-infoprovider 0.7.0, rOCCI client 4.3.8, Infrastructure Manager 1.5.1, ooi 1.1.1, keystone-VOMS 9.0.4, cASO 1.1.0

more details at the following links:
http://repository.egi.eu/2017/06/13/release-cmd-os-1-1-0/
http://repository.egi.eu/2017/06/13/release-cmd-os-1-1-1/
http://repository.egi.eu/2017/06/21/release-cmd-os-1-1-2/

2) The first release of CREAM (1.16.5) for CentOS7 is available in Preview. In the coming months it will be released in UMD as well, after the conclusion of the verification and staged rollout processes.
Please contact EGI Operations through a GGUS ticket in case you are interested in joining the staged rollout process.

For the installation and configuration, have a look at the following information:

- Link to the release notes: https://wiki.egi.eu/wiki/Preview_2.13.0#CREAM_1.16.5
- For configuring the Preview repository: https://wiki.egi.eu/wiki/Preview_Repository#Repository_configuration
Please be informed that wms.grid.icm.edu.pl service will be in decommissioning downtime starting 1 August 2017.

best regards, 
Marcin Stolarek 
ICM Site Operations Manager