Tags:
,
view all tags
---+!! The CREAM configuration file %TOC% ---++ The CREAM configuration file structure The default location of the CREAM configuration file is /opt/glite/etc/glite-ce-cream/cream-config.xml. It is a XML file composed of a set of elements basically of three different types: * _commandexecutor_ which defines the specific capabilities (e.g. delegation, job management, activity management) provided by CREAM * _dataSource_ used for setting up the access to CREAM DB (MySQL) * _authzchain_ which defines the security authorization layer based on ARGUS service or gJAF The configuration file looks like the following schema: <verbatim> <service id="CREAM service (core2)"> <commandexecutor id = "the id" category = "the category" ... <parameter name = "name_1" value = "value_1" /> <parameter name = "name_2" value = "value_2" /> ... <parameter name = "name_x" value = "value_x" /> </commandexecutor> <dataSource name = "datasource_name" type = "javax.sql.DataSource" factory = "org.apache.commons.dbcp.BasicDataSourceFactory" ... /> <authzchain name = "chain-1"> <plugin name = "the name" classname = "org.glite.ce.xxx"> <parameter name = "name_1" value = "value_1" /> <parameter name = "name_2" value = "value_2" /> ... <parameter name = "name_x" value = "value_x" /> </plugin> ... </authzchain> </service> </verbatim> ---++ The Command Executor The commandexeuctor represents the implementation of specific functionality provided by CREAM (e.g. delegation, job management, activity management). More than one commandexecutor can be defined in the configuration file and its XML structure is as the following: <verbatim> <commandexecutor id = "the id" category = "the category" commandqueuesize = "500" commandqueueshared = "false" commandworkerpoolsize = "50" filename = "/usr/share/java/EXECUTOR_NAME.jar"> <parameter name = "name_1" value = "value_1" /> <parameter name = "name_2" value = "value_2" /> ... <parameter name = "name_x" value = "value_x" /> </commandexecutor> </verbatim> The following is the list of the mandatory attributes with their meaning: * id: the unique id (*) * category: the name of the category to which the commandexecutor belongs (e.g. DELEGATION_MANAGEMENT, JOB_MANAGEMENT, ACTIVITY_MANAGEMENT) (*) * commandqueuesize: the size of the in memory prefetched command queue (default: 500) (*) * commandqueueshared: must be set to false (default) if the command queue is used by a single CREAM; must be set to true if there are multiple CREAM services using a single command queue (i.e. multiple CREAM services managing a single farm) (*) * commandworkerpoolsize: the number of threads getting and satisfying user requests stored in the CREAM command queue (default: 50) (*) * filename: the path of the jar implementing the commandexecutor (*) * please DO NOT change the default value which comes from the YAIM configuration. ---+++ The BLAH Executor This executor implements the CREAM's job management capabilities and it is based on the BLAH component. The attributes and parameters are accepted for well defining this commandexecutor are: *attributes* * id: _"BLAH executor"_ * category: _"JOB_MANAGEMENT"_ (*) * commandqueuesize: _"500"_ * commandqueueshared: _"false"_ * commandworkerpoolsize: _"50"_ * filename: _"/usr/share/java/glite-ce-cream-blahExecutor.jar"_ *parameters* * *SANDBOX_TRANSFER_METHOD*: sets the sandbox transfer method (GSIFTP/LRMS) (default: _"GSIFTP"_) * *CREAM_SANDBOX_DIR*: is the directory where the sandbox files are staged on the CREAM CE node (default: _"/var/cream_sandbox"_) * *CREAM_CREATE_SANDBOX_BIN_PATH*: the path of the executable for creating the job sandbox (default: _"/usr/bin/glite-cream-createsandboxdir"_) * *CREAM_COPY_PROXY_TO_SANDBOX_BIN_PATH*: the path of the script for copying the user delegation proxy into the specified job sandbox (default: _"/usr/bin/glite-cream-copyProxyToSandboxDir.sh"_) * *CREAM_PURGE_SANDBOX_BIN_PATH*: the path of the executable for purging the job sandbox (default: _"/usr/bin/glite-ce-cream-purge-sandbox"_) * *CREAM_PURGE_PROXY_FROM_SANDBOX_BIN_PATH*: the path of the executable for purging the user delegation proxy from the job sandbox (default: _"/usr/bin/glite-ce-cream-purge-proxy"_) * *CREAM_JOB_SENSOR_HOST*: enable this parameter (and set it to the hostname of the CREAM CE) if the CEMon job sensor plugin is installed (as needed for submissions via WMS/ICE) (default: parameter disabled) * *CREAM_JOB_SENSOR_PORT*: represents the port used by CREAM to get notifications from the CEMon job sensor plugin. Enable this parameter if the CEMon job sensor plugin is installed (as needed for submissions via WMS/ICE) (default: _"49154"_) * *MAX_LEASE_TIME*: the maximum allowed lease time (in second). I.e. if a client specifies a lease time too big, this value is used instead (dafault: _"36000"_) * *LEASE_EXECUTION_RATE*: specifies how often the job purger has to run (default: _"30"_ minutes) * *GLEXEC_BIN_PATH*: the path of the glexec executable (default: _"/usr/sbin/glexec"_) * *GLEXEC_CAT_CMD_PATH*: is the pathname of the "cat" command invoked by CREAM via glexec (default: _"/bin/cat"_) * *BLAHP_BIN_PATH*: is the path of the blahpd executable (default: _"/usr/bin/blahpd"_) * *BLAH_JOBID_PREFIX*: represents a prefix for job names for BLAH. If the same BLAH parser serves multiple CREAM CEs, please choose a different value for each of these CREAM services. The value MUST be a string 6 characters long that starts with 'cr' and ends with '_' (default: _"cream_"_) * *BLAH_COMMAND_TIMEOUT*: represents the maximum time interval accepted by CREAM for the execution of commands by BLAH (default: _"300"_ seconds) * *BLPARSER_RETRY_COUNT*: represents the number of attempts to contact the BLAH parser (if it is not reachable) before giving up. If -1 is specified, CREAM will never give up (default: _"100"_) * *BLPARSER_RETRY_DELAY*: is the time interval (ms) between two attempts to contact the BLAH parser (default: _"60000"_) * *LRMS_EVENT_LISTENER_PORT*: is the port used by CREAM to receive notifications about job status changes sent by the BLParser/JobWrapper (default: _"49152"_) * *HOST_SMP_SIZE*: the default value for the _hostsmpsize_ attribute (default: _"2"_) * JOB_WRAPPER_DELEGATION_TIME_SLOT = _"3600"_ <!-- sec. --> * JOB_WRAPPER_COPY_PROXY_MIN_RETRY_WAIT = _"60"_ <!-- sec. --> * JOB_WRAPPER_COPY_RETRY_COUNT_ISB = _"2"_ * JOB_WRAPPER_COPY_RETRY_FIRST_WAIT_ISB = _"60"_ <!-- sec. --> * JOB_WRAPPER_COPY_RETRY_COUNT_OSB = _"6"_ * JOB_WRAPPER_COPY_RETRY_FIRST_WAIT_OSB = _"300"_ <!-- sec. --> * *JOB_WRAPPER_TEMPLATE_PATH*: the path where the JobWrapper template is placed (default: _"/etc/glite-ce-cream/"_) * *JOBS_SCRATCH_DIR*: the tmp directory used by CREAM (dafault: _"/var/tmp"_) * JOB_SUBMISSION_MANAGER_ENABLE: _"true"_ * *JOB_SUBMISSION_MANAGER_SCRIPT_PATH*: _"/usr/bin/glite_cream_load_monitor /etc/glite-ce-cream-utils/glite_cream_load_monitor.conf"_ * *JOB_PURGE_POLICY*: the policy concerning which jobs should be deleted by the automatic job purger and when. For example, if JOB_PURGE_POLICY is _"ABORTED 1 days; CANCELLED 2 days; DONE-OK 3 days; DONE-FAILED 4 days; REGISTERED 5 days;"_ then the job purger will purge jobs which are: * in ABORTED status for more than 1 day * in CANCELLED status for more than 2 days * in DONE-OK status for more than 3 days * in DONE-FAILED status more than 4 days * in REGISTERED status for more than 5 days * *JOB_PURGE_RATE*: specifies how often the job purger has to run (default _"300"_ minutes) * please DO NOT change the default value which comes from the YAIM configuration. ---+++ The Activity Executor (EMI-ES) This Activity Executor implements the EMI-ES functionality. The accepted attributes and parameters are: *attributes* * id: _"ActivityExecutor"_ * category: _"ACTIVITY_MANAGEMENT"_ (*) * commandqueuesize: _"500"_ * commandqueueshared: _"false"_ * commandworkerpoolsize: _"50"_ * filename: _"/usr/share/java/glite-ce-cream-activityExecutor.jar"_ *parameters* * *ACTIVITY_STATUS_MONITOR_AGE*: defines how old should be a not terminated activity in order to ask its current status to the LRMS (default: _"24"_ hours) * *ACTIVITY_STATUS_MONITOR_RATE*: specifies how often CREAM checks the status of the not terminated activities (default: _"6"_ hours) * *ACTIVITY_WRAPPER_TEMPLATE_PATH*: the path where the ActivityWrapper template is placed (default: _"/etc/glite-ce-cream-es/"_) * *BDII_URI*: defines the BDII URI (e.g. _"ldap://cream.pd.infn.it:2170" _) * *BDII_RATE*: specifies how often CREAM has to get information from the BDII (default: _"60"_ minutes) * *BLAH_BIN_PATH*: is the path of the blahpd executable (default: _"/usr/bin/blahpd"_) * *BLAH_PREFIX*: represents a prefix for job names for BLAH. If the same BLAH parser serves multiple CREAM CEs, please choose a different value for each of these CREAM services. The value MUST be a string 6 characters long that starts with 'cr' and ends with '_' (default: _"cr-es_"_) * *BLAH_COMMAND_TIMEOUT*: represents the maximum time interval accepted by CREAM for the execution of commands by BLAH (default: _"300"_ seconds) * *BLAH_NOTIFICATION_LISTENER_PORT*: is the port used by CREAM to receive notifications about job status changes sent by the BLParser/ActivityWrapper (default: _"49155"_) * *BLAH_NOTIFIER_RETRY_COUNT*: represents the number of attempts to contact the BLAH parser (if it is not reachable) before giving up. If -1 is specified, CREAM will never give up (default: _"100"_) * *BLAH_NOTIFIER_RETRY_DELAY*: is the time interval (ms) between two attempts to contact the BLAH parser (default: _"60000"_) * COPY_PROXY_MIN_RETRY_WAIT: (default: _"60"_ seconds) * COPY_RETRY_COUNT_ISB: (default: _"2"_) * COPY_RETRY_FIRST_WAIT_ISB: (default: _"60"_ seconds) * COPY_RETRY_COUNT_OSB: (default: _"6"_) * COPY_RETRY_FIRST_WAIT_OSB: (default: _"300"_ seconds) * *CREATE_WRAPPER_BIN_PATH*: (default: _"/usr/bin/glite-ce-cream-create-wrapper"_) * *CREATE_SANDBOX_BIN_PATH*: the path of the executable for creating the job sandbox (default: _"/usr/bin/glite-cream-createsandboxdir"_) * *DEFAULT_LRMS_NAME*: defines the default LRMS used by CREAM if not specified by the user * *DEFAULT_QUEUE_NAME*: defines the default LRMS's queue used by CREAM if not specified by the user * DELEGATION_TIME_SLOT*: (default _"3600"_ seconds) * *LIMIT_FOR_LIST_ACTIVITIES*: defines the maximum number of items contained into the response to be sent back to the client (default: _"500"_) * *PURGE_SANDBOX_BIN_PATH*: the path of the executable for purging the job sandbox (default: _"/usr/bin/glite-ce-cream-purge-sandbox"_) * *SANDBOX_DIR*: is the directory where the sandbox files are staged on the CREAM CE node (default: _"/var/cream-es_sandbox"_) * please DO NOT change the default value which comes from the YAIM configuration. ---+++ The Delegation Executor This Delegation Executor implements delegation functionality. The accepted attributes and parameters are: *attributes* * id: _"DelegationExecutor"_ * category: _"DELEGATION_MANAGEMENT"_ (*) * commandqueuesize: _"0"_ (NB: the value MUST be _"0"_ because the executor doesn't need the command queue) (*) * commandqueueshared: _"false"_ (*) * commandworkerpoolsize: _"0"_ (NB: the value MUST be _"0"_ because the executor doesn't need the command queue) (*) * filename: _"/usr/share/java/glite-ce-cream-delegationExecutor.jar"_ *parameters* * *CREAM_COPY_PROXY_TO_SANDBOX_BIN_PATH*: the path of the script for copying the user delegation proxy into the specified job sandbox (default: "/usr/bin/glite-cream-copyProxyToSandboxDir.sh") * *CREAM_PURGE_PROXY_FROM_SANDBOX_BIN_PATH*: the path of the script for deleting the user delegation proxy from the specified job sandbox (default: _"/usr/bin/glite-ce-cream-purge-proxy"_) * *CREAM_SANDBOX_DIR*: is the directory where the sandbox files are staged on the CREAM CE node (default: _"/var/cream_sandbox"_) * *DELEGATION_PURGE_RATE*: specifies how often the delegation purger has to run (default _"10"_ minutes) * please DO NOT change the default value which comes from the YAIM configuration. -- Main.LisaZangrando - 2012-12-04
Edit
|
Attach
|
PDF
|
H
istory
:
r11
|
r7
<
r6
<
r5
<
r4
|
B
acklinks
|
V
iew topic
|
More topic actions...
Topic revision: r5 - 2012-12-06
-
LisaZangrando
Home
Site map
CEMon web
CREAM web
Cloud web
Cyclops web
DGAS web
EgeeJra1It web
Gows web
GridOversight web
IGIPortal web
IGIRelease web
MPI web
Main web
MarcheCloud web
MarcheCloudPilotaCNAF web
Middleware web
Operations web
Sandbox web
Security web
SiteAdminCorner web
TWiki web
Training web
UserSupport web
VOMS web
WMS web
WMSMonitor web
WeNMR web
General Doc
Functional Description
Batch System Support
CREAM and Information Service
Release Notes
Known Issues
Security in CREAM
Nagios Probes to monitor CREAM and WN
Papers
Presentations
User Doc
CREAM User Guide for EMI-1
CREAM User Guide for EMI-2
CREAM User Guide for EMI-3
CREAM JDL Guide
BLAH User Guide
Troubleshooting Guide
System Administrator Doc
System Administrator Guide for CREAM (EMI-3 release)
System Administrator Guide for CREAM (EMI-2 release)
System Administrator Guide for CREAM (EMI-1 release)
The CREAM configuration file
The CEMonitor configuration file
The CREAM CE Service Reference Card (EMI-2 release)
The CREAM CE Service Reference Card (EMI-1 release)
Batch System related documentation
Troubleshooting Guide
The guide for integrating EMIR in CREAM
]
Developers Doc
CREAM Client API C++ Documentation
CREAM Client API for Python
Other Doc
Contacts
Moving to CREAM from LCG-CE
Testing
Internal Collaboration Information
Credits
CREAM Web utilities
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
Edit
Attach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback