App Engine Python SDK  v1.6.9 rev.445
The Python runtime is available as an experimental Preview feature.
Static Public Attributes | List of all members
google.appengine.ext.mapreduce.parameters._ConfigDefaults Class Reference
Inheritance diagram for google.appengine.ext.mapreduce.parameters._ConfigDefaults:

Static Public Attributes

int SHARD_MAX_ATTEMPTS = 4
 
int TASK_MAX_ATTEMPTS = 31
 
int TASK_MAX_DATA_PROCESSING_ATTEMPTS = 11
 
string QUEUE_NAME = "default"
 
int SHARD_COUNT = 8
 
int PROCESSING_RATE_PER_SEC = 1000000
 
string BASE_PATH = "/_ah/mapreduce"
 

Detailed Description

Default configs.

Do not change parameters whose names begin with _.

SHARD_MAX_ATTEMPTS: Max attempts to execute a shard before giving up.

TASK_MAX_ATTEMPTS: Max attempts to execute a task before dropping it. Task
  is any taskqueue task created by MR framework. A task is dropped
  when its X-AppEngine-TaskExecutionCount is bigger than this number.
  Dropping a task will cause abort on the entire MR job.

TASK_MAX_DATA_PROCESSING_ATTEMPTS:
  Max times to execute a task when previous task attempts failed during
  data processing stage. An MR work task has three major stages:
  initial setup, data processing, and final checkpoint.
  Setup stage should be allowed to be retried more times than data processing
  stage: setup failures are caused by unavailable GAE services while
  data processing failures are mostly due to user function error out on
  certain input data. Thus, set TASK_MAX_ATTEMPTS higher than this parameter.

QUEUE_NAME: Default queue for MR.

SHARD_COUNT: Default shard count.

PROCESSING_RATE_PER_SEC: Default rate of processed entities per second.

BASE_PATH : Base path of mapreduce and pipeline handlers.

The documentation for this class was generated from the following file: