App Engine Python SDK  v1.6.9 rev.445
The Python runtime is available as an experimental Preview feature.
Public Member Functions | Static Public Attributes | List of all members
google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline Class Reference
Inheritance diagram for google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline:
google.appengine.ext.mapreduce.pipeline_base._OutputSlotsMixin google.appengine.ext.mapreduce.pipeline_base.PipelineBase

Public Member Functions

def run
 
def try_cancel
 
def callback
 
- Public Member Functions inherited from google.appengine.ext.mapreduce.pipeline_base.PipelineBase
def start
 

Static Public Attributes

 async = True
 
list output_names
 
- Static Public Attributes inherited from google.appengine.ext.mapreduce.pipeline_base._OutputSlotsMixin
list output_names = ["result_status"]
 

Detailed Description

Pipeline wrapper for mapper job.

Args:
  job_name: mapper job name as string
  handler_spec: mapper handler specification as string.
  input_reader_spec: input reader specification as string.
  output_writer_spec: output writer specification as string.
  params: mapper parameters for input reader and output writer as dict.
  shards: number of shards in the job as int.

Returns:
  default: the list of filenames produced by the mapper if there was any
    output and the map was completed successfully.
  result_status: one of model.MapreduceState._RESULTS.
  job_id: mr id that can be used to query model.MapreduceState. Available
    immediately after run returns.

Member Function Documentation

def google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline.callback (   self)
Callback after this async pipeline finishes.
def google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline.run (   self,
  job_name,
  handler_spec,
  input_reader_spec,
  output_writer_spec = None,
  params = None,
  shards = None 
)
Start a mapreduce job.

Args:
  job_name: mapreduce name. Only for display purpose.
  handler_spec: fully qualified name to your map function/class.
  input_reader_spec: fully qualified name to input reader class.
  output_writer_spec: fully qualified name to output writer class.
  params: a dictionary of parameters for input reader and output writer
initialization.
  shards: number of shards. This provides a guide to mapreduce. The real
number of shards is determined by how input are splited.
def google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline.try_cancel (   self)
Always allow mappers to be canceled and retried.

Member Data Documentation

list google.appengine.ext.mapreduce.mapper_pipeline.MapperPipeline.output_names
static
Initial value:
1 = [
2 
3 
4  "job_id",
5 
6  "counters"]

The documentation for this class was generated from the following file: