Monday, August 19, 2013

Mapping between EMR APIs and Yarn APIs

Before we get started, we need to remember that there are some equivalent concepts between Yarn and EMR. One application in Yarn is equal to a job flow in EMR. One job in Yarn is amount to a job step in EMR.
  1. RunJobFlow
    → ApplicationId  submitApplication(ApplicationSubmissionContext appContext) 
    The RunJobFlow api also include the cluster instantiate process while submitApplication assumes that a Yarn cluster is running.
  2. TerminateJobFlows
    →  void  killApplication(ApplicationId applicationId)  
  3. DescribeJobFlows
    →   ApplicationReport  getApplicationReport(ApplicationId appId)  

No comments:

Post a Comment