Spark Developer with AWS EMR Experience
Portland, Oregon
12 Months contract
Job Description:
Portland, Oregon
12 Months contract
Job Description:
- 5+ years of experience in programming with python. Strong proficiency in python
- Familiarity with functional programming concepts
- 3+ years of Hands on experience in developing ETL data pipelines using pyspark on AWS EMR
- Hands on experience of XML processing using python
- Good understanding of Spark’s RDD API
- Good understanding of Spark’s Dataframe and API
- Experience in configuring EMR clusters on AWS
- Experience and good understanding of Apache Spark Data sources API.
- Experience of dealing with AWS S3 object storage from Spark.
- Experience in trouble shooting spark jobs. Knowledge of monitoring spark jobs using Spark UI
- Performance tuning of Spark jobs.
- Understanding fundamental design principles behind a business processes
Send resume to adelina@jobs-n-jobs.com or adelinajohn279@gmail.com
Comments