- Job Id #ATI-240049
- Job Industry IT -Software
- Job Type Contract
- Job Location California
- Job Duration Long Term
- Job Posting Date 07/29/2019
- Salary DOE
Job Description
Our client is currently seeking a Sr.Data Engineer to work on-site in Menlo Park CA.
This is a Contract job opportunity.
For immediate consideration email resumes/applications to naveen@arohatechnologies.com or call 510-269-2233 Ext 201.
Responsibilities:
Responsible for scaling up data processing flow to meet the rapid data growth
Evolve data model and data schema based on business and engineering needs
Implement systems tracking data quality and consistency
Develop tools supporting self-service data pipeline management (ETL)
SQL and MapReduce job tuning to improve data processing performance
Experience:
5+ years of relevant professional experience
Experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
Good understanding of SQL Engine and able to conduct advanced performance tuning
Strong skills in scripting language (Python, Ruby, Bash)
1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)