Your job search starts here.Our team works with large Fortune 500 companies, giving you exposure to the best companies and the most current Technologies.
Our client is currently seeking a Sr. Data Engineer to work on-site in SFO, CA.
This is a Contract job opportunity.
For immediate consideration email resumes/applications to naveen@arohatechnologies.com or call 510-269-2233 Ext 201
Responsibilities:
Implement systems tracking data quality and consistency
Develop tools supporting self-service data pipeline management (ETL)
SQL and MapReduce job tuning to improve data processing performance
Experience & Skills:
Extensive experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
Good understanding of SQL Engine and able to conduct advanced performance tuning
Strong skills in the scripting language (Python, Ruby, Perl, Bash)
Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
Comfortable working directly with data analytics to bridge business requirements with data engineering