Gurgaon, Haryana, India Post Date: May 8, 2023 Full Time
Apply for job
Job Description
Responsibilities:
Mentor junior engineers and be a role model with skill set and attitude.
Drive to remain updated in technology by connecting with Industry and organizational technology evolutions.
As a leader of the big data team, lead a component design/development and implement scalable big data platform framework and services.
Ability to use data to drive products and decisions.
Be able to explain complex technical concepts to various stakeholders leadership teams, product managers, support, and other engineers.
You will be involved in the design of data solutions using Hadoop-based technologies along with Hadoop, and AWS.
Design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In----Memory Cache, Query Layer (SQL), Rule Engine, and Action Framework ).
Designed and Implemented a Data Access Layer, which can connect to various data sources and uses advanced caching techniques to provide fast responses to real-time SQL queries using Big Data Technologies.
Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies; spark architecture, Kafka, Cloud computing, etc.
Collaborate with leadership to define and set standards for engineering rigor and help cultivate the culture in the team.
Requirements:
7-9 years of hands-on software/data engineering experience.
Exp. in building large scalable and reliable enterprise technology platforms using Big Data open-source technologies such as Java, Hadoop, Spark, and Kafka.
Hands-on with one of the programming language java/scala/python.
Exp. in Data Storage: Good understanding of SQL & NoSQL Databases. Mysql, Mongo.
Familiar with cloud solutions for data infrastructure. AWS Preferably.
Good hands on one of the data handling frameworks - Spark, Apache Beam, Apache flink, etc.
Familiar with different types of data formats - Apache Parquet, Avro, ORC, etc.
Proficient with distributed file systems and computational concepts.
Prior team handling and stakeholder management exp. is must.