Job Description

Responsibilities:

• Mentor junior engineers and be a role model with skill set and attitude.
• Drive to remain updated in technology by connecting with Industry and organizational technology evolutions.
• As a leader of the big data team, lead a component design/development and implement scalable big data platform framework and services.
• Ability to use data to drive products and decisions.
• Be able to explain complex technical concepts to various stakeholders leadership teams, product managers, support, and other engineers.
• You will be involved in the design of data solutions using Hadoop-based technologies along with Hadoop, and AWS.
• Design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In----Memory Cache, Query Layer (SQL), Rule Engine, and Action Framework ).
• Designed and Implemented a Data Access Layer, which can connect to various data sources and uses advanced caching techniques to provide fast responses to real-time SQL queries using Big Data Technologies.
• Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies; spark architecture, Kafka, Cloud computing, etc.
• Collaborate with leadership to define and set standards for engineering rigor and help cultivate the culture in the team.

Requirements:

• 7-9 years of hands-on software/data engineering experience.
• Exp. in building large scalable and reliable enterprise technology platforms using Big Data open-source technologies such as Java, Hadoop, Spark, and Kafka.
• Hands-on with one of the programming language java/scala/python.
• Exp. in Data Storage: Good understanding of SQL & NoSQL Databases. Mysql, Mongo.
• Familiar with cloud solutions for data infrastructure. AWS Preferably.
• Good hands on one of the data handling frameworks - Spark, Apache Beam, Apache flink, etc.
• Familiar with different types of data formats - Apache Parquet, Avro, ORC, etc.
• Proficient with distributed file systems and computational concepts.
• Prior team handling and stakeholder management exp. is must.