Lead Engineer – Data Engineering

In This Role, Your Responsibilities Will Be:

• Select and integrate big data tools and frameworks (such as but not limited to Hadoop, Spark, Kafka, Azure Big Data services) to meet business requirements.
• Developing optimal data models and schemas for efficient data storage and retrieval.
• Designing, developing, and optimizing ETL/ELT processes to ensure data quality and consistency.
• Implement robust monitoring and alerting systems to proactively identify and address performance issues.
• Define and enforce data retention policies aligned with business and compliance requirements.
• Lead and mentor a team of data engineers, fostering a culture of innovation and excellence.
• Collaborate closely with data scientists and business collaborators to understand requirements and deliver impactful data solutions.
• Develop and implement data governance policies and standards to ensure data quality, security, and compliance.
• Drive data-driven decision making by providing actionable insights and recommendations.
• Partnering with data scientists, analysts, and business collaborators to understand requirements and deliver actionable insights.
• Developing and implementing automation frameworks for data pipelines and processes.

Who You Are:

You establish clear responsibilities and processes for monitoring work and measuring results You analyze multiple and diverse sources of information to define problems accurately before moving to solutions even in the absence of complete information You relate comfortably with people across levels, functions, cultures, and geography.

Skills and Qualifications

• B.E/Post graduate in Computer science Statistics or Data Science or experience in a relevant field
• 8+ years of experience in designing and implementing scalable, robust, and secure data architectures.
• Ability to define and implement data quality standards and metrics.
• Strong problem-solving and analytical skills with an ability to synthesize complex data sets into actionable insights.
• Excellent written and verbal communication skills, with the ability to present technical concepts to non-technical audiences
• Experience in data engineering and data pipeline architecture Experience with monitoring and alerting tools (e.g., Grafana, Prometheus).
• Proficiency in programming languages (Python, Scala, Java) and scripting languages (SQL, Python).Experience in Distributed computing and Data pipelines
• Experience using big data technologies and distributed computing engines – (e.g., HDFS, Spark, Kafka, Cassandra, Solr, Dask)
• Apache Kafka development experience with Kafka streaming, Kafka connect, Kafka APIs, KSQL, AMQ
• Experiences on Big Data opensource solutions including but not limited to Spark, Kafka, Hudi, Iceberg, Hadoop
• Experience in DevOps principles and infrastructure as code – (e.g., Docker Containerization, Kubernetes, RedHat OpenShift, Jenkins, GIT Ops)
• Experience in Microservices development on container-based platforms, e.g. OpenShift, Kubernetes
• Experience with messaging frameworks such as Kafka or AMQ
• Adhere to agile mindset – DevOps culture and CALMR approach (https://www.scaledagileframework.com/calmr/) – core values (Respect, Accountability, Collaboration, being adaptive to change, learning cycles, and improvement)

Our Offer To You

By joining Emerson, you will be given the opportunity to make a difference through the work you do.

Emerson’s compensation and benefits programs are designed to becompetitive within the industry and local labor markets. We also offer acomprehensive medical and insurance coverageto meet the needs of our employees.

We are committed to creating a global workplace thatsupports diversity, equity and embraces inclusion. We welcome foreign nationals to join us through ourWork Authorization Sponsorship.

We attract, develop, and retain exceptional people in an inclusive environment, where allemployees can reach their greatest potential. We are dedicated to the ongoing development of our employees because we know that it is critical to our success as a global company.

We have established our Remote Work Policy for eligible roles to promoteWork-Life Balancethrough a hybrid work set up where our team members can take advantage of working both from home and at the office.

Safety is paramount to us, and we are relentless in our pursuit to provide aSafe Working Environmentacross our global network and facilities.

Through our benefits, development opportunities, and an inclusive and safe work environment, we aim to create an organization our people are proud to represent.