KMC is seeking NiFi Engineer/Developer to provide technical leadership for its development team. A Successful candidate in this role will lead the NiFi Platform development, provide technical leadership in design and architecture of the application and also setting up the best practices for the NiFi Platform. He/she should be master in Data platform, NiFi
Responsibilities:
Design, develop, and implement ETL/ELT processes to extract data from various sources, transform it according to business requirements, and load it into data warehouses or data lakes.
Collaborate with cross-functional teams to understand data requirements and design scalable data solutions.
Optimize and tune existing ETL/ELT processes for performance and reliability.
Develop and maintain documentation for ETL/ELT processes, including data lineage and metadata management.
Monitor and troubleshoot data pipeline issues, ensuring data integrity and availability.
Stay updated with emerging technologies and trends in ETL/ELT, big data, and data streaming.
Requirements
Required Skills, Experience Qualities
Bachelordegree in computer science, Information Technology, or related field.
Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, Oracle).
Hands-on experience with ETL/ELT tools and frameworks such as Informatica, Apache Airflow, and Apache Astro.
Solid understanding of data warehousing concepts and methodologies.
Expertise in DBT (core/cloud) for data modelling and transformation.
Implemented ETL/ELT processes in production using Modern Data Stack, with products such as Cloudera, Databricks, Snowflake, DBT, AWS, Azure, Google Cloud, ETL Technologies, or other analytics solutions.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Ability to work effectively in a fast-paced environment and manage multiple tasks simultaneously.