Manager - Data Engineering and Analytics

Job Title: Manager - Data Engineering and Analytics

Job Description:

We are seeking a highly skilled and experienced Data Engineering and Analytics Manager to lead our data team. This role involves overseeing data import, transformation, and cleaning processes while ensuring the highest data quality standards. The ideal candidate will have strong leadership capabilities, technical expertise, and the ability to drive data initiatives that align with business objectives.

Responsibilities:

• Lead and manage the data engineering and analytics team, ensuring efficient execution of data projects.
• Oversee data import, ETL processes, data quality, and data governance to ensure clean, structured, and reliable data.
• Define data processing frameworks, automation strategies, and best practices for handling large-scale datasets.
• Collaborate with cross-functional teams, including business stakeholders, data analysts, and IT teams, to understand data needs and develop robust solutions.
• Monitor and optimize data pipelines, storage solutions, and database performance to improve efficiency.
• Establish data validation and integrity checks to ensure consistency and accuracy across systems.
• Develop standard operating procedures (SOPs) for data ingestion, transformation, and storage.
• Implement data security and compliance measures in accordance with industry standards and regulations.
• Mentor and guide data engineers and analysts, fostering a culture of learning and continuous improvement.
• Drive innovation by staying up-to-date with the latest trends in data engineering, cloud computing, and analytics.
• Lead and manage project timelines, resource allocation, and prioritization to meet business needs effectively.

Qualifications:

• Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, analytics, or related domains, with at least 2 years in a leadership role.
• Strong expertise in data ingestion, cleaning, and transformation processes, ensuring high-quality and structured datasets.
• Proficiency in SQL, Python, and ETL tools for data manipulation and processing.
• Experience with big data technologies such as Spark, Databricks, Snowflake, GCP, or AWS.
• Strong knowledge of data warehousing, data lakes, and database management systems.
• Excellent problem-solving, analytical, and critical thinking skills.
• Strong project management and stakeholder communication skills, with the ability to translate business needs into technical solutions.
• Ability to lead and mentor a team, fostering a collaborative and high-performance work environment.

Skills and Expertise:

1. Data Engineering Leadership: Ability to oversee end-to-end data processes, from ingestion to consumption.
2. ETL Development & Automation: Expertise in designing scalable ETL pipelines and implementing automated data workflows.
3. Data Quality & Governance: Strong focus on data integrity, standardization, and compliance.
4. Technical Proficiency: Proficiency in SQL, Python, Spark, and cloud-based data solutions.
5. Business Acumen: Strong understanding of business needs, enabling data-driven decision-making.
6. Communication & Stakeholder Management: Ability to explain complex data concepts to both technical and non-technical audiences.
7. Project & Resource Management: Experience in prioritizing data projects, managing budgets, and optimizing team efficiency.

Continuous Learning & Innovation: Keeping up with the latest trends in data engineering, analytics, and cloud technologies.

It has been brought to our attention that there have recently been instances of fraudulent job offers, purporting to be from Capillary Technologies. The individuals or organizations sending these false employment offers may pose as a Capillary Technologies recruiter or representative and request personal information, purchasing of equipment or funds to further the recruitment process or offer paid training. Be advised that Capillary Technologies does not extend unsolicited employment offers. Furthermore, Capillary Technologies does not charge prospective employees with fees or make requests for funding as a part of the recruitment process.
We commit to an inclusive recruitment process and equality of opportunity for all our job applicants.

Regards

Rajesh

TA Team