Acuity Knowledge Partners - Data Engineer - SQL/Python (4-6 yrs)

Job Purpose :

- As a Data Engineer, you will be a key player in building and maintaining the data infrastructure that supports our client's investment strategies.

- You will be responsible for the entire data lifecycle, from ingestion and processing to delivery and quality assurance.

- Your expertise in data engineering, cloud technologies, and financial data will be essential to ensure the timely and accurate delivery of high-quality data assets.

Key Responsibilities :

- Engage with vendors and internal technical teams to systematically ingest, evaluate, and create valuable data assets.

- This includes managing data acquisition from various sources, including FTP, APIs, S3 buckets, and other distribution channels.

- Collaborate with the core engineering team to develop and implement central capabilities for processing, managing, and distributing data assets at scale.

- This involves building scalable and efficient data pipelines.

- Implement robust data quality rules and processes to systematically qualify data deliveries and guarantee the integrity of financial datasets.

- You will be responsible for ensuring data accuracy and consistency.

- Act as a Subject Matter Expert (SME) on our data asset offerings, engaging with both technical and non-technical clients to understand their needs and provide support.

- Design and implement data models and data warehousing solutions to support efficient data storage and retrieval.

- Develop and maintain data pipelines using tools like Airflow, ensuring they are reliable, scalable, and performant.

- Leverage cloud-native tools for data processing and distribution, optimizing for cost and performance.

- Work with financial and/or alternative data products, demonstrating a strong understanding of financial data concepts.

- Contribute to the continuous improvement of our data engineering processes and tools.

Required Skills :

- B.Tech/M.Tech/MCA degree with 4-6 years of overall experience.

- Strong proficiency in Python and SQL.

- Extensive experience in data modeling, data warehousing, and building data pipelines.

- Hands-on experience working with various data sources and distribution channels, including FTP, APIs, S3, etc.

- Proven experience working with financial and/or alternative data products.

- Solid understanding of cloud-native tools for data processing and distribution.

- Expertise in Snowflake and Airflow.

- Excellent communication and collaboration skills.

- Strong analytical and problem-solving abilities.

- Experience working in an Agile environment is a plus