Senior Data Engineer

• Contribute actively to design, develop, and operate highly scalable data pipelines in distributed data processing platforms
• Collaborate with Architects, Engineers, Product Managers, Analysts, and Data Scientists to build products at scale
• Own and collaborate with other technical teams to extract, convert, and load data from multiple sources
• Share ideas with the product and non-technical teams to gather prerequisites and translate them into workable tasks
• Create and maintain batch and real-time data pipelines using AWS technologies such as API gateway, Glue, Kinesis, EMR, Lambda, and Athena, among others
• Develop CI/CD workflow tools, plug-ins, and solutions leveraging Jenkins, Cloud Formation, Docker, GitHub, and other microservices
• Investigate the most up-to-date big data and visualization tools to gain new capabilities and boost efficiency
• Drive and engage in debates about architecture, have a say in product roadmaps, and assume ownership and responsibility for new initiatives
• Maintain and support current platforms while transitioning to newer technology stacks and architectures
• Collaborate with the Data team, product owners, business stakeholders, and the Scrum-master to improve and estimate stories/epics
• Assist the scrum team in meeting deadlines and delivering high-quality products
• Examine and confirm that all code documentation is complete and up to date on a regular basis
• Analyze business problems and deliver optimal solutions using AWS Technologies by reviewing the work of junior colleagues in the team

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 5+ years of industry experience in software development, data engineering, business intelligence, or relevant field
• Experience designing scalable systems that enable the extraction and processing of large data sets to enable correct decision making
• Ability to construct and maintain sophisticated SQL statements
• Extensive knowledge in Python, Java, C++, and other object-oriented programming languages
• Experience with software configuration management tools like Git, CI/CD pipelines, Jenkins, and Nexus
• Proficiency in programming languages for data manipulation
• Experience with cloud infrastructure technologies such as Amazon Web Services and Google Cloud is advantageous
• Ability to create, develop, and deploy automated process sequences
• Knowledge of software engineering best practices across the development lifecycle
• Core competency in Agile methodologies, coding standards, code reviews, source management, build processes, tests, and operations
• Nice to have some experience in using business intelligence reporting tools like PowerBI and Tableau
• Prior experience with cloud platforms like Azure, Amazon, or Google is desirable
• Excellent communication abilities, both written and vocal