Data Engineer

• Help to develop distributed data processing system using AWS
• Analyze performance and upgrade existing solutions to manage the increased load
• Build and scale architecture, and select the optimal technologies and methodologies
• Contribute to end data deployment processes from inception to consumption
• Work closely with data science engineers to provide data for ML components
• Develop best practices for data integration and streaming processes
• Help in shipping clean, maintainable, easy to support codes by following the engineering best practices like testing, documenting, rapid prototyping, providing modular and structured solutions
• Adopt an agile thinking approach and adopt changes fast
• Work with an attention to detail and passion to fully understand the pros and cons of different technologies
• Work as a good team player, clearly state your point of view and listen to others carefully
• Work with data and assist in data-driven decision-making processes
• Adopt a simplistic approach with enough knowledge to judge future requirements
• Take ownership of incidents that fall within your domain and help resolve errors or provide assistance to others for the same

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 4+ years of relevant experience as a Data / Back-End Engineer
• Thorough understanding of data structures and algorithms
• Must have a strong grasp over SQL and NoSQL databases, design, and data retrieval methods
• Expertise in working with languages like Java and Scala is required
• Should possess a thorough understanding of Big Data technologies and solutions like Hadoop, Spark, etc
• Ability to work with streaming services like Apache Kafka or Kinesis
• Proven experience in working with cloud services (AWS preferred)
• Knowledge of working infrastructure as a code using Terraform is preferred
• Familiarity with containerization technologies like Docker and Kubernetes will be helpful
• Knowledge of Workflow engines like Apache Airflow or similar solutions is preferred
• Ability to work with languages like Python will be a bonus