Design and implement scalable and efficient big data architecture solutions to meet business requirements Develop and maintain data pipelines ensuring the availability and quality of data Collaborate with data scientists data engineers and other stakeholders to understand data needs and provide technical solutions Lead the evaluation and selection of big data tools and technologies Ensure data security and privacy compliance Optimize and tune big data systems for performance and costefficiency Document data architecture data flows and processes Stay uptodate with the latest industry trends and best practices in big data technologies Required Qualifications Bachelor s or Master s degree in Computer Science Information Technology or a related field 5 years of experience in big data architecture and engineering Proficiency in big data technologies such as Hadoop mapredue Spark batch and streaming Kafka HBase Scala Elastic Search and others Experience with AWS cloud platform Strong knowledge of data modeling ETL processes and data warehousing Proficiency in programming languages such as Java Scala Spark Familiarity with data visualization tools and techniques Excellent communication and collaboration skills Strong problemsolving abilities and attention to detail