Senior Software Engineer

Overview About BU The Product team forms the crux of our powerful platforms and connects millions of customers to the product magic. This team of innovative thinkers develop and build products that help Epsilon be a market differentiator. They map the future and set new standards for our products, empowered with industry best practices, ML and AI capabilities. The team passionately delivers intelligent end-to-end solutions and plays a key role in Epsilon s success story. Responsibilities Why we are looking for you? At Epsilon, we run on our people s ideas. It s how we solve problems and exceed expectations. Our team is now growing, and we are on the lookout for talented individuals who always raise the bar by constantly challenging themselves and are experts in building customized solutions in the digital marketing space. So, are you someone who wants to work with cutting-edge technology and enable marketers to create data-driven, omnichannel consumer experiences through data platforms? Then you could be exactly who we are looking for. Apply today and be part of a creative, innovative, and talented team that s not afraid to push boundaries or take risks. What will you enjoy in this role? We seek Software Engineers with experience building and scaling services in on-premises and cloud environments. What will you do? As a Senior Data Engineer, you will be instrumental in implementing and optimizing advanced data processing solutions using Scala, Spark, and Hadoop. You will collaborate with cross-functional teams to deploy scalable big data solutions on our on-premises and cloud infrastructure. Your responsibilities will include building, scheduling, and maintaining complex workflows, performing data integration and transformation tasks, and ensuring data quality through rigorous testing Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies - SCRUM. Qualifications Over 5+ years in Scala or Python programming and Apache Spark for developing scalable big data solutions on both on-premises and cloud platforms, such as AWS or Azure or GCP Cloud. Conducting extensive data validation checks using automated and manual testing techniques to ensure accuracy and consistency in large-scale datasets. Extensive experience in test automation, including the design and development of automation frameworks and scripts. Experience with performance testing tools (e.g., JMeter, Gatling) and load testing methodologies. Experience with developing and testing data pipelines, data engineering systems and solutioning with Spark. Skilled in implementing scalable, fault-tolerant data pipelines with comprehensive monitoring and alerting systems. Implementing robust automated testing frameworks for big data jobs, ensuring comprehensive data integrity and performance validation. Utilize and implementation of tools such as Apache Airflow, Jenkins, or similar to automate complex testing workflows, including integration, regression, and performance testing Hands-on experience with Python for infrastructure module development and strong SQL skills for handling large datasets Familiar with data warehousing concepts and technologies. Experienced with GIT or equivalent source control systems. Proficient in developing and implementing unit test cases to ensure code quality and reliability and experienced in utilizing integration testing frameworks to validate system interactions. Effective collaborator with stakeholders and teams to understand requirements and develop solutions. Ability to work within tight deadlines, prioritize tasks effectively, and perform under pressure. Experience in mentoring junior staff. Advantageous to have experience on below: Hands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues. Proficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualization. Strong background in analytics, including the ability to derive actionable insights from large datasets and support data-driven decision-making. Experience with data visualization tools like Tableau, Power BI, or Grafana. Familiarity with Docker for containerization and Kubernetes for orchestration. Additional Information Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we ve provided marketers from the world s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world. Epsilon has a core set of 5 values that define our culture and guide us to create value for our clients, our people and consumers. We are seeking candidates that align with our company values, demonstrate them and make them meaningful in their day-to-day work: Act with integrity. We are transparent and have the courage to do the right thing. Work together to win together. We believe collaboration is the catalyst that unlocks our full potential. Innovate with purpose. We shape the market with big ideas that drive big outcomes. Respect all voices. We embrace differences and foster a culture of connection and belonging. Empower with accountability. We trust each other to own and deliver on common goals. Because You Matter YOUniverse. A work-world with you at the heart of it! At Epsilon, we believe people make the place. And everything we do is designed with you in mind. That s why our work-world, aptly named YOUniverse is focused on creating a nurturing environment that elevates your growth, wellbeing and work-life harmony. So, come be part of a people-centric workspace where care for you is at the core of all we do. Take a trip to YOUniverse and explore our unique benefits, here. Epsilon is an Equal Opportunity Employer. Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.