Simplify Workforce - Senior Data Engineer - ETL/HBase (3-8 yrs)

Job Title: Sr. Data Engineer

Location: Noida, Hyderabad (Hybrid)

Company Description :

Simplify Workforce is the most innovative technology that provides a cloud-based Vendor Management System (VMS) to manage contingent workforce and services procurement programs.

Customers leverage Simplify Workforce to gain visibility into their external/non-employee workforce, including contingent labour, Statement of Work (SOW) and independent contractors, all while optimizing client spend, candidate quality, compliance procedures and talent supply efficiency.

At Simplify Workforce we are developing AI/ML based deep tech solutions that can be consumed by Enterprises as customizable SaaS offering.

We have a passionate and savvy team of technologists/professionals in the contingent workforce and services procurement industry, with one vision to create the greatest VMS/TTM (Total Talent Management) platform in the industry combined with exceptional user experience.

Responsibilities :

- Active participation in designing data warehouse, data lake, data fabric etc. on AWS platform.

- Design, build, and maintain scalable and robust data pipelines to support analytics and data science projects.

- Implement ETL processes and data warehousing solutions to facilitate data collection, storage, and retrieval.

- Work closely with data scientists and analysts to understand data needs and deliver solutions that enable effective data analysis and machine learning model development.

- Optimize data processing workflows and develop strategies for data quality assurance and error handling.

- Stay abreast of industry trends and advancements in big data technologies, recommending and implementing new tools and techniques to improve data infrastructure.

- Collaborate with IT and security teams to ensure compliance with data governance and security policies.

- Review the business process and conceptualise the entities that interoperate within the business process.

- Streamlining and optimizing existing pipelines and flows. Making the decisions on Performance and Cost Optimizations.

Requirements :

- Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or a related field.

- In depth knowledge of the data engineering concepts and principles.

- 5-8 years of experience in a Big Data engineering role, with a strong background in data warehousing, ETL processes, and data Modelling.

- Proficiency in big data technologies such as Hadoop, Spark, Flink, Kafka, Relational Databases, and NoSQL databases (e.g., HBase, Cassandra, MongoDB).

- Have good experience in managing High Volume and Big Scale Data.

- Good knowledge of Databricks.

- Strong programming skills in languages like Java, Scala, or Python.

- Experience with cloud computing services (AWS, Azure, or GCP) and their data processing tools.

- Familiarity with data visualization tools and techniques.

- Excellent problem-solving abilities and strong communication skills to effectively collaborate with cross-functional teams.

- Should have coding experience in Python and Python libraries that deals with data transformations, like Pandas, NumPy, Matplotlib, etc. Great if have experience with spark.

- Advanced SQL skills and expert on anyone - MySQL, Postgres, AWS Redshift

- Strong analytical, statistics, data profiling and problem-solving skills

- Strong verbal and written communication skills

- In depth knowledge of data warehouse design techniques like star schema, snowflake schema, etc

- Experience in Power BI ecosystem.

- Have experience in concepts of Data Governance, Localization, Security, and Data archival policies.

- Strong consultative, facilitation and consensus building skills.

Company values :

Simplify is fanatical about people and helping them to become successful. It's why we're in the talent industry. But we're also a youthful technology company with the vibrancy and creativity of a start-up. Our company culture is to encourage our team members to be self-starters and curious. We're always on the look-out for talent to add to our team, people with a flair for technology and a passion for what they do. We operate a flat management structure.

Equal Opportunity Employer :

We are an equal opportunity employer and prohibits discrimination and harassment of any kind. All applicants will be considered for employment regardless of their race, colour, religion, gender, or disability.