UsefulBI Corporation - Lead Data Engineer/Solution Architect - Python/Spark (15-20 yrs)

Job Description :

- Minimum 10+years' Experience in Data Engineering.

- Must have good knowledge and experience in Python.

- Must have good Knowledge of Pyspark or Spark.

- Must have good experience in AWS/Azure (Glue, EMR)

- Typically requires relevant analysis work and domain-area work experience.

- Expert in the management, manipulation, and analysis of very large datasets.

- Superior verbal and written communication skills, ability to convey rigorous mathematical concepts and considerations to non-experts.

- Good knowledge of scientific programming in scripting languages like Python.

Key Responsibilities :

- Create and maintain optimal data pipeline architecture.

- Assemble large, complex data sets that meet functional / non-functional business requirements.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing

data delivery, re-designing infrastructure for greater scalability, etc.

- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources

- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Perks & Benefits :

- Competitive Compensation

- Flexible Work Options

- Professional Growth Opportunities

- Work-Life Balance

- Employee Well-Being

- Modern Tools and Technology

- Recognition and Rewards