Data Engineer II - Big Data Technologies (4-8 yrs)

Data Engineer - SDE II

(Java, Python, ETL, GCP, Big Data)

Experience Required: 4 - 8 years

Mandatory (Company) - Product Companies ONLY

Maximum Notice Period 30 Days

Working Days: 5 days/week

Office Location: Mumbai, Bengaluru

Role & Responsibilities :

- Architect, Plan and Develop our data strategy and work with our team to turn it into working software.

- Co-create the detailed application architecture strategy with the teams, aligning your strategy with the teams' deliverables.

- Take an active role in collaborating to develop strategic direction, systems roadmap, and business and operational processes by providing the required technical guidance.

- Work with business stakeholders, product managers and architects to understand the business data and related processes.

- Own the communication and documentation of the strategy, syndicating with CTO, business and the development teams.

- Get hands-on in the code building prototypes and upholding best design and engineering practice, demonstrating the patterns you would like realized

- Extensive knowledge in data integration architecture/ETL/Data warehouse, especially large volumes with complex integrations.

- Help the teams slice their deliveries to allow for agile and incremental delivery of business value.

- Consult development teams towards application development in Cloud Native way.

- Evaluate tools / services and new technologies and suggest the right service and technology to be used.

- Speed as a Habit - can operate in a fast-moving environment, make quick decisions and execute fiercely to deliver outcomes.

- Using Agile and Dev/Ops methods, build platform architecture using a variety of sources (such as cloud IaaS/ SaaS).

- Integrate data from a variety of business subject areas: Leads management, Customer Portal, Seller App, SAP, Sales Force etc

- Implement rules & automate data cleansing, mapping, transformation, logging, and exception handling.

- Design, build, and deploy databases and data stores

- Participate in cross-functional teams to promote technology strategies, analyze and test products, perform proof-of-concept, and pilot new technologies and/or methods.

- Establish and document standards, guidelines, and best practices for teams utilizing the solutions.

- Review vendor solution designs to ensure technology appropriateness, standards compliance, and platform capacity alignment.

Ideal Candidate :

- At least 4+ years of overall experience with over 2+ years in architecting and working on big data applications and technologies

- Strong Data Engineering profiles

- Strong Object-Oriented Programming concepts.

- Mandatory experience - Must have 4+ YOE as a Data

- Engineer with ETL, Data Architecture and Integration.

- Mandatory experience - Must have 4+ YOE in Software Development with Java / Python

- Mandatory Core Skill - Must have Experience in Data / Big Data Engineering Technologies. Any one (e.g. Hive, Hadoop, H Base, HDFS, Airflow, Spark, Kafka, Google Cloud Data Engineering Technologies, Google Cloud Big Query, Google Cloud Data Flow, Google Cloud Data Lab, Google Cloud Dataplex, Google Cloud DataProc etc)

- Mandatory Core Skill- Must have Experience in any database - MySQL / PostgreSQL / Postgres / Oracle / SQL Server / DB2 / SQL

- Mandatory Core Skill- Must have experience with Data Pipelines

- Should be proficient in Server Side (Java/Linux) technologies.

- Expertise in GCP (google cloud platform) and ability to operate in DevOps model.

- Expertise in architecting or developing features for enterprise scale systems will be an added advantage

- Passion in being the technology ambassador and coaching engineering excellence to junior engineers.

- Strong understanding of the Software design/architecture/data-backed-decision-making processes.

- Hands-on deep knowledge of Java and Spring boot