Principal Engineer - Data Engineering

What youll be doing...

As a Principal Engineer with in-depth knowledge of data-intensive application development. Youll be part of the Network & Technology IT Organization focusing on end-to-end implementation of data movement/data pipeline solutions.

• Working on the overall IT architecture and design for complex Applications, System Architecture and functionality development.
• Providing technical guidance to cross-functional teams in crafting solutions and describing the impact of new solutions to systems and processes.
• Supporting mission & business critical applications in Network Systems covering Data movement platforms
• Playing a critical role in alignment with the Solution Architecture team to prepare HLD and LLD and taking responsibility for Development and Delivery on Time.
• Participating in planning, definition, and high-level design of the solution and explore solution alternatives
• Developing complex application migrations to the North Star technology platforms aligning with the SOE/SRE standards.
• Creating, leading, shaping and executing programs with initiatives to process optimization and modern technology adoption to create higher value for the business.
• Defining reusable components/frameworks, common schemas, standards to be used & tools to be used and helping bootstrap the Data Movement / Data Pipeline platforms.
• Preparing and Reviewing design to make sure design is aligned with the North Star Architecture and Data Engineering Industry Standards.
• Driving Technology and with best software engineering practices to impact on the entire architecture eco-system of the product.
• Participating in code reviews, design reviews, architecture discussions.
• Working with Solution Architects customers, stakeholders, and suppliers to establish high-level Solution Intent, and the solution intent information models and documentation requirements.

Where you'll be working

In this hybrid role, you'll have a defined work location that includes work from home and assigned office days set by your manager.

Youll need to have:

• Masters or Bachelors degree with more than ten years of work experience.
• Ten or more years of work experience in Big Data, Data Engineering concepts like Aggregations, Transformations, Rollups etc.,
• Hands on experience in Data Movement/Data Pipeline platforms

Primary Must Have Skills

• Experience in Distributed systems which are data-intensive applications
• Experience in Data Pipeline Design/ETL frameworks
• Experience in Data Ingestion/Processing Frameworks like: Apache Flink, Apache Spark, Apache Kafka
• Experience in Containers Orchestration tools like Kubernetes, Managed Kubernetes
• Experience in Big Data formats like Apache Parquet, Apache Orc and Apache Avro
• Experience in at least any one of OLAP Databases

Good to Have

• Orchestration Tools: Apache Airflow, Dagster, Prefect, Oozie
• Data Modeling: Logical/Conceptual data models, Snowflake vs Star schema, SCD types etc
• Experience in Data Quality/ Data Lineage/ Data Governance
• Hands on Experience in coding(Python, Java, SpringBoot), drive teams through massive refactoring exercises and improve coding standards across large code bases.
• Experience on providing solutions / Architecture for Modernization
• Experience in Compute & Storage Architectures
• Experience in Data Visualization tools like Apache Superset, Grafana etc.,
• Experience in Data storage formats - IceBerg/delta and Data Retrieval, DataBricks/Snowflake and Orchestration- Airflow
• Knowledge on cloud technologies - AWS/On-Prem cloud or docker containers -Kubernetes (K8S)

Even better if you have one or more of the following:

• A Master degree.
• Experience with object oriented programming, SOA, modular code development, design patterns, multi-threading.
• Contribution to industry forums (e.g., ETSI, 3GPP, TMForum, MEF).
• Knowledge of wireline and Wireless networks and services.