Azure Data Engineer

Role: Senior Data Engineer

Skills and Qualifications:

• Experience: 5+ years of experience as a Data Engineer or similar role, with hands-on experience in designing, building, and maintaining ETL pipelines.
• Technologies:

1. Proficient in PySpark for large-scale data processing.
2. Strong programming experience in Python, particularly for data engineering tasks.
3. Experience working with Databricks for big data processing and collaboration.
4. Hands-on experience with data storage solutions (e.g., AWS S3, Azure Data Lake, or Google Cloud Storage).
5. Solid understanding of ETL concepts, tools, and best practices.
6. Familiarity with SQL for querying and manipulating data in relational databases.
7. Experience working with data orchestration tools such as Apache Airflow or Luigi is a plus.

• Data Modeling & Warehousing:

1. Experience with data warehousing concepts and technologies (e.g., Redshift, Snowflake, or BigQuery).
2. Knowledge of data modeling, data transformations, and dimensional modeling.

• Soft Skills:

1. Strong analytical and problem-solving skills.
2. Excellent communication skills, capable of explaining complex data processes to non-technical stakeholders.
3. Ability to work in a fast-paced, collaborative environment and manage multiple priorities.

Preferred Qualifications:

• Bachelor's or Masters degree in Computer Science, Engineering, or a related field.
• Certification or experience with cloud platforms like AWS, Azure, or Google Cloud.
• Experience in Apache Kafka or other stream-processing technologies.