Data Engineer - Python/SQL (8-14 yrs)

Qualifications :

Essential Skills :

- Experience : 8+ years of professional experience as a Data Engineer, with a strong background in building and optimizing data pipelines and working with large-scale datasets.

- AWS Experience : Hands-on experience with AWS cloud services, particularly S3, Lambda, Glue, Redshift, RDS, and EC2.

- ETL Processes : Strong understanding of ETL concepts, tools, and frameworks. Experience with data integration, cleansing, and transformation.

- Programming Languages : Proficiency in Python, SQL, and other scripting languages (e.g., Bash, Scala, Java).

- Data Warehousing : Experience with relational and non-relational databases, including data warehousing solutions like AWS Redshift, Snowflake, or similar platforms.

- Data Modeling : Experience in designing data models, schema design, and data architecture for analytical systems.

- Version Control & CI/CD : Familiarity with version control tools (e.g., Git) and CI/CD pipelines.

- Problem-Solving : Strong troubleshooting skills, with an ability to optimize performance and resolve technical issues across the data pipeline.

Desirable Skills :

- Big Data Technologies : Experience with Hadoop, Spark, or other big data technologies.

- Containerization & Orchestration : Knowledge of Docker, Kubernetes, or similar containerization/orchestration technologies.

- Data Security : Experience implementing security best practices in the cloud and managing data privacy requirements.

- Data Streaming : Familiarity with data streaming technologies such as AWS Kinesis or Apache Kafka.

- Business Intelligence Tools : Experience with BI tools (Tableau, Quicksight) for visualization and reporting.

- Agile Methodology : Familiarity with Agile development practices and tools (Jira, Trello, etc.)