i
UpMan Placements
26 UpMan Placements Jobs
Senior Data Engineer - Python Programming (9-11 yrs)
UpMan Placements
posted 5d ago
Flexible timing
Key skills for the job
About WealthRight SaaS :
WealthRight SaaS, a division of WealthRight, is a rapidly expanding FinTech startup dedicated to empowering middle-income families in emerging markets with personalized financial planning and products.
Our high-performing technology team, comprised of passionate Product Managers, Developers, Designers, Data Analysts, and Client Success professionals, is building an innovative platform that seamlessly blends cutting-edge technology with human-centric experiences.
Role : Senior Data Engineer
Joining Timeframe : 15 days or less
Job Summary :
We are seeking a highly skilled and motivated Senior Data Engineer to join our team and play a pivotal role in building and maintaining our data infrastructure on Google Cloud Platform (GCP).
You will be responsible for designing, developing, and optimizing scalable data pipelines, ensuring data quality, and enabling data-driven insights for our clients and internal stakeholders.
This role requires a strong understanding of data warehousing, ETL processes, cloud-based data technologies, and real-time streaming platforms.
Responsibilities :
- Design, build, and maintain robust and scalable data pipelines using GCP services like Cloud Composer, Dataflow, and Dataproc.
- Optimize existing data pipelines for performance, efficiency, and cost-effectiveness within both OLTP and OLAP environments.
- Implement data transformations and enrichments using SQL, Python, and other relevant technologies.
- Develop and manage ETL/ELT processes to move data between various sources and destinations, including PostgreSQL and BigQuery.
- Design and implement data models that support business requirements and analytical needs.
- Collaborate with data analysts and data scientists to understand data requirements and translate them into technical solutions.
- Contribute to the development of data architecture standards and best practices.
- Leverage GCP services to build and manage a scalable and secure data infrastructure.
- Implement and manage data storage solutions using BigQuery, Cloud Storage, and other relevant GCP services.
- Monitor and optimize GCP resource utilization and costs.
- Implement IAM policies and access controls to ensure data security and compliance.
- Implement data quality checks and validation processes to ensure data accuracy and consistency.
- Develop and maintain data documentation and metadata.
- Enforce data governance policies and procedures.
- Design and implement distributed streaming platforms using technologies like Apache Kafka, Pub/Sub, or similar.
- Build real-time data pipelines to ingest and process streaming data.
- Ensure the scalability and reliability of real-time data systems.
- Collaborate with data analysts to provide data access and support for BI tools like Power BI.
- Optimize data for analytical queries and reporting.
- Work with Data Analysts to understand and satisfy reporting and dashboarding needs.
- Stay up-to-date with the latest advancements in cloud data technologies and best practices.
- Identify opportunities for process improvements and automation.
- Evaluate and recommend new tools and technologies to enhance the data platform.
Required Skills & Experience :
- Master's degree in Computer Science, Engineering, or a related field.
- Strong proficiency in SQL and experience with relational databases (PostgreSQL).
- Extensive experience with cloud-based data platforms, preferably Google Cloud Platform (GCP).
- Hands-on experience with GCP services like BigQuery, Cloud Storage, Dataflow, Dataproc, and Cloud Composer.
- Experience with ETL/ELT processes and tools.
- Experience with data modeling and data warehousing concepts.
- Experience with real-time data streaming platforms ( Apache Kafka, Pub/Sub).
- Proficiency in Python or other scripting languages.
- Experience with BI tools like Power BI.
- Strong understanding of data security and access control.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to join within 15 days or less.
Preferred Skills :
- Experience with infrastructure as code (IaC) tools like Terraform.
- Experience with containerization and orchestration technologies (Docker, Kubernetes).
- Experience with machine learning and data science workflows.
- Experience within the FinTech industry.
Why Join WealthRight SaaS :
- Competitive salary and comprehensive benefits package.
- Opportunities for rapid professional growth in an innovative and supportive environment.
- Chance to make a significant impact on the financial lives of millions.
- Work with a diverse and passionate team of technology enthusiasts.
- Be part of a fast-growing, well-funded startup at the forefront of FinTech innovation
Functional Areas: Software/Testing/Networking
Read full job descriptionPrepare for Senior Data Engineer roles with real interview advice
5-15 Yrs