Etl Developer

About Cybage:

Cybage Software is a technology consulting organization specializing in outsourced product engineering services. Our unique offerings span the technological spectrum from cutting-edge software development to transformative digital strategies. In 1995, Cybage was founded with a mission to revolutionize the product engineering landscape, empowering businesses to soar above their limitations. What commenced as a modest venture has transformed into a pioneering force, shaping the digital future with innovative solutions tailored to our clients' unique needs.

Technical Requirements

• 5+ years of experience in developing, testing, and maintaining applications using Python, Bash, and SQL, with a focus on delivering scalable solutions.
• Strong expertise in writing clean, efficient, and maintainable code, with a deep understanding of design patterns and best practices.
• In-depth knowledge of SQL and NoSQL databases, including database design and optimization techniques.
• Extensive experience with parallel processing and distributed computing frameworks like Hadoop, Spark, or Dask.
• Proven track record in custom ETL design, implementation, and operational maintenance in complex environments.
• Familiarity with ETL orchestration frameworks such as Luigi, Apache Airflow, or Apache NiFi is an advantage.
• Proficiency in backend frameworks like Django or Flask, with demonstrated experience in building and maintaining web services and APIs.
• Strong experience with cloud platforms (AWS, GCP, Microsoft Azure), including cloud-based data storage and processing solutions.
• Exposure to data analytics, data science, or machine learning workflows is a plus.

Job Responsibilities

• Development and optimization of scalable data pipelines for efficient extraction, transformation, and loading (ETL) of data from diverse sources, leveraging technologies like Spark, Dask, and other modern ETL frameworks.
• Architect and implement advanced data models for both NoSQL (e.g., HBase) and relational databases, ensuring high performance, scalability, and cost efficiency in data storage and retrieval processes.
• Establish robust systems to ensure data quality, implementing monitoring tools and validation frameworks to guarantee accuracy and availability of production data for key business stakeholders.
• Design, build, and maintain high-performance APIs to provide seamless access to curated data sets for both internal teams and external clients.
• Oversee the assembly of large, complex data sets that meet functional, non-functional, and business requirements, enabling data-driven decision-making across the organization.
• Conduct root cause analysis on internal and external data and processes to resolve business inquiries, support client requests, and proactively identify areas for system and process improvement.
• Collaborate closely with cross-functional teams, providing leadership and technical guidance to ensure alignment on data architecture and delivery goals.