Pyspark Developer

Project Role: Pyspark Developer

Work Experience: 4 to 7 Years

Work location: Bengaluru

Work Mode: Hybrid

Must Have Skills: Pyspark, SQL

Job Overview:

Designs/develops software solutions requiring general domain knowledge and developing business experience.

Analyzes user requirements/needs and makes decisions within limited parameters under regular supervision. The systems are primarily in the areas of medical, pharmaceutical and life sciences, and as such, require a strong understanding of related security considerations and practices.

Essential Functions:

• Designs/develops software solutions requiring general domain knowledge and developing business experience.
• Works at all layers of the application stack including front-end user interface and backend development.
• Under broad guidance, performs quantitative or qualitative analyses to support the development of solutions for internal or external client project teams.
• Identifies and interprets trends and patterns in datasets to support the development of recommendations .
• Constructs impact assessment based on business data and market knowledge. Creates specifications for reports and analysis based on business needs and required or available data elements.
• May directly produce datasets and reports for analysis using system reporting tools.
• Verifies data for accuracy and completeness.
• May manipulate and transform data to optimize analyses.
• Performs audits of own work or that of others to ensure conformance with established procedures or to resolve routine issues.
• May work with stand alone data systems or enterprise-wide tools supporting activities such as inquiry resolution, data validation, and trend analysis.

Technical Experience:

• Prior experience of healthcare information systems and healthcare / life sciences / clinical trials / pharma data
• 3 years of related experience preferably working with pharmaceutical data. Req
• Data analysis skills and previous experience using Microsoft software tools (Excel, PowerPoint, Word, and Access).
• Works willingly and effectively with others in and across the organization to accomplish team goals.
• Has good knowledge on ETL pipeline.
• Has a basic understanding of object-oriented programming, databases, data structures, and RDBMS. You should also be familiar with language like Python, javascript, SQL.
• Has 2 years of experience on big data tools like Apache Hadoop, Apache Spark and Data mining and Modelling.
• Good to have experience on pyspark or scala.
• Has worked previously on cloudera.
• Basic understanding of cloud platforms like AWS, azure or GCP.
• Has exposure to CI/CD pipeline and is aware of version control system like git.

Educational Qualification: BSc/BCA/BTech/MSc/MCA/MTech