Data Engineer

Role: Data Engineer

Experience: 7+ years

Job Experience Requirements: 

1. Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required
2. 7+ years of experience in working with data solutions.
3. 3+ years of experience coding in Python, or Scala or similar scripting language.  
4. 3+ years of experience in developing data pipelines in AWS Cloud Platform (preferred), Azure, or Snowflake at scale.
5. 2+ years Experience in designing and implementing data ingestion with real-time data streaming tools like Kafka, Kinesis or any similar tools.
6. SAP/Salesforce or other cloud integrations are preferred.
7. 3+ years experience working with MPP databases such as Snowflake (Preferred) , Redshift or similar MPP databases.
8. 2+ years experience working with Serverless ETL     processes (Lambda, AWS Glue, Matillion or similar)
9. 1+ years experience with big data technologies like EMR, Hadoop, Spark, Cassandra, MongoDB or other open source big data tools. 
10. Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
11. Experience designing, documenting, and defending designs for key components in large distributed computing systems
12. Demonstrated ability to learn new technologies quickly and independently
13. Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment
14. Ability to handle multiple competing priorities in a fast-paced environment
15. Excellent verbal and written communication skills, especially in technical communications
16. Strong interpersonal skills and a desire to work collaboratively
17. Experience participating in an Agile software development team, e.g. SCRUM

Job Responsibilities:  

1. Responsible for the building, deployment, and maintenance of critical scalable Data Pipelines to assemble large, complex sets of data that meet non-functional and functional business requirements
2. Work closely with SMEs, Data Modeler, Architects, Analysts and other team members on requirements to build scalable real time/near real time/batch data solutions.
3. Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading into Data Lake/Cloud Data Warehouse/MPP (Snowflake/Redshift/similar Technologies ) .
4. Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platforms quality, robustness, maintainability, and speed.
5. Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.
6. Interacts with technical teams across  Cepheid and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
7. Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
8. Keep up with current trends in big data and Analytics , evaluate tools and pace yourself for innovation.
9. Mentor Junior engineers ,create necessary documentation and Run-books while still being able to deliver on goals.