Industry Information Technology Employment Direct/Contract Job Description Responsibilities:
Design, build, and maintain data processing, storage, and analytics systems to meet business needs. Develop and implement data ingestion and transformation pipelines from various sources. Collaborate with cross-functional teams, including data scientists, software engineers, and product managers, to identify data needs and solve complex data-related problems. Ensure data integrity, accuracy, and availability through effective data management practices. Monitor and optimize the performance of data systems, resolve technical issues, and implement enhancements as needed. Stay current with the latest technologies, trends, and best practices in data engineering. Mentor and guide junior team members on data engineering best practices. Implement data security and privacy measures to ensure the protection of sensitive information.
Requirements:
Bachelors or Masters degree in Computer Science, Information Systems, or a related field. At least 5 years of professional experience in data engineering, software engineering, or a related field. Strong Python programming skills and experience with popular libraries such as NumPy, Pandas, and Scikit-learn. Experience with cloud computing platforms (e.g., AWS, Azure, or Google Cloud). Knowledge of SQL and NoSQL databases (e.g., MySQL, MongoDB, Cassandra). Strong understanding of data security, privacy, and governance best practices. Excellent problem-solving and analytical skills, communication and collaboration skills Ability to work in a fast-paced, dynamic, and team-oriented environment.