Senior Data Engineer

• Develop and implement Python and C++ solutions using pre-existing Python and Bash scripts
• Manage AWS autoscaling instances and update them in collaboration with the engineering team
• Maintain a data-labeling pipeline and ensure the completion of data collection
• Collaborate with the offshore labeling team and provide necessary scripts as needed
• Ingest labeled data into Dolt
• Enhance and maintain the video streaming pipeline
• Interact with the SQL/Redshift database, managing tables, writing queries, and ensuring smooth data flow
• Work with the QA manager to implement QA best practices
• Conduct data analysis for both the engineering team and other departments

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 3+ years of relevant experience as a Data Engineer
• Expert-level skills in Linux, Python, and Bash scripting
• Thorough understanding of FFmpeg and video pipelining processes (streaming servers, video players, SRT/RTMP) is a bonus
• Familiarity with SQL (PostgreSQL, Redshift), Dolt, and CUDA is a plus
• Previous experience with AWS (EC2, S3) or other cloud computing/storage services is advantageous
• Excellent communication skills and the ability to collaborate effectively with diverse individuals
• Strong inclination to understand ongoing projects and share insights
• Good English communication skills