Sr. Software Engineer - Data Engineer

About the Team:

Join the Usage Service and OPUS teams to innovate with impact, building scalable, modern solutions that power millions worldwide.

As a Data Engineer, you will excel in a data-driven environment, shaping the future with advanced analytics, real-time processing, and AI-driven insights. Partner with top talent, use the latest technologies, and accelerate your career in a culture that values learning, creativity, and new ideas. Candidate will report to Sr. Manager, Software Engineering.

• Design, develop, and maintain scalable data pipelines to collect, process, and analyze security-related data from various sources.
• Apply best practices for data integrity, reliability, and scalability in security data pipelines.
• Collaborate with partner security teams, leadership, and engineering to implement security solutions that effectively reduce risks in Avalara's cloud environments.
• Develop automated, cloud-native solutions across multiple hyperscale cloud providers (AWS, GCP, Azure, OCI).
• Ensure compliance with security standards, regulations, and industry best practices, working closely with compliance teams to implement necessary controls and reporting mechanisms.
• Conduct code and design reviews for internal and customer-facing software solutions.
• Maintain comprehensive documentation of pipeline architecture, configurations, and processes.
• Generate regular reports on pipeline performance, data quality, and security incidents.

• Bachelor's degree in Computer Science, Information Security, or relevant experience.
• 5+ years of professional experience in data engineering, design, and development roles.
• Expert-level proficiency in SQL.
• Strong experience in architecting complex data marts using dbt and Airflow.
• Proven ability to design and implement data solutions that ensure high data quality and anomaly detection.
• Hands-on experience with Snowflake for production analytics.
• Strong understanding of DevOps/DataOps practices, including Git and Terraform.
• Experience with containerization and orchestration technologies (Docker, Kubernetes, CI/CD).
• Extensive knowledge of AWS data engineering ecosystem and data security best practices.
• Experience designing secure cloud architectures across AWS, GCP, Azure, or OCI.
• Deep understanding of Identity and Access Management (IAM), RBAC Automation, and data security frameworks.

• Familiarity with global data security requirements such as GDPR, SOC 2, US privacy regulations, and PII protection.
• Experience in analyzing website traffic and network data.
• Ability to drive program maturity by evangelizing modern secure architectures and services.
• AWS or other professional data security certifications.
• Experience in data modeling.
• Proficiency in data visualization tools (Power BI, Tableau, Hex, R-Shiny) and data storytelling.