Big Data Engineer

First American maintains and curates the industry s largest property and ownership dataset with over 7 billion document images. Our major platforms and products include: DataTree , FraudGuard , RegsData , TaxSource and ACI . The First American Data & Analytics division boasts more than 20 patents and remains at the forefront of innovation - leveraging technology and data to deliver best-in-class decisioning solutions. Fueled by our industry-leading data and using our technology and proprietary process, our solutions provide lenders, real estate and title companies with actionable insights - enabling them to make better, increasingly automated, decisions. Job Summary

• Function as integrators between business needs and technology solutions, helping to create technology solutions to meet client s business needs.
• Identifying business requirements, requirements management, functional design, prototyping, process design (including scenario design, flow mapping), testing, training, defining support procedures and supporting implementations.
• Implement large-scale data ecosystems including data management, governance, and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms.
• Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions.
• Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise, and providing As-a-Service offerings for continuous insights and improvements.

• 3 years of experience in core JAVA and SQL and minimum 2 years of experience in Databricks
• Experience in Python & Unix Shell Scripting
• Experience in building scalable and high-performance data pipelines using Apache Hadoop, MapReduce, Pig & Hive
• Experience with big data cross platform compatible file formats like Apache Avro & Apache Parquet
• Experience in Apache Spark
• Experience with data lake implementations, core modernizations and data ingestion.
• Hands on experience designing and implementing data ingestion techniques for real time and batch processes for video, voice, weblog, sensor, machine, and social media data into Hadoop ecosystems and HDFS clusters.
• Experience designing and implementing reporting and visualization for unstructured and structured data sets.