Data Engineer - Hive/Hadoop (5-11 yrs)

Job Description :

- 5+ years of hands-on experience of Scala SDK 2.11.12 or higher, Apache Spark, Hadoop, Hive, and related ecosystem.

- Excellent knowledge of Scala EE, Web Services (REST/SOAP), Spring framework, MQ, Kafka, Databases (Db2/SQL), Webserver (Apache Tomcat preferred).

- Working Experience on Autosys for scheduling jobs or any other similar scheduling platform.

- Experience and very good understanding of Design Patterns.

- Good understanding of DevOps practices and tooling.

- Experience in understanding of requirements of large enterprise applications (security, entitlements etc.).

- Experience working in Agile development methodologies. Skills Desired:

- Working Knowledge of building applications in the Cloud.

- Working Knowledge of Unix/Linux and/or any scripting language.

- Working knowledge of financial market, document platform-based products and Wealth Management.

Education :

- Minimum BS degree

Job Functions/Duties and Responsibilities :

- Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems in Morgan Stanley.

- Perform Business analysis along with BA/QA's to ensure requirements documented, and implemented in Scala language. - Collaborating with multiple technology teams that are upstream and downstream to the application such as Books & Records System, Pricing System, Data Warehouse

- Working in the Agile development methodologies, collaborating with business and technology teams located globally.