Java/Sparks Engineer
- Country: United States
- Region: North Carolina
Title - Java/Sparks Engineer
Location - Durham, NC
Duration ? Contract
Job Description:
The Team:
Part of the team which acquire, transform, manage and distributes data to
multiple groups within the Company to perform business critical functions which
includes investment decisions, performance of funds, index, and manage
reference data for securities. The primary role of this group is to acquire
data from multiple market providers like Bloomberg, Morning Star, S&P, Moody?s,
Fitch etc. and prepare data in business-friendly format by applying business
transformation and validations. Once the data is converted into
business-friendly format make the data available to multiple consumers through
API, Feed, Golden Gate distribution and other channels like Queue, Streaming
etc.
The Role:
As part of UAP (Unified Acquisition Platform) team you will be working on
enhancing the next generation in-house acquisition platform using cloud
technologies. UAP will be built using Java Spark and Python programming
language and use AWS EMR as the infrastructure for execution. You would be
developing lambda, Spark, Python utilities for managing end to end feed flow.
We will focus on building tools and capabilities to accelerate acquisition,
compare data across vendors, externalize rules for data conversion, build
inventory/registry of feeds and track lineage.
You would be focusing on:
? Develop new application for managing feed inventory and tracking their usage
? Developing application interface using Java Spark for converting vendor
feeds into business-friendly format
? Develop accelerators for new feed acquisition
? Develop accelerators for data comparison reports
? Developing Lambda triggers for event driven and batch driven use case
? Supporting production during warranty period
? Participate in code review and define standard methodology
? Manage branching and deployments without conflicts
? Provide L3 production support
? Enhancing framework for future needs and make it a more generic product.
The Expertise and Skills You Bring:
? bachelor?s in information technology.
? 6+ years of experience with application development and hands on experience
with Spark/Scala.
? Expertise in providing leadership support by providing technical solutions.
? Expertise in handling huge dataset.
? Expertise in code reviews for standards and efficient coding practices.
? Expertise in building monitoring and alerting tools to report failure or
potential performance degradation.
? Experience with TDD (Test driven development) to build unit testing and
robust regression test suite.
COVID Work Policy:
Safety is our top priority. Once we can be together in person with fewer
safety measures, this role will follow our dynamic working approach. You?ll be
spending some of your time onsite depending on the nature and needs of your
role.
Dynamic Working ? Post Pandemic:
Our aim is to combine the best of working offsite with coming together in
person. For most teams this means a consistent balance of working from home and
office that supports the needs of your role, experience level, and working
style.
Your success and growth is important to us, so you?ll want to enjoy the
benefits of coming together in person ? face to face learning and training,
quality time with your manager and teammates, building your career network,
making friends, and taking full advantage of cultural and social experiences
our Company provides for you.
Reference : Java/Sparks Engineer jobs