About this role
About the position
In this role as a Senior Data Engineer, you will be responsible for development deliverables for the Finance Core Data Platform. The Platform, leveraging Hadoop Big-Data technologies, serves as the central repository of finance related datasets, with capabilities including the ingestion of positional/trade, sub-ledger, general-ledger trial balances, and reference data; as well as data enrichment, adjustment, reconciliation, analytics and reporting functions.
Responsibilities
• Work with the Product Owner, Product Manager, and Development Lead to understand and determine best mix of development and technical solutions to meet business requirements and project objectives.
• Work on detailed design and development phases of project initiatives; identifying, tracking and resolving technical issues.
• Ensure design/development solutions are aligned to the data/architecture strategy.
• Ensure adequate technical/reference documentation and training is in place.
• Provide assistance to the application support team in troubleshooting and resolving production issues.
• Coordinate with the Quality Engineering team on all aspects of testing and verification, ensuring quality assurance testing is performed for all changes.
• Impart knowledge, benefit of experience, and mentoring to other members of the team.
Requirements
• Total Experience 5+ years’ , with atleast 2-3 years experience with Spark (Scala/Python) , Big Data ,Databricks, Airflow ,DBT
• Solid experience (as evidenced by resume) with Apache Hadoop/Hive ETL/data-pipelines or other big-data platform technology/tools Cloudera
• Solid experience (as evidenced by resume) with SQL, Oracle/PL-SQL or any ANSI-compliant RDBMS platform preferred.
• Experience on Windows/Unix/Linux OS.
• Undergraduate degree/diploma in computer science/engineering or related technology discipline.
• Solid communication and time management skills.
Nice-to-haves
• Demonstrable experience with DevOps tools/technologies, including continuous integration/delivery tools and technologies such as GitHub, Jenkins, Synk, JIRA, Confluence, Airflow
• Demonstrable experience with containerization tools and technologies such as Docker, Kubernetes, Redhat OpenShift Container Platform (OCP).
• Experience with Capital Markets or other financial technology services’ middle/back office environments.
• Experience with/exposure to cloud technology platforms such as PCF (on-prem), AWS. Azure (off-prem).
• Experience with/exposure to Business Intelligence (BI)/Analytics/Reporting tools, such as Tableau, Datameer, Power BI, Presto, Snowflake, Apache Superset, etc.
• Experience with/exposure with Test driven development (TDD) and automated unit testing.
Benefits
• bonuses
• flexible benefits
• competitive compensation
• commissions
• stock where applicable