Lead Data Integration Engineer (SQL, Snowflake, Python)
DTCCDo you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.
The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential, building infrastructure capabilities to meet client needs and implementing data standards and governance.
Pay and Benefits:
- Competitive compensation, including base pay and annual incentive
- Comprehensive health and life insurance and well-being benefits, based on location
- Pension / Retirement benefits
- Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
- DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).
The development family is responsible for creating, designing, deploying, and supporting applications, programs, and software solutions. May include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities related to software products used internally or externally on product platforms supported by the firm. The software development process requires in-depth subject matter expertise in existing and emerging development methodologies, tools, and programming languages. Software Developers work closely with business partners and / or external clients in defining requirements and implementing solutions.
Lead data integration engineer role specializes in planning, detailing technical requirements, designing, developing, and testing all software systems and applications for the firm. Works closely with architects, product managers, project management, and end-users in the development and improvement of existing software systems and applications, proposing and recommending solutions that tackle complex business problems.
Qualifications:
- Minimum of 6 years of related experience
- Bachelor's degree preferred or equivalent experience
Talents Needed for Success:
Looking for a strong Database developer with hands-on experience in developing large scale Data engineering pipelines for financial services and preferably for risk management.
Minimum 6 years of Hands-on experience in writing, tuning, and managing complex SQL, creating stored procedures and database objects for a large-scale data warehouse systems in Snowflake
Minimum 6 years of related experience in building and maintaining large scale Data warehouse applications in cloud.
Minimum 3 years of experience in python as a developer, developing complex data pipelines loading data into Snowflake Database.
Must have knowledge in Dimensional modelling techniques like Star schema, type 2 slowly changing dimension and various type of fact tables.
Hands on experience in shell scripts for handling script-based ELT pipelines using Python or Snowpark.
Hands on experience in creating and managing Autosys JILs for orchestration or Airflow.
Knowledge in ETL tools like Talend or similar tools and create heterogenous pipelines.
Strong hands-on experience code versioning in bitbucket, GIT, Liquibase and managing multiple versions of release and CICD pipelines.
Good understanding of Enterprise Data integration concepts, Data warehouse modelling and Data architecture patterns.
Worked on Agile projects and knowledge of Jira for tracking and updating project tasks.
Actual salary is determined based on the role, location, individual experience, skills, and other considerations.We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.