Responsibilities
Test Data Management Engineer - Role & Responsibilities:
TDM Strategy & Design:
- Define, develop, and implement comprehensive Test Data Management (TDM) strategies, frameworks, and processes tailored for financial applications.
- Analyze complex application data models and relationships to design effective data subsetting, masking, and generation solutions using IBM Optim.
- Collaborate with stakeholders (QA, Development, Business Analysts, Compliance) to understand test data requirements and translate them into technical TDM solutions.
TDM Solution Implementation & Management:
- Design, configure, and execute TDM processes using relevant TDM tools (subsetting, masking, generation, synthetic data creation, data refresh).
- Implement and manage data masking/obfuscation techniques to comply with data privacy regulations (e.g., GDPR, CCPA, etc.) and internal policies for sensitive financial data.
- Manage the lifecycle of test data environments, including planning refresh cycles, executing data provisioning requests, and managing data retention.
- Troubleshoot and resolve complex test data-related issues across different environments.
Data Analysis & Provisioning:
- Perform in-depth data analysis to identify critical data elements, sensitive data, and complex data relationships required for various testing cycles (functional, performance, UAT).
- Provision timely and relevant test data sets to different testing environments based on project needs.
- Troubleshoot and resolve test data-related issues, ensuring data integrity and quality.
Compliance & Security:
- Ensure all TDM activities adhere strictly to internal data governance policies and external financial regulations regarding data privacy and security.
- Work closely with Compliance, Security, and Audit teams to validate TDM processes and controls.
Performance & Automation:
- Optimize IBM Optim processes and underlying database interactions for performance and efficiency.
- Identify opportunities for automation in test data provisioning and management workflows.
Collaboration & Business Alignment:
- Establish and promote TDM best practices, standards, and guidelines across the organization.
- Create and maintain detailed documentation for TDM processes, tools, and environments.
- Work closely with Database Administrators (DBAs) to manage test data storage, performance, and access.
- Collaborate with DevOps engineers to integrate TDM processes into CI/CD pipelines where applicable.
- Collaborate closely with Product Owners, Business Analysts, Software Engineers, to understand complex financial requirements, define precise testing criteria, and prioritize automation efforts.
Qualifications
Must Have:
10+ years of overall experience in IT, with a strong focus on Quality Assurance, Data Management, or Software Engineering.
6+ years of dedicated experience in Test Data Management (TDM).
- Proven experience implementing and managing TDM solutions for complex enterprise applications, preferably in the financial services industry.
- Strong Hands-on experience with industry-standard TDM tools like IBM Optim and Opensource tools
- Experience working in highly regulated environments with a strong understanding of data privacy and compliance challenges in finance.
- Strong SQL skills and experience working with various relational databases (e.g., Oracle, SQL Server, DB2, PostgreSQL , BQ, etc).
- Solid understanding of data modeling concepts and database structures.
- Proficiency in data masking, subsetting, and synthetic data generation techniques.
- Experience with scripting languages (e.g., Python, Shell, Perl) for automation and data manipulation.
- Experience with RBAC and have worked with Infra teams to achieve CI/CD automation to produce masked test data from production on demand.
- Familiarity with Linux/Unix command line.
- Solid understanding of data refreshers process
- Solid understanding of financial industry data structures, workflows, and testing challenges (e.g., trading, payments, banking, accounting, regulatory reporting).
- In-depth knowledge of relevant data privacy regulations (e.g., GDPR, CCPA, etc.) and their impact on test data handling.
- Excellent analytical and problem-solving skills with the ability to tackle complex data challenges.
- Strong communication and interpersonal skills, with the ability to explain technical concepts to non-technical stakeholders.
- Must have experience working with US public companies, with a strong understanding of security processes and how to apply them to Test Data Management (TDM) to ensure compliance with regulations.
- Ability to work effectively both independently and as a leader or contributor within a team.
- Proven ability to mentor junior team members and drive adoption of best practices.
Nice to Have:
- Experience with specific TDM tools like, Informatica TDM, Alteryx , PyETL,Deequ, Google DVT, etc
- Experience with data virtualization tools.
- Experience with AI for Synthetic Data Generation.
- Experience with cloud platforms (AWS, Azure, GCP) and cloud database services.
- Experience integrating TDM processes into CI/CD pipelines.
- Familiarity with performance testing concepts and data needs.
- Relevant certifications in TDM, databases, or cloud technologies.
Preferred Qualification:
- Bachelor鈥檚 Degree in Computer Science, Engineering or equivalent work experience
- Min of 6+ Test Data Management Engineer